Skip to content

OpenVINO Backend: Fuse IM2COL + MatMul convolution into OpenVINO convolution - #288

Merged
wine99 merged 1 commit into
ravi9:dev_backend_openvinofrom
mostafafaheem:fuse_to_convolution
Aug 19, 2026
Merged

OpenVINO Backend: Fuse IM2COL + MatMul convolution into OpenVINO convolution#288
wine99 merged 1 commit into
ravi9:dev_backend_openvinofrom
mostafafaheem:fuse_to_convolution

Conversation

@mostafafaheem

Copy link
Copy Markdown

This PR adds a transformation pass to bypass GGML's indirect convolution implementation and take advantage of OpenVINO's direct conv kernels, resulting in a ~2x performance improvement on CPU.

Normal:

Summary of Model0 @93920957150816
     Total(us): 58132
 Total_avg(us): 58132

Fused:

Summary of Model0 @94587286148704
     Total(us): 27038
 Total_avg(us): 27038

@mostafafaheem mostafafaheem changed the title OpenVINO Backend: Fuse IM2COL + MatMul convolution into OpenVINO conv… OpenVINO Backend: Fuse IM2COL + MatMul convolution into OpenVINO convolution Aug 18, 2026
@ravi9
ravi9 force-pushed the dev_backend_openvino branch from eb54a50 to 04b5691 Compare August 18, 2026 14:43

@cavusmustafa cavusmustafa left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, seems like the failing CI test not related to PR.

@wine99
wine99 merged commit 8ba9348 into ravi9:dev_backend_openvino Aug 19, 2026
4 of 16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants