Skip to content

feat(ascend): basic llama operators - #940

Merged
voltjia merged 1 commit into
masterfrom
feat/ascend-llama-ops
Aug 26, 2026
Merged

feat(ascend): basic llama operators#940
voltjia merged 1 commit into
masterfrom
feat/ascend-llama-ops

Conversation

@wooway777

@wooway777 wooway777 commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Add Ascend ACLNN implementations for Argmax, CausalSoftmax, Copy, FusedAddRmsNorm, RmsNorm, RotaryEmbedding, and SiluAndMul.
  • Cover the core operator paths required by Llama/Qwen inference, including BF16 and mixed-dtype normalization, non-contiguous tensors, repeated execution, and NeoX-style rotary embedding.

Motivation

Complete the Ascend operator coverage required by the InfiniLM inference path for Llama/Qwen-family models. The implementations use CANN ACLNN operators while preserving the semantics and numerical precision of the verified InfiniCore implementations.

Closes # N/A

Type of Change

  • feat — new feature / new operator / new platform
  • fix — bug fix
  • perf — performance improvement (no behavioral change)
  • refactor — code restructuring without behavior change
  • test — adding or fixing tests only
  • docs — documentation only
  • build / ci — build system or CI configuration
  • chore — tooling, formatting, or other non-code changes
  • Breaking change (requires a ! in the Conventional Commits prefix or a BREAKING CHANGE: footer)

Platforms Affected

  • CPU (WITH_CPU)
  • NVIDIA (WITH_NVIDIA)
  • Iluvatar (WITH_ILUVATAR)
  • MetaX (WITH_METAX)
  • Cambricon (WITH_CAMBRICON)
  • Moore (WITH_MOORE)
  • Ascend (WITH_ASCEND)
  • PyTorch C++ bindings (WITH_TORCH)
  • Build system / CMake / CI
  • Python bindings / user-facing API

Smoke Test Result

paste smoke test output here

Test Results on Supported Platforms

Platform Affected Build / Smoke Result Full Result / Notes
NVIDIA
Iluvatar
MetaX
Cambricon
Moore
Ascend
Full `pytest` output (optional)
paste here

Benchmark / Performance Impact

Notes for Reviewers

@wooway777
wooway777 requested a review from a team August 21, 2026 08:36
@wooway777
wooway777 force-pushed the feat/ascend-llama-ops branch from ab7047d to eb2741f Compare August 21, 2026 08:46
@wooway777
wooway777 force-pushed the feat/ascend-llama-ops branch 4 times, most recently from e920f26 to 53d4408 Compare August 25, 2026 09:54
@wooway777
wooway777 force-pushed the feat/ascend-llama-ops branch from 53d4408 to 1f3d182 Compare August 25, 2026 09:56
@voltjia
voltjia merged commit c8e15eb into master Aug 26, 2026
13 of 20 checks passed
@voltjia
voltjia deleted the feat/ascend-llama-ops branch August 26, 2026 01:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants