All pull requests

Pull requests

• docs: fix the dangling variable legend in the DSA decoding example

  #243·stwilliam503388-creator opened Oct 30, 2026·

  ·

• Fix no-sink split-KV combine normalization at large LSE offsets

  #240·SeverinVisionary opened Oct 23, 2026·

  ·
  1

  1

• Add native windows support.

  #238·chinazhangchao opened Oct 22, 2026·

  ·

• [Ascend] Shim asc_float2bfloat16_rn_v2_impl() with the public CANN API

  #237·dragonfive2002 opened Oct 21, 2026·

  ·

• Use the public BF16 odd-lane conversion API on Ascend

  #236·huangxinV587 opened Oct 21, 2026·

  ·
  1

• Defer the optional Triton profiler dependency until first use

  #235·huangxinV587 opened Oct 21, 2026·

  ·

• docs: add Simplified Chinese translation (README.zh.md)

  #234·JasonYeYuhe opened Oct 15, 2026·

  ·

• MLA decode on Ampere (RTX 3090, sm_86): v2 kernel at 94–99% of memory bandwidth, FP8/INT8 KV cache, skinny GEMM, and a fused single-graph decode layer 2.1–13.3× faster than unfused eager

  #233·KernelFlow-ops opened Oct 13, 2026·

  ·

• improve perf

  #231·zhoutianzi666 opened Oct 9, 2026·

  ·

• 优化 FlashMLA 64 头融合注意力内核的 Prefill 与 FP8 Decode 性能

  #227·cb521 opened Sep 24, 2026·

  ·

• fix: use standard C++ value-init for the sm100 layout temporaries

  #225·PerryLink opened Sep 15, 2026Contributor·

  ·

• [SM90] Support dynamic top-k for V3.2 sparse decode

  #216·Livinfly opened Aug 30, 2026·

  ·

• docs: use consistent TFlops unit in README

  #215·pengfaming opened Aug 28, 2026·

  ·

• Test README decoding example against API drift

  #214·shoemoney opened Aug 24, 2026·

  ·

• Fix duplicate TRAP_ONLY_DEVICE_ASSERT definition

  #209·tianchongchong opened Aug 7, 2026·

  ·

• [Draft]SM100 persistent sparse attention for V4 CSA/HCA

  #207·uchihatmtkinu opened Aug 4, 2026Collaborator·

  ·

• Mark auxiliary LSE output non-differentiable

  #203·Mr-Neutr0n opened Aug 3, 2026·

  ·

• Preserve input validation under Python optimization

  #202·Mr-Neutr0n opened Jul 31, 2026·

  ·
  1

• Fix scheduler state after backend failure

  #201·Mr-Neutr0n opened Jul 31, 2026·

  ·
  1

• [SM90] Add packed selected-KV sparse decode

  #200·xyz2606 opened Jul 26, 2026·

  ·

• Add sparse MLA backward (DSA top-k), sliding-window attention + attention sink, and block-sparse MLA forward/backward for SM100

  #198·kmswin1 opened Jul 16, 2026·

  ·

• sparse_prefill_fwd (sm100): skip trailing fully-invalid top-k blocks when topk_length is not provided

  #196·zkyue opened Jul 10, 2026·

  ·

• Add pyproject.toml with build-system metadata

  #195·Functionhx opened Jul 9, 2026·

  ·

• Become ABI Stable with LibTorch 2.11+

  #193·janeyx99 opened Jul 2, 2026Contributor·

  ·
  1

  1

• fix typo

  #191·wangtianxia-sjtu opened Jun 25, 2026·

  ·