Code

RPR on top of causal attention#453

Code

Draft

nicolasvasilache wants to merge 21 commits intoiree-org:mainiree-org/iree-turbine:mainfrom nicolasvasilache:rpe_on_top_of_stansnicolasvasilache/iree-turbine:rpe_on_top_of_stansCopy head branch name to clipboard

+1,697-32

Commits

Commits on Feb 4, 2025

• hack iota / self_index

  Show description for 74ee675
  

  ftynse

  authored and

  raikonenfnu

  committed
  74ee675

  Copy full SHA for 74ee675

• self_index fixes and stress test

  Show description for 4694911
  

  nicolasvasilache

  authored and

  raikonenfnu

  committed
  4694911

  Copy full SHA for 4694911

• Initial support for T5 RPE in vanilla attention

  Show description for dde2727
  

  nicolasvasilache

  authored and

  raikonenfnu

  committed
  dde2727

  Copy full SHA for dde2727

• Add support for tkw.minimum

  Show description for 823f61c
  

  nicolasvasilache

  authored and

  raikonenfnu

  committed
  823f61c

  Copy full SHA for 823f61c

• Finish T5 RPE on vanilla attention

  Show description for 427e0f8
  

  nicolasvasilache

  authored and

  raikonenfnu

  committed
  427e0f8

  Copy full SHA for 427e0f8

• Rework T5 RPE test

  Show description for fe3547a
  

  nicolasvasilache

  authored and

  raikonenfnu

  committed
  fe3547a

  Copy full SHA for fe3547a

• Rename files

  Show description for b1bcd74
  

  nicolasvasilache

  authored and

  raikonenfnu

  committed
  b1bcd74

  Copy full SHA for b1bcd74

• add signed integer comparisons, select and pow ops

  Show description for 8c983fe
  

  ftynse

  authored and

  raikonenfnu

  committed
  8c983fe

  Copy full SHA for 8c983fe

• Add simple triangular test that will be useful for causal attention

  Show description for aa56e14
  

  nicolasvasilache

  authored and

  raikonenfnu

  committed
  aa56e14

  Copy full SHA for aa56e14

• Add causal attention

  Show description for 81dd4d4
  

  nicolasvasilache

  authored and

  raikonenfnu

  committed
  81dd4d4

  Copy full SHA for 81dd4d4

• Debug causal attention

  

  nicolasvasilache

  authored and

  raikonenfnu

  committed
  0f1086f

  Copy full SHA for 0f1086f

• [Wave] Remove/clean all non causal related changes

  Show description for 4db62fa
  raikonenfnu

  committed
  4db62fa

  Copy full SHA for 4db62fa

• [Wave] Refactor sgt/slt/sge/sle op into pyoperator

  Show description for 33ce1d2
  raikonenfnu

  committed
  33ce1d2

  Copy full SHA for 33ce1d2

• Refactor/cleanliness of codegen.py

  Show description for 6f47a75
  raikonenfnu

  committed
  6f47a75

  Copy full SHA for 6f47a75

• Add Causal template mask + small cleanup

  Show description for 8b4b164
  raikonenfnu

  committed
  8b4b164

  Copy full SHA for 8b4b164

• pre-commit fix

  Show description for ec59e11
  raikonenfnu

  committed
  ec59e11

  Copy full SHA for ec59e11

• Add LIT test for self_index and causal

  Show description for 9431341
  raikonenfnu

  committed
  9431341

  Copy full SHA for 9431341

• Add GPR_NUM partition support for SelfIndex to enable more MMA intrinsic

  Show description for 061868f
  raikonenfnu

  committed
  061868f

  Copy full SHA for 061868f

• [Wave] add type checks and more type support for cmps

  Show description for 7ba8dcf
  raikonenfnu

  committed
  7ba8dcf

  Copy full SHA for 7ba8dcf

• Add T5 RPE variant

  Show description for cc8bf31
  nicolasvasilache

  committed
  cc8bf31

  Copy full SHA for cc8bf31

Commits on Feb 5, 2025

• Debug OFFSET does not accept vector

  nicolasvasilache

  committed
  58d5f13

  Copy full SHA for 58d5f13