Skip to content

Upgrade rocm-flashinfer to latest upstream trunk. #55

@diptorupd

Description

@diptorupd

The present amd-integration branch is a fork of an older version of flashinfer-ai/flashinfer (v0.2.5.1). We should plan to update the version to the latest trunk.

There are few design decisions that need to be sorted out prior to the upgrade:

  1. rocm-flashinfer made changes to the directory layout of the project.
    a. ./csrc -> ./flashinfer/csrc
    b. ./include -> ./libflashinfer/include
  2. We still use the removed aot-build-utils for AOT builds
  3. We use an old torch compile for JIT compilation.

There might be other issues that we need to discuss and resolve before we decide upon an upgrade strategy. The issue serves as a medium to discuss and decide the best way forward.

Metadata

Metadata

Labels

refactoringRequires refactoring of codebase.

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions