Paper: Mamba Models a replacement for Transformers?

[JaynouOliver]

If you are creating this PR in order to submit a draft of your paper, please name your PR with Paper: <title>. An editor will then add a paper label and GitHub Actions will be run to check and build your paper.

See the project readme for more information.

Editor: Meghann Agarwal @mepa

Reviewers:

• Tetsuo Koyama @tkoyama010
• Rohit Goswami @HaoZeke

[tkoyama010]

Thank you for the great paper. State-space models are something I have used in my own career and I am amazed that they can be applied in this way. Is it possible to share the URL of the GitHub repository you used for this model in this paper? I am sure it would be even better if you could share it so we can actually implement this idea.

[JaynouOliver]

I can share the code written originally by the authors of MAMBA https://github.com/state-spaces/mamba
Just wanted to check with you before I finally commit the changes

[tkoyama010]

Thanks, I was making that statement based on the fact that SciPy papers often emphasize being able to run the code and reproduce it. Do I need to run both Transformer and mamba to understand the results of this paper?

I think this paper could be an excellent introduction to mamba. To that end, I think it would be good to add a link to it appropriately (including Transformers) :)

[JaynouOliver]

Sure I can add those links in the paper. I will make these changes right away.

[JaynouOliver]

@tkoyama010 please add any further changes if needed after review.

[mepa]

Hi @tkoyama010 and @HaoZeke! In case a little extra time is needed, the initial complete review deadline has been extended to next Wednesday, July 3rd.

[tkoyama010]

Hi @tkoyama010 and @HaoZeke! In case a little extra time is needed, the initial complete review deadline has been extended to next Wednesday, July 3rd.

Yes please. Thanks!

[JaynouOliver]

@tkoyama010 please add any further changes if needed after review.

Hi @tkoyama010, all working and good!

[tkoyama010]

LGTM. Thanks!

[JaynouOliver]

Hi everyone @tkoyama010 @HaoZeke @ameyxd @mepa ,

I hope you’re all doing well. If there are any additional suggestions, feedback, or corrections needed before the author revision period ends on August 7th, please let me know. I’d be happy to make the necessary changes and incorporate your feedback.

Thank you very much!

[mepa]

Hi @tkoyama010 and @HaoZeke - Do you feel that this paper is ready for inclusion in the Proceedings?

@tkoyama010, I see that you have approved the PR so will assume "yes" unless I hear otherwise.

Thanks for reviewing!

[tkoyama010]

Yes! I am ready for it.

[HaoZeke]

LGTM, thanks for working on this!

[HaoZeke]

LGTM as well; go ahead :)

…

On 9/2/24 2:49 PM, Tetsuo Koyama ***@***.***> wrote: Yes! I am ready for it. — Reply to this email directly, view it on GitHub <#917 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABBCUTZJ4J6M74DRK7J7IWTZUR3GNAVCNFSM6AAAAABITCUAZ2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMRUHEYTQNBXGQ>. You are receiving this because you were mentioned.Message ID: ***@***.***>

[JaynouOliver]

Thanks a lot @tkoyama010 and @HaoZeke for the approval!!

[mepa]

Thanks very much for reviewing, @tkoyama010 and @HaoZeke.