🌌 Welcome to Axon: AI Research Lab 🚀🤖
This organization is a collaborative platform dedicated to:
- ✨ Implementing research papers in artificial intelligence.
- 🧠Conducting our own original research projects.
- đź“‘ Publishing research papers to contribute to the global AI community.
Our mission is to bridge the gap between theory and practice, by providing:
🔬 High-quality, reproducible implementations of seminal and contemporary AI works (e.g., InstructGPT, LLaMA, Transformers, Diffusion Models, RLHF, etc.)
đź“ť Novel contributions through our own research and publications.
Together, we aim to push forward the boundaries of artificial intelligence while keeping our work open, collaborative, and impactful. 🌍💡
ExpertRAG: Efficient RAG with Mixture of Experts -- Optimizing Context Retrieval for Adaptive LLM Responses |
Theoretical Foundations and Mitigation of Hallucination in Large Language Models |
Universal Approximation Theorem for a Single-Layer Transformer |
Galvatron: Automatic Distributed Training for Large Transformer Models |
Mixture of Transformers: Macro-Level Gating for Sparse Activation in LLM Ensembles |
Bachelor Thesis: AI Engine – Deep Learning and Neural Network Engine |