title	emoji	colorFrom	colorTo	sdk	sdk_version	app_file	pinned	license	short_description
Small Model Chatbot	😻	indigo	green	gradio	5.31.0	app.py	false	mit	Some small models chatbot

=======

Multi-Model Tiny Chatbot

A lightweight, multi-model chat application featuring several small language models optimized for different tasks. Built with Gradio for an intuitive web interface and designed for local deployment.

🌟 Features

• Multiple Model Support: Choose from 4 specialized small language models
• Lazy Loading: Models are loaded only when selected, optimizing memory usage
• Real-time Chat Interface: Smooth conversational experience with Gradio
• Lightweight: All models are under 200M parameters for fast inference
• Local Deployment: Run entirely on your local machine

🤖 Available Models

1. SmolLM2 (135M Parameters)

• Purpose: General conversation and instruction following
• Architecture: HuggingFace SmolLM2-135M-Instruct
• Best For: General Q&A, creative writing, coding help
• Language: English

2. NanoLM-25M (25M Parameters)

• Purpose: Ultra-lightweight instruction following
• Architecture: Mistral-based with chat template support
• Best For: Quick responses, simple tasks, resource-constrained environments
• Language: English

3. NanoTranslator-S (9M Parameters)

• Purpose: English to Chinese translation
• Architecture: LLaMA-based translation model
• Best For: Translating English text to Chinese
• Language: English → Chinese

4. NanoTranslator-XL (78M Parameters)

• Purpose: Enhanced English to Chinese translation
• Architecture: LLaMA-based with improved accuracy
• Best For: High-quality English to Chinese translation
• Language: English → Chinese

🚀 Quick Start

Prerequisites

• Python 3.8 or higher
• 4GB+ RAM recommended
• Internet connection for initial model downloads

Installation

1. Run the application

   uv run app.py

2. Open your browser

   • Navigate to http://localhost:7860
   • Select a model and start chatting!

🎯 Use Cases

General Conversation

• Use SmolLM2 or NanoLM-25M for general chat, Q&A, and assistance

Translation Tasks

• Use NanoTranslator-S for quick English→Chinese translations
• Use NanoTranslator-XL for higher quality English→Chinese translations

Resource-Constrained Environments

• NanoLM-25M (25M params) for ultra-lightweight deployment
• NanoTranslator-S (9M params) for minimal translation needs

💡 Model Performance

Model	Parameters	Use Case	Memory Usage	Speed
SmolLM2	135M	General Chat	~500MB	Fast
NanoLM-25M	25M	Lightweight Chat	~100MB	Very Fast
NanoTranslator-S	9M	Quick Translation	~50MB	Very Fast
NanoTranslator-XL	78M	Quality Translation	~300MB	Fast

Model Sources

• SmolLM2: HuggingFaceTB/SmolLM2-135M-Instruct
• NanoLM-25M: Mxode/NanoLM-25M-Instruct-v1.1
• NanoTranslator-S: Mxode/NanoTranslator-S
• NanoTranslator-XL: Mxode/NanoTranslator-XL

📝 License

This project is licensed under the MIT License - see the LICENSE file for details.

🙏 Acknowledgments

• HuggingFace for the Transformers library and model hosting
• Mxode for the Nano series models
• Gradio for the amazing web interface framework