In the annals of the digital age, a grand saga unfolds. In a realm where the forces of artificial intelligence are harnessed by a select few, the question arises: shall this power remain concentrated, or shall it be distributed for the benefit of all humankind?
- About WOMBO
- About w.ai
- Intro to EdgeMaxxing Subnet
- Miners and Validators Functionality
- Get Started with Mining or Validating
- Proposals for Optimizations
- Roadmap
WOMBO is one of the world’s leading consumer AI companies, and early believers in generative AI.
We've launched - two #1 apps, WOMBO and Dream which have been downloaded over 200M times and have each hit #1 on the app stores in 100+ countries
These results were only possible due to the immense capabilities of bleeding edge generative AI techniques and the power of open source AI. Our unique understanding of this research space through a consumer entertainment lens allows us to craft products people love to use and share.
We are at the very beginning of the Synthetic Media Revolution, which will completely transform how people create, consume, and distribute content. We're building the apps and infrastructure to power this change and bring AI entertainment potential to the masses.
w.ai envisions a future where artificial intelligence is decentralized, democratized, and accessible to everyone. This vision is embodied in a global supercomputer composed of individual user devices—laptops, gaming rigs, and smartphones. By harnessing the untapped potential of these devices, w.ai aims to create a vast decentralized network of computing power, democratizing access to the most advanced AI technologies. This approach will foster a thriving ecosystem of AI applications, driving innovation and ensuring the benefits of AI are shared by all of humanity.
The EdgeMaxxing subnet aims to create the world's most optimized AI models for consumer devices, starting with Stable Diffusion XL on the NVIDIA GeForce RTX 4090.
The subnet will expand to support optimization for various end devices, models, and modalities overtime.
Optimizing AI models is crucial to realizing a vision of decentralized AI.
- Accessibility: Enabling these advanced models to run on consumer devices, from smartphones to laptops, bringing AI capabilities to everyone.
- Decentralization: Allowing millions of users to contribute their computing power, rather than relying on a small number of powerful miners, creating a truly distributed AI network.
By optimizing popular models like LLAMA3 and Stable Diffusion, we transform idle computing resources into valuable contributors to a global AI network. This democratizes both AI usage and creation, offering earning opportunities to millions.
- Current GPU: NVIDIA GeForce RTX 4090
- Current Model:
stablediffusionapi/newdream-sdxl-20 - Netuid: 39
The EdgeMaxxing subnet defines specific models, pipelines, and target hardware for optimization. Miners and validators collaborate in a daily competition to improve AI model performance on consumer devices.
Miners are incentivized through a ranking-based reward system. The more effective their optimization, the higher their tier is. Every day at 12PM EST a contest is run, where:
- 🥇 Golden Tier: 80% of the total reward pool
- 🥈 Silver Tier: 16%
- 🥉 Bronze Tier: 3.2%
- 🎖️ All other tiers share the remaining pool
Each tier's rewards are divided evenly among its contestants.
Validators receive rewards for their consistent operation and accurate scoring.
- Miners submit optimized models
- Validators score submissions
- Contest runs daily at 12 PM New York time
- Miners receive rewards based on their ranking
- Actively submit optimized checkpoints of the specified model or pipeline. No need for continuous operation; can wait for results after submission
- Use custom algorithms or tools to enhance model performance
- Aim to produce the most generically optimized version of the model
- Must run on the specified target hardware (e.g., NVIDIA GeForce RTX 4090, M2 MacBook)
- Collect all miner submissions daily
- Benchmark each submission against the baseline checkpoint
- Score models based on:
- Speed improvements
- Accuracy maintenance
- Overall efficiency gains
- Select the best-performing model as the daily winner
To start working with a registered hotkey, clone the repository and install poetry
# Poetry
if [ "$USER" = "root" ]; then
apt install pipx
else
sudo apt install pipx
fi
pipx ensurepath
pipx install poetry
# Repository
git clone https://github.com/womboai/edge-maxxing
cd edge-maxxingThere is no need to manage venvs in any way, as poetry will handle that.
- Clone the base inference repository
git clone --recursive --depth 1 https://github.com/womboai/sdxl-newdream-20-inference model- Make your own repository on a git provider such as
GitHuborHuggingFaceto optimize in - Edit the
src/pipeline.pyfile to include any loading or inference optimizations, and save any changed models inmodels(use git submodules for referencing huggingface models or other git provider repositories) and commit - After creating and optimizing your repository, run:
cd miner
poetry install- Submit the model, changing the options as necessary
poetry run submit_model \
--netuid {netuid} \
--subtensor.network finney \
--wallet.name {wallet} \
--wallet.hotkey {hotkey} \
--logging.trace \
--logging.debug- Follow the interactive prompts to submit the repository link, revision, and contest to participate in
- Optionally, benchmark your submission locally before submitting (make sure you have the right hardware e.g. NVIDIA GeForce RTX 4090).
- Validators will collect your submission on 12PM New York time and test it in the remainder of the day
The validator setup requires two components, an API container and a scoring validator
If your hardware is not accessed within a container(as in, can use Docker), then the easiest way to set the different components up is to use docker compose.
To get started, go to the validator, and create a .env file with the following contents:
VALIDATOR_ARGS=--netuid {netuid} --subtensor.network {network} --wallet.name {wallet} --wallet.hotkey {hotkey} --logging.trace --logging.debug
VALIDATOR_HOTKEY_SS58_ADDRESS={ss58-address}
And then start docker compose
env docker compose up --detachTo setup auto-updating, simply run
./initialize-docker-auto-update.shIf running in a containerized environment like RunPod(which does not support Docker), then you need to run 2 pods/containers. The following setup assumes using PM2.
In one pod/container with a GPU, we'll set up the API component, start as follows:
git clone https://github.com/womboai/edge-maxxing /api
cd /api/validator
./submission_tester/setup.shAnd then run as follows:
su api
export VALIDATOR_HOTKEY_SS58_ADDRESS={ss58-address}
pm2 start /home/api/.local/bin/poetry --name edge-maxxing-submission-tester --interpreter none -- \
run uvicorn \
--host 0.0.0.0 \
--port 8000 \
submission_tester:appMake sure port 8000(or whichever you set) is exposed!
If you want this to auto-update(which is recommended), start another pm2 process using auto-update.sh like the following:
pm2 start auto-update.sh --name edge-validator-updater --interpreter bash -- edge-maxxing-submission-testerThe argument at the end is the name of the main PM2 process. This will keep your PM2 validator instance up to date as long as it is running.
In the another pod/container without a GPU, to run the scoring validator, clone the repository as per the common instructions, then do as follows
cd validator
poetry install
pm2 start poetry --name edge-validator --interpreter none -- \
run start_validator \
--netuid {netuid} \
--subtensor.network {network} \
--wallet.name {wallet} \
--wallet.hotkey {hotkey} \
--logging.trace \
--logging.debug \
--benchmarker_api {API component route}Make sure to replace the API component route with the route to the API container(which can be something in the format of http://ip:port), refer to the instructions above at API Component
Additionally, the auto-updating script can be used here
pm2 start auto-update.sh --name edge-validator-updater --interpreter bash -- edge-validatorThere are several effective techniques to explore when optimizing machine learning models for edge devices. Here are some key approaches to consider:
-
Knowledge Distillation: Train a smaller, more efficient model to mimic a larger, more complex one. This technique is particularly useful for deploying models on devices with limited computational resources.
-
Quantization: Reduce the precision of the model's weights and activations, typically from 32-bit floating-point to 8-bit integers. This decreases memory usage and computational requirements, making it possible to run models on edge devices. Additionally, exploring low-precision representation for weights (e.g., using 8-bit integers) can reduce memory bandwidth usage for memory-bound models, even if the actual compute is done in higher precision (e.g., 32-bit).
-
TensorRT and Hardware-Specific Optimizations: Utilize NVIDIA's TensorRT to optimize deep learning models for inference on NVIDIA GPUs. This involves more than just layer fusion; it includes optimizing assembly, identifying prefetch opportunities, optimizing L2 memory allocation, writing specialized kernels, and performing graph optimizations. These techniques enhance performance and reduce latency by tailoring the model to the specific hardware configuration.
-
Hyperparameter Tuning: Optimize the configuration settings of the model to improve its performance. This can be done manually or through automated methods such as grid search or Bayesian optimization. While not a direct edge optimization, it is an essential step in the overall process of model optimization.
We encourage developers to explore these optimization techniques or develop other approaches to enhance model performance and efficiency specifically for edge devices.
Our mission is to create the world's most optimized AI models for edge devices, democratizing access to powerful AI capabilities. Here's our path forward:
Phase 1: Foundation (Current)
- Perfect contest and benchmarking mechanisms
- Establish a robust framework for measuring model performance across hardware
- Cultivate a community of world-class miners skilled in optimizing models for edge devices
Phase 2: Expansion
- Support a diverse range of AI models, pipelines, and consumer-grade hardware
- Develop tools to lower entry barriers for new participants
- Integrate initial set of optimized models into the w.ai platform
Phase 3: Mass Adoption and Accessibility
- Launch user-friendly mobile app for widespread participation in the network
- Implement intuitive interfaces for non-technical users to contribute and benefit from optimized AI models
- Fully integrate EdgeMaxxing with w.ai, making all optimized models instantly available and usable on the platform
Long-term Vision
- Transform EdgeMaxxing into a cornerstone of decentralized AI, where:
- Any device, from smartphones to high-end GPUs, can contribute to and benefit from the network
- Optimized models power a new generation of AI-driven applications
- EdgeMaxxing becomes the go-to platform for rapid benchmarking and optimization of new AI models on diverse hardware
Through each phase, we'll continuously refine our techniques, expand hardware support, and push the boundaries of AI optimization for edge computing.
The WOMBO Bittensor subnet is released under the MIT License.
Connect with us on social media
