Update April 27

[BrutalCoding]

What have I done?

For the devs: I've added Dart bindings and I've successfully tested a 3B sized model.

For the normal human beings: I've managed to merge an AI model (totally different programming language) into ShadyAI's app. I have not made it chat yet, but I did run ShadyAI, which in turn loaded the AI model, and I requested the AI to run its own "test". That returned a success.

What will I do next?

Now that the groundwork has been set, I will add a chat interface.

After the chat UI, I will set full focus on finding the best user experience way to have an AI model built-in. The goal is that all you need to do is download and open ShadyAI. No terminal commands. No additional steps. Just download and open it the same way you do for any other normal apps.

For the nerds

If you've got a Mac (M1) and 15min of your time, follow these steps to verify whether the Raven 3B model works with ShadyAI's frontend:

Prerequisites

• 15min of your precious time

• Latest MacOS (Linux & Windows binaries have not been added yet)

• I've only tested it on an Macbook M1 16GB RAM, ideally you have the same system with equal or more RAM.

Getting Started

1. Download the Raven 3B model and convert it a quantized model. Please follow the steps in the README of the rwkv.cpp repo. You should have a .bin file.

2. Rename the model (the .bin) to "daddy.bin".

3. Git checkout my eval branch

4. Place daddy.bin in shady_ai_flutter/assets/rwkv

5. In your terminal: flutter run

Hey, that whole downloading part and converting is confusing right? Obviously this is far from ideal, thus for any curious people out there: don't worry.

Remember that the goal of ShadyAI is that my dad "the retired butcher" can use it? I'll make it a seamless experience.