Skip to content

A set of standardised benchmarks to assess the performance of Auto-GPTs.

License

Notifications You must be signed in to change notification settings

specialized806/Auto-GPT-Benchmarks

 
 

Repository files navigation

This repo has been deprecated. The benchmark code is now in the main AutoGPT repo: https://github.com/Significant-Gravitas/Auto-GPT

Auto-GPT Benchmarks

Built for the purpose of benchmarking the performance of agents regardless of how they work.

Objectively know how well your agent is performing in categories like code, retrieval, memory, and safety.

Save time and money while doing it through smart dependencies. The best part? It's all automated.

Scores:

Screenshot 2023-07-25 at 10 35 01 AM

Ranking overall:

Detailed results:

Screenshot 2023-07-25 at 10 42 15 AM

Click here to see the results and the raw data!!

More agents coming soon !

About

A set of standardised benchmarks to assess the performance of Auto-GPTs.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 89.7%
  • Python 10.3%