Investigate Free Alternatives to ChatModels for GPT Dungeon Master

[SverreNystad]

Problem Statement

As our project relies on OpenAI's GPT for the Dungeon Master functionality, the costs associated with the usage of the ChatModels API can be significant. In order to make our project more sustainable and accessible to a wider audience, it's essential to explore free or more cost-effective alternatives.

Objective

Identify and evaluate free (or cheaper) alternatives to ChatModels that can provide similar functionality and integrate seamlessly with our existing GPT Dungeon Master setup.

Tasks

Research and list potential free/cheaper alternatives to ChatModels.
Evaluate the pros and cons of each alternative.
Test the most promising alternatives with our existing setup.
Document findings, including performance comparisons and integration challenges.
If a suitable alternative is found, plan out the integration steps.

Acceptance Criteria

A list of potential alternatives with a brief overview of each.
Performance and cost comparisons between the alternatives and ChatModels.
Recommendations based on the research and tests.

Notes

Considering the popularity and advancements in the field of language models and chatbots, there might be emerging solutions that could fit our requirements. Engaging with the community for suggestions could also be beneficial.

[SverreNystad]

Alternatives
https://github.com/nomic-ai/gpt4all
License: GNU GENERAL PUBLIC LICENSE Aka GPT dungeon master must stay under the same license aka none commercial
https://github.com/xtekky/gpt4free
Licsense: MIT

[SverreNystad]

https://python.langchain.com/docs/guides/local_llms