CodiumAI token minimization

In this repository we provide implementation for token-reduction techniques introduce in our blog "Reduce Your Costs by 30% When Using GPT-3 for Python Code"

Example code for the proposed techniques is provided in example.py.

Tokens for baseline code

Tokens for tabified code

Tokens for tabified and minimized code

Note that both tabification and minimization operations do not change the code functionality.

Feel free to contact if there are any questions or issues.

Acknowledgement

To perform code minimization, we use the excellent Python Minifier package.