Prompt formatting tracking

[chitalian]

Let's kick off the discussion about how we can best support the ability to track prompt formats and how prompts were constructed.

Our main focus is ensuring the UX is good and there are no major code changes/workflow disruptions to add this logging.

We currently have formatted templates https://docs.helicone.ai/advanced-usage/templated-prompts. But as @ianbicking from HN mentioned, they might want to add formatting details and not have helicone format the prompt for them.

Here is one idea we can do

template = {
    "prompt": "Write an amazing poem about Helicone",
    "promptFormat": "Write an amazing poem about Helicone"
}

serialized_template = json.dumps(template)

openai.Completion.create(
    model="text-davinci-003",
    prompt=serialized_template,
    headers={
        'Helicone-Prompt-Format': 'on',
    }
)

[chitalian]

#209