Tool call support (Llama 3.x, Functionary v3, Hermes 2 Pro, Mistral Nemo, generic) w/ lazy grammars & minimalist Jinja engine #9639
Commits on Sep 25, 2024
-
-
-
tool-call: basic Functionary 3.2, Llama 3.1, Hermes 2 Pro grammar g……enerators + parsers
-
-
-
-
-
Commits on Sep 26, 2024
-
minja: fix llama_chat_apply_template + adde use_jinja param to vali……date_model_chat_template
-
-
-
server: catch errors in oaicompat_completion_params_parse instead o……f taking server down
-
-
-
-
-
server: catch errors in format_final_response_oaicompat instead of ……taking server down
-
-
-
-
-
tool-call: test/fix functionary-medium-v3.1's template (can "look" ……like llama3.1 template)
-
-
-
-
-
tool-call: refactor llama_chat_template class + use in validate_mod……el_chat_template
-
-
-
Commits on Sep 27, 2024
-
-
-
-
-
-
-
tool-call: fix crash / test non-tool call case (added llama_sampler……_is_grammar_empty)
-
tool-call: fix functionary-small-3.2 (first tool starts w/ name\n, ……subsequent are >>>name\n)
-
-
-
minja: fix identifiers parsing (when start w/ not/is/etc) and lstri……p_blocks corner case (needed by DeepSeek-V2.5
-
minja: generate chat goldens w/ fixed date to support Llama-3.2-3B-……Instruct (uses strftime_now)
Commits on Sep 28, 2024
-
-
tool-call: let the tool call handler expand chat template, moving b……uiltin_tools down as extra_context
-
-
tool-call: more eager function call parsing for Functionary & Llama…… (give a chance to 3B model)
-
-
-
chat-template: enumerate files w/ C API rather than private using s……td::__fs::filesystem
-
-
-
-
-
-
-
-
-
-
-
-
Commits on Oct 1, 2024
-
tool-call: prepare possible externalization of minja + factor tool ……call style out of template
-
Commits on Oct 2, 2024
-
-
tool-call: promote getting chat templates w/ dedicated script rathe……r than rely on test resources
-
-
agent: remove *lots* of cruft from tool definitions derived from Fa……stAPI catalog (and remove wait* tools which can be implemented in Python anyway)
-
-
agent: drop fastify.py -> simpler serve_tools.py, and expose other ……tools to python interpreter
Commits on Oct 3, 2024
-
antiprompts: ensure partial match is at end of string (or else serv……er stops sending replies)
-
tool-call: adjust triggers to most common tool call variations from…… Llama-3.1-8B and Llama-3.2-3B
-
agent: tool tweaks (remove ansi escapes from python output, update ……env keys + provider docs)
Commits on Oct 4, 2024
Commits on Oct 7, 2024
Commits on Oct 8, 2024
Commits on Oct 22, 2024
Commits on Oct 23, 2024
-
tool-calls: basic Nemo support, default parallel to true if templat……e mentions tool_call_id
-
-
-
Commits on Oct 24, 2024
-
agent: isolate tools container + log its outgoing HTTP & HTTPS traf……fic w/ docker compose + self-signed squid proxy
-
-
-
agent: ditch aiohttp & define REQUESTS_CA_BUNDLE to fix http proxyi……ng / trust the self-signed cert from python
-
-
-