-
Notifications
You must be signed in to change notification settings - Fork 123
Open
Labels
featureNew feature or requestNew feature or request
Description
Feature description
With parallel tool calling, LLMs will be able to call multiple tools in single turn of interaction with Ragbits agent.
For example:
- model needs to read 3 files
- model includes all 3 tool calls in a single response
- ragbits executes all tools in parallel
- results are sent back in one go
Motivation
It is massive improvement in latency and token usage.
Additional context
https://platform.openai.com/docs/guides/function-calling/parallel-function-calling#parallel-function-calling
https://blog.continue.dev/parallel-tool-calling/
Metadata
Metadata
Assignees
Labels
featureNew feature or requestNew feature or request
Type
Projects
Status
In Progress