Skip to content

feat: agent parallel tool calling #834

@mhordynski

Description

@mhordynski

Feature description

With parallel tool calling, LLMs will be able to call multiple tools in single turn of interaction with Ragbits agent.

For example:

  • model needs to read 3 files
  • model includes all 3 tool calls in a single response
  • ragbits executes all tools in parallel
  • results are sent back in one go

Motivation

It is massive improvement in latency and token usage.

Additional context

https://platform.openai.com/docs/guides/function-calling/parallel-function-calling#parallel-function-calling
https://blog.continue.dev/parallel-tool-calling/

Metadata

Metadata

Assignees

Labels

featureNew feature or request

Type

No type

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions