Skip to content

[feat] Use openrouter to load balance overloading issues with fallback #2501

@Kitenite

Description

@Kitenite

Describe the feature

For context, anthropic can sometime throw overloaded_error at certain times.

https://docs.anthropic.com/en/api/errors

 {"error":{"type":"overloaded_error","message":"Overloaded"}}

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions