Skip to content

Conversation

@romartin
Copy link
Contributor

@romartin romartin commented Nov 1, 2025

Resolve [litellm/azure] dependency problems after upgrade to lightspeed-core 0.3.0.

Tested inference and tool calling for:

  • RHOAI (vLLM) provider - model: granite-3.3-8b-instruct
  • OpenAI provider - model: gpt-4o-mini
  • AzureAI provider - model: gpt-4o-mini

BTW Identified the need for "reverting" some latest tool calling related changes in the system prompt (see #108), to make OpenAI / AzureAI tool calling to work properly

@romartin romartin force-pushed the chatbot-azure--depdendnecy-fix branch from cff9cb5 to 3586ad1 Compare November 1, 2025 22:10
@romartin romartin force-pushed the chatbot-azure--depdendnecy-fix branch from 3586ad1 to 526acd3 Compare November 1, 2025 22:10
@romartin
Copy link
Contributor Author

romartin commented Nov 1, 2025

Rebased and signed commit.

@romartin
Copy link
Contributor Author

romartin commented Nov 2, 2025

not sure why checks failed... error is not clear to me. Also clicked on re-run failed jobs, and no job re-run happened, also I don't longer see the re-run button :(

@romartin
Copy link
Contributor Author

romartin commented Nov 3, 2025

/retest

@romartin romartin merged commit 28824c0 into ansible:main Nov 3, 2025
2 checks passed
@romartin romartin deleted the chatbot-azure--depdendnecy-fix branch November 3, 2025 14:42
ldjebran pushed a commit to ldjebran/ansible-chatbot-stack that referenced this pull request Nov 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants