Skip to content

Conversation

jamie-beck
Copy link
Contributor

I added the missing groq model parse code and handled the model_tokens correctly

fix model_tokens not being used for ollama
the groq model parsing code was missing. it is in known_models so I think this should exist
@jamie-beck
Copy link
Contributor Author

This does what #589 does but also passes model_tokens. Sorry I did not realize this was already waiting.

@jamie-beck jamie-beck closed this Aug 26, 2024
@VinciGit00
Copy link
Collaborator

Thx.
Btw we have to think about the context window, so thank you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants