Suggestion: support Gemini LLM Provider in the config file.

[igorlima]

First off, thank you for this inspiring open-source project.

This issue concerns considering the support for additional language models, such as Gemini.

I have already opened a PR as a recommendation to add a free cloud LLM model, known as Gemini.

The Gemini has OpenAI API compatibility, which allows us to leverage it by reusing the existing API call with no extra code changes, simply by tweaking the configuration file.

Not all cloud LLM model provides this sort of compatibility. For those who don’t, there is already the library LiteLLM to standardize the API across the variety of LLMs available. To do so, a code change is required. I'm mentioning it here to plant a seed and foster improvements and enhancements.

On this issue, let me focus on documenting further details about Gemini, including additional information on obtaining its API key, among other details.

To get a Gemini API Key, access the Google AI Studio website and follow all the required steps. Refer to the image below for an illustration of each step.

• https://aistudio.google.com/api-keys
  • image...

    

For those interested, additional documentation on Gemini’s support for the OpenAI API is available.

Thank you again for your open-source work and for sharing such a valuable project!