Update to llama-3.3-70b-versatile and Codebase Enhancements

[LeonardSEO]

Overview

This pull request updates the model to llama-3.3-70b-versatile (128K Context Length) and includes various codebase improvements to enhance robustness, consistency, and performance.

Key Changes

1. Model Update:

   • Upgraded the Groq model to llama-3.3-70b-versatile, which offers a significantly larger context length (128K tokens) compared to the previous llama3-70b-8192. This allows for better handling of longer contexts without loss of information.
   • Importantly, this new model is cost-equivalent to the previous one, ensuring no additional expenses.

2. Improved Error Handling:

   • Replaced print statements with the logging module for consistent and configurable logging.
   • Added detailed error messages for better debugging and error reporting.

3. Environment Variable Validation:

   • Added validation for critical API keys such as GROQ_API_KEY and COHERE_API_KEY to prevent runtime errors.

4. Consistent Type Annotations:

   • Added type annotations to all functions, improving code readability and compatibility with modern development tools.

5. Code Cleanup:

   • Removed redundant or inefficient code.
   • Standardized documentation and code formatting.

Benefits

These changes make the codebase more robust, readable, and maintainable while improving the system's scalability and performance by leveraging the advanced features of llama-3.3-70b-versatile.

Looking forward to your feedback and suggestions for further enhancements!