v2.40.0

New Features

  • Enhanced BaseLLM Content Handling: Updated BaseLLM and related types to support complex content types per message, enabling handling of images and other base64 or URL submissions.

  • Logprobs Support in ChatParams: Introduced logprobs support to BaseLLM's ChatParams, implemented for OpenAI and extended to other LLM providers.

Improvements

  • Codebase Cleanup: Removed usage of any types to enhance type safety and maintainability.

  • Gemini Implementation: Added Gemini implementation for the new approach to content handling in AI packages.