Add support for Mistral and Codestral models #1707

dst03106 · 2025-04-18T05:15:40Z

Related Issue: Add Support for Mistral API #1461

PR Type

Enhancement, Documentation

Description

Added support for Mistral and Codestral models.
Updated API key handling for Mistral and Codestral.
Documented usage of Mistral and Codestral models in the usage guide.

Changes walkthrough 📝

Relevant files

Enhancement

__init__.py `Added Mistral and Codestral models to configuration` pr_agent/algo/init.py Added new Mistral and Codestral models to the model configuration dictionary. Defined specific configurations for these models with respective token limits.	+14/-0
litellm_ai_handler.py `Added API key support for Mistral and Codestral` pr_agent/algo/ai_handlers/litellm_ai_handler.py Added API key handling for Mistral models. Added API key handling for Codestral models.	+8/-0

Documentation

changing_a_model.md `Added documentation for Mistral and Codestral usage` docs/docs/usage-guide/changing_a_model.md Documented configuration and usage for Mistral models. Documented configuration and usage for Codestral models. Provided links to obtain API keys for Mistral and Codestral.	+28/-0

Need help?
Type /help how to ... in the comments thread for any questions about Qodo Merge usage.
Check out the documentation for more information.

qodo-merge-for-open-source · 2025-04-18T05:35:15Z

PR Description updated to latest commit (869a179)

Copy walkthrough table to "Files Changed" Tab

qodo-merge-for-open-source · 2025-04-18T05:37:10Z

PR Reviewer Guide 🔍

(Review updated until commit `869a179`)

Here are some key observations to aid the review process:

🎫 Ticket compliance analysis ✅ 1461 - Fully compliant Compliant requirements: • Add support for Codestral model through the Mistral API • Ensure the Mistral API integration works, which is currently free
⏱️ Estimated effort to review: 2 🔵🔵⚪⚪⚪
🧪 No relevant tests
🔒 No security concerns identified
⚡ Recommended focus areas for review Model Duplication The Codestral model appears to be added twice with different prefixes: "mistral/codestral-latest" and "codestral/codestral-latest". This could cause confusion for users about which one to use. "mistral/codestral-latest": 8191, "mistral/open-mistral-nemo": 128000, "mistral/open-mistral-nemo-2407": 128000, "mistral/open-codestral-mamba": 256000, "mistral/codestral-mamba-latest": 256000, "codestral/codestral-latest": 8191, "codestral/codestral-2405": 8191, Documentation Clarity The documentation for Mistral and Codestral models could be clearer about the differences between using "mistral/codestral-latest" versus "codestral/codestral-latest" and when to use each. ### Mistral To use models like Mistral or Codestral with Mistral, for example, set: ```toml [config] # in configuration.toml model = "mistral/mistral-small-latest" fallback_models = ["mistral/mistral-medium-latest"] [mistral] # in .secrets.toml key = "..." # your Mistral api key (you can obtain a Mistral key from here) Codestral To use Codestral model with Codestral, for example, set: [config] # in configuration.toml model = "codestral/codestral-latest" fallback_models = ["codestral/codestral-2405"] [codestral] # in .secrets.toml key = "..." # your Codestral api key (you can obtain a Codestral key from here) `</details> </td></tr> </table>`

qodo-merge-for-open-source · 2025-04-18T05:37:38Z

PR Code Suggestions ✨

Explore these optional code suggestions:

Category	Suggestion	Impact
Possible issue	Fix Codestral API key variable The environment variable for Codestral API key should be "MISTRAL_API_KEY" not "CODESTRAL_API_KEY" since Codestral is provided by Mistral and uses the same API infrastructure. Using a non-standard environment variable will cause authentication failures. pr_agent/algo/ai_handlers/litellm_ai_handler.py [104-106] # Support mistral models if get_settings().get("MISTRAL.KEY", None): os.environ["MISTRAL_API_KEY"] = get_settings().get("MISTRAL.KEY") # Support codestral models if get_settings().get("CODESTRAL.KEY", None): - os.environ["CODESTRAL_API_KEY"] = get_settings().get("CODESTRAL.KEY") + os.environ["MISTRAL_API_KEY"] = get_settings().get("CODESTRAL.KEY") `[To ensure code accuracy, apply this suggestion manually]` Suggestion importance[1-10]: 9 __ Why: This suggestion addresses a critical authentication issue. Since Codestral is provided by Mistral and uses the same API infrastructure, using "CODESTRAL_API_KEY" instead of "MISTRAL_API_KEY" would cause authentication failures when attempting to use Codestral models.	High
Possible issue	Align Codestral token limits There's inconsistency in the token limits for Codestral models. The Mistral-hosted Codestral models have 256000 tokens while the direct Codestral models have only 8191. According to Mistral's documentation, Codestral models support much larger context windows. Verify and align the token limits for consistency. pr_agent/algo/init.py [125-128] "mistral/open-codestral-mamba": 256000, "mistral/codestral-mamba-latest": 256000, -"codestral/codestral-latest": 8191, -"codestral/codestral-2405": 8191, +"codestral/codestral-latest": 256000, +"codestral/codestral-2405": 256000, Apply this suggestion Suggestion importance[1-10]: 8 __ Why: The suggestion correctly identifies an inconsistency in token limits for Codestral models. The direct Codestral models have 8191 tokens while Mistral-hosted versions have 256000, which could lead to suboptimal performance. Aligning these values would ensure consistent behavior.	Medium
Learned best practice	Retrieve configuration values once and store them in variables before using them to improve efficiency and prevent potential inconsistencies The code retrieves the API key twice for each model type - once for the condition check and again for the assignment. This is inefficient and could lead to inconsistencies if the settings change between calls. Store the API key in a variable first, then check if it exists before assigning it to the environment variable. pr_agent/algo/ai_handlers/litellm_ai_handler.py [100-106] # Support mistral models -if get_settings().get("MISTRAL.KEY", None): - os.environ["MISTRAL_API_KEY"] = get_settings().get("MISTRAL.KEY") +mistral_key = get_settings().get("MISTRAL.KEY", None) +if mistral_key: + os.environ["MISTRAL_API_KEY"] = mistral_key # Support codestral models -if get_settings().get("CODESTRAL.KEY", None): - os.environ["CODESTRAL_API_KEY"] = get_settings().get("CODESTRAL.KEY") +codestral_key = get_settings().get("CODESTRAL.KEY", None) +if codestral_key: + os.environ["CODESTRAL_API_KEY"] = codestral_key Apply this suggestion Suggestion importance[1-10]: 6	Low
More

Author self-review: I have reviewed the PR code suggestions, and addressed the relevant ones.

dst03106 · 2025-04-18T06:03:58Z

pr_agent/algo/__init__.py

+    "mistral/mistral-small-latest": 8191,
+    "mistral/mistral-medium-latest": 8191,
+    "mistral/mistral-large-2407": 128000,
+    "mistral/mistral-large-latest": 128000,
+    "mistral/open-mistral-7b": 8191,
+    "mistral/open-mixtral-8x7b": 8191,
+    "mistral/open-mixtral-8x22b": 8191,
+    "mistral/codestral-latest": 8191,
+    "mistral/open-mistral-nemo": 128000,
+    "mistral/open-mistral-nemo-2407": 128000,
+    "mistral/open-codestral-mamba": 256000,
+    "mistral/codestral-mamba-latest": 256000,
+    "codestral/codestral-latest": 8191,
+    "codestral/codestral-2405": 8191,


I referred to the following liteLLM links for information about the model and max tokens:

Mistral provider

Codestral provider

max_tokens

anislanguer · 2025-04-18T10:44:53Z

Cool, i want to run this fork locally in docker and i want to test it how to pass the codestral key ?

mrT23 · 2025-04-18T18:16:21Z

/review

qodo-merge-for-open-source · 2025-04-18T18:16:38Z

Persistent review updated to latest commit 869a179

mrT23 · 2025-04-18T18:17:15Z

👍

dst03106 · 2025-04-18T19:06:16Z

@anislanguer
I added the environment variables to the .env file and ran the following Docker commands (ref link). Hope this helps!

# .env
CODESTRAL__KEY="..."
GITHUB__USER_TOKEN="..."

docker build -t pr-agent -f ./docker/Dockerfile .
docker run --rm -it --env-file .env pr-agent --pr_url {PR_URL} review_pr

anislanguer · 2025-04-22T12:54:54Z

@dst03106 it doesnt work for me idk why :( it shows me this error

mrT23 · 2025-04-22T13:22:35Z

i removed one of the pictures, as it contained personal information.

Also, the configuration seems wrong.
You didn't change the model

https://qodo-merge-docs.qodo.ai/usage-guide/changing_a_model/#mistral

feat: add support for Mistral and Codestral models

869a179

dst03106 marked this pull request as ready for review April 18, 2025 05:36

qodo-merge-for-open-source bot added the Review effort 2/5 label Apr 18, 2025

dst03106 commented Apr 18, 2025

View reviewed changes

mrT23 approved these changes Apr 18, 2025

View reviewed changes

qodo-ai deleted a comment from qodo-merge-for-open-source bot Apr 18, 2025

mrT23 approved these changes Apr 18, 2025

View reviewed changes

mrT23 merged commit f177ff4 into qodo-ai:main Apr 18, 2025

dst03106 deleted the feature/add-support-for-mistral-and-codestral branch April 18, 2025 19:06

dst03106 mentioned this pull request Apr 22, 2025

Add Support for Mistral API #1461

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add support for Mistral and Codestral models #1707

Add support for Mistral and Codestral models #1707

Uh oh!

dst03106 commented Apr 18, 2025 •

edited by mrT23

Loading

Uh oh!

qodo-merge-for-open-source bot commented Apr 18, 2025

Uh oh!

qodo-merge-for-open-source bot commented Apr 18, 2025 •

edited

Loading

Codestral

Uh oh!

qodo-merge-for-open-source bot commented Apr 18, 2025

Uh oh!

dst03106 Apr 18, 2025 •

edited

Loading

Uh oh!

anislanguer commented Apr 18, 2025 •

edited

Loading

Uh oh!

mrT23 commented Apr 18, 2025

Uh oh!

qodo-merge-for-open-source bot commented Apr 18, 2025

Uh oh!

mrT23 commented Apr 18, 2025

Uh oh!

dst03106 commented Apr 18, 2025

Uh oh!

anislanguer commented Apr 22, 2025 •

edited by mrT23

Loading

Uh oh!

mrT23 commented Apr 22, 2025 •

edited

Loading

Uh oh!

Uh oh!

Add support for Mistral and Codestral models #1707

Add support for Mistral and Codestral models #1707

Uh oh!

Conversation

dst03106 commented Apr 18, 2025 • edited by mrT23 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

PR Type

Description

Changes walkthrough 📝

Uh oh!

qodo-merge-for-open-source bot commented Apr 18, 2025

Uh oh!

qodo-merge-for-open-source bot commented Apr 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

PR Reviewer Guide 🔍

(Review updated until commit 869a179)

Codestral

Uh oh!

qodo-merge-for-open-source bot commented Apr 18, 2025

PR Code Suggestions ✨

Uh oh!

dst03106 Apr 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

anislanguer commented Apr 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mrT23 commented Apr 18, 2025

Uh oh!

qodo-merge-for-open-source bot commented Apr 18, 2025

Uh oh!

mrT23 commented Apr 18, 2025

Uh oh!

dst03106 commented Apr 18, 2025

Uh oh!

anislanguer commented Apr 22, 2025 • edited by mrT23 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mrT23 commented Apr 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

dst03106 commented Apr 18, 2025 •

edited by mrT23

Loading

qodo-merge-for-open-source bot commented Apr 18, 2025 •

edited

Loading

(Review updated until commit `869a179`)

dst03106 Apr 18, 2025 •

edited

Loading

anislanguer commented Apr 18, 2025 •

edited

Loading

anislanguer commented Apr 22, 2025 •

edited by mrT23

Loading

mrT23 commented Apr 22, 2025 •

edited

Loading