feat: Groq provider support #3898
Conversation
🦋 Changeset detectedLatest commit: cafe343 The changes in this PR will be included in the next version bump. This PR includes changesets to release 1 package
Not sure what this means? Click here to learn what changesets are. Click here if you're a maintainer who wants to add another changeset to this PR |
0e11cef to
52fafea
Compare
|
@edwin-truthsearch-io Isn't the existing X AI provider the same thing? |
|
@celestial-vault Groq is not to be confused with Grok. Groq is known for speed. https://groq.com/. Groq has nothing to do with xAI or Grok. |
No, Groq is different than Grok, completely different companies. |
03ea720 to
ad02e48
Compare
ac2a9c1 to
d6be594
Compare
6163785 to
d71b79c
Compare
d71b79c to
cafe343
Compare
|
@edwin-truthsearch-io we are interested in adding the groq provider. we are in the middle or refactoring ApiOptions.tsx - would you be able to get groq to be structured similarly to like mistral/deepseek where the ui component is in its own file? also are you willing to open this pr up to contributor changes. surface level i think there might be issues with the protobuf messaging which would be easier for me to fix rather than going back and forth. also i can't see the merge conflicts |
|
+1 for groq |
|
Thank you for the contribution 🙏 I apologize we couldn't get to your PR but we have added Groq support in the latest v3.20.2. Appreciate your patience here! |
Description
Implement feature request #565 to support Groq provider. This includes adding proper support for the qwen-qwq-32b model in Groq, which now actually works (no reasoning pollution).
Test Procedure
Unit tests, some feature tests that are enabled by setting the environment variable GROQ_API_KEY.
Ran all known regression tests, and used the updated plugin in VS Code while developing.
Type of Change
Pre-flight Checklist
npm test) and code is formatted and linted (npm run format && npm run lint)npm run changeset(required for user-facing changes)Screenshots
Additional Notes
@saoudrizwan I noted you had said this was on the todo list. Please let me know what I need to fix to get this one incorporated. Thanks!
Important
Adds support for Groq provider, including model handling, API integration, and UI updates for Groq models.
qwen-qwq-32bmodel.ApiOptions.tsxto include Groq in the provider dropdown and handle API key input.refreshGroqModelsinrefreshGroqModels.tsto fetch and cache Groq models.GroqHandleringroq.tsfor API interactions and model management.GroqHandler.GroqHandleringroq.test.ts.ChatRow.tsxto render Groq model outputs.ApiOptions.tsx.This description was created by
for d71b79c. You can customize this summary. It will automatically update as commits are pushed.