Add AI model aliases and default models #15782

lucas-koehler · 2025-06-06T09:32:17Z

What it does

Initial implementation of #15395

Introduces support for AI model aliases to facilitate updating many agents' used models at once.
An alias either points to a single model selected by the user or a chain of default/fallback models to consider in priority order.
For the fallback chain, the first ready model (e.g. has an API key configured) is used. For this the language model was extended with a status to be set by its manager.

Introduces a language model alias registry for registering and retrieving model aliases and chains
Adds support for chains of default model aliases (code, universal, code completion, summarize)
Selects the first available model (with an API key) from the chain when resolving an alias; falls back to the first in the chain if none are ready
Enables users to point an alias to use a specific model
Extends language models to track readiness (e.g., whether an API key is set)
Adds a new Model Aliases tab to the the AI configuration UI to:
- Display alias chains
- Select a mode for an alias

How to test

Open AI configuration view -> agents configuration
Select an agent (e.g. Coder)
Open the language model dropdown. Observe:
- there are 4 aliases at the top of the dropdown
- models you don't have an API key are not selectable and show a tooltip when hovering over them
Select the "default/code" alias
Go to the new Model Aliases tab in the AI configuration view
Have an anthropic key configured
open a chat and request something
observe: tokens for claude 3.7 are used
remove api key for anthropic and have a openai key configured
do another request
observe: tokens for gpt 4.1 are used
select a model explicitly for the default/code alias (e.g. gpt-4.1-nano)
do another request and observe tokens for the selected model are used

Follow-ups

~~Render Agents using an alias in alias view (@sgraband has a WIP implementation)~~
~~Show resolved model for an alias in alias config view and in agent config view~~
~~Display in chain the ones that are ready and the one that is chosen (only if applicable)~~
Configure aliases as default models for agents
Define fallbackchains for aliases
Better display that a model is not ready just disabled for now
Allow to add aliases

Breaking changes

This PR introduces breaking changes and requires careful review. If yes, the breaking changes section in the changelog has been updated.

Review checklist

As an author, I have thoroughly tested my changes and carefully followed the review guidelines

Reminder for reviewers

As a reviewer, I agree to behave in accordance with the review guidelines

sdirix

Does not work for me. When testing on latest master, Theia AI works as expected. When I start from this PR, then all models are gone.

There are a lot of errors in the console which are likely the cause of this:

ERROR Error: You are attempting to construct Symbol(AnthropicLanguageModelsManager) in a synchronous way but it has asynchronous dependencies.
ERROR Error: You are attempting to construct Symbol(LanguageModelRegistryFrontendDelegate) in a synchronous way but it has asynchronous dependencies.
[...]
ERROR Uncaught Exception:  Error: No matching bindings found for serviceIdentifier: Symbol(LanguageModelAliasRegistry)
Trying to resolve bindings for "BackendLanguageModelRegistry"
ERROR Error: No matching bindings found for serviceIdentifier: Symbol(LanguageModelAliasRegistry)

packages/ai-anthropic/src/node/anthropic-language-model.ts

packages/ai-core/src/browser/frontend-language-model-alias-registry.ts

packages/ai-core/src/common/language-model.ts

packages/ai-core/src/common/language-model-alias.ts

packages/ai-core/src/common/language-model.ts

packages/ai-ide/src/browser/ai-configuration/language-model-renderer.tsx

packages/ai-ide/src/browser/ai-configuration/model-aliases-configuration-widget.tsx

packages/ai-openai/src/node/openai-language-models-manager-impl.ts

sgraband · 2025-06-30T11:45:15Z

@sdirix Thanks for the feedback. I incorporated most of it and also fixed the regression you reported. I added comments on two of your suggestions. Could you take another look?

packages/ai-openai/src/browser/openai-frontend-application-contribution.ts

sdirix

In general the functionality works. However regarding UX and feature set there are quite a lot of things to be improved.

packages/ai-ide/src/browser/ai-configuration/language-model-renderer.tsx

packages/ai-ide/src/browser/ai-configuration/model-aliases-configuration-widget.tsx

packages/ai-core/src/browser/ai-core-preferences.ts

packages/ai-core/src/browser/frontend-language-model-alias-registry.ts

packages/ai-ide/src/browser/ai-configuration/model-aliases-configuration-widget.tsx

sdirix

Works for me! I only have minor comments left. Feel free to tackle them here or log them as follow ups

packages/ai-ide/src/browser/ai-configuration/model-aliases-configuration-widget.tsx

packages/ai-ide/src/browser/ai-configuration/language-model-renderer.tsx

packages/ai-ide/src/browser/ai-configuration/model-aliases-configuration-widget.tsx

sgraband · 2025-07-28T13:04:40Z

@JonasHelming Could you go over the proposed aliases here and adjust which ones should be available, which models they should reference and the description. And then change the default model of the agents to a suitable alias and just add this as an commit on this PR?

JonasHelming · 2025-07-29T12:59:08Z

I would go:

    {
        id: 'default/code',
        defaultModelIds: [
            'anthropic/claude-3-7-sonnet-latest',
            'openai/gpt-4.1',
            'google/gemini-2.5-pro-exp-03-25'
        ],
        description: 'Optimized for code understanding and generation tasks.'
    },
    {
        id: 'default/universal',
        defaultModelIds: [
            'openai/gpt-4o',
            'anthropic/claude-3-7-sonnet-latest',
            'google/gemini-2.5-pro-exp-03-25'
        ],
        description: 'Well-balanced for both code and general language use.'
    },
    {
        id: 'default/code-completion',
        defaultModelIds: [
            'openai/gpt-4.1',
            'anthropic/claude-3-7-sonnet-latest',
            'google/gemini-2.5-pro-exp-03-25'
        ],
        description: 'Best suited for code autocompletion scenarios.'
    },
    {
        id: 'default/summarize',
        defaultModelIds: [
            'openai/gpt-4.1',
            'anthropic/claude-3-7-sonnet-latest',
            'google/gemini-2.5-pro-exp-03-25'
        ],
        description: 'Models prioritized for summarization and condensation of content.'
    }
];

Initial implementation of #15395 Introduces support for AI model aliases to facilitate updating many agents' used models at once. An alias either points to a single model selected by the user or a chain of default/fallback models to consider in priority order. For the fallback chain, the first ready model (e.g. has an API key configured) is used. For this the language model was extended with a status to be set by its manager. - Introduces a language model alias registry for registering and retrieving model aliases and chains - Adds support for chains of default model aliases (`code`, `universal`, `code completion`, `summarize`) - Selects the first available model (with an API key) from the chain when resolving an alias; falls back to the first in the chain if none are ready - Enables users to point an alias to use a specific model - Extends language models to track readiness (e.g., whether an API key is set) - Adds a new Model Aliases tab to the the AI configuration UI to: - Display alias chains - Select a mode for an alias Signed-off-by: Simon Graband <sgraband@eclipsesource.com> Co-authored-by: Lucas Koehler <lkoehler@eclipsesource.com> Co-authored-by: Stefan Dirix <sdirix@eclipsesource.com>

Signed-off-by: Simon Graband <sgraband@eclipsesource.com>

sgraband · 2025-07-30T09:56:55Z

@JonasHelming could you take a look at the assignment between agents and aliases? Best to just delete your ai-features.agentSettings block in the settings.json.

@sdirix Could you take a look at the changes of this commit? This was needed to properly render the agents using this alias if the setting was not set.

sdirix

I deleted all my ai-feature preferences and the tool worked as expected

Signed-off-by: Simon Graband <sgraband@eclipsesource.com>

Previously the alias would not be associated with the agent if the setting was empty. Signed-off-by: Simon Graband <sgraband@eclipsesource.com>

JonasHelming · 2025-08-05T13:31:29Z

@sgraband The follow up section above mentions: "Configure aliases as default models for agents" => isn't this done?

sgraband · 2025-08-05T13:36:47Z

Yes. Since i already created a follow-up. I did not update this further.

Initial implementation of eclipse-theia#15395 Introduces support for AI model aliases to facilitate updating many agents' used models at once. An alias either points to a single model selected by the user or a chain of default/fallback models to consider in priority order. For the fallback chain, the first ready model (e.g. has an API key configured) is used. For this the language model was extended with a status to be set by its manager. - Introduces a language model alias registry for registering and retrieving model aliases and chains - Adds support for chains of default model aliases (`code`, `universal`, `code completion`, `summarize`) - Selects the first available model (with an API key) from the chain when resolving an alias; falls back to the first in the chain if none are ready - Enables users to point an alias to use a specific model - Extends language models to track readiness (e.g., whether an API key is set) - Adds a new Model Aliases tab to the the AI configuration UI to: - Display alias chains - Select a mode for an alias Signed-off-by: Simon Graband <sgraband@eclipsesource.com> Co-authored-by: Simon Graband <sgraband@eclipsesource.com> Co-authored-by: Stefan Dirix <sdirix@eclipsesource.com>

github-project-automation bot added this to PR Backlog Jun 6, 2025

github-project-automation bot moved this to Waiting on reviewers in PR Backlog Jun 6, 2025

This was referenced Jun 6, 2025

Default Model Management eclipsesource/theia#217

Open

[Theia AI] Default Model Management #15395

Closed

ndoschek mentioned this pull request Jun 11, 2025

Theia AI Epic - 1.63 #15809

Closed

61 tasks

sgraband force-pushed the issues/15395-model-aliases branch from 7b55b3b to fc65afb Compare June 12, 2025 08:07

ndoschek requested a review from sdirix June 12, 2025 13:40

sgraband force-pushed the issues/15395-model-aliases branch from 57abfe7 to 6e6566d Compare June 18, 2025 07:55

sdirix requested changes Jun 23, 2025

View reviewed changes

github-project-automation bot moved this from Waiting on reviewers to Waiting on author in PR Backlog Jun 23, 2025

ndoschek mentioned this pull request Jun 24, 2025

Theia AI Epic - 1.64 #15877

Closed

15 tasks

sgraband force-pushed the issues/15395-model-aliases branch from 143fcc7 to c81c0f2 Compare June 30, 2025 11:44

sgraband requested a review from sdirix June 30, 2025 11:44

sdirix reviewed Jul 4, 2025

View reviewed changes

packages/ai-openai/src/browser/openai-frontend-application-contribution.ts Outdated Show resolved Hide resolved

sgraband force-pushed the issues/15395-model-aliases branch 2 times, most recently from 6337ccd to bcabb50 Compare July 7, 2025 10:03

sgraband requested a review from sdirix July 7, 2025 10:03

sdirix requested changes Jul 16, 2025

View reviewed changes

sgraband force-pushed the issues/15395-model-aliases branch 2 times, most recently from bee21fe to 393c0f0 Compare July 23, 2025 11:28

sdirix approved these changes Jul 28, 2025

View reviewed changes

github-project-automation bot moved this from Waiting on author to Needs merge in PR Backlog Jul 28, 2025

sgraband force-pushed the issues/15395-model-aliases branch from fc13df6 to 184753b Compare July 30, 2025 09:52

sgraband and others added 2 commits July 30, 2025 11:54

Set aliases

51b2e99

Signed-off-by: Simon Graband <sgraband@eclipsesource.com>

sgraband force-pushed the issues/15395-model-aliases branch from 184753b to cc13d53 Compare July 30, 2025 09:54

sdirix approved these changes Jul 30, 2025

View reviewed changes

sgraband added 2 commits July 30, 2025 14:53

Set aliases as default model for agents

22a2399

Signed-off-by: Simon Graband <sgraband@eclipsesource.com>

Fix Agents using this Alias calculation

93a56e5

Previously the alias would not be associated with the agent if the setting was empty. Signed-off-by: Simon Graband <sgraband@eclipsesource.com>

sgraband force-pushed the issues/15395-model-aliases branch from cc13d53 to 93a56e5 Compare July 30, 2025 12:53

sgraband merged commit 442802e into master Jul 30, 2025
9 of 11 checks passed

github-project-automation bot moved this from Needs merge to Done in PR Backlog Jul 30, 2025

github-actions bot added this to the 1.64.0 milestone Jul 30, 2025

Add AI model aliases and default models #15782

Add AI model aliases and default models #15782

Uh oh!

Conversation

lucas-koehler commented Jun 6, 2025 • edited by sgraband Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What it does

How to test

Follow-ups

Breaking changes

Review checklist

Reminder for reviewers

Uh oh!

sdirix left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

sgraband commented Jun 30, 2025

Uh oh!

Uh oh!

sdirix left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

sdirix left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

sgraband commented Jul 28, 2025

Uh oh!

JonasHelming commented Jul 29, 2025

Uh oh!

sgraband commented Jul 30, 2025

Uh oh!

sdirix left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

JonasHelming commented Aug 5, 2025

Uh oh!

sgraband commented Aug 5, 2025

Uh oh!

Uh oh!

lucas-koehler commented Jun 6, 2025 •

edited by sgraband

Loading