Skip to content

Conversation

sigoden
Copy link
Owner

@sigoden sigoden commented Oct 3, 2024

Why? As an open-source LLM inference platform, it has too few models and updates are not timely.

Since OctoAI is an OpenAI-compatible client, users can still access it, but they need to manually configure the models field.

@sigoden sigoden merged commit 7f37317 into main Oct 3, 2024
3 checks passed
@sigoden sigoden deleted the feat branch October 3, 2024 04:41
@fn5
Copy link

fn5 commented Oct 3, 2024

This makes sense as OctoAI is not providing any models from October 31. They have been acquired by NVIDIA and are ending the brandname.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants