Skip to content

[Feature] Support InterVL #3092

@zhaochenyang20

Description

@zhaochenyang20

Checklist

Motivation

https://huggingface.co/internlm/internlm-xcomposer2-vl-7b

As demonstrated by @YerongLi , this model is a good starter, and it's well-performed. Also, take this in mind:

We need a new documents for “adding a new VLM in SGLang” (we have adding a new LLM in SGLang already);

Read this docs, and write one while you are developing:

https://zhuanlan.zhihu.com/p/715805386

And later submit one to guide others on supporting new VLM in SGLang.

@mickqian and @yizhang2077 will help you while developing and reviewing your codes.

You can check mick's latest PR for help.

Related resources

No response

Metadata

Metadata

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions