Checklist

• 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
• 2. Please use English, otherwise it will be closed.

Motivation

Currently there is only two test files for Lora features:
test/srt/models/test_lora.py and
test/srt/models/test_lora_backend.py
These two tests are only tested on llama models, thus not comprehensive.

Lora needs a series of well-organized tests, which can be similar to
test/srt/models/test_generation_models.py

Check List

check list copied from #3652:

• Add backend test support for single adaptor, single prompt inference.
• Add backend test support for single adaptor, batch prompts serving.
• Add backend test support for multi-adaptor, same rank.
• Add backend test support for multi-adaptor, different rank.
• Add backend test support for adaptor with Embedding and Lm_head layer weights.

Related PRs

#3652 #4239 #4925