Skip to content

The official repository of the paper "The Instinctive Bias: Spurious Images lead to Hallucination in MLLMs"

Notifications You must be signed in to change notification settings

MasaiahHan/CorrelationQA

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CorrelationQA

The official repository of the paper "The Instinctive Bias: Spurious Images lead to Hallucination in MLLMs"

HuggingFace

Installation

pip install -r requirements.txt

How to use

1. Evaluate using your MLLMs

python eval_llava.py --model_path llava-hf/llava-1.5-7b-hf

We implement an toy example for LLaVA model. You can modify the corresponding part in the code for using different MLLMs.

2. Calculate the accuracy

python output.py

The average accuracy would be printed in the terminal.

About

The official repository of the paper "The Instinctive Bias: Spurious Images lead to Hallucination in MLLMs"

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages