Skip to content

Update Dockerfile to work with latest version of autoawq and torch #28

@amscosta

Description

@amscosta

Hi,
Just uploaded the last docker image and issued on Ubuntu 22.04 (WSL 2):
docker run -d --gpus=all -it -p 8501:8501 -e LLM=hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 -e TEXTBACKEND=docling -e DATA=/data/path -v /home/c0274/pdf_text_test:/data/path neuml/rag

Got the following screen:

Image

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions