What happened?

Trying to run to llama.cpp in a container but so far it's been unsuccessful.

> docker run -v  /ssdpool/llm-models:/models  ghcr.io/ggerganov/llama.cpp:light -m /models/Meta-Llama-3-8B.Q8_0.gguf -p "Building a website can be done in 10 simple steps:" -n 512

gets me

/main: error while loading shared libraries: libgomp.so.1: cannot open shared object file: No such file or directory

I have CUDA installed:

> nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2021 NVIDIA Corporation
Built on Thu_Nov_18_09:45:30_PST_2021
Cuda compilation tools, release 11.5, V11.5.119
Build cuda_11.5.r11.5/compiler.30672275_0

I have also installed nvidia-container-toolkit and followed these instructions

I get the same error when I create the image myself from master (local/llama.cpp:light-cuda)

Name and Version

Docker

What operating system are you seeing the problem on?

Linux

Relevant log output

No response