Would be nice to have this work with Intel Arc gpus (a750, a770) using ipex or vulkan instead of cuda.

Links to stuff related to this:
https://github.com/intel/intel-extension-for-deepspeed
https://github.com/intel/intel-extension-for-pytorch
https://www.intel.com/content/www/us/en/developer/tools/oneapi/overview.html
https://www.intel.com/content/www/us/en/developer/tools/openvino-toolkit/overview.html
https://www.lunarg.com/vulkan-sdk/
https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/webui_quickstart.html