remove gguf from mlx-swift build

See https://github.com/ml-explore/mlx-swift/issues/110

From @awni

> Hmm, we should build without GGUF support in MLX Swift / MLX C (MLX_BUILD_GGUF=OFF). We don't support it in the API anyway so it doesn't make sense to include it right?