example.com/path/to/article
000 points · username · 0 hours ago
example.com106 points · 18 comments · 22 days ago · Maverick617
colinsane
PcChip
antonyragleap
peddling-brink
llama.cpp via Vulkan (AMD / Intel / NVIDIA) or CPU fallback
I got excited about someone paying attention to intel. Oh well.
kgeist
DylanMerigaud
dlcarrier
Local inference — llama.cpp via Vulkan (AMD / Intel / NVIDIA) or CPU fallback
so this is just a go binary that exec's `llama-server --model $MODEL_PATH ...`? there's room for llama wrappers, sure, but the readme only shows features that are already exposed directly from llama-server. it doesn't seem to do anything besides rename the CLI arguments: i don't get it.