!localllama@sh.itjust.works
I wrote about running LLMs locally on the Intel Arc Pro B60 GPU previously, where I used Intel's official software stack (llm-scaler / vLLM).
Local votes are a bit more private.
Default mode: public.