Artificial intelligence (AI), hardware, linux

vLLM: faster, better, with native support on Strix Halo

TL;DR: its great to see vLLM on Strix Halo. With some experimenting you could come up with recipes that work well on Strix Halo, though