crosspost it to c/actually_infuriating

heavily depends on the model and quantization level

choose the model you want on this website and it’ll give you some specs likely to run it

https://runthisllm.com/

any/most distros will do, especially if you run it on Docker

if you’re going with intel cards (best $ per GB VRAM right now), you could get a decent machine under $3k

micro for sensible defaults out of the box, and because I don’t like modal editors.

containers

framework as in the laptop brand, or…?

Because if so, I think you can also install arch/arch-based and have bleeding edge

I hope people in the us wake the fuck up and these companies start losing users to foreign ones by the millions