![](https://sh.itjust.works/pictrs/image/eff0bc9f-29b4-4a29-b078-b880ee1a09f3.webp)
![](https://fry.gs/pictrs/image/c6832070-8625-4688-b9e5-5d519541e092.png)
Beautiful take on the Arrogant Worms classic! <3
Beautiful take on the Arrogant Worms classic! <3
Exactly! If you only want to use a Large Language Model (LLM) to run your own local chatbot, then using a quantized version will dramatically improve speed and performance. It also allows consumer hardware to run larger models which would otherwise be prohibitively resource intensive.
You can, and it’s easier than you might think! Check out a platform like Oobabooga and find a nice 4-bit quantized LLM of a flavor you prefer. Check out TheBloke on hugging face, they quantized a ton of great LLMs.
ICQ… Now there’s a name I haven’t heard in a long time. I used to use the crap out of that service, but I can’t for the life of me recall what killed it anymore than I can recall migrating from AIM.
Give https://lemmy.dbzer0.com/c/piracy a try!
Edit: Lemmy link - !piracy@lemmy.dbzer0.com
Don’t forget the “fix” Sony offered after they were initally caught was an even MORE invasive rootkit. 🫠
Targets: the Dirty Dozen