I have avoided AI (LLMS) because it didn’t seem nearly useful enough to warrant supporting these tech assholes. Is there anyway to use it locally on a normal device (16 Gb ram, 8 year old Geforce graphics, etc?). Can I just slow it down and get it to work locally?
To be honest, I’m not sure how it all works exactly, but I downloaded some models that run locally and i can choose an agent that can run models that will work with my (and your) limited graphics memory. It’s all local and you don’t have any limits or anything and it’s private. No tokens. However, it will run very slowly depending on what you are doing.
I haven’t used it. I tried a couple of times but I was trying to generate an image and apparently it was too much for it and I never tried it again. But maybe that somehow supports rich assholes. I don’t know. I didn’t pay anything and I was under the impression it was open source.
If you want to try, you can go on YouTube and search under something like “running AI locally.” And you should find some tutorials. Good luck.
Personally I have a love/hate relationship with AI. It’s simultaneously amazing and horrifying.