I have avoided AI (LLMS) because it didn’t seem nearly useful enough to warrant supporting these tech assholes. Is there anyway to use it locally on a normal device (16 Gb ram, 8 year old Geforce graphics, etc?). Can I just slow it down and get it to work locally?
I’ve run local models on my work laptop, whose specs I don’t know by heart, but it is a relatively ordinary laptop given out to software developers at a large company. It wasn’t instant, but it did produce some useful results. Look into ollama.