I have avoided AI (LLMS) because it didn’t seem nearly useful enough to warrant supporting these tech assholes. Is there anyway to use it locally on a normal device (16 Gb ram, 8 year old Geforce graphics, etc?). Can I just slow it down and get it to work locally?
Yes. LMstudio runs on most recent systems with a 4-12B token model available to load (there’s lots to choose from) and can answer questions and do editing/scripting tasks without any changes.
I run it on a M1 laptop and it does what I want, fairly quickly. See if it does what you’re looking for.