They don’t. The models are trained on sanitized data, and don’t permanently “learn”. They have a large context window to pull from (reaching 200k ‘tokens’ in some instances) but lots of people misunderstand how this stuff works on a fundamental level.
Even LLMs in the context of coding, I am no programmer - I have memory issues, and it means I can’t keep the web of information in my head long enough to debug the stuff I attempt to write.
With AI assistants, I’ve been able to create multiple microcontroller projects that I wouldn’t have even started otherwise. They are amazing assistive technologies. Many times, they’re even better than language documentation themselves because they can give an example of something that almost works. So yes, even LLMs deserve the amount of hype they’ve been given. I’ve made a whole game-server management back-end for ARK servers with the help of an LLM (qwen-coder 14b).
I couldn’t have done it otherwise; or I would have had to pay someone $60k; which I don’t have, and which means the software never would have existed.
I’ve even moved onto modifying some open source Android apps for a specialized camera application. Compared to a normal programmer, sure - maybe it’s not as good. But having it next to me as an inexperienced nobody allows me to write programs I wouldn’t have otherwise been able to, or that would have been too daunting of a task.