Warning: Inference takes ages.
Pics & Media: https://x.com/VulcanIgnis/status/1893420241310335329
I once tried to slap TLS/SSL stack onto ZX Spectrum – so HTTPS connection on it worked, but it took solid two minutes to just load a certificate – sometimes you gotta do the "I made a screaming robot - why? - hmmmmmm...."
“No? Well, now you can!”
Lol, I’m stealin’ that.
"How this works" - Slowly!
I was chatting with ChatGPT 4o the other day and I was asking it on "what steps/software/tools/etc. I need to set up my own LLM offline on a PC".
I suggested a few PCs I got, they were all super slow, but for the purpose I want it (numerical analysis) I can make it work. But even my stupid old PCs are times-infinity faster than this C64!!