This seems really cool.
They said the models can scale to "private cloud compute" based on Apple Silicon which will be ensured by your device to run "publicly verifiable software" in order to guarantee no misuse of your data.
I wonder if their server-side code will be open-source? That'd be positively surprising. Curious to see how this evolves.
Anyway, overall looks really really cool. If it works as marketed, then it will be an easy "shut up and take my money".
They need a lot more information about how "Apple Intelligence" actually works. They can't just wave the magic wand and say "some" of the functionality runs in the "private" cloud - we need one single checkbox to say we want the cloud or not and strong guarantees things don't accidentally get cloud-ified.
They've named this platform "Personal Intelligence Service"... Or PIS. Which seems like the type of brand name you'd find in a GTA game.
Publicly verifiable server workers to run larger models? It's interesting how private it will actually turn out to be.
Is Apple running a proprietary LLM or are they licensing one from OpenAI, Google, etc?
I think the most important and somewhat massive news is that Apple built an entire LLM private cloud using Apple Silicon - that's a big deal/investment.