Despite the Liquid Glass controversy, our team is quite excited about the new on-device ASR model and Foundation Model Framework. It makes building local-first AI apps much easier, it was very easy to build a basic scribe app compared to our first iteration of our meeting note taker. Everything runs locally with zero cloud dependencies. With the option to combine with cloud models for more complex tasks, we hope to see more local-first AI apps.
Microsoft just announced Foundry local as well, and it'll be interesting to see where they go with it.
There are still some limitations with the foundation model, such as a 4,096 context window, but it will probably get better over time: https://gist.github.com/samhenrigold/3aad01b762ccc87e34e6115...