I’ve used Gemma2-2B from GDM for a day, and it's a really solid model for its size from my experience. So I built a CLI app for a Mac.
More notes here: https://x.com/notnotrishi/status/1819085403728875557
More notes here: https://x.com/notnotrishi/status/1819085403728875557