M2 Ultra can run 128 streams of Llama 2 7B in parallelgithub.com/ggerganov268 pointsbehnamoh3 years ago