Show HN: 60% higher tokens per second for 70B custom LLMsbaseten.co1 pointmikejulietbravo2 years agoWe optimized Writer's Palmyra Fin and Palmyra Med for 60% higher TPS at 35% reduced cost