HK
Heykuki News
Top
New
Best
Ask
Show
Jobs
Toggle theme
Top
New
Best
Ask
Show
Jobs
Request
1.
▲
A Python Library to 6-7x the inference speed of your HF models
github.com/MDK8888
15 comments
2 years ago
MDK8888
75 points
2.
▲
A Minimal Implementation of Vllm
github.com/MDK8888
1 comment
2 years ago
MDK8888
3 points
3.
▲
Show HN: SageMode - A Python library for deploying, scaling, and monitoring LLMs
github.com/MDK8888
1 comment
2 years ago
MDK8888
3 points