HK
Heykuki News
Top
New
Best
Ask
Show
Jobs
Toggle theme
Top
New
Best
Ask
Show
Jobs
Request
61.
▲
Fair: A Go library for serving resources fairly
github.com/satmihir
41 comments
2 years ago
ngaut
213 points
62.
▲
Show HN: Turbolite – a SQLite VFS serving sub-250ms cold JOIN queries from S3
github.com/russellromney
43 comments
3 months ago
russellthehippo
185 points
63.
▲
MediaCrush – A website for serving media super fast
github.com/MediaCrush
92 comments
13 years ago
ddevault
159 points
64.
▲
Show HN: Nano-web – a low latency one binary webserver designed for serving SPAs
github.com/radiosilence
115 comments
2 years ago
antihero
157 points
65.
▲
Nvidia Dynamo: A Datacenter Scale Distributed Inference Serving Framework
github.com/ai-dynamo
39 comments
a year ago
ashvardanian
150 points
66.
▲
Show HN: Blast – Fast, multi-threaded serving engine for web browsing AI agents
github.com/stanford-mast
66 comments
a year ago
calebhwin
145 points
67.
▲
Punica: Serving multiple LoRA finetuned LLM as one
github.com/punica-ai
26 comments
3 years ago
abcdabcd987
135 points
68.
▲
S-LoRA: Serving Concurrent LoRA Adapters
github.com/S-LoRA
20 comments
3 years ago
Labo333
73 points
69.
▲
Kvcached: Virtualized, elastic KV cache for LLM serving on shared GPUs
notion.so
13 comments
8 months ago
Jrxing
69 points
70.
▲
Show HN: Cortex – Open-source alternative to SageMaker for model serving
github.com/cortexlabs
19 comments
6 years ago
calebkaiser
65 points
71.
▲
My first simple 97-loc Sinatra/Freebase/Heroku single-serving app
github.com/bkudria
8 comments
17 years ago
bkudria
23 points
72.
▲
Clipper: A prediction serving system for TensorFlow, PyTorch, PySpark and others
github.com/ucbrise
5 comments
7 years ago
kot-behemoth
13 points
73.
▲
Serving both sync and async/comet HTTP with RingoJS
hns.github.com
2 comments
16 years ago
hannesw
13 points
74.
▲
Mooncake: A KVCache-Centric Disaggregated Architecture for LLM Serving
github.com/kvcache-ai
discuss
2 years ago
zinccat
13 points
75.
▲
Yahoo Cloud Serving Benchmark
wiki.github.com
discuss
16 years ago
helwr
12 points
76.
▲
BentoML: A platform for serving and deploying machine learning models
github.com/bentoml
5 comments
7 years ago
kevlar1818
10 points
77.
▲
Simple Agent API: A Minimal Setup for Serving Agents with FastAPI and Postgres
github.com/agno-agi
discuss
a year ago
bediashpreet
10 points
78.
▲
Chronon: A data platform for serving for AI/ML applications
github.com/airbnb
2 comments
9 months ago
tanelpoder
8 points
79.
▲
TorchServe: Model Serving Library for PyTorch
github.com/pytorch
1 comment
6 years ago
gtrevize
8 points
80.
▲
Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving
github.com/kvcache-ai
discuss
a year ago
sarkory
8 points
81.
▲
A full-stack Python model serving library
github.com/Lightning-AI
discuss
2 years ago
theaniketmaurya
8 points
82.
▲
BentoML: An open-source platform for ML model serving
github.com/bentoml
discuss
6 years ago
paranoyang
8 points
83.
▲
Show HN: Serving Django and Twisted using HAproxy
gist.github.com
4 comments
13 years ago
sspross
7 points
84.
▲
Ask HN: Are there any reliable benchmarks for Machine Learning Model Serving?
3 comments
2 years ago
KuriousCat
6 points
85.
▲
Show HN: PyPI server for serving Python packages out of GitHub
github.com/brettlangdon
1 comment
10 years ago
brettlangdon
6 points
86.
▲
Show HN: Deadsimple – A static site server serving Markdown as Bootstrap HTML
github.com/ncthis
9 comments
12 years ago
lunarcave
5 points
87.
▲
Turning PostgreSQL into a queue serving 10,000 jobs per second
gist.github.com
discuss
13 years ago
chanks
5 points
88.
▲
Show HN: ServeIt – simple API serving for Python ML models
github.com/rtlee9
discuss
8 years ago
ryantl
5 points
89.
▲
Show HN: A CLI tool that speeds carthage build by serving pre-built frameworks
discuss
10 years ago
n4rc071x
5 points
90.
▲
Show HN: One-stop ML model managing, converting, profiling and serving platform
github.com/cap-ntu
3 comments
6 years ago
huangyz0918
4 points
More