HK
Heykuki News
Top
New
Best
Ask
Show
Jobs
Toggle theme
Top
New
Best
Ask
Show
Jobs
Request
31.
▲
Show HN: Turbolite – a SQLite VFS serving sub-250ms cold JOIN queries from S3
github.com/russellromney
43 comments
3 months ago
russellthehippo
185 points
32.
▲
MediaCrush – A website for serving media super fast
github.com/MediaCrush
92 comments
13 years ago
ddevault
159 points
33.
▲
Show HN: Nano-web – a low latency one binary webserver designed for serving SPAs
github.com/radiosilence
115 comments
2 years ago
antihero
157 points
34.
▲
Nvidia Dynamo: A Datacenter Scale Distributed Inference Serving Framework
github.com/ai-dynamo
39 comments
a year ago
ashvardanian
150 points
35.
▲
Show HN: Blast – Fast, multi-threaded serving engine for web browsing AI agents
github.com/stanford-mast
66 comments
a year ago
calebhwin
145 points
36.
▲
Punica: Serving multiple LoRA finetuned LLM as one
github.com/punica-ai
26 comments
3 years ago
abcdabcd987
135 points
37.
▲
S-LoRA: Serving Concurrent LoRA Adapters
github.com/S-LoRA
20 comments
3 years ago
Labo333
73 points
38.
▲
Kvcached: Virtualized, elastic KV cache for LLM serving on shared GPUs
notion.so
13 comments
8 months ago
Jrxing
69 points
39.
▲
Show HN: Cortex – Open-source alternative to SageMaker for model serving
github.com/cortexlabs
19 comments
6 years ago
calebkaiser
65 points
40.
▲
Show HN: macOS app to reduce eye strain (open-source)
github.com/oxremy
15 comments
a year ago
Remy42
43 points
41.
▲
My first simple 97-loc Sinatra/Freebase/Heroku single-serving app
github.com/bkudria
8 comments
17 years ago
bkudria
23 points
42.
▲
Clipper: A prediction serving system for TensorFlow, PyTorch, PySpark and others
github.com/ucbrise
5 comments
7 years ago
kot-behemoth
13 points
43.
▲
Serving both sync and async/comet HTTP with RingoJS
hns.github.com
2 comments
16 years ago
hannesw
13 points
44.
▲
Mooncake: A KVCache-Centric Disaggregated Architecture for LLM Serving
github.com/kvcache-ai
discuss
2 years ago
zinccat
13 points
45.
▲
Yahoo Cloud Serving Benchmark
wiki.github.com
discuss
16 years ago
helwr
12 points
46.
▲
BentoML: A platform for serving and deploying machine learning models
github.com/bentoml
5 comments
7 years ago
kevlar1818
10 points
47.
▲
Simple Agent API: A Minimal Setup for Serving Agents with FastAPI and Postgres
github.com/agno-agi
discuss
a year ago
bediashpreet
10 points
48.
▲
Chronon: A data platform for serving for AI/ML applications
github.com/airbnb
2 comments
9 months ago
tanelpoder
8 points
49.
▲
TorchServe: Model Serving Library for PyTorch
github.com/pytorch
1 comment
6 years ago
gtrevize
8 points
50.
▲
Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving
github.com/kvcache-ai
discuss
a year ago
sarkory
8 points
51.
▲
A full-stack Python model serving library
github.com/Lightning-AI
discuss
2 years ago
theaniketmaurya
8 points
52.
▲
BentoML: An open-source platform for ML model serving
github.com/bentoml
discuss
6 years ago
paranoyang
8 points
53.
▲
Show HN: Serving Django and Twisted using HAproxy
gist.github.com
4 comments
13 years ago
sspross
7 points
54.
▲
Ask HN: Are there any reliable benchmarks for Machine Learning Model Serving?
3 comments
2 years ago
KuriousCat
6 points
55.
▲
Show HN: PyPI server for serving Python packages out of GitHub
github.com/brettlangdon
1 comment
9 years ago
brettlangdon
6 points
56.
▲
Show HN: Deadsimple – A static site server serving Markdown as Bootstrap HTML
github.com/ncthis
9 comments
12 years ago
lunarcave
5 points
57.
▲
Turning PostgreSQL into a queue serving 10,000 jobs per second
gist.github.com
discuss
13 years ago
chanks
5 points
58.
▲
Show HN: ServeIt – simple API serving for Python ML models
github.com/rtlee9
discuss
8 years ago
ryantl
5 points
59.
▲
Show HN: A CLI tool that speeds carthage build by serving pre-built frameworks
discuss
10 years ago
n4rc071x
5 points
60.
▲
Show HN: One-stop ML model managing, converting, profiling and serving platform
github.com/cap-ntu
3 comments
6 years ago
huangyz0918
4 points
More