Search: github.com/tnfe | Heykuki News

HK

Heykuki News

Top New Best Ask Show Jobs

Top New Best Ask Show Jobs

301.

Show HN: Bhumi–OSS Python Library w Rust Underhead for 2.5x Faster LLM Inference

bhumi.trilok.ai

a year ago

8 points

302.

Show HN: ChainFactory – Run Structured LLM Inference with Easy Parallelism

github.com/pankajgarkoti

2 years ago

8 points

303.

gg: "M2 Ultra is the absolute best personal LLM inference node you can buy."

github.com/ggerganov

3 years ago

8 points

304.

LLaMA-rs: a Rust port of llama.cpp for fast LLaMA inference on CPU

github.com/setzer22

3 years ago

8 points

305.

Sahi: A Vision library for sliced inference on large images/small objects

github.com/obss

5 years ago

yagizdegirmenci

8 points

306.

Show HN: Docker Model Runner Integrates vLLM for High-Throughput Inference

github.com/docker

7 months ago

7 points

307.

Show HN: Jlama – A fast Java inference engine for GPT and Llama models

github.com/tjake

3 years ago

7 points

308.

Show HN: Llamero – A GUI app to easily download, install and infer LLaMA models

github.com/mpociot

3 years ago

7 points

309.

Alpa: Auto-parallelizing large model training and inference (by UC Berkeley)

github.com/alpa-projects

4 years ago

7 points

310.

Show HN: Secure XGBoost training and inference on encrypted data

github.com/mc2-project

6 years ago

7 points

311.

Show HN: Composable middleware for LLM inference Optimization Passes

github.com/liquidos-ai

4 months ago

7 points

312.

Distributed LLama3 Inference

github.com/evilsocket

2 years ago

7 points

313.

Stable Diffusion Inference on iOS

github.com/madebyollin

4 years ago

7 points

314.

Cligen: A Native API-Inferred Command-Line Interface Generator for Nim

github.com/c-blake

a year ago

6 points

315.

RxInferServer – Remote Bayesian Inference from Python via Julia

a year ago

6 points

316.

Show HN: Larq – Binarized Neural Network Inference with MLIR and TFLite

github.com/larq

6 years ago

6 points

317.

OpenUMA – bring Apple-style unified memory to x86 AI inference (Rust, Linux)

github.com/hamtun24

3 months ago

6 points

318.

Llama.cpp: Deterministic Inference Mode (CUDA): RMSNorm, MatMul, Attention

github.com/ggml-org

9 months ago

6 points

319.

Llama Inference in 150 Lines

gist.github.com

2 years ago

6 points

320.

Show HN: Launch StableStudio local inference in one commmand

github.com/brycedrennan

3 years ago

6 points

321.

Rust+OpenCL+AVX2 implementation of LLaMA inference code

github.com/Noeda

3 years ago

6 points

322.

ncnn: High-performance neural network inference framework optimized for mobile

github.com/Tencent

4 years ago

6 points

323.

Wase – WebAssembly made easy. Strongly typed infered low-level language for WASM

github.com/area9innovation

4 years ago

6 points

324.

Statistical Inference Considered Harmful

github.com/frankmcsherry

10 years ago

6 points

325.

Ask HN: What is the best tool to infer data type of tabular data?

5 years ago

5 points

326.

Show HN: Zod – TypeScript-first validation library with static type inference

github.com/vriad

6 years ago

5 points

327.

Show HN: GPT-J inference on the CPU using C/C++

github.com/ggerganov

4 years ago

5 points

328.

I implemented CLIP inference in plain C/C++

github.com/monatis

3 years ago

5 points

329.

GeosPy: Geolocation Inference Made Easy

github.com/tylfin

10 years ago

5 points

330.

Show HN: CUDA Profiler for Production Inference

github.com/graphsignal

26 minutes ago

5 points