HK
Heykuki News
Top
New
Best
Ask
Show
Jobs
Toggle theme
Top
New
Best
Ask
Show
Jobs
Request
31.
▲
Rust Programmer Join the Party, first binary project "crawler"
github.com/ALAWIII
1 comment
a year ago
allawiii
1 points
32.
▲
Using GPT for Automated Crawling
github.com/gh18l
1 comment
3 years ago
ccccoffee
1 points
33.
▲
Crawl4AI: Open-Source LLM Friendly Web Crawler and Scraper
github.com/unclecode
discuss
7 months ago
zoooey
1 points
34.
▲
Crawl4ai – open-source web crawler for your AI agent
github.com/unclecode
discuss
a year ago
basic_banana
1 points
35.
▲
A Crawler Admin GitHub Project Reaching 5k Stars in 1 Year
github.com/crawlab-team
discuss
6 years ago
tikazyq
1 points
36.
▲
A 50 lines, minimalist Node.js crawler for GitHub-Trending,just try it
github.com/ZY2071
discuss
7 years ago
zy_2071
1 points
37.
▲
Crawlpy: python crawler with login (handles CSRF), dynamic depth and save to disk
github.com/cytopia
discuss
10 years ago
everythingcli
1 points
38.
▲
Crawlpy: python crawler with login (handles CSRF), dynamic depth and save to disk
github.com/cytopia
discuss
10 years ago
everythingcli
1 points
39.
▲
Quick but powerful research for AI agents with data scrapping and selenium
6 comments
a year ago
alexvomwald
8 points
40.
▲
Show HN: Flatagents: State machine orchestration with stateless LLM agents
github.com/memgrafter
1 comment
5 months ago
beacon294
4 points
41.
▲
Show HN: Ask questions to your tech stack documentation
ask-your-stack.vercel.app
discuss
3 years ago
tudorg
4 points
42.
▲
Show HN: Simple Crawling Server
github.com/rumca-js
1 comment
a year ago
renegat0x0
2 points
43.
▲
Show HN: ETL System to Extract Product Data from Websites and Upload to Shopify
github.com/GustavoFortti
discuss
a year ago
gustavofortti
2 points
44.
▲
Show HN: SiteOne Crawler – in-depth website analyzer and exporter (open-source)
github.com/janreges
2 comments
2 years ago
janreges
32 points
45.
▲
Ether Crawler – A dungeon crawler and challenge market based on Ethereum
github.com/ConsenSys
2 comments
11 years ago
phodo
9 points
46.
▲
Show HN: A Node.js script powered by Puppeteer for undetectable web scraping
github.com/darkotodoric
2 comments
2 years ago
darkotodoric
6 points
47.
▲
Show HN: Get paid for crawling the web
github.com/datafiniti
7 comments
12 years ago
jdrock
5 points
48.
▲
Show HN: Python Testing Crawler – spider your Flask or Django website in tests
github.com/python-testing-crawler
1 comment
6 years ago
wodow
5 points
49.
▲
Show HN: SiteOne Crawler – Single-binary CI/CD gate for web quality regressions
github.com/janreges
2 comments
3 months ago
janreges
3 points
50.
▲
Show HN: A Simple Web Crawler with Spring, Postgres and Redis
github.com/firattamur
1 comment
2 years ago
engineerick
3 points
51.
▲
Show HN: PDF Crawler
github.com/zillabyte
discuss
12 years ago
cblock811
3 points
52.
▲
Social crawler – Discover social share count of all pages on your website
github.com/AbhishekGahlot
discuss
12 years ago
abhishek_it
3 points
53.
▲
Kickstarter-crawler: 35+ data points. utilize 61,356 kickstarter urls (node)
github.com/ghostsnstuff
discuss
12 years ago
jaredhalpert
3 points
54.
▲
Open-source toolkit to download EDGAR financial reports
github.com/nlpaueb
discuss
2 years ago
pppoe
3 points
55.
▲
Amazon Web Crawler
github.com/yashpokar
discuss
8 years ago
yashpokar
3 points
56.
▲
Show HN: Domain Crawler
github.com/zillabyte
2 comments
12 years ago
cblock811
2 points
57.
▲
Turn any site into a custom GPT with just a URL
github.com/BuilderIO
2 comments
3 years ago
steve8708
2 points
58.
▲
Show HN: A super simple webcrawler framework written in Python
github.com/mrafayaleem
2 comments
10 years ago
iamspoilt
2 points
59.
▲
Node.js Web Crawler
github.com/sylvinus
discuss
12 years ago
jwdunne
2 points
60.
▲
Show HN: Turn Any Website into Clean Markdown for LLMs/RAG with SiteOne Crawler
github.com/janreges
discuss
7 months ago
janreges
2 points
More