HK
Heykuki News
Top
New
Best
Ask
Show
Jobs
Toggle theme
Top
New
Best
Ask
Show
Jobs
Request
1.
▲
Show HN: Crawlee for Python – a web scraping and browser automation library
crawlee.dev
57 comments
2 years ago
jancurn
254 points
2.
▲
Ask HN: How to approach writing a web crawler that can handle JavaScript?
3 comments
10 years ago
awclives
4 points
3.
▲
Show HN: Crawlee Cloud Self-hosted platform for running Crawlee and Apify actor
crawlee.cloud
discuss
6 months ago
aminembarki
4 points
4.
▲
Ask HN: What do you use (AI based) web crawlers for?
discuss
5 months ago
dhruv_ahuja
3 points
5.
▲
Show HN: Crawlab: Open-Source Web Crawler Admin Platform That Runs Any Language
github.com/tikazyq
18 comments
7 years ago
tikazyq
116 points
6.
▲
Dungeon Crawl: Stone Soup
github.com/crawl
40 comments
10 years ago
nodivbyzero
98 points
7.
▲
Show HN: Crawlie – Free open-source SEO audit tool for humans and agents
github.com/spronta
6 comments
4 days ago
seandotexe
20 points
8.
▲
Crawl4AI is an open-source, LLM-friendly web crawler and scraper
github.com/unclecode
2 comments
a year ago
rmason
7 points
9.
▲
Crawly – Elixir web scraping framework
github.com/elixir-crawly
discuss
3 years ago
rahimnathwani
7 points
10.
▲
Distributed Web Crawler Management Platform
github.com/crawlab-team
discuss
6 years ago
tikazyq
7 points
11.
▲
Crawl4AI: Open-Source Web Crawler for Seamless AI Data Scraping
github.com/unclecode
discuss
2 years ago
ProbeCraft
6 points
12.
▲
Show HN: An open source web crawler for the Mwmbl non-profit search engine
github.com/mwmbl
discuss
4 years ago
daoudc
6 points
13.
▲
Show HN: An open source web crawler for the Mwmbl non-profit search engine
github.com/mwmbl
4 comments
4 years ago
daoudc
4 points
14.
▲
crawl4ai: The Adaptive Intelligence Update
github.com/unclecode
discuss
a year ago
hbcondo714
4 points
15.
▲
Announcing Crawler v1.0.0 – easy web crawling / scraping powered by Elixir
github.com/fredwu
discuss
9 years ago
fredwu
4 points
16.
▲
Crawl Code – because prompting was a text adventure
github.com/machinarii
discuss
2 months ago
datalater
3 points
17.
▲
Automatic Web Content Detection
github.com/crawlab-team
discuss
3 years ago
tikazyq
3 points
18.
▲
Qcrawl: Fast async web crawling and scraping framework for Python
github.com/crawlcore
1 comment
7 months ago
vasiliyk
2 points
19.
▲
Launching Crawlee for Python v1.0 to simplify building web scrapers and crawlers
github.com/apify
1 comment
9 months ago
jancurn
2 points
20.
▲
Show HN: Crawl - python module for finding files in a set of paths.
github.com/OiNutter
discuss
13 years ago
OiNutter
2 points
21.
▲
Show HN: crawlora-deadweb – 14% of the web is dead
github.com/Crawlora-org
discuss
3 days ago
tonywangcn
2 points
22.
▲
Pythonic Crawling / Scraping Framework Built on Eventlet
github.com/jmg
discuss
14 years ago
jmgutn
2 points
23.
▲
Crawl4AI
github.com/unclecode
discuss
2 years ago
synergy20
2 points
24.
▲
Crawlee: Crawlee–build reliable crawlers. Works with Puppeteer, Playwright, Ch
github.com/apify
discuss
2 years ago
todsacerdoti
2 points
25.
▲
Show HN: Mwmbl crawler extension: crawl the web from Firefox
github.com/mwmbl
discuss
4 years ago
daoudc
2 points
26.
▲
Crawlab: Distributed web crawler admin platform for spiders management
github.com/crawlab-team
discuss
6 years ago
r_singh
2 points
27.
▲
Crawlab: Crawler Admin Platform Managing Any Web Crawler
github.com/tikazyq
discuss
7 years ago
tikazyq
2 points
28.
▲
A golang crawler
github.com/kai712
discuss
8 years ago
ck11212
2 points
29.
▲
Crawlpy: python crawler with login (handles CSRF), cust depth lvl and save to disk
github.com/cytopia
discuss
10 years ago
everythingcli
2 points
30.
▲
Crawlp
github.com/zzengineer
discuss
10 years ago
everythingcli
2 points
More