Open-source crawler & scrapper API that turns websites into LLM-ready data.
9
196
1K
79K
2K
Download Image
@GithubProjects Nice, as long as it's set up to respect robots txt file, we're good
@GithubProjects this one's based probably a good alternative to firecraw will try it this weekend! spotlighting t on microlaunch.net weekly
@GithubProjects Ignoring the small details early on... often creates bigger problems later. Esp. with new tech.
@GithubProjects Beat my Deescrape github.com/stretchcloud/d… Scrape, Batch Scrape, Markdown or JSON, Summarize, and Schema based extraction, run it locally and run with your local LLM using @vllm_project
