rodricios /wxpath
wxpath - declarative web crawling with XPath; a Web Query Language (WQL)
$ git clone https://github.com/rodricios/wxpath.gitCategories
More in Search & Retrieval
m92vyas/llm-reader🔥 active
Turn Webpage to LLM friendly input text. Similar to Firecrawl and Jina Reader API. Makes RAG, AI web scraping, image & webpage links extraction easy.
unclecode/crawl4ai🔥 active
Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
AKSarav/pdfstract
PDFStract - Extract, Chunking and Embedding Layer in Your RAG Pipeline - Available as CLI - WEBUI - API
AnkitNayak-dev/CrawlAI-RAG
CrawlAI RAG is an AI-powered website intelligence platform that allows users to crawl entire websites, index their content, and ask natural-language questions using Retrieval-Augmented Generation (RAG). It transforms static websites into queryable knowledge bases.
Data from GitHub · snapshot Nov 13, 2026