crawl4ai

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

84.2k
Stars
Python
Language

🎭 Best For

⚖️ Compare With

🏷️ Topics & Ecosystem

ai ai-agents crawler data-extraction llm markdown mcp open-source playwright python rag scraper web-crawler web-crawling web-scraping

📊 Activity

Latest commit: 2026-09-25. Activity data is based on daily RepoPi snapshots of the GitHub repository.