🕷️ #Crawl4AI v0.2.77: Free, open-source web crawling tool for #LLMs and #AI applications
🐳 New official #Docker image on Docker Hub for easy deployment
🌐 Improved #Selenium integration, removing ChromeDriver dependency
🖼️ Added ability to generate textual descriptions for extracted images
⚡ Performance enhancements for faster crawling and extraction
Key features:
🤖 #LLM-friendly output formats (JSON, cleaned HTML, markdown)
🌍 Supports crawling multiple URLs simultaneously
🎨 Extracts all media tags (Images, Audio, Video)
📚 Various chunking strategies: topic-based, regex, sentence
🧠 Advanced extraction: cosine clustering, #LLM-based
#scraping
https://github.com/unclecode/crawl4ai