An open-source Python library for AI-powered web scraping using LLMs

ScrapeGraphAI is a Python library that leverages LLMs and graph logic to automate the creation of scraping pipelines for websites, local documents (XML, HTML, JSON), and other data sources. It aims to simplify web scraping by allowing users to specify the information they need in natural language, and the AI handles the extraction process. The library supports multiple LLMs including GPT, Gemini, Groq, Azure, and local models via Ollama.