agentic_fabric.tools.scraping_tools

Website scraping tools for CrewAI-compatible runners.

Module Contents

Classes

ScrapeWebsiteTool	A small first-party website scraping tool with CrewAI-compatible shape.
CrawlWebsiteTool	A tool for crawling a website and scraping its content.

Data

log
MAX_CRAWL_PAGES
MAX_CRAWL_DEPTH

API

agentic_fabric.tools.scraping_tools.log = 'getLogger(...)'

agentic_fabric.tools.scraping_tools.MAX_CRAWL_PAGES = 25

agentic_fabric.tools.scraping_tools.MAX_CRAWL_DEPTH = 2

class agentic_fabric.tools.scraping_tools.ScrapeWebsiteTool

A small first-party website scraping tool with CrewAI-compatible shape.

name: str = 'ScrapeWebsiteTool'

description: str = 'Scrape readable content from a URL.'

class agentic_fabric.tools.scraping_tools.CrawlWebsiteTool

Bases: agentic_fabric.tools.scraping_tools.ScrapeWebsiteTool

A tool for crawling a website and scraping its content.

This tool extends ScrapeWebsiteTool to support crawling multiple pages starting from a given URL.

name: str = 'CrawlWebsiteTool'

description: str = 'Crawl a website from a given URL and scrape its content.'