🤖 Dify.ai Custom Tool

Integrate Live Web Scraping into Dify.ai

Q: Does FlyCrawl require KYC or identity verification?

No. FlyCrawl is 100% No-KYC. Developers can create an account and pay anonymously using USDT (TRC-20), TON, or TRX with instant on-chain confirmation and zero identity disclosure.

Q: How does FlyCrawl compare to Firecrawl in speed and pricing?

FlyCrawl is up to 80% more affordable ($0.39 to $0.96 per 1,000 pages vs $5.33 per 1,000 pages on Firecrawl) and engineered with a zero-memory-leak Go and .NET 10 core that extracts pages in under 400ms.

Q: Does FlyCrawl generate vector embeddings directly?

Yes! FlyCrawl includes an in-memory high-dimensional vector engine generating 1536-dimensional (Fast) and 3072-dimensional (Large) embeddings directly from scraped Markdown, ready for Pinecone, Qdrant, and Milvus.

Q: Can I connect FlyCrawl to Cursor IDE, Windsurf, or Claude Desktop?

Yes! FlyCrawl hosts a native Model Context Protocol (MCP) server at /api/v1/mcp enabling AI coding agents to crawl, search, and ingest web knowledge seamlessly.

Empower your Dify conversational agents and knowledge bases with real-time web scraping. Works natively with DeepSeek-R1, Qwen 2.5, and Claude models.

Claim 100 Free Credits → OpenAPI Spec

Dify Tool Definition YAML

name: flycrawl_scraper
description: Scrape URL into clean Markdown for LLMs
parameters:
  - name: url
    type: string
    required: true
endpoint: https://api.flycrawl.net/api/v1/scrape