🧠 Ingest & Vectorize in 1 Round-Trip

Web Data Extraction for Enterprise RAG Pipelines

Transform live websites and documentation into semantic Markdown chunks and native 1536-dim or 3072-dim vector embeddings directly for Pinecone, Qdrant, Milvus, and pgvector.

RAG Ingestion with Native Embeddings
curl -X POST https://api.flycrawl.net/api/v1/scrape \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://docs.python.org",
    "formats": ["markdown", "chunks", "embeddings"],
    "embeddings": {
      "model": "native-large",
      "dimensions": 3072
    }
  }'