Feature Area
Integration with external tools
Is your feature request related to a an existing bug? Please link it here.
NA
Describe the solution you'd like
Add ProxyClaw as a native CrewAI tool — a residential proxy + web access layer built specifically for AI agents.
What is ProxyClaw?
ProxyClaw lets AI agents browse the web through 2M+ residential IPs across 195+ countries, bypass CAPTCHAs, Cloudflare, and anti-bot systems automatically, and returns clean Markdown/JSON instead of raw HTML — making it natively LLM-ready.
Why it fits CrewAI:
- Enables CrewAI agents to browse any live website, scrape data, and retrieve structured content
-
- Returns Markdown/JSON directly — no parsing needed, perfect for RAG and agentic workflows
-
-
- Anti-bot bypass built in — 100% success rate across 66 tested sites, zero config
-
-
-
- Free tier (0.5 GB, no credit card) + earn credits by running a Docker node
-
-
-
-
- Pricing: $1.50/GB vs competitors at $8–15/GB
-
-
-
-
-
- Already integrated with LangChain (
pip install langchain-proxyclaw)
Links:
- Website: https://proxyclaw.ai
-
-
-
-
-
- Install:
pip install iploop-sdk
Example usage in a CrewAI agent:
from iploop import IPLoop
client = IPLoop(api_key="your_key")
result = client.fetch("https://example.com") # Returns clean MarkdownDescribe alternatives you've considered
Existing alternatives like BrightData, Oxylabs, and ScraperAPI are built for human scrapers — they return raw HTML and require complex parsing pipelines. CrewAI's built-in ScrapeWebsiteTool works for simple public pages but fails on Cloudflare-protected, JS-rendered, or rate-limited sites. ProxyClaw was designed from the ground up for AI agents, solving these exact problems natively.
Additional context
ProxyClaw is already integrated with LangChain (live on PyPI: pip install langchain-proxyclaw) and has an open feature request on LlamaIndex (run-llama/llama_index#21366). A CrewAI integration would complete coverage of the major Python agent frameworks.
Stats: 10M+ IPs, 195+ countries, 100% anti-bot success rate, 66 tested sites, free 0.5 GB tier.
Willingness to Contribute
Yes, I'd be happy to submit a pull request
Feature Area
Integration with external tools
Is your feature request related to a an existing bug? Please link it here.
NA
Describe the solution you'd like
Add ProxyClaw as a native CrewAI tool — a residential proxy + web access layer built specifically for AI agents.
What is ProxyClaw?
ProxyClaw lets AI agents browse the web through 2M+ residential IPs across 195+ countries, bypass CAPTCHAs, Cloudflare, and anti-bot systems automatically, and returns clean Markdown/JSON instead of raw HTML — making it natively LLM-ready.
Why it fits CrewAI:
pip install langchain-proxyclaw)Links:
pip install iploop-sdkExample usage in a CrewAI agent:
Describe alternatives you've considered
Existing alternatives like BrightData, Oxylabs, and ScraperAPI are built for human scrapers — they return raw HTML and require complex parsing pipelines. CrewAI's built-in
ScrapeWebsiteToolworks for simple public pages but fails on Cloudflare-protected, JS-rendered, or rate-limited sites. ProxyClaw was designed from the ground up for AI agents, solving these exact problems natively.Additional context
ProxyClaw is already integrated with LangChain (live on PyPI:
pip install langchain-proxyclaw) and has an open feature request on LlamaIndex (run-llama/llama_index#21366). A CrewAI integration would complete coverage of the major Python agent frameworks.Stats: 10M+ IPs, 195+ countries, 100% anti-bot success rate, 66 tested sites, free 0.5 GB tier.
Willingness to Contribute
Yes, I'd be happy to submit a pull request