Open Source

Python Web Scraper

The scraping library Python was missing. One pip install. Anti-bot bypass built in. JavaScript rendering included. No Selenium. No Playwright config. No proxy setup.

pip install scraper8

Simple by Design

Local Usage (self-hosted, free)
from scraper8 import Scraper8

scraper = Scraper8()

# Scrape any website — anti-bot bypass is automatic
result = scraper.scrape("https://example.com")

print(result.title)         # Page title
print(result.text)          # Clean extracted text
print(result.links)         # All links
print(result.metadata)      # Meta tags, OG data

# Extract structured data
data = scraper.extract("https://news-site.com",
                        schema="article")
print(data.headline)
print(data.author)
print(data.content)
API Usage (managed, 50 free requests/day)
import requests

# Use the managed API — no infrastructure to maintain
response = requests.post(
    "https://vision8solutions.com/api/scraper8/scrape",
    headers={"X-API-Key": "s8_your_api_key"},
    json={"url": "https://cloudflare-protected-site.com"}
)

data = response.json()
print(data["title"])
print(data["text"])
print(data["links"])

Why Not requests, Selenium, or Scrapy?

Traditional Python scraping tools weren't built for the modern web. Sites now use Cloudflare, DataDome, and fingerprint detection. Here's how Scraper8 compares:

requests + BeautifulSoup

Strengths

Simple, lightweight

Limitations

No JS rendering, no anti-bot bypass, manual parsing

Scraper8

Built-in JS rendering, auto anti-bot bypass, structured output

Selenium

Strengths

Full browser control

Limitations

Slow, detectable, complex setup, resource-heavy

Scraper8

Stealth browser with anti-detection, 10x faster, zero config

Scrapy

Strengths

Scalable framework

Limitations

Learning curve, no anti-bot, needs middleware for JS

Scraper8

One function call, anti-bot included, JS rendering included

Playwright

Strengths

Modern browser automation

Limitations

Still detectable, no auto-escalation, manual fingerprinting

Scraper8

Undetectable fingerprints, auto-escalation, domain intelligence

Two Ways to Use Scraper8

Self-Host (Open Source)

  • pip install scraper8
  • Unlimited scraping, no API costs
  • Full engine: HTTP + stealth browser + full browser
  • Domain intelligence included
  • Run locally or deploy with Docker
  • Perfect for: research, learning, small projects

Managed API

  • 50 free requests/day, no credit card
  • Scales to millions of requests/month
  • No infrastructure to maintain
  • Authentication, rate limiting, usage tracking
  • Batch scraping (up to 100 URLs)
  • Perfect for: production apps, SaaS, teams

Frequently Asked Questions

Is Scraper8 better than BeautifulSoup?

They solve different problems. BeautifulSoup is an HTML parser — you still need requests to fetch pages, and it can't handle JavaScript or anti-bot protection. Scraper8 handles fetching, rendering, anti-bot bypass, AND parsing in one package. Think of it as requests + Selenium + BeautifulSoup combined, but faster and undetectable.

Can Scraper8 replace Selenium for web scraping?

Yes, for scraping use cases. Selenium is a browser automation tool that happens to be used for scraping. Scraper8 is purpose-built for scraping — it's faster, undetectable, and requires zero browser configuration. If you need to fill forms or interact with pages, Selenium/Playwright is still better.

Is the Python library really free?

Yes. The scraper8 Python package is open source and free to use. pip install scraper8 and scrape unlimited pages locally. The managed API also has a free tier (50 requests/day) if you prefer not to run your own infrastructure.

Does it work with Python 3.11+?

Yes. Scraper8 supports Python 3.11 and above. It uses modern async patterns and type hints throughout.

Start Scraping with Python

Self-host for free or use the managed API. Either way, you're scraping in under 60 seconds.