How is this different from the User Agent Parser?

The User Agent Parser only tells you what the client *claims* to be in their HTTP headers (which is easily spoofed). This Verified Bots API checks the underlying network IP against official provider infrastructure databases to prove *who they actually are*.

Do you use reverse DNS to verify Googlebot?

No. Reverse and forward DNS lookups (rDNS/fDNS) add hundreds of milliseconds of latency and can occasionally fail. Instead, we directly ingest the official IP range JSON feeds published by Google, Bing, OpenAI, and other providers.

Which bots and crawlers do you track?

We currently ingest data for Google (Googlebot, User-Triggered Fetchers), Bing, OpenAI (GPTBot, ChatGPT, SearchBot), Apple (Applebot), Meta/Facebook, X/Twitter, Pinterest, Telegram, DuckDuckGo, Ahrefs, SEMrush, and CommonCrawler.

How often are the IP ranges updated?

Our engine continuously polls the official provider endpoints (JSON, CSV, and HTML pages) and automatically distributes updates to the edge nodes.

IP Shield

Account

SEO Protection

Verified Bots & Crawlers API

Accurately identify legitimate search engine crawlers and automated agents using official provider geofeeds—no slow DNS lookups required.

    {
  "ok": true,
  "date": "2025-06-12T00:00:00Z",
  "data": {
    "ip": "66.249.66.1",
    "proxy": false,
    "vpn": false,
    "threat_level": 0,
    "is_known_bot": true,
    "bot_details": {
      "bot_owner": "google",
      "creationTime": "2024-03-09T22:00:00.000Z"
    },
    "is_tor_node": false,
    "tor_details": null,
    "asn": {
      "asn_id": "15169",
      "asn_name": "GOOGLE",
      "classification": "Search Engine",
      "route_visibility_count": 2679
    }
  },
  "meta": {
    "total_credits": 10000,
    "credits_remaining": 9999
  }
}

Pre-Fetched Official Geofeeds

Unlike legacy systems that rely on slow and spoofable reverse/forward DNS lookups, our engine proactively fetches official IP ranges directly from verified providers (Google, Bing, OpenAI, etc.).

100% Accuracy
Traffic flagged as a known bot is mathematically guaranteed to belong to that provider's published infrastructure.
Zero Latency
Bypassing DNS queries means bot verification happens in-memory at the edge in less than 1 millisecond.
Broad Provider Support
We track IP ranges for Google, Bing, OpenAI, Meta, Apple, DuckDuckGo, Ahrefs, and more.

Search engine verification abstract visualization

AI Scraper & Crawler Protection

Control how AI models and specialized web crawlers access your content. Quickly allow, limit, or block agents like OpenAI's GPTBot, CommonCrawler, or Ahrefs based on verified IP ownership.

OpenAI Detection
Accurately identify GPTBot, ChatGPT User, and SearchBot traffic.
Protect Bandwidth
Block resource-intensive crawlers like SEMrush or Ahrefs if they impact server performance.
Prevent Content Scraping
Enforce your robots.txt dynamically by denying access at the network edge.

Verified Bot Identification

Stop impostors while rolling out the red carpet for legitimate SEO crawlers.

Search Engine Verification

Never accidentally block Googlebot or Bingbot from indexing your site.

Spoofing Prevention

Automatically catch attackers setting fake Googlebot User-Agents to bypass WAFs.

No Slow DNS Lookups

Avoid the massive latency penalty of standard reverse DNS verification checks.

Continually Updated

Geofeeds and lists are refreshed regularly to capture provider infrastructure changes.

Simple Integration

The `is_known_bot` boolean flag provides a simple yes/no answer for your firewall rules.

AI Scraper Controls

Readily identify AI bots like GPTBot to protect your copyrighted data from being ingested.

Broad Coverage

Encompasses all major global and regional search providers and diagnostic bots.

Protect your SEO rankings

Get 1,000 free requests per month when you register.

Get API Key