IP Shield

IP Shield

Traffic Analysis

User Agent & Bot Parser API

Parse user agents and cross-verify IPs to identify legitimate search engine crawlers and flag malicious scrapers.
User Agent & Bot Parser API
    {
  "ok": true,
  "date": "2025-06-12T00:00:00.000Z",
  "data": {
    "useragent": "Nmap Scripting Engine 7.92",
    "useragent_rx": "^Nmap Scripting Engine.*",
    "description": "Nmap Network Mapper",
    "tool": "Scanner",
    "category": "Reconnaissance",
    "link": "https://nmap.org/",
    "priority": "high",
    "severity": "critical"
  },
  "meta": {
    "total_credits": 10000,
    "credits_remaining": 9999
  }
}

Bot & Scraper Detection

Raw User-Agent strings are messy, frequently spoofed, and hard to analyze. The Bot Parser normalizes these strings into structured data, allowing you to easily identify automated scripts, HTTP libraries, and known scraping tools.
  • Malicious Bot Detection
    Catch automated scrapers and headless browsers instantly.
  • Programmatic Blocking
    Easily drop requests coming from default programmatic agents like Python Requests or curl.
  • Vulnerability Scanners
    Detect and block automated tools probing your application for security flaws.
Bot Parsing and Traffic Analysis

Search Engine Verification

Attackers frequently change their User-Agent to masquerade as Googlebot or Bingbot to bypass WAF rules. True verification requires cross-referencing the claimed identity with the underlying network infrastructure.
  • SEO Management
    Accurately categorize legitimate search engine crawlers versus impostors.
  • Spoof Detection
    (When combined with the Network API) mathematically verify if the IP ownership matches the claimed crawler.
  • Crawler Metadata
    Retrieve detailed information about the exact crawler tool and category.
Search engine verification abstract visualization

Device & Browser Parsing

Extract meaningful demographic data from complex HTTP headers. The parser returns structured information about the device type, operating system, and browser rendering engine.
  • Device Extraction
    Identify if the traffic originates from Mobile, Tablet, Desktop, or Smart TV devices.
  • OS Identification
    Parse out the exact operating system (Windows, macOS, iOS, Android).
  • Actionable Analytics
    Build accurate demographic and device usage reports from normalized data.
Device and browser parsing abstract visualization

Understand Your Traffic

Convert messy HTTP headers into actionable structured intelligence.
Ultra-Fast Parsing
Regex evaluations are optimized using LMDB at the edge for sub-millisecond response times.
Continuous Regex Updates
Our parser rules are constantly updated to identify new bots and scraping tools.
Threat Severity
Responses include a severity score (safe, suspicious, malicious) for easy blocking logic.
Deep Categorization
Classify traffic into granular categories like "Search Engine", "Uptime Monitor", or "Scraper".
Low Payload Size
Streamlined JSON responses keep your application fast and efficient.
Rate Limiting
Standard API quota management ensures reliable access without unexpected overages.
Seamless Integration
Pass the raw header directly in the URL path; we handle the decoding and parsing.

Analyze your traffic

Get 1,000 free requests per month when you register.
Get API Key
Logo