Semrush Bot

Semrush documents SemrushBot behavior and robots.txt controls on semrush.com/bot. They advise against blocking the crawler by IP because egress is not confined to consecutive blocks. The maintained prefix list below is a reference snapshot of commonly observed Semrush ranges (useful for allowlists and forensics), not a complete or Semrush-endorsed deny list — use robots.txt user-agent rules when you need to restrict crawling.

Autonomous systems

BGP context

Semrush operates AS209366. Crawler traffic is also observed on Google Cloud (AS396982) and may traverse other providers at the edge; combine ASN context with Semrush’s bot documentation and your own traces rather than ASN-only blocking.

AS209366

Third-party hosting & clouds

Google LLC (GCP)

AS396982

SemrushBot egress is commonly seen from GCP addressing (AS396982) in addition to AS209366.

Published ranges

SemrushBot

Maintained feed

Maintained IPv4 prefixes often associated with Semrush crawlers, exported as Google-style JSON at /feeds/semrush.json. Semrush’s official guidance is to manage access with robots.txt (and related user-agents), not IP blocks — treat this list as a reference aid for allowlisting or log correlation, and re-verify against Semrush if you depend on it for production policy.

Published prefixes

  • 85.208.96.0/24
  • 185.191.171.0/24
  • 85.208.98.128/25
  • 85.208.98.32/28
  • 85.208.98.48/28
AhrefsBot Crawlers & bots AmazonBot Crawlers & bots Apple Crawlers & bots Baidu Crawlers & bots BingBot Crawlers & bots Bytespider (ByteDance) Crawlers & bots