Crawlers & bots

ByteDance

ByteDance operates Bytespider (e.g. for Toutiao / search-related crawling). Official documentation is published on the ByteDance / Toutiao webmaster portal (Chinese).

Autonomous systems

Network background

Bytespider traffic is often associated with Chinese and global cloud address space. ByteDance does not provide a single English JSON prefix file in the same style as OpenAI or Googlebot; verify with their webmaster docs and rDNS.

Published ranges

Official documentation and feeds for each product—open the links for current ranges and verification guidance.

Official documentation

Bytespider

Official ByteDance / Toutiao webmaster documentation for Bytespider.

User agents

  • Mozilla/5.0 (compatible; Bytespider; https://zhanzhang.toutiao.com/) AppleWebKit/537.36