Bytespider (ByteDance)

ByteDance operates Bytespider (e.g. for Toutiao / search-related crawling). ByteDance does not publish a single English JSON prefix file like OpenAI or Googlebot; the list below is a maintained aggregate for tooling, deduplicated so smaller prefixes are dropped when a larger listed prefix already covers them.

Bytespider traffic is frequently observed from Amazon AWS (AS16509), not only from ByteDance’s own BGP origin (AS396986). Combine official webmaster guidance, live rDNS, and your traces - do not rely on ASN or static IPv4 lists alone.

Autonomous systems

BGP context

AS396986 appears in public data for ByteDance-related addressing. Substantial Bytespider egress is also seen from AWS (AS16509).

AS396986

Third-party hosting & clouds

Amazon.com, Inc. (AWS)

AS16509

Many Bytespider requests originate from AWS addressing (AS16509); treat the maintained prefix list as non-exhaustive.

Bytespider - maintained IPv4 Maintained feed

Published prefixes

  • 71.18.0.0/16
  • 101.45.0.0/24
  • 101.45.3.0/24
  • 101.45.4.0/24
  • 101.45.5.0/24