Crawler transparency

SeoniusBot identifies itself and respects site owner controls.

SeoniusBot powers the Site Crawl tool. It crawls public pages requested by authenticated Seonius users and stores structured technical SEO findings instead of full page source.

Bot identity

A crawler designed for transparent SEO checks

Workflow
1

Identify

Use the user-agent string to recognize crawler traffic.

2

Control

Use robots.txt to allow, disallow, or slow the crawl.

3

Contact

Reach Seonius support when you need help with crawl handling.

Published user-agent

Use this string in logs, allowlists, or robots.txt rules.

SeoniusBot/0.1 (+https://seonius.com/bot)

Bot information URL: https://seonius.com/bot

robots.txt example

Site owners can scope SeoniusBot access explicitly.

User-agent: SeoniusBot Disallow: /private/ Crawl-delay: 5

Controls

Crawl behavior for site owners

This page is intentionally operational: it explains how the crawler identifies itself and which boundaries it follows.

Public requests only

SeoniusBot performs public GET and HEAD crawl requests for the Site Crawl tool.

Respects robots controls

It obeys robots.txt rules and crawl-delay instructions when available.

No private-area attempts

It does not submit forms or attempt authenticated, paywalled, CAPTCHA, or private areas.

Transparency

What SeoniusBot is and is not

The crawler exists for user-requested SEO analysis, not private scraping or identity spoofing.

User-agent is explicit

Site owners can identify SeoniusBot from the published user-agent string.

Crawl purpose is narrow

The crawler supports technical SEO analysis for user-requested Site Crawl jobs.

No impersonation

SeoniusBot does not pretend to be Googlebot or any other crawler.

Next step

Need help with SeoniusBot?

Contact support if you want help interpreting crawler traffic or adjusting robots.txt access.