Crawler Verification

MyRankBuddy Crawler

This page helps website owners, security administrators, and hosting providers verify and whitelist the MyRankBuddy crawler.

Purpose

What our crawler does

MyRankBuddy uses an automated crawler to perform SEO audits on behalf of website owners who have registered with our platform. The crawler analyzes:

Technical SEO

Page structure, meta tags, headings, schema markup, and site architecture.

Performance

Page load times, DOM size, resource optimization, and mobile compatibility.

Crawl Diagnostics

Redirect chains, broken links, canonical configuration, and indexing directives.

Search Visibility

Content quality signals, internal linking, and OpenGraph/Twitter card presence.

Identification

Crawler User-Agent

Our crawler identifies itself with the following User-Agent string:

Mozilla/5.0 (compatible; MyRankBuddyBot/1.0; +https://myrankbuddy.com/crawler)

The User-Agent always contains MyRankBuddyBot and links back to this verification page.

Network

Crawler IP Addresses

All crawler requests originate from these IP addresses:

44.222.94.150

These IPs may be updated periodically. Check this page for the latest list.

Configuration

Whitelisting Our Crawler

If your website uses a WAF, CDN, or bot protection service, you may need to whitelist our crawler to enable SEO analysis.

A

By User-Agent

Add the following User-Agent to your WAF or CDN allow-list:

MyRankBuddyBot/1.0

Works with: Cloudflare, Sucuri, Akamai, AWS WAF, Wordfence, and most firewall systems.

B

By IP Address

Add our crawler IP to your firewall allow-list:

44.222.94.150

Preferred for Cloudflare IP Access Rules, AWS Security Groups, and hosting-level firewalls.

Compliance

robots.txt

MyRankBuddy fully respects robots.txt directives. If your robots.txt disallows our crawler, we will not crawl those pages.

# To allow MyRankBuddy:
User-agent: MyRankBuddyBot
Allow: /
Behavior

Crawl Behavior

  • Crawls only websites registered by their owners
  • Rate-limited to avoid server impact
  • Respects robots.txt and noindex directives
  • Does not submit forms or modify content
Support

Need Help?

If you have questions about our crawler or need assistance with whitelisting, our team is here to help. Please write to us on contact@myrankbuddy.com.