A bot, also known as a web robot, web spider or web crawler, is a software application designed to automatically perform simple and repetitive tasks in a more effective, structured, and concise manner than any human could ever do.
The most common use of bots is in web spidering or web crawling.

AlphaSeoBot is the search bot software that AlphaSeoBot sends out to discover and collect new and updated web data.

Data collected by AlphaSeoBot is used in:

  • the AdSense (Display Advertising) reports
  • the public backlink search engine index maintained as a dedicated tool called “AlphaSeo backlinks” (web graph of links)
  • the Site Audit tool that analyzes on-page SEO, technical and usability issues

How AlphaSeoBot Crawls Your Site

  AlphaSeoBot’s crawl process starts with a list of web page URLs. When AlphaSeoBot visits these URLs it crawls the internal website structure detecting all the hyperlinks within the site and adding them to the list of URLs to follow. This list, also known as the "crawl frontier", is recursively visited according to a set of AlphaSeoBot policies to effectively map a site for updates: content changes, new pages, and dead links. Also, AlphaSeoBot searches for advertising information, such as Google AdSense.  

How To Block AlphaSeoBot From Crawling Your Site


Bots are crawling your web pages to help parse your site content, so that the relevant information within your site is easily indexed and more readily available to users searching for the content you provide.

Although most bots are harmless and quite beneficial, you still may want to prevent bots from crawling your site (please note, however, that not everyone on the web is using a bot to help index your site). The easiest and quickest way to do this is to use “robots.txt”. This text file contains instructions on how a bot should process your site data.

To stop AlphaSeoBot from crawling your site, add the following rules to your "robots.txt" file:

  • To block AlphaSeoBot from crawling your site for web graph of links, add:
    User-agent: AlphaSeoBot
    Disallow: /
  Please note that there might be a delay up to two weeks before AlphaSeoBot discovers the changes you made to robots.txt.  
  • To remove AlphaSeoBot from crawling your site for different SEO and technical issues, add:
    User-agent: AlphaSeoBot-SA
    Disallow: /

If you want to prevent the "file not found" error messages in your web browser server log, create an empty "robots.txt" file.

Make sure that the "robots.txt" file is in the top directory of the server; otherwise, there will be no effect on the AlphaSeoBot behavior.

Please do not try to block AlphaSeoBot via IP in .htaccess as we do not use any consecutive IP blocks.

If AlphaSeoBot is still crawling your site, make sure AlphaSeoBot can retrieve your "robots.txt.


More Information About Bots

  For more information about bots, please refer to  

Getting Support


If you still have any questions about AlphaSeoBot, please contact us at and we will respond as soon as possible.

If you think that AlphaSeoBot does not obey your "robots.txt" rules, please provide us with your website URL, the log entries showing AlphaSeoBot crawling the pages that it was not supposed to, and we will work quickly to resolve the issue.