PMG Digital Made for Humans

Crawl Rate Tracker & Multisite WordPress Installs

2 MINUTE READ | July 26, 2011

Crawl Rate Tracker & Multisite WordPress Installs

Author's headshot

Christopher Davis

Christopher Davis has written this article. More details coming soon.

Crawl Rate Tracker has been in my WordPress toolbox for a while now. It’s one of those plugins that gets installed on every WordPress site I put up, and, despite it being written for WordPress 2.5, it still works.

Recently, however, a client wanted a multisite installation. After the initial setup, I put in the usual plugins, including Crawl Rate Tracker.

Unfortunately, Crawl Rate Tracker does not work on multisite. Sure, it will work fine for normal visitors, but it causes major errors for bots. Install and activate the plugin then change your user agent to the googlebot (or something similar) and visit the site; you’ll get a white screen of death that just says a table can’t be found. Crawl Rate Tracker doesn’t add tables on a per blog basis, instead it only adds one. The result is a MySQL error because WordPress can’t find the table for the crawl rate tracker logs. This only happens for bots because the Crawl Rate Tracker checks the $_SERVER['HTTP_USER_AGENT'] for google, yahoo, or technorati bots and logs something only if one of the three is found.

After poking around the Crawl Rate Tracker code a bit, I can safely say that it’s a plugin PMG will no longer be using. It does work on single WordPress installs, but the code is old. It makes use of many deprecated WP functions and doesn’t take advantage of any of the WordPress data validation functions.

Stay in touch

Bringing news to you

Subscribe to our newsletter

By clicking and subscribing, you agree to our Terms of Service and Privacy Policy

Perhaps an updated Crawl Rate Tracker from PMG is in the future?

Related Content

thumbnail image

SEO For ReactJS Websites

4 MINUTES READ | April 11, 2018

thumbnail image

A New Strategy for Testing Google AMP

3 MINUTES READ | July 13, 2017

thumbnail image

Optimizing for Amazon Echo Search

4 MINUTES READ | August 8, 2016

thumbnail image

Not a Publisher? AMP Pages for the Rest of Us

3 MINUTES READ | March 3, 2016

thumbnail image

Using jQuery PJAX in Your WordPress Themes

5 MINUTES READ | February 28, 2012

thumbnail image

How SEO's Can Use Python

5 MINUTES READ | October 24, 2011

thumbnail image

SEO Auto Linker

2 MINUTES READ | August 23, 2011