CreeperSiteMap

Mar 30 2011 Published by under MediaCreeper

Somewhere along all updates I forgot to update the CreeperSiteMapEngine, perhaps one of the most important pieces for search enging robots to index, it generates an XML with links, priority, update frequence for almost all pages on the site, again it was a silly error .. encoding of urls. As we accept IDN-domains, a small piece of code that handled the encoding that wasn’t very well written, which made the script emit errors and halt less than half way through.

That might explain why I haven’t seen as much traffic to certain pages as expected, hopefully the sitemap.xml will be re-indexed in a while and traffic returns.

There is also a humans.txt file available as well, with credits to the helpful people around me.

No responses yet

Leave a Reply