Andrew da Silva

Crawling Through Habari's 404 "Handler"

Couple of weeks ago I noticed PDO exceptions in my Habari logs, Google's crawler was most often the originator and I couldn't read the full message since Habari's error handling system is still very basic.

After checking the Webmaster Tools on my Google Account, I noticed their crawler kept requesting high-numbered pages on the Atom feed. Found out the 'last-page' parameter was calculated with the site's pagination option rather the Atom feed's. Reported: Ticket #1112.