This will improve performance as currently bots are fetching contents
from /changes which contains JSON data of patches, diffs as files and
archives which are generated on the fly, really nothing of relevance
to search engines.