Bay 12 Games Forum

Please login or register.

Login with username, password and session length
Advanced search  

Author Topic: robots.txt limit to current release namespace?  (Read 3513 times)

draeath

  • Bay Watcher
  • So it has come to this...
    • View Profile
robots.txt limit to current release namespace?
« on: May 02, 2016, 08:20:47 pm »

Is there any way we can tweak for crawlers like google, so that search results tend to point to current namespace pages instead of older ones? For example, if one searches Google for "dwarf fortress materials" the first hit that comes up is v0.34:Material, the current version equivalent is actually the third result.

I'm thinking something like this would be called for (or if already present, adjustments could stand to be made)
Logged
Urist McAlchemist cancels extract isotope: interrupted by supercriticality accident.
This kea is so raw it stole my wheelbarrow!

Brightgalrs

  • Bay Watcher
    • View Profile
Re: robots.txt limit to current release namespace?
« Reply #1 on: May 11, 2016, 08:11:11 am »

I agree, the default results should be for the latest version.
Logged

lethosor

  • Bay Watcher
    • View Profile
Re: robots.txt limit to current release namespace?
« Reply #2 on: May 12, 2016, 09:59:59 pm »

Briess/Locriani says it's hard, from what I remember. It might be possible to block older versions from search listings entirely, but that's not really something we want either. Another possibility is making a more visible "old version" warning, like at https://docs.djangoproject.com/en/1.7/
Logged
DFHack - Dwarf Manipulator (Lua) - DF Wiki talk

There was a typo in the siegers' campfire code. When the fires went out, so did the game.