Hi,
As discussed during the NGM meeting, we will start allowing Google bot to index the KMS pages.
This will be enabled on Sunday June 19th. If this goes well, we intend to enable other bots in the future (Bing, Yahoo, etc.)
The institutions have some control over the bots, using the robots.txt feature.
For performance reasons, we recommend everyone turns this on, with default settings.
To do this, go to your KMSadmin, find the Robots module, enable it and hit "reset to default" and save.
If some institutions want to block indexing for an entire KMS instance (e.g. test instances), they can replace the content with the following
For more advanced usage you can read up on the robot exclusion standard here:
Note: This does not block any access or prevent indexers from accessing the pages. This is simply an advice for the bots.
Don't see this as a security feature, more like a way to manage your presence on search engines.
Regards,
Petur