[Playlist] Fwd: [Mediagroup] Controlling bot indexing (Google Bot)

Hej alla! Som ni ser så kommer indexering av de öppna filerna på Playtjänsten att slås på nu till helgen. Ni kan själva ställa in parametrar enligt mejlet nedan. Monika Allöv Andersson Systemförvaltare/System administrator SUNET Mediateam ---------- Forwarded message --------- Från: Petur Olsen Date: mån 13 juni 2022 kl 11:48 Subject: [Mediagroup] Controlling bot indexing (Google Bot) Hi, As discussed during the NGM meeting, we will start allowing Google bot to index the KMS pages. This will be enabled on Sunday June 19th. If this goes well, we intend to enable other bots in the future (Bing, Yahoo, etc.) The institutions have some control over the bots, using the robots.txt feature. For performance reasons, we recommend everyone turns this on, with default settings. To do this, go to your KMSadmin, find the Robots module, enable it and hit "reset to default" and save. If some institutions want to block indexing for an entire KMS instance (e.g. test instances), they can replace the content with the following User-agent: * Disallow: / For more advanced usage you can read up on the robot exclusion standard here: https://en.wikipedia.org/wiki/Robots_exclusion_standard *Note*: This does not block any access or prevent indexers from accessing the pages. This is simply an advice for the bots. Don't see this as a security feature, more like a way to manage your presence on search engines. Regards, Petur _______________________________________________