cgspace-notes/docs/robots.txt
2018-05-30 09:05:40 -07:00

42 lines
1.3 KiB
Plaintext

User-agent: *
Disallow: /cgspace-notes/2018-05/
Disallow: /cgspace-notes/2018-04/
Disallow: /cgspace-notes/2018-03/
Disallow: /cgspace-notes/2018-02/
Disallow: /cgspace-notes/2018-01/
Disallow: /cgspace-notes/2017-12/
Disallow: /cgspace-notes/2017-11/
Disallow: /cgspace-notes/2017-10/
Disallow: /cgspace-notes/cgiar-library-migration/
Disallow: /cgspace-notes/2017-09/
Disallow: /cgspace-notes/2017-08/
Disallow: /cgspace-notes/2017-07/
Disallow: /cgspace-notes/2017-06/
Disallow: /cgspace-notes/2017-05/
Disallow: /cgspace-notes/2017-04/
Disallow: /cgspace-notes/2017-03/
Disallow: /cgspace-notes/2017-02/
Disallow: /cgspace-notes/2017-01/
Disallow: /cgspace-notes/2016-12/
Disallow: /cgspace-notes/2016-11/
Disallow: /cgspace-notes/2016-10/
Disallow: /cgspace-notes/2016-09/
Disallow: /cgspace-notes/2016-08/
Disallow: /cgspace-notes/2016-07/
Disallow: /cgspace-notes/2016-06/
Disallow: /cgspace-notes/2016-05/
Disallow: /cgspace-notes/2016-04/
Disallow: /cgspace-notes/2016-03/
Disallow: /cgspace-notes/2016-02/
Disallow: /cgspace-notes/2016-01/
Disallow: /cgspace-notes/2015-12/
Disallow: /cgspace-notes/2015-11/
Disallow: /cgspace-notes/
Disallow: /cgspace-notes/categories/
Disallow: /cgspace-notes/tags/notes/
Disallow: /cgspace-notes/categories/notes/
Disallow: /cgspace-notes/posts/
Disallow: /cgspace-notes/tags/