Add notes for 2021-05-02

2024-11-22 14:45:03 +01:00 · 2021-05-02 19:55:06 +03:00 · 2021-05-02 19:55:06 +03:00 · 7f32b1d76a
commit 7f32b1d76a
parent 7d21ec6de7
103 changed files with 1227 additions and 714 deletions
--- a/content/posts/2021-05.md
+++ b/content/posts/2021-05.md
@ -0,0 +1,95 @@
 ---
 title: "May, 2021"
 date: 2021-05-02T09:50:54+03:00
 author: "Alan Orth"
 categories: ["Notes"]
 ---
 ## 2021-05-01
 - I looked at the top user agents and IPs in the Solr statistics for last month and I see these user agents:
  - "RI/1.0", 1337
  - "Microsoft Office Word 2014", 941
 - I will add the RI/1.0 pattern to our DSpace agents overload and purge them from Solr (we had previously seen this agent with 9,000 hits or so in 2020-09), but I think I will leave the Microsoft Word one... as that's an actual user...
 <!--more-->
 - I should probably add the `RI/1.0` pattern to COUNTER-Robots project
 - As well as these IPs:
  - 193.169.254.178, 21648
  - 181.62.166.177, 20323
  - 45.146.166.180, 19376
 - The first IP seems to be in Estonia and their requests to the REST API change user agents from curl to Mac OS X to Windows and more
  - Also, they seem to be trying to exploit something:
 ```console
 193.169.254.178 - - [21/Apr/2021:01:59:01 +0200] "GET /rest/collections/1179/items?limit=812&expand=metadata\x22%20and%20\x2221\x22=\x2221 HTTP/1.1" 400 5 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)"
 193.169.254.178 - - [21/Apr/2021:02:00:36 +0200] "GET /rest/collections/1179/items?limit=812&expand=metadata-21%2B21*01 HTTP/1.1" 200 458201 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)"
 193.169.254.178 - - [21/Apr/2021:02:00:36 +0200] "GET /rest/collections/1179/items?limit=812&expand=metadata'||lower('')||' HTTP/1.1" 400 5 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)"
 193.169.254.178 - - [21/Apr/2021:02:02:10 +0200] "GET /rest/collections/1179/items?limit=812&expand=metadata'%2Brtrim('')%2B' HTTP/1.1" 200 458209 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)"
 ```
 - I will report the IP on abuseipdb.com and purge their hits from Solr
 - The second IP is in Colombia and is making thousands of requests for what looks like some test site:
 ```console
 181.62.166.177 - - [20/Apr/2021:22:48:42 +0200] "GET /rest/collections/d1e11546-c62a-4aee-af91-fd482b3e7653/items?expand=metadata HTTP/2.0" 200 123613 "http://cassavalighthousetest.org/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.128 Safari/537.36"
 181.62.166.177 - - [20/Apr/2021:22:55:39 +0200] "GET /rest/collections/d1e11546-c62a-4aee-af91-fd482b3e7653/items?expand=metadata HTTP/2.0" 200 123613 "http://cassavalighthousetest.org/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.128 Safari/537.36"
 ```
 - But this site does not exist (yet?)
  - I will purge them from Solr
 - The third IP is in Russia apparently, and the user agent has the `pl-PL` locale with thousands of requests like this:
 ```console
 45.146.166.180 - - [18/Apr/2021:16:28:44 +0200] "GET /bitstream/handle/10947/4153/.AAS%202014%20Annual%20Report.pdf?sequence=1%22%29%29%20AND%201691%3DUTL_INADDR.GET_HOST_ADDRESS%28CHR%28113%29%7C%7CCHR%28118%29%7C%7CCHR%28113%29%7C%7CCHR%28106%29%7C%7CCHR%28113%29%7C%7C%28SELECT%20%28CASE%20WHEN%20%281691%3D1691%29%20THEN%201%20ELSE%200%20END%29%20FROM%20DUAL%29%7C%7CCHR%28113%29%7C%7CCHR%2898%29%7C%7CCHR%28122%29%7C%7CCHR%28120%29%7C%7CCHR%28113%29%29%20AND%20%28%28%22RKbp%22%3D%22RKbp&isAllowed=y HTTP/1.1" 200 918998 "http://cgspace.cgiar.org:80/bitstream/handle/10947/4153/.AAS 2014 Annual Report.pdf" "Mozilla/5.0 (Windows; U; Windows NT 5.1; pl-PL) AppleWebKit/523.15 (KHTML, like Gecko) Version/3.0 Safari/523.15"
 ```
 - I will purge these all with my `check-spider-ip-hits.sh` script:
 ```console
 $ ./ilri/check-spider-ip-hits.sh -f /tmp/ips.txt -p
 Purging 21648 hits from 193.169.254.178 in statistics
 Purging 20323 hits from 181.62.166.177 in statistics
 Purging 19376 hits from 45.146.166.180 in statistics
 Total number of bot hits purged: 61347
 ```
 ## 2021-05-02
 - Check the AReS Harvester indexes:
 ```console
 $ curl -s http://localhost:9200/_cat/indices | grep openrxv-items
 yellow open openrxv-items-temp       H-CGsyyLTaqAj6-nKXZ-7w 1 1      0 0    283b    283b
 yellow open openrxv-items-final      ul3SKsa7Q9Cd_K7qokBY_w 1 1 103951 0   254mb   254mb
 $ curl -s 'http://localhost:9200/_alias/' | python -m json.tool
 ...
    "openrxv-items-temp": {
        "aliases": {}
    },
    "openrxv-items-final": {
        "aliases": {
            "openrxv-items": {}
        }
    },
 ```
 - I think they look OK (`openrxv-items` is an alias of `openrxv-items-final`), but I took a backup just in case:
 ```console
 $ elasticdump --input=http://localhost:9200/openrxv-items --output=/home/aorth/openrxv-items_mapping.json --type=mapping
 $ elasticdump --input=http://localhost:9200/openrxv-items --output=/home/aorth/openrxv-items_data.json --type=data --limit=1000
 ```
 - Then I started an indexing in the AReS Explorer admin dashboard
 - The indexing finished, but it looks like the aliases are messed up again:
 ```console
 $ curl -s http://localhost:9200/_cat/indices | grep openrxv-items
 yellow open openrxv-items-temp       H-CGsyyLTaqAj6-nKXZ-7w 1 1 104165 105024 487.7mb 487.7mb
 yellow open openrxv-items-final      d0tbMM_SRWimirxr_gm9YA 1 1    937      0   2.2mb   2.2mb
 ```
 <!-- vim: set sw=2 ts=2: -->
--- a/docs/2015-11/index.html
+++ b/docs/2015-11/index.html
@ -242,6 +242,8 @@ db.statementpool = true
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -250,8 +252,6 @@ db.statementpool = true
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2015-12/index.html
+++ b/docs/2015-12/index.html
@ -264,6 +264,8 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -272,8 +274,6 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2016-01/index.html
+++ b/docs/2016-01/index.html
@ -200,6 +200,8 @@ $ find SimpleArchiveForBio/ -iname &ldquo;*.pdf&rdquo; -exec basename {} ; | sor
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -208,8 +210,6 @@ $ find SimpleArchiveForBio/ -iname &ldquo;*.pdf&rdquo; -exec basename {} ; | sor
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2016-02/index.html
+++ b/docs/2016-02/index.html
@ -378,6 +378,8 @@ Bitstream: tést señora alimentación.pdf
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -386,8 +388,6 @@ Bitstream: tést señora alimentación.pdf
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2016-03/index.html
+++ b/docs/2016-03/index.html
@ -316,6 +316,8 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -324,8 +326,6 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2016-04/index.html
+++ b/docs/2016-04/index.html
@ -495,6 +495,8 @@ dspace.log.2016-04-27:7271
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -503,8 +505,6 @@ dspace.log.2016-04-27:7271
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2016-05/index.html
+++ b/docs/2016-05/index.html
@ -371,6 +371,8 @@ sys     0m20.540s
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -379,8 +381,6 @@ sys     0m20.540s
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2016-06/index.html
+++ b/docs/2016-06/index.html
@ -409,6 +409,8 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -417,8 +419,6 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2016-07/index.html
+++ b/docs/2016-07/index.html
@ -325,6 +325,8 @@ discovery.index.authority.ignore-variants=true
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -333,8 +335,6 @@ discovery.index.authority.ignore-variants=true
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2016-08/index.html
+++ b/docs/2016-08/index.html
@ -389,6 +389,8 @@ $ JAVA_OPTS=&quot;-Dfile.encoding=UTF-8 -Xmx512m&quot; /home/cgspace.cgiar.org/b
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -397,8 +399,6 @@ $ JAVA_OPTS=&quot;-Dfile.encoding=UTF-8 -Xmx512m&quot; /home/cgspace.cgiar.org/b
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2016-09/index.html
+++ b/docs/2016-09/index.html
@ -606,6 +606,8 @@ $ ./delete-metadata-values.py -i ilrisubjects-delete-13.csv -f cg.subject.ilri -
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -614,8 +616,6 @@ $ ./delete-metadata-values.py -i ilrisubjects-delete-13.csv -f cg.subject.ilri -
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2016-10/index.html
+++ b/docs/2016-10/index.html
@ -372,6 +372,8 @@ dspace=# update metadatavalue set text_value = regexp_replace(text_value, 'http:
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -380,8 +382,6 @@ dspace=# update metadatavalue set text_value = regexp_replace(text_value, 'http:
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2016-11/index.html
+++ b/docs/2016-11/index.html
@ -548,6 +548,8 @@ org.dspace.discovery.SearchServiceException: Error executing query
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -556,8 +558,6 @@ org.dspace.discovery.SearchServiceException: Error executing query
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2016-12/index.html
+++ b/docs/2016-12/index.html
@ -784,6 +784,8 @@ $ exit
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -792,8 +794,6 @@ $ exit
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2017-01/index.html
+++ b/docs/2017-01/index.html
@ -369,6 +369,8 @@ $ gs -sDEVICE=pdfwrite -dCompatibilityLevel=1.4 -dPDFSETTINGS=/ebook -dNOPAUSE -
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -377,8 +379,6 @@ $ gs -sDEVICE=pdfwrite -dCompatibilityLevel=1.4 -dPDFSETTINGS=/ebook -dNOPAUSE -
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2017-02/index.html
+++ b/docs/2017-02/index.html
@ -424,6 +424,8 @@ COPY 1968
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -432,8 +434,6 @@ COPY 1968
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2017-03/index.html
+++ b/docs/2017-03/index.html
@ -355,6 +355,8 @@ $ ./delete-metadata-values.py -i Investors-Delete-121.csv -f dc.description.spon
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -363,8 +365,6 @@ $ ./delete-metadata-values.py -i Investors-Delete-121.csv -f dc.description.spon
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2017-04/index.html
+++ b/docs/2017-04/index.html
@ -585,6 +585,8 @@ $ gem install compass -v 1.0.3
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -593,8 +595,6 @@ $ gem install compass -v 1.0.3
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2017-05/index.html
+++ b/docs/2017-05/index.html
@ -391,6 +391,8 @@ UPDATE 187
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -399,8 +401,6 @@ UPDATE 187
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2017-06/index.html
+++ b/docs/2017-06/index.html
@ -270,6 +270,8 @@ $ JAVA_OPTS=&quot;-Xmx1024m -Dfile.encoding=UTF-8&quot; [dspace]/bin/dspace impo
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -278,8 +280,6 @@ $ JAVA_OPTS=&quot;-Xmx1024m -Dfile.encoding=UTF-8&quot; [dspace]/bin/dspace impo
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2017-07/index.html
+++ b/docs/2017-07/index.html
@ -275,6 +275,8 @@ delete from metadatavalue where resource_type_id=2 and metadata_field_id=235 and
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -283,8 +285,6 @@ delete from metadatavalue where resource_type_id=2 and metadata_field_id=235 and
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2017-08/index.html
+++ b/docs/2017-08/index.html
@ -517,6 +517,8 @@ org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -525,8 +527,6 @@ org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2017-09/index.html
+++ b/docs/2017-09/index.html
@ -659,6 +659,8 @@ Cert Status: good
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -667,8 +669,6 @@ Cert Status: good
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2017-10/index.html
+++ b/docs/2017-10/index.html
@ -443,6 +443,8 @@ session_id=6C30F10B4351A4ED83EC6ED50AFD6B6A
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -451,8 +453,6 @@ session_id=6C30F10B4351A4ED83EC6ED50AFD6B6A
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2017-11/index.html
+++ b/docs/2017-11/index.html
@ -944,6 +944,8 @@ $ cat dspace.log.2017-11-28 | grep -o -E 'session_id=[A-Z0-9]{32}' | sort -n | u
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -952,8 +954,6 @@ $ cat dspace.log.2017-11-28 | grep -o -E 'session_id=[A-Z0-9]{32}' | sort -n | u
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2017-12/index.html
+++ b/docs/2017-12/index.html
@ -783,6 +783,8 @@ DELETE 20
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -791,8 +793,6 @@ DELETE 20
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2018-01/index.html
+++ b/docs/2018-01/index.html
@ -1452,6 +1452,8 @@ Catalina:type=Manager,context=/,host=localhost  activeSessions  8
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -1460,8 +1462,6 @@ Catalina:type=Manager,context=/,host=localhost  activeSessions  8
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2018-02/index.html
+++ b/docs/2018-02/index.html
@ -1039,6 +1039,8 @@ UPDATE 3
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -1047,8 +1049,6 @@ UPDATE 3
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2018-03/index.html
+++ b/docs/2018-03/index.html
@ -585,6 +585,8 @@ Fixed 5 occurences of: GENEBANKS
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -593,8 +595,6 @@ Fixed 5 occurences of: GENEBANKS
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2018-04/index.html
+++ b/docs/2018-04/index.html
@ -594,6 +594,8 @@ $ pg_restore -O -U dspacetest -d dspacetest -W -h localhost /tmp/dspace_2018-04-
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -602,8 +604,6 @@ $ pg_restore -O -U dspacetest -d dspacetest -W -h localhost /tmp/dspace_2018-04-
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2018-05/index.html
+++ b/docs/2018-05/index.html
@ -523,6 +523,8 @@ $ psql -h localhost -U postgres dspacetest
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -531,8 +533,6 @@ $ psql -h localhost -U postgres dspacetest
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2018-06/index.html
+++ b/docs/2018-06/index.html
@ -517,6 +517,8 @@ $ sed '/^id/d' 10568-*.csv | csvcut -c 1,2 &gt; map-to-cifor-archive.csv
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -525,8 +527,6 @@ $ sed '/^id/d' 10568-*.csv | csvcut -c 1,2 &gt; map-to-cifor-archive.csv
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2018-07/index.html
+++ b/docs/2018-07/index.html
@ -569,6 +569,8 @@ dspace=# select count(text_value) from metadatavalue where resource_type_id=2 an
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -577,8 +579,6 @@ dspace=# select count(text_value) from metadatavalue where resource_type_id=2 an
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2018-08/index.html
+++ b/docs/2018-08/index.html
@ -442,6 +442,8 @@ $ dspace database migrate ignored
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -450,8 +452,6 @@ $ dspace database migrate ignored
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2018-09/index.html
+++ b/docs/2018-09/index.html
@ -748,6 +748,8 @@ UPDATE metadatavalue SET text_value='ja' WHERE resource_type_id=2 AND metadata_f
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -756,8 +758,6 @@ UPDATE metadatavalue SET text_value='ja' WHERE resource_type_id=2 AND metadata_f
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2018-10/index.html
+++ b/docs/2018-10/index.html
@ -656,6 +656,8 @@ $ curl -X GET -H &quot;Content-Type: application/json&quot; -H &quot;Accept: app
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -664,8 +666,6 @@ $ curl -X GET -H &quot;Content-Type: application/json&quot; -H &quot;Accept: app
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2018-11/index.html
+++ b/docs/2018-11/index.html
@ -553,6 +553,8 @@ $ dspace dsrun org.dspace.eperson.Groomer -a -b 11/27/2016 -d
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -561,8 +563,6 @@ $ dspace dsrun org.dspace.eperson.Groomer -a -b 11/27/2016 -d
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2018-12/index.html
+++ b/docs/2018-12/index.html
@ -594,6 +594,8 @@ UPDATE 1
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -602,8 +604,6 @@ UPDATE 1
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2019-01/index.html
+++ b/docs/2019-01/index.html
@ -1264,6 +1264,8 @@ identify: CorruptImageProfile `xmp' @ warning/profile.c/SetImageProfileInternal/
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -1272,8 +1274,6 @@ identify: CorruptImageProfile `xmp' @ warning/profile.c/SetImageProfileInternal/
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2019-02/index.html
+++ b/docs/2019-02/index.html
@ -1344,6 +1344,8 @@ Please see the DSpace documentation for assistance.
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -1352,8 +1354,6 @@ Please see the DSpace documentation for assistance.
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2019-03/index.html
+++ b/docs/2019-03/index.html
@ -1208,6 +1208,8 @@ sys     0m2.551s
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -1216,8 +1218,6 @@ sys     0m2.551s
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2019-04/index.html
+++ b/docs/2019-04/index.html
@ -1299,6 +1299,8 @@ UPDATE 14
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -1307,8 +1309,6 @@ UPDATE 14
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2019-05/index.html
+++ b/docs/2019-05/index.html
@ -631,6 +631,8 @@ COPY 64871
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -639,8 +641,6 @@ COPY 64871
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2019-06/index.html
+++ b/docs/2019-06/index.html
@ -317,6 +317,8 @@ UPDATE 2
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -325,8 +327,6 @@ UPDATE 2
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2019-07/index.html
+++ b/docs/2019-07/index.html
@ -554,6 +554,8 @@ issn.validate('1020-3362')
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -562,8 +564,6 @@ issn.validate('1020-3362')
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2019-08/index.html
+++ b/docs/2019-08/index.html
@ -573,6 +573,8 @@ sys     2m27.496s
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -581,8 +583,6 @@ sys     2m27.496s
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2019-09/index.html
+++ b/docs/2019-09/index.html
@ -581,6 +581,8 @@ $ csv-metadata-quality -i /tmp/clarisa-institutions.csv -o /tmp/clarisa-institut
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -589,8 +591,6 @@ $ csv-metadata-quality -i /tmp/clarisa-institutions.csv -o /tmp/clarisa-institut
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2019-10/index.html
+++ b/docs/2019-10/index.html
@ -385,6 +385,8 @@ $ dspace import -a -c 10568/104057 -e fuu@cgiar.org -m 2019-10-15-Bioversity.map
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -393,8 +395,6 @@ $ dspace import -a -c 10568/104057 -e fuu@cgiar.org -m 2019-10-15-Bioversity.map
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2019-11/index.html
+++ b/docs/2019-11/index.html
@ -692,6 +692,8 @@ $ tidy -xml -utf8 -iq -m -w 0 dspace/config/controlled-vocabularies/cg-creator-i
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -700,8 +702,6 @@ $ tidy -xml -utf8 -iq -m -w 0 dspace/config/controlled-vocabularies/cg-creator-i
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2019-12/index.html
+++ b/docs/2019-12/index.html
@ -404,6 +404,8 @@ UPDATE 1
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -412,8 +414,6 @@ UPDATE 1
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2020-01/index.html
+++ b/docs/2020-01/index.html
@ -604,6 +604,8 @@ COPY 2900
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -612,8 +614,6 @@ COPY 2900
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2020-02/index.html
+++ b/docs/2020-02/index.html
@ -1275,6 +1275,8 @@ Moving: 21993 into core statistics-2019
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -1283,8 +1285,6 @@ Moving: 21993 into core statistics-2019
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2020-03/index.html
+++ b/docs/2020-03/index.html
@ -484,6 +484,8 @@ $ tidy -xml -utf8 -iq -m -w 0 dspace/config/controlled-vocabularies/cg-creator-i
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -492,8 +494,6 @@ $ tidy -xml -utf8 -iq -m -w 0 dspace/config/controlled-vocabularies/cg-creator-i
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2020-04/index.html
+++ b/docs/2020-04/index.html
@ -658,6 +658,8 @@ $ psql -c 'select * from pg_stat_activity' | wc -l
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -666,8 +668,6 @@ $ psql -c 'select * from pg_stat_activity' | wc -l
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2020-05/index.html
+++ b/docs/2020-05/index.html
@ -477,6 +477,8 @@ Caused by: java.lang.NullPointerException
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -485,8 +487,6 @@ Caused by: java.lang.NullPointerException
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2020-06/index.html
+++ b/docs/2020-06/index.html
@ -811,6 +811,8 @@ $ csvcut -c 'id,cg.subject.ilri[],cg.subject.ilri[en_US],dc.subject[en_US]' /tmp
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -819,8 +821,6 @@ $ csvcut -c 'id,cg.subject.ilri[],cg.subject.ilri[en_US],dc.subject[en_US]' /tmp
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2020-07/index.html
+++ b/docs/2020-07/index.html
@ -1142,6 +1142,8 @@ Fixed 4 occurences of: Muloi, D.M.
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -1150,8 +1152,6 @@ Fixed 4 occurences of: Muloi, D.M.
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2020-08/index.html
+++ b/docs/2020-08/index.html
@ -798,6 +798,8 @@ $ grep -c added /tmp/2020-08-27-countrycodetagger.log
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -806,8 +808,6 @@ $ grep -c added /tmp/2020-08-27-countrycodetagger.log
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2020-09/index.html
+++ b/docs/2020-09/index.html
@ -717,6 +717,8 @@ solr_query_params = {
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -725,8 +727,6 @@ solr_query_params = {
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2020-10/index.html
+++ b/docs/2020-10/index.html
@ -1241,6 +1241,8 @@ $ ./delete-metadata-values.py -i 2020-10-31-delete-74-sponsors.csv -db dspace -u
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -1249,8 +1251,6 @@ $ ./delete-metadata-values.py -i 2020-10-31-delete-74-sponsors.csv -db dspace -u
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2020-11/index.html
+++ b/docs/2020-11/index.html
@ -731,6 +731,8 @@ $ ./fix-metadata-values.py -i 2020-11-30-fix-hung-orcid.csv -db dspace63 -u dspa
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -739,8 +741,6 @@ $ ./fix-metadata-values.py -i 2020-11-30-fix-hung-orcid.csv -db dspace63 -u dspa
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2020-12/index.html
+++ b/docs/2020-12/index.html
@ -869,6 +869,8 @@ $ curl -XDELETE 'http://localhost:9200/openrxv-items-2020-12-29?pretty'
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -877,8 +879,6 @@ $ curl -XDELETE 'http://localhost:9200/openrxv-items-2020-12-29?pretty'
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2021-01/index.html
+++ b/docs/2021-01/index.html
@ -688,6 +688,8 @@ java.lang.IllegalArgumentException: Invalid character found in the request targe
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -696,8 +698,6 @@ java.lang.IllegalArgumentException: Invalid character found in the request targe
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2021-02/index.html
+++ b/docs/2021-02/index.html
@ -899,6 +899,8 @@ dspace.log.2021-02-28:0
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -907,8 +909,6 @@ dspace.log.2021-02-28:0
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2021-03/index.html
+++ b/docs/2021-03/index.html
@ -875,6 +875,8 @@ COPY 3081
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -883,8 +885,6 @@ COPY 3081
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2021-04/index.html
+++ b/docs/2021-04/index.html
@ -24,7 +24,7 @@ Perhaps one of the containers crashed, I should have looked closer but I was in
 <meta property="og:type" content="article" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2021-04/" />
 <meta property="article:published_time" content="2021-04-01T09:50:54+03:00" />
-<meta property="article:modified_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="article:modified_time" content="2021-04-28T18:57:48+03:00" />
@ -56,7 +56,7 @@ Perhaps one of the containers crashed, I should have looked closer but I was in
  "url": "https://alanorth.github.io/cgspace-notes/2021-04/",
  "wordCount": "4669",
  "datePublished": "2021-04-01T09:50:54+03:00",
-  "dateModified": "2021-04-26T15:58:48+03:00",
+  "dateModified": "2021-04-28T18:57:48+03:00",
  "author": {
    "@type": "Person",
    "name": "Alan Orth"
@ -1042,6 +1042,8 @@ $ ./ilri/doi-to-handle.py -i /tmp/dois.txt -o /tmp/handles.csv -db dspace63 -u d
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -1050,8 +1052,6 @@ $ ./ilri/doi-to-handle.py -i /tmp/dois.txt -o /tmp/handles.csv -db dspace63 -u d
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/2021-05/index.html
+++ b/docs/2021-05/index.html
@ -0,0 +1,279 @@
 <!DOCTYPE html>
 <html lang="en" >
  <head>
    <meta charset="utf-8">
 <meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">
 <meta property="og:title" content="May, 2021" />
 <meta property="og:description" content="2021-05-01
 I looked at the top user agents and IPs in the Solr statistics for last month and I see these user agents:
 &ldquo;RI/1.0&rdquo;, 1337
 &ldquo;Microsoft Office Word 2014&rdquo;, 941
 I will add the RI/1.0 pattern to our DSpace agents overload and purge them from Solr (we had previously seen this agent with 9,000 hits or so in 2020-09), but I think I will leave the Microsoft Word one&hellip; as that&rsquo;s an actual user&hellip;
 " />
 <meta property="og:type" content="article" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2021-05/" />
 <meta property="article:published_time" content="2021-05-02T09:50:54+03:00" />
 <meta property="article:modified_time" content="2021-05-02T09:50:54+03:00" />
 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="May, 2021"/>
 <meta name="twitter:description" content="2021-05-01
 I looked at the top user agents and IPs in the Solr statistics for last month and I see these user agents:
 &ldquo;RI/1.0&rdquo;, 1337
 &ldquo;Microsoft Office Word 2014&rdquo;, 941
 I will add the RI/1.0 pattern to our DSpace agents overload and purge them from Solr (we had previously seen this agent with 9,000 hits or so in 2020-09), but I think I will leave the Microsoft Word one&hellip; as that&rsquo;s an actual user&hellip;
 "/>
 <meta name="generator" content="Hugo 0.82.0" />
 <script type="application/ld+json">
 {
  "@context": "http://schema.org",
  "@type": "BlogPosting",
  "headline": "May, 2021",
  "url": "https://alanorth.github.io/cgspace-notes/2021-05/",
  "wordCount": "537",
  "datePublished": "2021-05-02T09:50:54+03:00",
  "dateModified": "2021-05-02T09:50:54+03:00",
  "author": {
    "@type": "Person",
    "name": "Alan Orth"
  },
  "keywords": "Notes"
 }
 </script>
    <link rel="canonical" href="https://alanorth.github.io/cgspace-notes/2021-05/">
    <title>May, 2021 | CGSpace Notes</title>
    <!-- combined, minified CSS -->
    <link href="https://alanorth.github.io/cgspace-notes/css/style.beb8012edc08ba10be012f079d618dc243812267efe62e11f22fe49618f976a4.css" rel="stylesheet" integrity="sha256-vrgBLtwIuhC&#43;AS8HnWGNwkOBImfv5i4R8i/klhj5dqQ=" crossorigin="anonymous">
    <!-- minified Font Awesome for SVG icons -->
    <script defer src="https://alanorth.github.io/cgspace-notes/js/fontawesome.min.ffbfea088a9a1666ec65c3a8cb4906e2a0e4f92dc70dbbf400a125ad2422123a.js" integrity="sha256-/7/qCIqaFmbsZcOoy0kG4qDk&#43;S3HDbv0AKElrSQiEjo=" crossorigin="anonymous"></script>
    <!-- RSS 2.0 feed -->
  </head>
  <body>
    <div class="blog-masthead">
      <div class="container">
        <nav class="nav blog-nav">
          <a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
        </nav>
      </div>
    </div>
    <header class="blog-header">
      <div class="container">
        <h1 class="blog-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/" rel="home">CGSpace Notes</a></h1>
        <p class="lead blog-description" dir="auto">Documenting day-to-day work on the <a href="https://cgspace.cgiar.org">CGSpace</a> repository.</p>
      </div>
    </header>
    <div class="container">
      <div class="row">
        <div class="col-sm-8 blog-main">
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-05/">May, 2021</a></h2>
    <p class="blog-post-meta">
 <time datetime="2021-05-02T09:50:54+03:00">Sun May 02, 2021</time>
 in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2021-05-01">2021-05-01</h2>
 <ul>
 <li>I looked at the top user agents and IPs in the Solr statistics for last month and I see these user agents:
 <ul>
 <li>&ldquo;RI/1.0&rdquo;, 1337</li>
 <li>&ldquo;Microsoft Office Word 2014&rdquo;, 941</li>
 </ul>
 </li>
 <li>I will add the RI/1.0 pattern to our DSpace agents overload and purge them from Solr (we had previously seen this agent with 9,000 hits or so in 2020-09), but I think I will leave the Microsoft Word one&hellip; as that&rsquo;s an actual user&hellip;</li>
 </ul>
 <ul>
 <li>I should probably add the <code>RI/1.0</code> pattern to COUNTER-Robots project</li>
 <li>As well as these IPs:
 <ul>
 <li>193.169.254.178, 21648</li>
 <li>181.62.166.177, 20323</li>
 <li>45.146.166.180, 19376</li>
 </ul>
 </li>
 <li>The first IP seems to be in Estonia and their requests to the REST API change user agents from curl to Mac OS X to Windows and more
 <ul>
 <li>Also, they seem to be trying to exploit something:</li>
 </ul>
 </li>
 </ul>
 <pre><code class="language-console" data-lang="console">193.169.254.178 - - [21/Apr/2021:01:59:01 +0200] &quot;GET /rest/collections/1179/items?limit=812&amp;expand=metadata\x22%20and%20\x2221\x22=\x2221 HTTP/1.1&quot; 400 5 &quot;-&quot; &quot;Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)&quot;
 193.169.254.178 - - [21/Apr/2021:02:00:36 +0200] &quot;GET /rest/collections/1179/items?limit=812&amp;expand=metadata-21%2B21*01 HTTP/1.1&quot; 200 458201 &quot;-&quot; &quot;Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)&quot;
 193.169.254.178 - - [21/Apr/2021:02:00:36 +0200] &quot;GET /rest/collections/1179/items?limit=812&amp;expand=metadata'||lower('')||' HTTP/1.1&quot; 400 5 &quot;-&quot; &quot;Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)&quot;
 193.169.254.178 - - [21/Apr/2021:02:02:10 +0200] &quot;GET /rest/collections/1179/items?limit=812&amp;expand=metadata'%2Brtrim('')%2B' HTTP/1.1&quot; 200 458209 &quot;-&quot; &quot;Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)&quot;
 </code></pre><ul>
 <li>I will report the IP on abuseipdb.com and purge their hits from Solr</li>
 <li>The second IP is in Colombia and is making thousands of requests for what looks like some test site:</li>
 </ul>
 <pre><code class="language-console" data-lang="console">181.62.166.177 - - [20/Apr/2021:22:48:42 +0200] &quot;GET /rest/collections/d1e11546-c62a-4aee-af91-fd482b3e7653/items?expand=metadata HTTP/2.0&quot; 200 123613 &quot;http://cassavalighthousetest.org/&quot; &quot;Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.128 Safari/537.36&quot;
 181.62.166.177 - - [20/Apr/2021:22:55:39 +0200] &quot;GET /rest/collections/d1e11546-c62a-4aee-af91-fd482b3e7653/items?expand=metadata HTTP/2.0&quot; 200 123613 &quot;http://cassavalighthousetest.org/&quot; &quot;Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.128 Safari/537.36&quot;
 </code></pre><ul>
 <li>But this site does not exist (yet?)
 <ul>
 <li>I will purge them from Solr</li>
 </ul>
 </li>
 <li>The third IP is in Russia apparently, and the user agent has the <code>pl-PL</code> locale with thousands of requests like this:</li>
 </ul>
 <pre><code class="language-console" data-lang="console">45.146.166.180 - - [18/Apr/2021:16:28:44 +0200] &quot;GET /bitstream/handle/10947/4153/.AAS%202014%20Annual%20Report.pdf?sequence=1%22%29%29%20AND%201691%3DUTL_INADDR.GET_HOST_ADDRESS%28CHR%28113%29%7C%7CCHR%28118%29%7C%7CCHR%28113%29%7C%7CCHR%28106%29%7C%7CCHR%28113%29%7C%7C%28SELECT%20%28CASE%20WHEN%20%281691%3D1691%29%20THEN%201%20ELSE%200%20END%29%20FROM%20DUAL%29%7C%7CCHR%28113%29%7C%7CCHR%2898%29%7C%7CCHR%28122%29%7C%7CCHR%28120%29%7C%7CCHR%28113%29%29%20AND%20%28%28%22RKbp%22%3D%22RKbp&amp;isAllowed=y HTTP/1.1&quot; 200 918998 &quot;http://cgspace.cgiar.org:80/bitstream/handle/10947/4153/.AAS 2014 Annual Report.pdf&quot; &quot;Mozilla/5.0 (Windows; U; Windows NT 5.1; pl-PL) AppleWebKit/523.15 (KHTML, like Gecko) Version/3.0 Safari/523.15&quot;
 </code></pre><ul>
 <li>I will purge these all with my <code>check-spider-ip-hits.sh</code> script:</li>
 </ul>
 <pre><code class="language-console" data-lang="console">$ ./ilri/check-spider-ip-hits.sh -f /tmp/ips.txt -p
 Purging 21648 hits from 193.169.254.178 in statistics
 Purging 20323 hits from 181.62.166.177 in statistics
 Purging 19376 hits from 45.146.166.180 in statistics
 Total number of bot hits purged: 61347
 </code></pre><h2 id="2021-05-02">2021-05-02</h2>
 <ul>
 <li>Check the AReS Harvester indexes:</li>
 </ul>
 <pre><code class="language-console" data-lang="console">$ curl -s http://localhost:9200/_cat/indices | grep openrxv-items
 yellow open openrxv-items-temp       H-CGsyyLTaqAj6-nKXZ-7w 1 1      0 0    283b    283b
 yellow open openrxv-items-final      ul3SKsa7Q9Cd_K7qokBY_w 1 1 103951 0   254mb   254mb
 $ curl -s 'http://localhost:9200/_alias/' | python -m json.tool
 ...
    &quot;openrxv-items-temp&quot;: {
        &quot;aliases&quot;: {}
    },
    &quot;openrxv-items-final&quot;: {
        &quot;aliases&quot;: {
            &quot;openrxv-items&quot;: {}
        }
    },
 </code></pre><ul>
 <li>I think they look OK (<code>openrxv-items</code> is an alias of <code>openrxv-items-final</code>), but I took a backup just in case:</li>
 </ul>
 <pre><code class="language-console" data-lang="console">$ elasticdump --input=http://localhost:9200/openrxv-items --output=/home/aorth/openrxv-items_mapping.json --type=mapping
 $ elasticdump --input=http://localhost:9200/openrxv-items --output=/home/aorth/openrxv-items_data.json --type=data --limit=1000
 </code></pre><ul>
 <li>Then I started an indexing in the AReS Explorer admin dashboard</li>
 <li>The indexing finished, but it looks like the aliases are messed up again:</li>
 </ul>
 <pre><code class="language-console" data-lang="console">$ curl -s http://localhost:9200/_cat/indices | grep openrxv-items
 yellow open openrxv-items-temp       H-CGsyyLTaqAj6-nKXZ-7w 1 1 104165 105024 487.7mb 487.7mb
 yellow open openrxv-items-final      d0tbMM_SRWimirxr_gm9YA 1 1    937      0   2.2mb   2.2mb
 </code></pre><!-- raw HTML omitted -->
 </article> 
        </div> <!-- /.blog-main -->
        <aside class="col-sm-3 ml-auto blog-sidebar">
        <section class="sidebar-module">
    <h4>Recent Posts</h4>
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
 <li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
    </ol>
  </section>
  <section class="sidebar-module">
    <h4>Links</h4>
    <ol class="list-unstyled">
      <li><a href="https://cgspace.cgiar.org">CGSpace</a></li>
      <li><a href="https://dspacetest.cgiar.org">DSpace Test</a></li>
      <li><a href="https://github.com/ilri/DSpace">CGSpace @ GitHub</a></li>
    </ol>
  </section>
 </aside>
      </div> <!-- /.row -->
    </div> <!-- /.container -->
    <footer class="blog-footer">
      <p dir="auto">
      Blog template created by <a href="https://twitter.com/mdo">@mdo</a>, ported to Hugo by <a href='https://twitter.com/mralanorth'>@mralanorth</a>.
      </p>
      <p>
      <a href="#">Back to top</a>
      </p>
    </footer>
  </body>
 </html>
--- a/docs/404.html
+++ b/docs/404.html
@ -95,6 +95,8 @@
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -103,8 +105,6 @@
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/categories/index.html
+++ b/docs/categories/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -84,7 +84,7 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/categories/notes/">Notes</a></h2>
-    <p class="blog-post-meta"><time datetime="2021-04-01T09:50:54+03:00">Thu Apr 01, 2021</time> by Alan Orth</p>
+    <p class="blog-post-meta"><time datetime="2021-05-02T09:50:54+03:00">Sun May 02, 2021</time> by Alan Orth</p>
  </header>
  <a href='https://alanorth.github.io/cgspace-notes/categories/notes/'>Read more →</a>
@ -108,6 +108,8 @@
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -116,8 +118,6 @@
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/categories/index.xml
+++ b/docs/categories/index.xml
@ -6,11 +6,11 @@
    <description>Recent content in Categories on CGSpace Notes</description>
    <generator>Hugo -- gohugo.io</generator>
    <language>en-us</language>
-    <lastBuildDate>Thu, 01 Apr 2021 09:50:54 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/categories/index.xml" rel="self" type="application/rss+xml" />
+    <lastBuildDate>Sun, 02 May 2021 09:50:54 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/categories/index.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>Notes</title>
      <link>https://alanorth.github.io/cgspace-notes/categories/notes/</link>
-      <pubDate>Thu, 01 Apr 2021 09:50:54 +0300</pubDate>
+      <pubDate>Sun, 02 May 2021 09:50:54 +0300</pubDate>
      <guid>https://alanorth.github.io/cgspace-notes/categories/notes/</guid>
      <description></description>
--- a/docs/categories/notes/index.html
+++ b/docs/categories/notes/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -81,6 +81,33 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-05/">May, 2021</a></h2>
    <p class="blog-post-meta"><time datetime="2021-05-02T09:50:54+03:00">Sun May 02, 2021</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2021-05-01">2021-05-01</h2>
 <ul>
 <li>I looked at the top user agents and IPs in the Solr statistics for last month and I see these user agents:
 <ul>
 <li>&ldquo;RI/1.0&rdquo;, 1337</li>
 <li>&ldquo;Microsoft Office Word 2014&rdquo;, 941</li>
 </ul>
 </li>
 <li>I will add the RI/1.0 pattern to our DSpace agents overload and purge them from Solr (we had previously seen this agent with 9,000 hits or so in 2020-09), but I think I will leave the Microsoft Word one&hellip; as that&rsquo;s an actual user&hellip;</li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2021-05/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-04/">April, 2021</a></h2>
@ -334,39 +361,6 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-09/">September, 2020</a></h2>
    <p class="blog-post-meta"><time datetime="2020-09-02T15:35:54+03:00">Wed Sep 02, 2020</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2020-09-02">2020-09-02</h2>
 <ul>
 <li>Replace Marissa van Epp for Rhys Bucknall in the CCAFS groups on CGSpace because Marissa no longer works at CCAFS</li>
 <li>The AReS Explorer hasn&rsquo;t updated its index since 2020-08-22 when I last forced it
 <ul>
 <li>I restarted it again now and told Moayad that the automatic indexing isn&rsquo;t working</li>
 </ul>
 </li>
 <li>Add <code>Alliance of Bioversity International and CIAT</code> to affiliations on CGSpace</li>
 <li>Abenet told me that the general search text on AReS doesn&rsquo;t get reset when you use the &ldquo;Reset Filters&rdquo; button
 <ul>
 <li>I filed a bug on OpenRXV: <a href="https://github.com/ilri/OpenRXV/issues/39">https://github.com/ilri/OpenRXV/issues/39</a></li>
 </ul>
 </li>
 <li>I filed an issue on OpenRXV to make some minor edits to the admin UI: <a href="https://github.com/ilri/OpenRXV/issues/40">https://github.com/ilri/OpenRXV/issues/40</a></li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2020-09/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
@ -391,6 +385,8 @@
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -399,8 +395,6 @@
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/categories/notes/index.xml
+++ b/docs/categories/notes/index.xml
@ -6,7 +6,25 @@
    <description>Recent content in Notes on CGSpace Notes</description>
    <generator>Hugo -- gohugo.io</generator>
    <language>en-us</language>
-    <lastBuildDate>Thu, 01 Apr 2021 09:50:54 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/categories/notes/index.xml" rel="self" type="application/rss+xml" />
+    <lastBuildDate>Sun, 02 May 2021 09:50:54 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/categories/notes/index.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>May, 2021</title>
      <link>https://alanorth.github.io/cgspace-notes/2021-05/</link>
      <pubDate>Sun, 02 May 2021 09:50:54 +0300</pubDate>
      <guid>https://alanorth.github.io/cgspace-notes/2021-05/</guid>
      <description>&lt;h2 id=&#34;2021-05-01&#34;&gt;2021-05-01&lt;/h2&gt;
 &lt;ul&gt;
 &lt;li&gt;I looked at the top user agents and IPs in the Solr statistics for last month and I see these user agents:
 &lt;ul&gt;
 &lt;li&gt;&amp;ldquo;RI/1.0&amp;rdquo;, 1337&lt;/li&gt;
 &lt;li&gt;&amp;ldquo;Microsoft Office Word 2014&amp;rdquo;, 941&lt;/li&gt;
 &lt;/ul&gt;
 &lt;/li&gt;
 &lt;li&gt;I will add the RI/1.0 pattern to our DSpace agents overload and purge them from Solr (we had previously seen this agent with 9,000 hits or so in 2020-09), but I think I will leave the Microsoft Word one&amp;hellip; as that&amp;rsquo;s an actual user&amp;hellip;&lt;/li&gt;
 &lt;/ul&gt;</description>
    </item>
    <item>
      <title>April, 2021</title>
      <link>https://alanorth.github.io/cgspace-notes/2021-04/</link>
--- a/docs/categories/notes/page/2/index.html
+++ b/docs/categories/notes/page/2/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -81,6 +81,39 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-09/">September, 2020</a></h2>
    <p class="blog-post-meta"><time datetime="2020-09-02T15:35:54+03:00">Wed Sep 02, 2020</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2020-09-02">2020-09-02</h2>
 <ul>
 <li>Replace Marissa van Epp for Rhys Bucknall in the CCAFS groups on CGSpace because Marissa no longer works at CCAFS</li>
 <li>The AReS Explorer hasn&rsquo;t updated its index since 2020-08-22 when I last forced it
 <ul>
 <li>I restarted it again now and told Moayad that the automatic indexing isn&rsquo;t working</li>
 </ul>
 </li>
 <li>Add <code>Alliance of Bioversity International and CIAT</code> to affiliations on CGSpace</li>
 <li>Abenet told me that the general search text on AReS doesn&rsquo;t get reset when you use the &ldquo;Reset Filters&rdquo; button
 <ul>
 <li>I filed a bug on OpenRXV: <a href="https://github.com/ilri/OpenRXV/issues/39">https://github.com/ilri/OpenRXV/issues/39</a></li>
 </ul>
 </li>
 <li>I filed an issue on OpenRXV to make some minor edits to the admin UI: <a href="https://github.com/ilri/OpenRXV/issues/40">https://github.com/ilri/OpenRXV/issues/40</a></li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2020-09/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-08/">August, 2020</a></h2>
@ -348,44 +381,6 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-11/">November, 2019</a></h2>
    <p class="blog-post-meta"><time datetime="2019-11-04T12:20:30+02:00">Mon Nov 04, 2019</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2019-11-04">2019-11-04</h2>
 <ul>
 <li>Peter noticed that there were 5.2 million hits on CGSpace in 2019-10 according to the Atmire usage statistics
 <ul>
 <li>I looked in the nginx logs and see 4.6 million in the access logs, and 1.2 million in the API logs:</li>
 </ul>
 </li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/*access.log.*.gz | grep -cE &quot;[0-9]{1,2}/Oct/2019&quot;
 4671942
 # zcat --force /var/log/nginx/{rest,oai,statistics}.log.*.gz | grep -cE &quot;[0-9]{1,2}/Oct/2019&quot;
 1277694
 </code></pre><ul>
 <li>So 4.6 million from XMLUI and another 1.2 million from API requests</li>
 <li>Let&rsquo;s see how many of the REST API requests were for bitstreams (because they are counted in Solr stats):</li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/rest.log.*.gz | grep -c -E &quot;[0-9]{1,2}/Oct/2019&quot;
 1183456 
 # zcat --force /var/log/nginx/rest.log.*.gz | grep -E &quot;[0-9]{1,2}/Oct/2019&quot; | grep -c -E &quot;/rest/bitstreams&quot;
 106781
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2019-11/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
  <a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/" rel="prev" role="button">Previous page</a>
@ -410,6 +405,8 @@
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -418,8 +415,6 @@
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/categories/notes/page/3/index.html
+++ b/docs/categories/notes/page/3/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -81,6 +81,44 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-11/">November, 2019</a></h2>
    <p class="blog-post-meta"><time datetime="2019-11-04T12:20:30+02:00">Mon Nov 04, 2019</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2019-11-04">2019-11-04</h2>
 <ul>
 <li>Peter noticed that there were 5.2 million hits on CGSpace in 2019-10 according to the Atmire usage statistics
 <ul>
 <li>I looked in the nginx logs and see 4.6 million in the access logs, and 1.2 million in the API logs:</li>
 </ul>
 </li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/*access.log.*.gz | grep -cE &quot;[0-9]{1,2}/Oct/2019&quot;
 4671942
 # zcat --force /var/log/nginx/{rest,oai,statistics}.log.*.gz | grep -cE &quot;[0-9]{1,2}/Oct/2019&quot;
 1277694
 </code></pre><ul>
 <li>So 4.6 million from XMLUI and another 1.2 million from API requests</li>
 <li>Let&rsquo;s see how many of the REST API requests were for bitstreams (because they are counted in Solr stats):</li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/rest.log.*.gz | grep -c -E &quot;[0-9]{1,2}/Oct/2019&quot;
 1183456 
 # zcat --force /var/log/nginx/rest.log.*.gz | grep -E &quot;[0-9]{1,2}/Oct/2019&quot; | grep -c -E &quot;/rest/bitstreams&quot;
 106781
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2019-11/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-10/">October, 2019</a></h2>
@ -380,40 +418,6 @@ sys     0m1.979s
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-01/">January, 2019</a></h2>
    <p class="blog-post-meta"><time datetime="2019-01-02T09:48:30+02:00">Wed Jan 02, 2019</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2019-01-02">2019-01-02</h2>
 <ul>
 <li>Linode alerted that CGSpace (linode18) had a higher outbound traffic rate than normal early this morning</li>
 <li>I don&rsquo;t see anything interesting in the web server logs around that time though:</li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;02/Jan/2019:0(1|2|3)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
     92 40.77.167.4
     99 210.7.29.100
    120 38.126.157.45
    177 35.237.175.180
    177 40.77.167.32
    216 66.249.75.219
    225 18.203.76.93
    261 46.101.86.248
    357 207.46.13.1
    903 54.70.40.11
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2019-01/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
  <a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/page/2/" rel="prev" role="button">Previous page</a>
@ -438,6 +442,8 @@ sys     0m1.979s
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -446,8 +452,6 @@ sys     0m1.979s
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/categories/notes/page/4/index.html
+++ b/docs/categories/notes/page/4/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -81,6 +81,40 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-01/">January, 2019</a></h2>
    <p class="blog-post-meta"><time datetime="2019-01-02T09:48:30+02:00">Wed Jan 02, 2019</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2019-01-02">2019-01-02</h2>
 <ul>
 <li>Linode alerted that CGSpace (linode18) had a higher outbound traffic rate than normal early this morning</li>
 <li>I don&rsquo;t see anything interesting in the web server logs around that time though:</li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;02/Jan/2019:0(1|2|3)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
     92 40.77.167.4
     99 210.7.29.100
    120 38.126.157.45
    177 35.237.175.180
    177 40.77.167.32
    216 66.249.75.219
    225 18.203.76.93
    261 46.101.86.248
    357 207.46.13.1
    903 54.70.40.11
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2019-01/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-12/">December, 2018</a></h2>
@ -327,27 +361,6 @@ sys     2m7.289s
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-03/">March, 2018</a></h2>
    <p class="blog-post-meta"><time datetime="2018-03-02T16:07:54+02:00">Fri Mar 02, 2018</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2018-03-02">2018-03-02</h2>
 <ul>
 <li>Export a CSV of the IITA community metadata for Martin Mueller</li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
  <a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/page/3/" rel="prev" role="button">Previous page</a>
@ -372,6 +385,8 @@ sys     2m7.289s
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -380,8 +395,6 @@ sys     2m7.289s
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/categories/notes/page/5/index.html
+++ b/docs/categories/notes/page/5/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -81,6 +81,27 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-03/">March, 2018</a></h2>
    <p class="blog-post-meta"><time datetime="2018-03-02T16:07:54+02:00">Fri Mar 02, 2018</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2018-03-02">2018-03-02</h2>
 <ul>
 <li>Export a CSV of the IITA community metadata for Martin Mueller</li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-02/">February, 2018</a></h2>
@ -315,6 +336,8 @@ COPY 54701
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -323,8 +346,6 @@ COPY 54701
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/cgiar-library-migration/index.html
+++ b/docs/cgiar-library-migration/index.html
@ -282,6 +282,8 @@ dspace=# select setval('handle_seq',86873);
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -290,8 +292,6 @@ dspace=# select setval('handle_seq',86873);
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/cgspace-cgcorev2-migration/index.html
+++ b/docs/cgspace-cgcorev2-migration/index.html
@ -462,6 +462,8 @@
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -470,8 +472,6 @@
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/cgspace-dspace6-upgrade/index.html
+++ b/docs/cgspace-dspace6-upgrade/index.html
@ -471,6 +471,8 @@ $ chrt -b 0 dspace solr-upgrade-statistics-6x -n 2500000 -i statistics-2018
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -479,8 +481,6 @@ $ chrt -b 0 dspace solr-upgrade-statistics-6x -n 2500000 -i statistics-2018
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/index.html
+++ b/docs/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-04-01T09:50:54+03:00",
+  "dateModified": "2021-05-02T09:50:54+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,33 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-05/">May, 2021</a></h2>
    <p class="blog-post-meta"><time datetime="2021-05-02T09:50:54+03:00">Sun May 02, 2021</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2021-05-01">2021-05-01</h2>
 <ul>
 <li>I looked at the top user agents and IPs in the Solr statistics for last month and I see these user agents:
 <ul>
 <li>&ldquo;RI/1.0&rdquo;, 1337</li>
 <li>&ldquo;Microsoft Office Word 2014&rdquo;, 941</li>
 </ul>
 </li>
 <li>I will add the RI/1.0 pattern to our DSpace agents overload and purge them from Solr (we had previously seen this agent with 9,000 hits or so in 2020-09), but I think I will leave the Microsoft Word one&hellip; as that&rsquo;s an actual user&hellip;</li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2021-05/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-04/">April, 2021</a></h2>
@ -349,39 +376,6 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-09/">September, 2020</a></h2>
    <p class="blog-post-meta"><time datetime="2020-09-02T15:35:54+03:00">Wed Sep 02, 2020</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2020-09-02">2020-09-02</h2>
 <ul>
 <li>Replace Marissa van Epp for Rhys Bucknall in the CCAFS groups on CGSpace because Marissa no longer works at CCAFS</li>
 <li>The AReS Explorer hasn&rsquo;t updated its index since 2020-08-22 when I last forced it
 <ul>
 <li>I restarted it again now and told Moayad that the automatic indexing isn&rsquo;t working</li>
 </ul>
 </li>
 <li>Add <code>Alliance of Bioversity International and CIAT</code> to affiliations on CGSpace</li>
 <li>Abenet told me that the general search text on AReS doesn&rsquo;t get reset when you use the &ldquo;Reset Filters&rdquo; button
 <ul>
 <li>I filed a bug on OpenRXV: <a href="https://github.com/ilri/OpenRXV/issues/39">https://github.com/ilri/OpenRXV/issues/39</a></li>
 </ul>
 </li>
 <li>I filed an issue on OpenRXV to make some minor edits to the admin UI: <a href="https://github.com/ilri/OpenRXV/issues/40">https://github.com/ilri/OpenRXV/issues/40</a></li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2020-09/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
@ -406,6 +400,8 @@
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -414,8 +410,6 @@
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/index.xml
+++ b/docs/index.xml
@ -6,7 +6,25 @@
    <description>Recent content on CGSpace Notes</description>
    <generator>Hugo -- gohugo.io</generator>
    <language>en-us</language>
-    <lastBuildDate>Thu, 01 Apr 2021 09:50:54 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/index.xml" rel="self" type="application/rss+xml" />
+    <lastBuildDate>Sun, 02 May 2021 09:50:54 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/index.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>May, 2021</title>
      <link>https://alanorth.github.io/cgspace-notes/2021-05/</link>
      <pubDate>Sun, 02 May 2021 09:50:54 +0300</pubDate>
      <guid>https://alanorth.github.io/cgspace-notes/2021-05/</guid>
      <description>&lt;h2 id=&#34;2021-05-01&#34;&gt;2021-05-01&lt;/h2&gt;
 &lt;ul&gt;
 &lt;li&gt;I looked at the top user agents and IPs in the Solr statistics for last month and I see these user agents:
 &lt;ul&gt;
 &lt;li&gt;&amp;ldquo;RI/1.0&amp;rdquo;, 1337&lt;/li&gt;
 &lt;li&gt;&amp;ldquo;Microsoft Office Word 2014&amp;rdquo;, 941&lt;/li&gt;
 &lt;/ul&gt;
 &lt;/li&gt;
 &lt;li&gt;I will add the RI/1.0 pattern to our DSpace agents overload and purge them from Solr (we had previously seen this agent with 9,000 hits or so in 2020-09), but I think I will leave the Microsoft Word one&amp;hellip; as that&amp;rsquo;s an actual user&amp;hellip;&lt;/li&gt;
 &lt;/ul&gt;</description>
    </item>
    <item>
      <title>April, 2021</title>
      <link>https://alanorth.github.io/cgspace-notes/2021-04/</link>
--- a/docs/page/2/index.html
+++ b/docs/page/2/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-04-01T09:50:54+03:00",
+  "dateModified": "2021-05-02T09:50:54+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,39 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-09/">September, 2020</a></h2>
    <p class="blog-post-meta"><time datetime="2020-09-02T15:35:54+03:00">Wed Sep 02, 2020</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2020-09-02">2020-09-02</h2>
 <ul>
 <li>Replace Marissa van Epp for Rhys Bucknall in the CCAFS groups on CGSpace because Marissa no longer works at CCAFS</li>
 <li>The AReS Explorer hasn&rsquo;t updated its index since 2020-08-22 when I last forced it
 <ul>
 <li>I restarted it again now and told Moayad that the automatic indexing isn&rsquo;t working</li>
 </ul>
 </li>
 <li>Add <code>Alliance of Bioversity International and CIAT</code> to affiliations on CGSpace</li>
 <li>Abenet told me that the general search text on AReS doesn&rsquo;t get reset when you use the &ldquo;Reset Filters&rdquo; button
 <ul>
 <li>I filed a bug on OpenRXV: <a href="https://github.com/ilri/OpenRXV/issues/39">https://github.com/ilri/OpenRXV/issues/39</a></li>
 </ul>
 </li>
 <li>I filed an issue on OpenRXV to make some minor edits to the admin UI: <a href="https://github.com/ilri/OpenRXV/issues/40">https://github.com/ilri/OpenRXV/issues/40</a></li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2020-09/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-08/">August, 2020</a></h2>
@ -363,44 +396,6 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-11/">November, 2019</a></h2>
    <p class="blog-post-meta"><time datetime="2019-11-04T12:20:30+02:00">Mon Nov 04, 2019</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2019-11-04">2019-11-04</h2>
 <ul>
 <li>Peter noticed that there were 5.2 million hits on CGSpace in 2019-10 according to the Atmire usage statistics
 <ul>
 <li>I looked in the nginx logs and see 4.6 million in the access logs, and 1.2 million in the API logs:</li>
 </ul>
 </li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/*access.log.*.gz | grep -cE &quot;[0-9]{1,2}/Oct/2019&quot;
 4671942
 # zcat --force /var/log/nginx/{rest,oai,statistics}.log.*.gz | grep -cE &quot;[0-9]{1,2}/Oct/2019&quot;
 1277694
 </code></pre><ul>
 <li>So 4.6 million from XMLUI and another 1.2 million from API requests</li>
 <li>Let&rsquo;s see how many of the REST API requests were for bitstreams (because they are counted in Solr stats):</li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/rest.log.*.gz | grep -c -E &quot;[0-9]{1,2}/Oct/2019&quot;
 1183456 
 # zcat --force /var/log/nginx/rest.log.*.gz | grep -E &quot;[0-9]{1,2}/Oct/2019&quot; | grep -c -E &quot;/rest/bitstreams&quot;
 106781
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2019-11/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
  <a class="btn btn-outline-primary" href="/cgspace-notes/" rel="prev" role="button">Previous page</a>
@ -425,6 +420,8 @@
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -433,8 +430,6 @@
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/page/3/index.html
+++ b/docs/page/3/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-04-01T09:50:54+03:00",
+  "dateModified": "2021-05-02T09:50:54+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,44 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-11/">November, 2019</a></h2>
    <p class="blog-post-meta"><time datetime="2019-11-04T12:20:30+02:00">Mon Nov 04, 2019</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2019-11-04">2019-11-04</h2>
 <ul>
 <li>Peter noticed that there were 5.2 million hits on CGSpace in 2019-10 according to the Atmire usage statistics
 <ul>
 <li>I looked in the nginx logs and see 4.6 million in the access logs, and 1.2 million in the API logs:</li>
 </ul>
 </li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/*access.log.*.gz | grep -cE &quot;[0-9]{1,2}/Oct/2019&quot;
 4671942
 # zcat --force /var/log/nginx/{rest,oai,statistics}.log.*.gz | grep -cE &quot;[0-9]{1,2}/Oct/2019&quot;
 1277694
 </code></pre><ul>
 <li>So 4.6 million from XMLUI and another 1.2 million from API requests</li>
 <li>Let&rsquo;s see how many of the REST API requests were for bitstreams (because they are counted in Solr stats):</li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/rest.log.*.gz | grep -c -E &quot;[0-9]{1,2}/Oct/2019&quot;
 1183456 
 # zcat --force /var/log/nginx/rest.log.*.gz | grep -E &quot;[0-9]{1,2}/Oct/2019&quot; | grep -c -E &quot;/rest/bitstreams&quot;
 106781
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2019-11/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-10/">October, 2019</a></h2>
@ -395,40 +433,6 @@ sys     0m1.979s
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-01/">January, 2019</a></h2>
    <p class="blog-post-meta"><time datetime="2019-01-02T09:48:30+02:00">Wed Jan 02, 2019</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2019-01-02">2019-01-02</h2>
 <ul>
 <li>Linode alerted that CGSpace (linode18) had a higher outbound traffic rate than normal early this morning</li>
 <li>I don&rsquo;t see anything interesting in the web server logs around that time though:</li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;02/Jan/2019:0(1|2|3)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
     92 40.77.167.4
     99 210.7.29.100
    120 38.126.157.45
    177 35.237.175.180
    177 40.77.167.32
    216 66.249.75.219
    225 18.203.76.93
    261 46.101.86.248
    357 207.46.13.1
    903 54.70.40.11
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2019-01/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
  <a class="btn btn-outline-primary" href="/cgspace-notes/page/2/" rel="prev" role="button">Previous page</a>
@ -453,6 +457,8 @@ sys     0m1.979s
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -461,8 +467,6 @@ sys     0m1.979s
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/page/4/index.html
+++ b/docs/page/4/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-04-01T09:50:54+03:00",
+  "dateModified": "2021-05-02T09:50:54+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,40 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-01/">January, 2019</a></h2>
    <p class="blog-post-meta"><time datetime="2019-01-02T09:48:30+02:00">Wed Jan 02, 2019</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2019-01-02">2019-01-02</h2>
 <ul>
 <li>Linode alerted that CGSpace (linode18) had a higher outbound traffic rate than normal early this morning</li>
 <li>I don&rsquo;t see anything interesting in the web server logs around that time though:</li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;02/Jan/2019:0(1|2|3)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
     92 40.77.167.4
     99 210.7.29.100
    120 38.126.157.45
    177 35.237.175.180
    177 40.77.167.32
    216 66.249.75.219
    225 18.203.76.93
    261 46.101.86.248
    357 207.46.13.1
    903 54.70.40.11
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2019-01/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-12/">December, 2018</a></h2>
@ -342,27 +376,6 @@ sys     2m7.289s
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-03/">March, 2018</a></h2>
    <p class="blog-post-meta"><time datetime="2018-03-02T16:07:54+02:00">Fri Mar 02, 2018</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2018-03-02">2018-03-02</h2>
 <ul>
 <li>Export a CSV of the IITA community metadata for Martin Mueller</li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
  <a class="btn btn-outline-primary" href="/cgspace-notes/page/3/" rel="prev" role="button">Previous page</a>
@ -387,6 +400,8 @@ sys     2m7.289s
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -395,8 +410,6 @@ sys     2m7.289s
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/page/5/index.html
+++ b/docs/page/5/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-04-01T09:50:54+03:00",
+  "dateModified": "2021-05-02T09:50:54+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,27 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-03/">March, 2018</a></h2>
    <p class="blog-post-meta"><time datetime="2018-03-02T16:07:54+02:00">Fri Mar 02, 2018</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2018-03-02">2018-03-02</h2>
 <ul>
 <li>Export a CSV of the IITA community metadata for Martin Mueller</li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-02/">February, 2018</a></h2>
@ -397,24 +418,6 @@ COPY 54701
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-06/">June, 2017</a></h2>
    <p class="blog-post-meta"><time datetime="2017-06-01T10:14:52+03:00">Thu Jun 01, 2017</time> by Alan Orth in 
 <span class="fas fa-tag" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
 </p>
  </header>
  2017-06-01  After discussion with WLE and CGSpace content people, we decided to just add one metadata field for the WLE Research Themes The cg.identifier.wletheme field will be used for both Phase I and Phase II Research Themes Then we&rsquo;ll create a new sub-community for Phase II and create collections for the research themes there The current &ldquo;Research Themes&rdquo; community will be renamed to &ldquo;WLE Phase I Research Themes&rdquo; Tagged all items in the current Phase I collections with their appropriate themes Create pull request to add Phase II research themes to the submission form: #328 Add cg.
  <a href='https://alanorth.github.io/cgspace-notes/2017-06/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
  <a class="btn btn-outline-primary" href="/cgspace-notes/page/4/" rel="prev" role="button">Previous page</a>
@ -439,6 +442,8 @@ COPY 54701
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -447,8 +452,6 @@ COPY 54701
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/page/6/index.html
+++ b/docs/page/6/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-04-01T09:50:54+03:00",
+  "dateModified": "2021-05-02T09:50:54+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,24 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-06/">June, 2017</a></h2>
    <p class="blog-post-meta"><time datetime="2017-06-01T10:14:52+03:00">Thu Jun 01, 2017</time> by Alan Orth in 
 <span class="fas fa-tag" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
 </p>
  </header>
  2017-06-01  After discussion with WLE and CGSpace content people, we decided to just add one metadata field for the WLE Research Themes The cg.identifier.wletheme field will be used for both Phase I and Phase II Research Themes Then we&rsquo;ll create a new sub-community for Phase II and create collections for the research themes there The current &ldquo;Research Themes&rdquo; community will be renamed to &ldquo;WLE Phase I Research Themes&rdquo; Tagged all items in the current Phase I collections with their appropriate themes Create pull request to add Phase II research themes to the submission form: #328 Add cg.
  <a href='https://alanorth.github.io/cgspace-notes/2017-06/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-05/">May, 2017</a></h2>
@ -345,36 +363,6 @@ DELETE 1
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-08/">August, 2016</a></h2>
    <p class="blog-post-meta"><time datetime="2016-08-01T15:53:00+03:00">Mon Aug 01, 2016</time> by Alan Orth in 
 <span class="fas fa-tag" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
 </p>
  </header>
  <h2 id="2016-08-01">2016-08-01</h2>
 <ul>
 <li>Add updated distribution license from Sisay (<a href="https://github.com/ilri/DSpace/issues/259">#259</a>)</li>
 <li>Play with upgrading Mirage 2 dependencies in <code>bower.json</code> because most are several versions of out date</li>
 <li>Bootstrap is at 3.3.0 but upstream is at 3.3.7, and upgrading to anything beyond 3.3.1 breaks glyphicons and probably more</li>
 <li>bower stuff is a dead end, waste of time, too many issues</li>
 <li>Anything after Bootstrap 3.3.1 makes glyphicons disappear (HTTP 404 trying to access from incorrect path of <code>fonts</code>)</li>
 <li>Start working on DSpace 5.1 → 5.5 port:</li>
 </ul>
 <pre><code>$ git checkout -b 55new 5_x-prod
 $ git reset --hard ilri/5_x-prod
 $ git rebase -i dspace-5.5
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
  <a class="btn btn-outline-primary" href="/cgspace-notes/page/5/" rel="prev" role="button">Previous page</a>
@ -399,6 +387,8 @@ $ git rebase -i dspace-5.5
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -407,8 +397,6 @@ $ git rebase -i dspace-5.5
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/page/7/index.html
+++ b/docs/page/7/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-04-01T09:50:54+03:00",
+  "dateModified": "2021-05-02T09:50:54+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,36 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-08/">August, 2016</a></h2>
    <p class="blog-post-meta"><time datetime="2016-08-01T15:53:00+03:00">Mon Aug 01, 2016</time> by Alan Orth in 
 <span class="fas fa-tag" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
 </p>
  </header>
  <h2 id="2016-08-01">2016-08-01</h2>
 <ul>
 <li>Add updated distribution license from Sisay (<a href="https://github.com/ilri/DSpace/issues/259">#259</a>)</li>
 <li>Play with upgrading Mirage 2 dependencies in <code>bower.json</code> because most are several versions of out date</li>
 <li>Bootstrap is at 3.3.0 but upstream is at 3.3.7, and upgrading to anything beyond 3.3.1 breaks glyphicons and probably more</li>
 <li>bower stuff is a dead end, waste of time, too many issues</li>
 <li>Anything after Bootstrap 3.3.1 makes glyphicons disappear (HTTP 404 trying to access from incorrect path of <code>fonts</code>)</li>
 <li>Start working on DSpace 5.1 → 5.5 port:</li>
 </ul>
 <pre><code>$ git checkout -b 55new 5_x-prod
 $ git reset --hard ilri/5_x-prod
 $ git rebase -i dspace-5.5
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-07/">July, 2016</a></h2>
@ -354,6 +384,8 @@ dspacetest=# select text_value from  metadatavalue where metadata_field_id=3 and
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -362,8 +394,6 @@ dspacetest=# select text_value from  metadatavalue where metadata_field_id=3 and
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/posts/index.html
+++ b/docs/posts/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-04-01T09:50:54+03:00",
+  "dateModified": "2021-05-02T09:50:54+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,33 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-05/">May, 2021</a></h2>
    <p class="blog-post-meta"><time datetime="2021-05-02T09:50:54+03:00">Sun May 02, 2021</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2021-05-01">2021-05-01</h2>
 <ul>
 <li>I looked at the top user agents and IPs in the Solr statistics for last month and I see these user agents:
 <ul>
 <li>&ldquo;RI/1.0&rdquo;, 1337</li>
 <li>&ldquo;Microsoft Office Word 2014&rdquo;, 941</li>
 </ul>
 </li>
 <li>I will add the RI/1.0 pattern to our DSpace agents overload and purge them from Solr (we had previously seen this agent with 9,000 hits or so in 2020-09), but I think I will leave the Microsoft Word one&hellip; as that&rsquo;s an actual user&hellip;</li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2021-05/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-04/">April, 2021</a></h2>
@ -349,39 +376,6 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-09/">September, 2020</a></h2>
    <p class="blog-post-meta"><time datetime="2020-09-02T15:35:54+03:00">Wed Sep 02, 2020</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2020-09-02">2020-09-02</h2>
 <ul>
 <li>Replace Marissa van Epp for Rhys Bucknall in the CCAFS groups on CGSpace because Marissa no longer works at CCAFS</li>
 <li>The AReS Explorer hasn&rsquo;t updated its index since 2020-08-22 when I last forced it
 <ul>
 <li>I restarted it again now and told Moayad that the automatic indexing isn&rsquo;t working</li>
 </ul>
 </li>
 <li>Add <code>Alliance of Bioversity International and CIAT</code> to affiliations on CGSpace</li>
 <li>Abenet told me that the general search text on AReS doesn&rsquo;t get reset when you use the &ldquo;Reset Filters&rdquo; button
 <ul>
 <li>I filed a bug on OpenRXV: <a href="https://github.com/ilri/OpenRXV/issues/39">https://github.com/ilri/OpenRXV/issues/39</a></li>
 </ul>
 </li>
 <li>I filed an issue on OpenRXV to make some minor edits to the admin UI: <a href="https://github.com/ilri/OpenRXV/issues/40">https://github.com/ilri/OpenRXV/issues/40</a></li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2020-09/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
@ -406,6 +400,8 @@
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -414,8 +410,6 @@
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/posts/index.xml
+++ b/docs/posts/index.xml
@ -6,7 +6,25 @@
    <description>Recent content in Posts on CGSpace Notes</description>
    <generator>Hugo -- gohugo.io</generator>
    <language>en-us</language>
-    <lastBuildDate>Thu, 01 Apr 2021 09:50:54 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/posts/index.xml" rel="self" type="application/rss+xml" />
+    <lastBuildDate>Sun, 02 May 2021 09:50:54 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/posts/index.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>May, 2021</title>
      <link>https://alanorth.github.io/cgspace-notes/2021-05/</link>
      <pubDate>Sun, 02 May 2021 09:50:54 +0300</pubDate>
      <guid>https://alanorth.github.io/cgspace-notes/2021-05/</guid>
      <description>&lt;h2 id=&#34;2021-05-01&#34;&gt;2021-05-01&lt;/h2&gt;
 &lt;ul&gt;
 &lt;li&gt;I looked at the top user agents and IPs in the Solr statistics for last month and I see these user agents:
 &lt;ul&gt;
 &lt;li&gt;&amp;ldquo;RI/1.0&amp;rdquo;, 1337&lt;/li&gt;
 &lt;li&gt;&amp;ldquo;Microsoft Office Word 2014&amp;rdquo;, 941&lt;/li&gt;
 &lt;/ul&gt;
 &lt;/li&gt;
 &lt;li&gt;I will add the RI/1.0 pattern to our DSpace agents overload and purge them from Solr (we had previously seen this agent with 9,000 hits or so in 2020-09), but I think I will leave the Microsoft Word one&amp;hellip; as that&amp;rsquo;s an actual user&amp;hellip;&lt;/li&gt;
 &lt;/ul&gt;</description>
    </item>
    <item>
      <title>April, 2021</title>
      <link>https://alanorth.github.io/cgspace-notes/2021-04/</link>
--- a/docs/posts/page/2/index.html
+++ b/docs/posts/page/2/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-04-01T09:50:54+03:00",
+  "dateModified": "2021-05-02T09:50:54+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,39 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-09/">September, 2020</a></h2>
    <p class="blog-post-meta"><time datetime="2020-09-02T15:35:54+03:00">Wed Sep 02, 2020</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2020-09-02">2020-09-02</h2>
 <ul>
 <li>Replace Marissa van Epp for Rhys Bucknall in the CCAFS groups on CGSpace because Marissa no longer works at CCAFS</li>
 <li>The AReS Explorer hasn&rsquo;t updated its index since 2020-08-22 when I last forced it
 <ul>
 <li>I restarted it again now and told Moayad that the automatic indexing isn&rsquo;t working</li>
 </ul>
 </li>
 <li>Add <code>Alliance of Bioversity International and CIAT</code> to affiliations on CGSpace</li>
 <li>Abenet told me that the general search text on AReS doesn&rsquo;t get reset when you use the &ldquo;Reset Filters&rdquo; button
 <ul>
 <li>I filed a bug on OpenRXV: <a href="https://github.com/ilri/OpenRXV/issues/39">https://github.com/ilri/OpenRXV/issues/39</a></li>
 </ul>
 </li>
 <li>I filed an issue on OpenRXV to make some minor edits to the admin UI: <a href="https://github.com/ilri/OpenRXV/issues/40">https://github.com/ilri/OpenRXV/issues/40</a></li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2020-09/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-08/">August, 2020</a></h2>
@ -363,44 +396,6 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-11/">November, 2019</a></h2>
    <p class="blog-post-meta"><time datetime="2019-11-04T12:20:30+02:00">Mon Nov 04, 2019</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2019-11-04">2019-11-04</h2>
 <ul>
 <li>Peter noticed that there were 5.2 million hits on CGSpace in 2019-10 according to the Atmire usage statistics
 <ul>
 <li>I looked in the nginx logs and see 4.6 million in the access logs, and 1.2 million in the API logs:</li>
 </ul>
 </li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/*access.log.*.gz | grep -cE &quot;[0-9]{1,2}/Oct/2019&quot;
 4671942
 # zcat --force /var/log/nginx/{rest,oai,statistics}.log.*.gz | grep -cE &quot;[0-9]{1,2}/Oct/2019&quot;
 1277694
 </code></pre><ul>
 <li>So 4.6 million from XMLUI and another 1.2 million from API requests</li>
 <li>Let&rsquo;s see how many of the REST API requests were for bitstreams (because they are counted in Solr stats):</li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/rest.log.*.gz | grep -c -E &quot;[0-9]{1,2}/Oct/2019&quot;
 1183456 
 # zcat --force /var/log/nginx/rest.log.*.gz | grep -E &quot;[0-9]{1,2}/Oct/2019&quot; | grep -c -E &quot;/rest/bitstreams&quot;
 106781
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2019-11/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
  <a class="btn btn-outline-primary" href="/cgspace-notes/posts/" rel="prev" role="button">Previous page</a>
@ -425,6 +420,8 @@
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -433,8 +430,6 @@
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/posts/page/3/index.html
+++ b/docs/posts/page/3/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-04-01T09:50:54+03:00",
+  "dateModified": "2021-05-02T09:50:54+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,44 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-11/">November, 2019</a></h2>
    <p class="blog-post-meta"><time datetime="2019-11-04T12:20:30+02:00">Mon Nov 04, 2019</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2019-11-04">2019-11-04</h2>
 <ul>
 <li>Peter noticed that there were 5.2 million hits on CGSpace in 2019-10 according to the Atmire usage statistics
 <ul>
 <li>I looked in the nginx logs and see 4.6 million in the access logs, and 1.2 million in the API logs:</li>
 </ul>
 </li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/*access.log.*.gz | grep -cE &quot;[0-9]{1,2}/Oct/2019&quot;
 4671942
 # zcat --force /var/log/nginx/{rest,oai,statistics}.log.*.gz | grep -cE &quot;[0-9]{1,2}/Oct/2019&quot;
 1277694
 </code></pre><ul>
 <li>So 4.6 million from XMLUI and another 1.2 million from API requests</li>
 <li>Let&rsquo;s see how many of the REST API requests were for bitstreams (because they are counted in Solr stats):</li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/rest.log.*.gz | grep -c -E &quot;[0-9]{1,2}/Oct/2019&quot;
 1183456 
 # zcat --force /var/log/nginx/rest.log.*.gz | grep -E &quot;[0-9]{1,2}/Oct/2019&quot; | grep -c -E &quot;/rest/bitstreams&quot;
 106781
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2019-11/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-10/">October, 2019</a></h2>
@ -395,40 +433,6 @@ sys     0m1.979s
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-01/">January, 2019</a></h2>
    <p class="blog-post-meta"><time datetime="2019-01-02T09:48:30+02:00">Wed Jan 02, 2019</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2019-01-02">2019-01-02</h2>
 <ul>
 <li>Linode alerted that CGSpace (linode18) had a higher outbound traffic rate than normal early this morning</li>
 <li>I don&rsquo;t see anything interesting in the web server logs around that time though:</li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;02/Jan/2019:0(1|2|3)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
     92 40.77.167.4
     99 210.7.29.100
    120 38.126.157.45
    177 35.237.175.180
    177 40.77.167.32
    216 66.249.75.219
    225 18.203.76.93
    261 46.101.86.248
    357 207.46.13.1
    903 54.70.40.11
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2019-01/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
  <a class="btn btn-outline-primary" href="/cgspace-notes/posts/page/2/" rel="prev" role="button">Previous page</a>
@ -453,6 +457,8 @@ sys     0m1.979s
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -461,8 +467,6 @@ sys     0m1.979s
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/posts/page/4/index.html
+++ b/docs/posts/page/4/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-04-01T09:50:54+03:00",
+  "dateModified": "2021-05-02T09:50:54+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,40 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-01/">January, 2019</a></h2>
    <p class="blog-post-meta"><time datetime="2019-01-02T09:48:30+02:00">Wed Jan 02, 2019</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2019-01-02">2019-01-02</h2>
 <ul>
 <li>Linode alerted that CGSpace (linode18) had a higher outbound traffic rate than normal early this morning</li>
 <li>I don&rsquo;t see anything interesting in the web server logs around that time though:</li>
 </ul>
 <pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;02/Jan/2019:0(1|2|3)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
     92 40.77.167.4
     99 210.7.29.100
    120 38.126.157.45
    177 35.237.175.180
    177 40.77.167.32
    216 66.249.75.219
    225 18.203.76.93
    261 46.101.86.248
    357 207.46.13.1
    903 54.70.40.11
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2019-01/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-12/">December, 2018</a></h2>
@ -342,27 +376,6 @@ sys     2m7.289s
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-03/">March, 2018</a></h2>
    <p class="blog-post-meta"><time datetime="2018-03-02T16:07:54+02:00">Fri Mar 02, 2018</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2018-03-02">2018-03-02</h2>
 <ul>
 <li>Export a CSV of the IITA community metadata for Martin Mueller</li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
  <a class="btn btn-outline-primary" href="/cgspace-notes/posts/page/3/" rel="prev" role="button">Previous page</a>
@ -387,6 +400,8 @@ sys     2m7.289s
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -395,8 +410,6 @@ sys     2m7.289s
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/posts/page/5/index.html
+++ b/docs/posts/page/5/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-04-01T09:50:54+03:00",
+  "dateModified": "2021-05-02T09:50:54+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,27 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-03/">March, 2018</a></h2>
    <p class="blog-post-meta"><time datetime="2018-03-02T16:07:54+02:00">Fri Mar 02, 2018</time> by Alan Orth in 
 <span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
 </p>
  </header>
  <h2 id="2018-03-02">2018-03-02</h2>
 <ul>
 <li>Export a CSV of the IITA community metadata for Martin Mueller</li>
 </ul>
  <a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-02/">February, 2018</a></h2>
@ -397,24 +418,6 @@ COPY 54701
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-06/">June, 2017</a></h2>
    <p class="blog-post-meta"><time datetime="2017-06-01T10:14:52+03:00">Thu Jun 01, 2017</time> by Alan Orth in 
 <span class="fas fa-tag" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
 </p>
  </header>
  2017-06-01  After discussion with WLE and CGSpace content people, we decided to just add one metadata field for the WLE Research Themes The cg.identifier.wletheme field will be used for both Phase I and Phase II Research Themes Then we&rsquo;ll create a new sub-community for Phase II and create collections for the research themes there The current &ldquo;Research Themes&rdquo; community will be renamed to &ldquo;WLE Phase I Research Themes&rdquo; Tagged all items in the current Phase I collections with their appropriate themes Create pull request to add Phase II research themes to the submission form: #328 Add cg.
  <a href='https://alanorth.github.io/cgspace-notes/2017-06/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
  <a class="btn btn-outline-primary" href="/cgspace-notes/posts/page/4/" rel="prev" role="button">Previous page</a>
@ -439,6 +442,8 @@ COPY 54701
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -447,8 +452,6 @@ COPY 54701
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/posts/page/6/index.html
+++ b/docs/posts/page/6/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-04-01T09:50:54+03:00",
+  "dateModified": "2021-05-02T09:50:54+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,24 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-06/">June, 2017</a></h2>
    <p class="blog-post-meta"><time datetime="2017-06-01T10:14:52+03:00">Thu Jun 01, 2017</time> by Alan Orth in 
 <span class="fas fa-tag" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
 </p>
  </header>
  2017-06-01  After discussion with WLE and CGSpace content people, we decided to just add one metadata field for the WLE Research Themes The cg.identifier.wletheme field will be used for both Phase I and Phase II Research Themes Then we&rsquo;ll create a new sub-community for Phase II and create collections for the research themes there The current &ldquo;Research Themes&rdquo; community will be renamed to &ldquo;WLE Phase I Research Themes&rdquo; Tagged all items in the current Phase I collections with their appropriate themes Create pull request to add Phase II research themes to the submission form: #328 Add cg.
  <a href='https://alanorth.github.io/cgspace-notes/2017-06/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-05/">May, 2017</a></h2>
@ -345,36 +363,6 @@ DELETE 1
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-08/">August, 2016</a></h2>
    <p class="blog-post-meta"><time datetime="2016-08-01T15:53:00+03:00">Mon Aug 01, 2016</time> by Alan Orth in 
 <span class="fas fa-tag" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
 </p>
  </header>
  <h2 id="2016-08-01">2016-08-01</h2>
 <ul>
 <li>Add updated distribution license from Sisay (<a href="https://github.com/ilri/DSpace/issues/259">#259</a>)</li>
 <li>Play with upgrading Mirage 2 dependencies in <code>bower.json</code> because most are several versions of out date</li>
 <li>Bootstrap is at 3.3.0 but upstream is at 3.3.7, and upgrading to anything beyond 3.3.1 breaks glyphicons and probably more</li>
 <li>bower stuff is a dead end, waste of time, too many issues</li>
 <li>Anything after Bootstrap 3.3.1 makes glyphicons disappear (HTTP 404 trying to access from incorrect path of <code>fonts</code>)</li>
 <li>Start working on DSpace 5.1 → 5.5 port:</li>
 </ul>
 <pre><code>$ git checkout -b 55new 5_x-prod
 $ git reset --hard ilri/5_x-prod
 $ git rebase -i dspace-5.5
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a>
 </article> 
 <nav class="blog-pagination">
  <a class="btn btn-outline-primary" href="/cgspace-notes/posts/page/5/" rel="prev" role="button">Previous page</a>
@ -399,6 +387,8 @@ $ git rebase -i dspace-5.5
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -407,8 +397,6 @@ $ git rebase -i dspace-5.5
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/posts/page/7/index.html
+++ b/docs/posts/page/7/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2021-04-26T15:58:48+03:00" />
+<meta property="og:updated_time" content="2021-05-02T09:50:54+03:00" />
@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-04-01T09:50:54+03:00",
+  "dateModified": "2021-05-02T09:50:54+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,36 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-08/">August, 2016</a></h2>
    <p class="blog-post-meta"><time datetime="2016-08-01T15:53:00+03:00">Mon Aug 01, 2016</time> by Alan Orth in 
 <span class="fas fa-tag" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
 </p>
  </header>
  <h2 id="2016-08-01">2016-08-01</h2>
 <ul>
 <li>Add updated distribution license from Sisay (<a href="https://github.com/ilri/DSpace/issues/259">#259</a>)</li>
 <li>Play with upgrading Mirage 2 dependencies in <code>bower.json</code> because most are several versions of out date</li>
 <li>Bootstrap is at 3.3.0 but upstream is at 3.3.7, and upgrading to anything beyond 3.3.1 breaks glyphicons and probably more</li>
 <li>bower stuff is a dead end, waste of time, too many issues</li>
 <li>Anything after Bootstrap 3.3.1 makes glyphicons disappear (HTTP 404 trying to access from incorrect path of <code>fonts</code>)</li>
 <li>Start working on DSpace 5.1 → 5.5 port:</li>
 </ul>
 <pre><code>$ git checkout -b 55new 5_x-prod
 $ git reset --hard ilri/5_x-prod
 $ git rebase -i dspace-5.5
 </code></pre>
  <a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a>
 </article> 
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-07/">July, 2016</a></h2>
@ -354,6 +384,8 @@ dspacetest=# select text_value from  metadatavalue where metadata_field_id=3 and
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -362,8 +394,6 @@ dspacetest=# select text_value from  metadatavalue where metadata_field_id=3 and
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/robots.txt
+++ b/docs/robots.txt
@ -1,11 +1,12 @@
 User-agent: *
 Disallow: /cgspace-notes/2021-04/
 Disallow: /cgspace-notes/categories/
 Disallow: /cgspace-notes/
 Disallow: /cgspace-notes/2021-05/
 Disallow: /cgspace-notes/categories/notes/
 Disallow: /cgspace-notes/posts/
 Disallow: /cgspace-notes/2021-04/
 Disallow: /cgspace-notes/2021-03/
 Disallow: /cgspace-notes/cgspace-cgcorev2-migration/
 Disallow: /cgspace-notes/tags/migration/
--- a/docs/sitemap.xml
+++ b/docs/sitemap.xml
@ -2,20 +2,23 @@
 <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
  xmlns:xhtml="http://www.w3.org/1999/xhtml">
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/2021-04/</loc>
    <lastmod>2021-04-26T15:58:48+03:00</lastmod>
  </url><url>
    <loc>https://alanorth.github.io/cgspace-notes/categories/</loc>
-    <lastmod>2021-04-26T15:58:48+03:00</lastmod>
+    <lastmod>2021-05-02T09:50:54+03:00</lastmod>
  </url><url>
    <loc>https://alanorth.github.io/cgspace-notes/</loc>
-    <lastmod>2021-04-26T15:58:48+03:00</lastmod>
+    <lastmod>2021-05-02T09:50:54+03:00</lastmod>
  </url><url>
    <loc>https://alanorth.github.io/cgspace-notes/2021-05/</loc>
    <lastmod>2021-05-02T09:50:54+03:00</lastmod>
  </url><url>
    <loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
-    <lastmod>2021-04-26T15:58:48+03:00</lastmod>
+    <lastmod>2021-05-02T09:50:54+03:00</lastmod>
  </url><url>
    <loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
-    <lastmod>2021-04-26T15:58:48+03:00</lastmod>
+    <lastmod>2021-05-02T09:50:54+03:00</lastmod>
  </url><url>
    <loc>https://alanorth.github.io/cgspace-notes/2021-04/</loc>
    <lastmod>2021-04-28T18:57:48+03:00</lastmod>
  </url><url>
    <loc>https://alanorth.github.io/cgspace-notes/2021-03/</loc>
    <lastmod>2021-04-13T21:13:08+03:00</lastmod>
--- a/docs/tags/index.html
+++ b/docs/tags/index.html
@ -122,6 +122,8 @@
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -130,8 +132,6 @@
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/docs/tags/migration/index.html
+++ b/docs/tags/migration/index.html
@ -155,6 +155,8 @@
    <ol class="list-unstyled">
 <li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
 <li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
 <li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
@ -163,8 +165,6 @@
 <li><a href="/cgspace-notes/2021-02/">February, 2021</a></li>
 <li><a href="/cgspace-notes/2021-01/">January, 2021</a></li>
    </ol>
  </section>
--- a/Show More
+++ b/Show More