Add 2021-11 and regenerate docs

content/posts/2021-10.md: Fix toml syntax issue
Add notes for 2021-10-31
2024-11-29 01:48:19 +01:00 · 2021-11-01 10:49:21 +02:00 · 2021-11-01 10:48:13 +02:00 · 2021-11-01 10:07:51 +02:00 · 2021-11-01 10:07:11 +02:00
113 changed files with 1258 additions and 831 deletions
--- a/content/posts/2021-10.md
+++ b/content/posts/2021-10.md
@ -531,4 +531,78 @@ $ wc -l /tmp/ips-to-purge.txt
 - Help ICARDA colleagues with GLDC reports on AReS
  - There was an issue due to differences in CRP metadata between repositories

+## 2021-10-28
+
+- Meeting with Medha and a bunch of others about the FAIRscribe tool they have been developing
+  - Seems it is a submission tool like MEL
+
+## 2021-10-29
+
+- Linode alerted me that CGSpace (linode18) has high outbound traffic for the last two hours
+  - This has happened a few other times this week so I decided to go look at the Solr stats for today
+  - I see 93.158.91.62 is making thousands of requests to Discover with a normal user agent:
+
+```
+Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.81 Safari/537.36
+```
+
+- Even more annoying, they are not re-using their session ID:
+
+```console
+$ grep 93.158.91.62 log/dspace.log.2021-10-29 | grep -oE 'session_id=[A-Z0-9]{32}:ip_addr=' | sort | uniq | wc -l
+4888
+```
+
+- This IP has made 36,000 requests to CGSpace...
+- The IP is owned by [Internet Vikings](internetvikings.com) in Sweden
+- I purged their statistics and set up a temporary HTTP 403 telling them to use a real user agent
+- I see another one in Sweden a few days ago (192.36.109.131), also using the same exact user agent as above, but belonging to [Resilans AB](http://webb.resilans.se/)
+  - I purged another 74,619 hits from this bot
+- I added these two IPs to the nginx IP bot identifier
+- Jesus I found a few Russian IPs attempting SQL injection and path traversal, ie:
+
+```
+45.9.20.71 - - [20/Oct/2021:02:31:15 +0200] "GET /bitstream/handle/10568/1820/Rhodesgrass.pdf?sequence=4&OoxD=6591%20AND%201%3D1%20UNION%20ALL%20SELECT%201%2CNULL%2C%27%3Cscript%3Ealert%28%22XSS%22%29%3C%2Fscript%3E%27%2Ctable_name%20FROM%20information_schema.tables%20WHERE%202%3E1--%2F%2A%2A%2F%3B%20EXEC%20xp_cmdshell%28%27cat%20..%2F..%2F..%2Fetc%2Fpasswd%27%29%23 HTTP/1.1" 200 143070 "https://cgspace.cgiar.org:443/bitstream/handle/10568/1820/Rhodesgrass.pdf" "Mozilla/5.0 (X11; U; Linux i686; es-AR; rv:1.8.1.11) Gecko/20071204 Ubuntu/7.10 (gutsy) Firefox/2.0.0.11"
+```
+
+- I reported them to AbuseIPDB.com and purged their hits:
+
+```console
+$ ./ilri/check-spider-ip-hits.sh -f /tmp/ip.txt -p
+Purging 6364 hits from 45.9.20.71 in statistics
+Purging 8039 hits from 45.146.166.157 in statistics
+Purging 3383 hits from 45.155.204.82 in statistics
+
+Total number of bot hits purged: 17786
+```
+
+## 2021-10-31
+
+- Update Docker containers for AReS on linode20 and run a fresh harvest
+- Found some strange IP (94.71.3.44) making 51,000 requests today with the user agent "Microsoft Internet Explorer"
+  - It is in Greece, and it seems to be requesting each item's XMLUI full metadata view, so I suspect it's Gardian actually
+  - I found it making another 25,000 requests yesterday...
+  - I purged them from Solr
+- Found 20,000 hits from Qualys (according to AbuseIPDB.com) using normal user agents... ugh, must be some ILRI ICT scan
+- Found more request from a Swedish IP (93.158.90.34) using that weird Firefox user agent that I noticed a few weeks ago:
+
+```
+Mozilla/5.0 (Macintosh; Intel Mac OS X 11.1; rv:84.0) Gecko/20100101 Firefox/84.0
+```
+
+- That's from ASN 12552 (IPO-EU, SE), which is operated by Internet Vikings, though AbuseIPDB.com says it's [Availo Networks AB](availo.se)
+- There's another IP (3.225.28.105) that made a few thousand requests to the REST API from Amazon, though it's using a normal user agent
+
+```console
+# zgrep 3.225.28.105 /var/log/nginx/rest.log.* | wc -l
+3991
+~# zgrep 3.225.28.105 /var/log/nginx/rest.log.* | grep -oE 'GET /rest/(collections|handle|items)' | sort | uniq -c
+   3154 GET /rest/collections
+    427 GET /rest/handle
+    410 GET /rest/items
+```
+
+- It requested the [CIAT Story Maps](https://cgspace.cgiar.org/handle/10568/75560) collection over 3,000 times last month...
+  - I will purge those hits
+
 <!-- vim: set sw=2 ts=2: -->
--- a/content/posts/2021-11.md
+++ b/content/posts/2021-11.md
@ -0,0 +1,12 @@
+---
+title: "November, 2021"
+date: 2021-11-01T11:14:07+03:00
+author: "Alan Orth"
+categories: ["Notes"]
+---
+
+## 2021-11-01
+
+<!--more-->
+
+<!-- vim: set sw=2 ts=2: -->
--- a/docs/2015-11/index.html
+++ b/docs/2015-11/index.html
@ -242,6 +242,8 @@ db.statementpool = true
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -250,8 +252,6 @@ db.statementpool = true

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2015-12/index.html
+++ b/docs/2015-12/index.html
@ -264,6 +264,8 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -272,8 +274,6 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2016-01/index.html
+++ b/docs/2016-01/index.html
@ -200,6 +200,8 @@ $ find SimpleArchiveForBio/ -iname &ldquo;*.pdf&rdquo; -exec basename {} ; | sor
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -208,8 +210,6 @@ $ find SimpleArchiveForBio/ -iname &ldquo;*.pdf&rdquo; -exec basename {} ; | sor

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2016-02/index.html
+++ b/docs/2016-02/index.html
@ -378,6 +378,8 @@ Bitstream: tést señora alimentación.pdf
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -386,8 +388,6 @@ Bitstream: tést señora alimentación.pdf

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2016-03/index.html
+++ b/docs/2016-03/index.html
@ -316,6 +316,8 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -324,8 +326,6 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2016-04/index.html
+++ b/docs/2016-04/index.html
@ -495,6 +495,8 @@ dspace.log.2016-04-27:7271
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -503,8 +505,6 @@ dspace.log.2016-04-27:7271

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2016-05/index.html
+++ b/docs/2016-05/index.html
@ -371,6 +371,8 @@ sys     0m20.540s
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -379,8 +381,6 @@ sys     0m20.540s

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2016-06/index.html
+++ b/docs/2016-06/index.html
@ -409,6 +409,8 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -417,8 +419,6 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2016-07/index.html
+++ b/docs/2016-07/index.html
@ -325,6 +325,8 @@ discovery.index.authority.ignore-variants=true
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -333,8 +335,6 @@ discovery.index.authority.ignore-variants=true

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2016-08/index.html
+++ b/docs/2016-08/index.html
@ -389,6 +389,8 @@ $ JAVA_OPTS=&quot;-Dfile.encoding=UTF-8 -Xmx512m&quot; /home/cgspace.cgiar.org/b
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -397,8 +399,6 @@ $ JAVA_OPTS=&quot;-Dfile.encoding=UTF-8 -Xmx512m&quot; /home/cgspace.cgiar.org/b

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2016-09/index.html
+++ b/docs/2016-09/index.html
@ -606,6 +606,8 @@ $ ./delete-metadata-values.py -i ilrisubjects-delete-13.csv -f cg.subject.ilri -
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -614,8 +616,6 @@ $ ./delete-metadata-values.py -i ilrisubjects-delete-13.csv -f cg.subject.ilri -

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2016-10/index.html
+++ b/docs/2016-10/index.html
@ -372,6 +372,8 @@ dspace=# update metadatavalue set text_value = regexp_replace(text_value, 'http:
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -380,8 +382,6 @@ dspace=# update metadatavalue set text_value = regexp_replace(text_value, 'http:

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2016-11/index.html
+++ b/docs/2016-11/index.html
@ -548,6 +548,8 @@ org.dspace.discovery.SearchServiceException: Error executing query
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -556,8 +558,6 @@ org.dspace.discovery.SearchServiceException: Error executing query

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2016-12/index.html
+++ b/docs/2016-12/index.html
@ -784,6 +784,8 @@ $ exit
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -792,8 +794,6 @@ $ exit

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2017-01/index.html
+++ b/docs/2017-01/index.html
@ -369,6 +369,8 @@ $ gs -sDEVICE=pdfwrite -dCompatibilityLevel=1.4 -dPDFSETTINGS=/ebook -dNOPAUSE -
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -377,8 +379,6 @@ $ gs -sDEVICE=pdfwrite -dCompatibilityLevel=1.4 -dPDFSETTINGS=/ebook -dNOPAUSE -

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2017-02/index.html
+++ b/docs/2017-02/index.html
@ -424,6 +424,8 @@ COPY 1968
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -432,8 +434,6 @@ COPY 1968

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2017-03/index.html
+++ b/docs/2017-03/index.html
@ -355,6 +355,8 @@ $ ./delete-metadata-values.py -i Investors-Delete-121.csv -f dc.description.spon
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -363,8 +365,6 @@ $ ./delete-metadata-values.py -i Investors-Delete-121.csv -f dc.description.spon

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2017-04/index.html
+++ b/docs/2017-04/index.html
@ -585,6 +585,8 @@ $ gem install compass -v 1.0.3
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -593,8 +595,6 @@ $ gem install compass -v 1.0.3

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2017-05/index.html
+++ b/docs/2017-05/index.html
@ -391,6 +391,8 @@ UPDATE 187
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -399,8 +401,6 @@ UPDATE 187

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2017-06/index.html
+++ b/docs/2017-06/index.html
@ -270,6 +270,8 @@ $ JAVA_OPTS=&quot;-Xmx1024m -Dfile.encoding=UTF-8&quot; [dspace]/bin/dspace impo
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -278,8 +280,6 @@ $ JAVA_OPTS=&quot;-Xmx1024m -Dfile.encoding=UTF-8&quot; [dspace]/bin/dspace impo

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2017-07/index.html
+++ b/docs/2017-07/index.html
@ -275,6 +275,8 @@ delete from metadatavalue where resource_type_id=2 and metadata_field_id=235 and
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -283,8 +285,6 @@ delete from metadatavalue where resource_type_id=2 and metadata_field_id=235 and

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2017-08/index.html
+++ b/docs/2017-08/index.html
@ -517,6 +517,8 @@ org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -525,8 +527,6 @@ org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2017-09/index.html
+++ b/docs/2017-09/index.html
@ -659,6 +659,8 @@ Cert Status: good
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -667,8 +669,6 @@ Cert Status: good

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2017-10/index.html
+++ b/docs/2017-10/index.html
@ -443,6 +443,8 @@ session_id=6C30F10B4351A4ED83EC6ED50AFD6B6A
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -451,8 +453,6 @@ session_id=6C30F10B4351A4ED83EC6ED50AFD6B6A

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2017-11/index.html
+++ b/docs/2017-11/index.html
@ -944,6 +944,8 @@ $ cat dspace.log.2017-11-28 | grep -o -E 'session_id=[A-Z0-9]{32}' | sort -n | u
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -952,8 +954,6 @@ $ cat dspace.log.2017-11-28 | grep -o -E 'session_id=[A-Z0-9]{32}' | sort -n | u

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2017-12/index.html
+++ b/docs/2017-12/index.html
@ -783,6 +783,8 @@ DELETE 20
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -791,8 +793,6 @@ DELETE 20

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2018-01/index.html
+++ b/docs/2018-01/index.html
@ -1452,6 +1452,8 @@ Catalina:type=Manager,context=/,host=localhost  activeSessions  8
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -1460,8 +1462,6 @@ Catalina:type=Manager,context=/,host=localhost  activeSessions  8

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2018-02/index.html
+++ b/docs/2018-02/index.html
@ -1039,6 +1039,8 @@ UPDATE 3
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -1047,8 +1049,6 @@ UPDATE 3

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2018-03/index.html
+++ b/docs/2018-03/index.html
@ -585,6 +585,8 @@ Fixed 5 occurences of: GENEBANKS
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -593,8 +595,6 @@ Fixed 5 occurences of: GENEBANKS

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2018-04/index.html
+++ b/docs/2018-04/index.html
@ -594,6 +594,8 @@ $ pg_restore -O -U dspacetest -d dspacetest -W -h localhost /tmp/dspace_2018-04-
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -602,8 +604,6 @@ $ pg_restore -O -U dspacetest -d dspacetest -W -h localhost /tmp/dspace_2018-04-

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2018-05/index.html
+++ b/docs/2018-05/index.html
@ -523,6 +523,8 @@ $ psql -h localhost -U postgres dspacetest
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -531,8 +533,6 @@ $ psql -h localhost -U postgres dspacetest

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2018-06/index.html
+++ b/docs/2018-06/index.html
@ -517,6 +517,8 @@ $ sed '/^id/d' 10568-*.csv | csvcut -c 1,2 &gt; map-to-cifor-archive.csv
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -525,8 +527,6 @@ $ sed '/^id/d' 10568-*.csv | csvcut -c 1,2 &gt; map-to-cifor-archive.csv

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2018-07/index.html
+++ b/docs/2018-07/index.html
@ -569,6 +569,8 @@ dspace=# select count(text_value) from metadatavalue where resource_type_id=2 an
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -577,8 +579,6 @@ dspace=# select count(text_value) from metadatavalue where resource_type_id=2 an

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2018-08/index.html
+++ b/docs/2018-08/index.html
@ -442,6 +442,8 @@ $ dspace database migrate ignored
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -450,8 +452,6 @@ $ dspace database migrate ignored

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2018-09/index.html
+++ b/docs/2018-09/index.html
@ -748,6 +748,8 @@ UPDATE metadatavalue SET text_value='ja' WHERE resource_type_id=2 AND metadata_f
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -756,8 +758,6 @@ UPDATE metadatavalue SET text_value='ja' WHERE resource_type_id=2 AND metadata_f

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2018-10/index.html
+++ b/docs/2018-10/index.html
@ -656,6 +656,8 @@ $ curl -X GET -H &quot;Content-Type: application/json&quot; -H &quot;Accept: app
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -664,8 +666,6 @@ $ curl -X GET -H &quot;Content-Type: application/json&quot; -H &quot;Accept: app

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2018-11/index.html
+++ b/docs/2018-11/index.html
@ -553,6 +553,8 @@ $ dspace dsrun org.dspace.eperson.Groomer -a -b 11/27/2016 -d
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -561,8 +563,6 @@ $ dspace dsrun org.dspace.eperson.Groomer -a -b 11/27/2016 -d

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2018-12/index.html
+++ b/docs/2018-12/index.html
@ -594,6 +594,8 @@ UPDATE 1
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -602,8 +604,6 @@ UPDATE 1

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2019-01/index.html
+++ b/docs/2019-01/index.html
@ -1264,6 +1264,8 @@ identify: CorruptImageProfile `xmp' @ warning/profile.c/SetImageProfileInternal/
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -1272,8 +1274,6 @@ identify: CorruptImageProfile `xmp' @ warning/profile.c/SetImageProfileInternal/

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2019-02/index.html
+++ b/docs/2019-02/index.html
@ -1344,6 +1344,8 @@ Please see the DSpace documentation for assistance.
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -1352,8 +1354,6 @@ Please see the DSpace documentation for assistance.

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2019-03/index.html
+++ b/docs/2019-03/index.html
@ -1208,6 +1208,8 @@ sys     0m2.551s
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -1216,8 +1218,6 @@ sys     0m2.551s

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2019-04/index.html
+++ b/docs/2019-04/index.html
@ -1299,6 +1299,8 @@ UPDATE 14
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -1307,8 +1309,6 @@ UPDATE 14

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2019-05/index.html
+++ b/docs/2019-05/index.html
@ -631,6 +631,8 @@ COPY 64871
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -639,8 +641,6 @@ COPY 64871

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2019-06/index.html
+++ b/docs/2019-06/index.html
@ -317,6 +317,8 @@ UPDATE 2
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -325,8 +327,6 @@ UPDATE 2

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2019-07/index.html
+++ b/docs/2019-07/index.html
@ -554,6 +554,8 @@ issn.validate('1020-3362')
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -562,8 +564,6 @@ issn.validate('1020-3362')

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2019-08/index.html
+++ b/docs/2019-08/index.html
@ -573,6 +573,8 @@ sys     2m27.496s
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -581,8 +583,6 @@ sys     2m27.496s

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2019-09/index.html
+++ b/docs/2019-09/index.html
@ -581,6 +581,8 @@ $ csv-metadata-quality -i /tmp/clarisa-institutions.csv -o /tmp/clarisa-institut
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -589,8 +591,6 @@ $ csv-metadata-quality -i /tmp/clarisa-institutions.csv -o /tmp/clarisa-institut

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2019-10/index.html
+++ b/docs/2019-10/index.html
@ -385,6 +385,8 @@ $ dspace import -a -c 10568/104057 -e fuu@cgiar.org -m 2019-10-15-Bioversity.map
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -393,8 +395,6 @@ $ dspace import -a -c 10568/104057 -e fuu@cgiar.org -m 2019-10-15-Bioversity.map

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2019-11/index.html
+++ b/docs/2019-11/index.html
@ -692,6 +692,8 @@ $ tidy -xml -utf8 -iq -m -w 0 dspace/config/controlled-vocabularies/cg-creator-i
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -700,8 +702,6 @@ $ tidy -xml -utf8 -iq -m -w 0 dspace/config/controlled-vocabularies/cg-creator-i

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2019-12/index.html
+++ b/docs/2019-12/index.html
@ -404,6 +404,8 @@ UPDATE 1
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -412,8 +414,6 @@ UPDATE 1

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2020-01/index.html
+++ b/docs/2020-01/index.html
@ -604,6 +604,8 @@ COPY 2900
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -612,8 +614,6 @@ COPY 2900

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2020-02/index.html
+++ b/docs/2020-02/index.html
@ -1275,6 +1275,8 @@ Moving: 21993 into core statistics-2019
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -1283,8 +1285,6 @@ Moving: 21993 into core statistics-2019

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2020-03/index.html
+++ b/docs/2020-03/index.html
@ -484,6 +484,8 @@ $ tidy -xml -utf8 -iq -m -w 0 dspace/config/controlled-vocabularies/cg-creator-i
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -492,8 +494,6 @@ $ tidy -xml -utf8 -iq -m -w 0 dspace/config/controlled-vocabularies/cg-creator-i

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2020-04/index.html
+++ b/docs/2020-04/index.html
@ -658,6 +658,8 @@ $ psql -c 'select * from pg_stat_activity' | wc -l
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -666,8 +668,6 @@ $ psql -c 'select * from pg_stat_activity' | wc -l

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2020-05/index.html
+++ b/docs/2020-05/index.html
@ -477,6 +477,8 @@ Caused by: java.lang.NullPointerException
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -485,8 +487,6 @@ Caused by: java.lang.NullPointerException

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2020-06/index.html
+++ b/docs/2020-06/index.html
@ -811,6 +811,8 @@ $ csvcut -c 'id,cg.subject.ilri[],cg.subject.ilri[en_US],dc.subject[en_US]' /tmp
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -819,8 +821,6 @@ $ csvcut -c 'id,cg.subject.ilri[],cg.subject.ilri[en_US],dc.subject[en_US]' /tmp

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2020-07/index.html
+++ b/docs/2020-07/index.html
@ -1142,6 +1142,8 @@ Fixed 4 occurences of: Muloi, D.M.
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -1150,8 +1152,6 @@ Fixed 4 occurences of: Muloi, D.M.

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2020-08/index.html
+++ b/docs/2020-08/index.html
@ -798,6 +798,8 @@ $ grep -c added /tmp/2020-08-27-countrycodetagger.log
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -806,8 +808,6 @@ $ grep -c added /tmp/2020-08-27-countrycodetagger.log

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2020-09/index.html
+++ b/docs/2020-09/index.html
@ -717,6 +717,8 @@ solr_query_params = {
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -725,8 +727,6 @@ solr_query_params = {

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2020-10/index.html
+++ b/docs/2020-10/index.html
@ -1241,6 +1241,8 @@ $ ./delete-metadata-values.py -i 2020-10-31-delete-74-sponsors.csv -db dspace -u
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -1249,8 +1251,6 @@ $ ./delete-metadata-values.py -i 2020-10-31-delete-74-sponsors.csv -db dspace -u

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2020-11/index.html
+++ b/docs/2020-11/index.html
@ -731,6 +731,8 @@ $ ./fix-metadata-values.py -i 2020-11-30-fix-hung-orcid.csv -db dspace63 -u dspa
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -739,8 +741,6 @@ $ ./fix-metadata-values.py -i 2020-11-30-fix-hung-orcid.csv -db dspace63 -u dspa

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2020-12/index.html
+++ b/docs/2020-12/index.html
@ -869,6 +869,8 @@ $ curl -XDELETE 'http://localhost:9200/openrxv-items-2020-12-29?pretty'
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -877,8 +879,6 @@ $ curl -XDELETE 'http://localhost:9200/openrxv-items-2020-12-29?pretty'

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2021-01/index.html
+++ b/docs/2021-01/index.html
@ -688,6 +688,8 @@ java.lang.IllegalArgumentException: Invalid character found in the request targe
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -696,8 +698,6 @@ java.lang.IllegalArgumentException: Invalid character found in the request targe

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2021-02/index.html
+++ b/docs/2021-02/index.html
@ -898,6 +898,8 @@ dspace.log.2021-02-28:0
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -906,8 +908,6 @@ dspace.log.2021-02-28:0

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2021-03/index.html
+++ b/docs/2021-03/index.html
@ -875,6 +875,8 @@ COPY 3081
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -883,8 +885,6 @@ COPY 3081

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2021-04/index.html
+++ b/docs/2021-04/index.html
@ -1042,6 +1042,8 @@ $ ./ilri/doi-to-handle.py -i /tmp/dois.txt -o /tmp/handles.csv -db dspace63 -u d
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -1050,8 +1052,6 @@ $ ./ilri/doi-to-handle.py -i /tmp/dois.txt -o /tmp/handles.csv -db dspace63 -u d

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2021-05/index.html
+++ b/docs/2021-05/index.html
@ -685,6 +685,8 @@ Please see the DSpace documentation for assistance.
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -693,8 +695,6 @@ Please see the DSpace documentation for assistance.

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2021-06/index.html
+++ b/docs/2021-06/index.html
@ -693,6 +693,8 @@ COPY 1710
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -701,8 +703,6 @@ COPY 1710

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2021-07/index.html
+++ b/docs/2021-07/index.html
@ -715,6 +715,8 @@ $ cat AS* /tmp/ddos-networks-to-block.txt | sed -e '/^$/d' -e '/^#/d' -e '/^{/d'
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -723,8 +725,6 @@ $ cat AS* /tmp/ddos-networks-to-block.txt | sed -e '/^$/d' -e '/^#/d' -e '/^{/d'

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2021-08/index.html
+++ b/docs/2021-08/index.html
@ -606,6 +606,8 @@ $ ./ilri/add-orcid-identifiers-csv.py -i 2021-08-25-add-orcids.csv -db dspace -u
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -614,8 +616,6 @@ $ ./ilri/add-orcid-identifiers-csv.py -i 2021-08-25-add-orcids.csv -db dspace -u

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2021-09/index.html
+++ b/docs/2021-09/index.html
@ -588,6 +588,8 @@ $ csvcut -c subject,'match type' /tmp/2021-09-29-ilri-subjects.csv | sed -e 's/m
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -596,8 +598,6 @@ $ csvcut -c subject,'match type' /tmp/2021-09-29-ilri-subjects.csv | sed -e 's/m

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2021-10/index.html
+++ b/docs/2021-10/index.html
@ -25,7 +25,7 @@ So we have 1879/7100 (26.46%) matching already
 <meta property="og:type" content="article" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2021-10/" />
 <meta property="article:published_time" content="2021-10-01T11:14:07+03:00" />
-<meta property="article:modified_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="article:modified_time" content="2021-11-01T10:48:13+02:00" />



@ -56,9 +56,9 @@ So we have 1879/7100 (26.46%) matching already
  "@type": "BlogPosting",
  "headline": "October, 2021",
  "url": "https://alanorth.github.io/cgspace-notes/2021-10/",
-  "wordCount": "3747",
+  "wordCount": "4224",
  "datePublished": "2021-10-01T11:14:07+03:00",
-  "dateModified": "2021-10-24T21:21:01+03:00",
+  "dateModified": "2021-11-01T10:48:13+02:00",
  "author": {
    "@type": "Person",
    "name": "Alan Orth"
@ -694,6 +694,82 @@ $ wc -l /tmp/ips-to-purge.txt
 </ul>
 </li>
 </ul>
+<h2 id="2021-10-28">2021-10-28</h2>
+<ul>
+<li>Meeting with Medha and a bunch of others about the FAIRscribe tool they have been developing
+<ul>
+<li>Seems it is a submission tool like MEL</li>
+</ul>
+</li>
+</ul>
+<h2 id="2021-10-29">2021-10-29</h2>
+<ul>
+<li>Linode alerted me that CGSpace (linode18) has high outbound traffic for the last two hours
+<ul>
+<li>This has happened a few other times this week so I decided to go look at the Solr stats for today</li>
+<li>I see 93.158.91.62 is making thousands of requests to Discover with a normal user agent:</li>
+</ul>
+</li>
+</ul>
+<pre tabindex="0"><code>Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.81 Safari/537.36
+</code></pre><ul>
+<li>Even more annoying, they are not re-using their session ID:</li>
+</ul>
+<pre tabindex="0"><code class="language-console" data-lang="console">$ grep 93.158.91.62 log/dspace.log.2021-10-29 | grep -oE 'session_id=[A-Z0-9]{32}:ip_addr=' | sort | uniq | wc -l
+4888
+</code></pre><ul>
+<li>This IP has made 36,000 requests to CGSpace&hellip;</li>
+<li>The IP is owned by <a href="internetvikings.com">Internet Vikings</a> in Sweden</li>
+<li>I purged their statistics and set up a temporary HTTP 403 telling them to use a real user agent</li>
+<li>I see another one in Sweden a few days ago (192.36.109.131), also using the same exact user agent as above, but belonging to <a href="http://webb.resilans.se/">Resilans AB</a>
+<ul>
+<li>I purged another 74,619 hits from this bot</li>
+</ul>
+</li>
+<li>I added these two IPs to the nginx IP bot identifier</li>
+<li>Jesus I found a few Russian IPs attempting SQL injection and path traversal, ie:</li>
+</ul>
+<pre tabindex="0"><code>45.9.20.71 - - [20/Oct/2021:02:31:15 +0200] &quot;GET /bitstream/handle/10568/1820/Rhodesgrass.pdf?sequence=4&amp;OoxD=6591%20AND%201%3D1%20UNION%20ALL%20SELECT%201%2CNULL%2C%27%3Cscript%3Ealert%28%22XSS%22%29%3C%2Fscript%3E%27%2Ctable_name%20FROM%20information_schema.tables%20WHERE%202%3E1--%2F%2A%2A%2F%3B%20EXEC%20xp_cmdshell%28%27cat%20..%2F..%2F..%2Fetc%2Fpasswd%27%29%23 HTTP/1.1&quot; 200 143070 &quot;https://cgspace.cgiar.org:443/bitstream/handle/10568/1820/Rhodesgrass.pdf&quot; &quot;Mozilla/5.0 (X11; U; Linux i686; es-AR; rv:1.8.1.11) Gecko/20071204 Ubuntu/7.10 (gutsy) Firefox/2.0.0.11&quot;
+</code></pre><ul>
+<li>I reported them to AbuseIPDB.com and purged their hits:</li>
+</ul>
+<pre tabindex="0"><code class="language-console" data-lang="console">$ ./ilri/check-spider-ip-hits.sh -f /tmp/ip.txt -p
+Purging 6364 hits from 45.9.20.71 in statistics
+Purging 8039 hits from 45.146.166.157 in statistics
+Purging 3383 hits from 45.155.204.82 in statistics
+
+Total number of bot hits purged: 17786
+</code></pre><h2 id="2021-10-31">2021-10-31</h2>
+<ul>
+<li>Update Docker containers for AReS on linode20 and run a fresh harvest</li>
+<li>Found some strange IP (94.71.3.44) making 51,000 requests today with the user agent &ldquo;Microsoft Internet Explorer&rdquo;
+<ul>
+<li>It is in Greece, and it seems to be requesting each item&rsquo;s XMLUI full metadata view, so I suspect it&rsquo;s Gardian actually</li>
+<li>I found it making another 25,000 requests yesterday&hellip;</li>
+<li>I purged them from Solr</li>
+</ul>
+</li>
+<li>Found 20,000 hits from Qualys (according to AbuseIPDB.com) using normal user agents&hellip; ugh, must be some ILRI ICT scan</li>
+<li>Found more request from a Swedish IP (93.158.90.34) using that weird Firefox user agent that I noticed a few weeks ago:</li>
+</ul>
+<pre tabindex="0"><code>Mozilla/5.0 (Macintosh; Intel Mac OS X 11.1; rv:84.0) Gecko/20100101 Firefox/84.0
+</code></pre><ul>
+<li>That&rsquo;s from ASN 12552 (IPO-EU, SE), which is operated by Internet Vikings, though AbuseIPDB.com says it&rsquo;s <a href="availo.se">Availo Networks AB</a></li>
+<li>There&rsquo;s another IP (3.225.28.105) that made a few thousand requests to the REST API from Amazon, though it&rsquo;s using a normal user agent</li>
+</ul>
+<pre tabindex="0"><code class="language-console" data-lang="console"># zgrep 3.225.28.105 /var/log/nginx/rest.log.* | wc -l
+3991
+~# zgrep 3.225.28.105 /var/log/nginx/rest.log.* | grep -oE 'GET /rest/(collections|handle|items)' | sort | uniq -c
+   3154 GET /rest/collections
+    427 GET /rest/handle
+    410 GET /rest/items
+</code></pre><ul>
+<li>It requested the <a href="https://cgspace.cgiar.org/handle/10568/75560">CIAT Story Maps</a> collection over 3,000 times last month&hellip;
+<ul>
+<li>I will purge those hits</li>
+</ul>
+</li>
+</ul>
 <!-- raw HTML omitted -->

  
@ -715,6 +791,8 @@ $ wc -l /tmp/ips-to-purge.txt
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -723,8 +801,6 @@ $ wc -l /tmp/ips-to-purge.txt

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/2021-11/index.html
+++ b/docs/2021-11/index.html
@ -0,0 +1,180 @@
+<!DOCTYPE html>
+<html lang="en" >
+
+  <head>
+    <meta charset="utf-8">
+<meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">
+
+
+<meta property="og:title" content="November, 2021" />
+<meta property="og:description" content="2021-11-01" />
+<meta property="og:type" content="article" />
+<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2021-11/" />
+<meta property="article:published_time" content="2021-11-01T11:14:07+03:00" />
+<meta property="article:modified_time" content="2021-11-01T11:14:07+03:00" />
+
+
+
+<meta name="twitter:card" content="summary"/>
+<meta name="twitter:title" content="November, 2021"/>
+<meta name="twitter:description" content="2021-11-01"/>
+<meta name="generator" content="Hugo 0.88.1" />
+
+
+    
+<script type="application/ld+json">
+{
+  "@context": "http://schema.org",
+  "@type": "BlogPosting",
+  "headline": "November, 2021",
+  "url": "https://alanorth.github.io/cgspace-notes/2021-11/",
+  "wordCount": "1",
+  "datePublished": "2021-11-01T11:14:07+03:00",
+  "dateModified": "2021-11-01T11:14:07+03:00",
+  "author": {
+    "@type": "Person",
+    "name": "Alan Orth"
+  },
+  "keywords": "Notes"
+}
+</script>
+
+
+
+    <link rel="canonical" href="https://alanorth.github.io/cgspace-notes/2021-11/">
+
+    <title>November, 2021 | CGSpace Notes</title>
+
+    
+    <!-- combined, minified CSS -->
+    
+    <link href="https://alanorth.github.io/cgspace-notes/css/style.beb8012edc08ba10be012f079d618dc243812267efe62e11f22fe49618f976a4.css" rel="stylesheet" integrity="sha256-vrgBLtwIuhC&#43;AS8HnWGNwkOBImfv5i4R8i/klhj5dqQ=" crossorigin="anonymous">
+    
+
+    <!-- minified Font Awesome for SVG icons -->
+    
+    <script defer src="https://alanorth.github.io/cgspace-notes/js/fontawesome.min.f5072c55a0721857184db93a50561d7dc13975b4de2e19db7f81eb5f3fa57270.js" integrity="sha256-9QcsVaByGFcYTbk6UFYdfcE5dbTeLhnbf4HrXz&#43;lcnA=" crossorigin="anonymous"></script>
+
+    <!-- RSS 2.0 feed -->
+    
+
+    
+
+  </head>
+
+  <body>
+
+    
+    <div class="blog-masthead">
+      <div class="container">
+        <nav class="nav blog-nav">
+          <a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
+        </nav>
+      </div>
+    </div>
+    
+
+    
+    
+    <header class="blog-header">
+      <div class="container">
+        <h1 class="blog-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/" rel="home">CGSpace Notes</a></h1>
+        <p class="lead blog-description" dir="auto">Documenting day-to-day work on the <a href="https://cgspace.cgiar.org">CGSpace</a> repository.</p>
+      </div>
+    </header>
+    
+    
+
+    
+    <div class="container">
+      <div class="row">
+        <div class="col-sm-8 blog-main">
+
+          
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-11/">November, 2021</a></h2>
+    <p class="blog-post-meta">
+<time datetime="2021-11-01T11:14:07+03:00">Mon Nov 01, 2021</time>
+ in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2021-11-01">2021-11-01</h2>
+<!-- raw HTML omitted -->
+
+  
+
+  
+
+</article> 
+
+
+
+        </div> <!-- /.blog-main -->
+
+        <aside class="col-sm-3 ml-auto blog-sidebar">
+  
+
+  
+        <section class="sidebar-module">
+    <h4>Recent Posts</h4>
+    <ol class="list-unstyled">
+
+
+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
+<li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>
+
+<li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
+
+<li><a href="/cgspace-notes/2021-08/">August, 2021</a></li>
+
+<li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>
+
+    </ol>
+  </section>
+
+  
+
+  
+  <section class="sidebar-module">
+    <h4>Links</h4>
+    <ol class="list-unstyled">
+      
+      <li><a href="https://cgspace.cgiar.org">CGSpace</a></li>
+      
+      <li><a href="https://dspacetest.cgiar.org">DSpace Test</a></li>
+      
+      <li><a href="https://github.com/ilri/DSpace">CGSpace @ GitHub</a></li>
+      
+    </ol>
+  </section>
+  
+</aside>
+
+
+      </div> <!-- /.row -->
+    </div> <!-- /.container -->
+    
+
+    
+    <footer class="blog-footer">
+      <p dir="auto">
+      
+      Blog template created by <a href="https://twitter.com/mdo">@mdo</a>, ported to Hugo by <a href='https://twitter.com/mralanorth'>@mralanorth</a>.
+      
+      </p>
+      <p>
+      <a href="#">Back to top</a>
+      </p>
+    </footer>
+    
+
+  </body>
+
+</html>
--- a/docs/404.html
+++ b/docs/404.html
@ -95,6 +95,8 @@
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -103,8 +105,6 @@

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/categories/index.html
+++ b/docs/categories/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -84,7 +84,7 @@
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/categories/notes/">Notes</a></h2>
-    <p class="blog-post-meta"><time datetime="2021-10-01T11:14:07+03:00">Fri Oct 01, 2021</time> by Alan Orth</p>
+    <p class="blog-post-meta"><time datetime="2021-11-01T11:14:07+03:00">Mon Nov 01, 2021</time> by Alan Orth</p>
  </header>
  
  <a href='https://alanorth.github.io/cgspace-notes/categories/notes/'>Read more →</a>
@ -108,6 +108,8 @@
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -116,8 +118,6 @@

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/categories/index.xml
+++ b/docs/categories/index.xml
@ -6,11 +6,11 @@
    <description>Recent content in Categories on CGSpace Notes</description>
    <generator>Hugo -- gohugo.io</generator>
    <language>en-us</language>
-    <lastBuildDate>Fri, 01 Oct 2021 11:14:07 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/categories/index.xml" rel="self" type="application/rss+xml" />
+    <lastBuildDate>Mon, 01 Nov 2021 11:14:07 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/categories/index.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>Notes</title>
      <link>https://alanorth.github.io/cgspace-notes/categories/notes/</link>
-      <pubDate>Fri, 01 Oct 2021 11:14:07 +0300</pubDate>
+      <pubDate>Mon, 01 Nov 2021 11:14:07 +0300</pubDate>
      
      <guid>https://alanorth.github.io/cgspace-notes/categories/notes/</guid>
      <description></description>
--- a/docs/categories/notes/index.html
+++ b/docs/categories/notes/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -81,6 +81,24 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-11/">November, 2021</a></h2>
+    <p class="blog-post-meta"><time datetime="2021-11-01T11:14:07+03:00">Mon Nov 01, 2021</time> by Alan Orth in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2021-11-01">2021-11-01</h2>
+  <a href='https://alanorth.github.io/cgspace-notes/2021-11/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-10/">October, 2021</a></h2>
@ -326,45 +344,6 @@ COPY 20994



-
-<article class="blog-post">
-  <header>
-    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-02/">February, 2021</a></h2>
-    <p class="blog-post-meta"><time datetime="2021-02-01T10:13:54+02:00">Mon Feb 01, 2021</time> by Alan Orth in 
-<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
-
-
-</p>
-  </header>
-  <h2 id="2021-02-01">2021-02-01</h2>
-<ul>
-<li>Abenet said that CIP found more duplicate records in their export from AReS
-<ul>
-<li>I re-opened <a href="https://github.com/ilri/OpenRXV/issues/67">the issue</a> on OpenRXV where we had previously noticed this</li>
-<li>The shared link where the duplicates are is here: <a href="https://cgspace.cgiar.org/explorer/shared/heEOz3YBnXdK69bR2ra6">https://cgspace.cgiar.org/explorer/shared/heEOz3YBnXdK69bR2ra6</a></li>
-</ul>
-</li>
-<li>I had a call with CodeObia to discuss the work on OpenRXV</li>
-<li>Check the results of the AReS harvesting from last night:</li>
-</ul>
-<pre tabindex="0"><code class="language-console" data-lang="console">$ curl -s 'http://localhost:9200/openrxv-items-temp/_count?q=*&amp;pretty'
-{
-  &quot;count&quot; : 100875,
-  &quot;_shards&quot; : {
-    &quot;total&quot; : 1,
-    &quot;successful&quot; : 1,
-    &quot;skipped&quot; : 0,
-    &quot;failed&quot; : 0
-  }
-}
-</code></pre>
-  <a href='https://alanorth.github.io/cgspace-notes/2021-02/'>Read more →</a>
-</article> 
-
-
-
-
-
 <nav class="blog-pagination">
  
  
@ -389,6 +368,8 @@ COPY 20994
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -397,8 +378,6 @@ COPY 20994

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/categories/notes/index.xml
+++ b/docs/categories/notes/index.xml
@ -6,7 +6,16 @@
    <description>Recent content in Notes on CGSpace Notes</description>
    <generator>Hugo -- gohugo.io</generator>
    <language>en-us</language>
-    <lastBuildDate>Fri, 01 Oct 2021 11:14:07 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/categories/notes/index.xml" rel="self" type="application/rss+xml" />
+    <lastBuildDate>Mon, 01 Nov 2021 11:14:07 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/categories/notes/index.xml" rel="self" type="application/rss+xml" />
+    <item>
+      <title>November, 2021</title>
+      <link>https://alanorth.github.io/cgspace-notes/2021-11/</link>
+      <pubDate>Mon, 01 Nov 2021 11:14:07 +0300</pubDate>
+      
+      <guid>https://alanorth.github.io/cgspace-notes/2021-11/</guid>
+      <description>&lt;h2 id=&#34;2021-11-01&#34;&gt;2021-11-01&lt;/h2&gt;</description>
+    </item>
+    
    <item>
      <title>October, 2021</title>
      <link>https://alanorth.github.io/cgspace-notes/2021-10/</link>
--- a/docs/categories/notes/page/2/index.html
+++ b/docs/categories/notes/page/2/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -81,6 +81,45 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-02/">February, 2021</a></h2>
+    <p class="blog-post-meta"><time datetime="2021-02-01T10:13:54+02:00">Mon Feb 01, 2021</time> by Alan Orth in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2021-02-01">2021-02-01</h2>
+<ul>
+<li>Abenet said that CIP found more duplicate records in their export from AReS
+<ul>
+<li>I re-opened <a href="https://github.com/ilri/OpenRXV/issues/67">the issue</a> on OpenRXV where we had previously noticed this</li>
+<li>The shared link where the duplicates are is here: <a href="https://cgspace.cgiar.org/explorer/shared/heEOz3YBnXdK69bR2ra6">https://cgspace.cgiar.org/explorer/shared/heEOz3YBnXdK69bR2ra6</a></li>
+</ul>
+</li>
+<li>I had a call with CodeObia to discuss the work on OpenRXV</li>
+<li>Check the results of the AReS harvesting from last night:</li>
+</ul>
+<pre tabindex="0"><code class="language-console" data-lang="console">$ curl -s 'http://localhost:9200/openrxv-items-temp/_count?q=*&amp;pretty'
+{
+  &quot;count&quot; : 100875,
+  &quot;_shards&quot; : {
+    &quot;total&quot; : 1,
+    &quot;successful&quot; : 1,
+    &quot;skipped&quot; : 0,
+    &quot;failed&quot; : 0
+  }
+}
+</code></pre>
+  <a href='https://alanorth.github.io/cgspace-notes/2021-02/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-01/">January, 2021</a></h2>
@ -332,32 +371,6 @@



-
-<article class="blog-post">
-  <header>
-    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-05/">May, 2020</a></h2>
-    <p class="blog-post-meta"><time datetime="2020-05-02T09:52:04+03:00">Sat May 02, 2020</time> by Alan Orth in 
-<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
-
-
-</p>
-  </header>
-  <h2 id="2020-05-02">2020-05-02</h2>
-<ul>
-<li>Peter said that CTA is having problems submitting an item to CGSpace
-<ul>
-<li>Looking at the PostgreSQL stats it seems to be the same issue that Tezira was having last week, as I see the number of connections in &lsquo;idle in transaction&rsquo; and &lsquo;waiting for lock&rsquo; state are increasing again</li>
-<li>I see that CGSpace (linode18) is still using PostgreSQL JDBC driver version 42.2.11, and there were some bugs related to transactions fixed in 42.2.12 (which I had updated in the Ansible playbooks, but not deployed yet)</li>
-</ul>
-</li>
-</ul>
-  <a href='https://alanorth.github.io/cgspace-notes/2020-05/'>Read more →</a>
-</article> 
-
-
-
-
-
 <nav class="blog-pagination">
  
  <a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/" rel="prev" role="button">Previous page</a>
@ -382,6 +395,8 @@
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -390,8 +405,6 @@

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/categories/notes/page/3/index.html
+++ b/docs/categories/notes/page/3/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -81,6 +81,32 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-05/">May, 2020</a></h2>
+    <p class="blog-post-meta"><time datetime="2020-05-02T09:52:04+03:00">Sat May 02, 2020</time> by Alan Orth in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2020-05-02">2020-05-02</h2>
+<ul>
+<li>Peter said that CTA is having problems submitting an item to CGSpace
+<ul>
+<li>Looking at the PostgreSQL stats it seems to be the same issue that Tezira was having last week, as I see the number of connections in &lsquo;idle in transaction&rsquo; and &lsquo;waiting for lock&rsquo; state are increasing again</li>
+<li>I see that CGSpace (linode18) is still using PostgreSQL JDBC driver version 42.2.11, and there were some bugs related to transactions fixed in 42.2.12 (which I had updated in the Ansible playbooks, but not deployed yet)</li>
+</ul>
+</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2020-05/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-04/">April, 2020</a></h2>
@ -373,34 +399,6 @@



-
-<article class="blog-post">
-  <header>
-    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-07/">July, 2019</a></h2>
-    <p class="blog-post-meta"><time datetime="2019-07-01T12:13:51+03:00">Mon Jul 01, 2019</time> by Alan Orth in 
-<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
-
-
-</p>
-  </header>
-  <h2 id="2019-07-01">2019-07-01</h2>
-<ul>
-<li>Create an &ldquo;AfricaRice books and book chapters&rdquo; collection on CGSpace for AfricaRice</li>
-<li>Last month Sisay asked why the following &ldquo;most popular&rdquo; statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
-<ul>
-<li><a href="https://dspacetest.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&amp;time_filter_end_date=01%2F12%2F2018">DSpace Test</a></li>
-<li><a href="https://cgspace.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&amp;time_filter_end_date=01%2F12%2F2018">CGSpace</a></li>
-</ul>
-</li>
-<li>Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community</li>
-</ul>
-  <a href='https://alanorth.github.io/cgspace-notes/2019-07/'>Read more →</a>
-</article> 
-
-
-
-
-
 <nav class="blog-pagination">
  
  <a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/page/2/" rel="prev" role="button">Previous page</a>
@ -425,6 +423,8 @@
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -433,8 +433,6 @@

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/categories/notes/page/4/index.html
+++ b/docs/categories/notes/page/4/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -81,6 +81,34 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-07/">July, 2019</a></h2>
+    <p class="blog-post-meta"><time datetime="2019-07-01T12:13:51+03:00">Mon Jul 01, 2019</time> by Alan Orth in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2019-07-01">2019-07-01</h2>
+<ul>
+<li>Create an &ldquo;AfricaRice books and book chapters&rdquo; collection on CGSpace for AfricaRice</li>
+<li>Last month Sisay asked why the following &ldquo;most popular&rdquo; statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
+<ul>
+<li><a href="https://dspacetest.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&amp;time_filter_end_date=01%2F12%2F2018">DSpace Test</a></li>
+<li><a href="https://cgspace.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&amp;time_filter_end_date=01%2F12%2F2018">CGSpace</a></li>
+</ul>
+</li>
+<li>Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2019-07/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-06/">June, 2019</a></h2>
@ -367,30 +395,6 @@ sys     0m1.979s



-
-<article class="blog-post">
-  <header>
-    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-09/">September, 2018</a></h2>
-    <p class="blog-post-meta"><time datetime="2018-09-02T09:55:54+03:00">Sun Sep 02, 2018</time> by Alan Orth in 
-<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
-
-
-</p>
-  </header>
-  <h2 id="2018-09-02">2018-09-02</h2>
-<ul>
-<li>New <a href="https://jdbc.postgresql.org/documentation/changelog.html#version_42.2.5">PostgreSQL JDBC driver version 42.2.5</a></li>
-<li>I&rsquo;ll update the DSpace role in our <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure playbooks</a> and run the updated playbooks on CGSpace and DSpace Test</li>
-<li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
-<li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li>
-</ul>
-  <a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
-</article> 
-
-
-
-
-
 <nav class="blog-pagination">
  
  <a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/page/3/" rel="prev" role="button">Previous page</a>
@ -415,6 +419,8 @@ sys     0m1.979s
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -423,8 +429,6 @@ sys     0m1.979s

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/categories/notes/page/5/index.html
+++ b/docs/categories/notes/page/5/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -81,6 +81,30 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-09/">September, 2018</a></h2>
+    <p class="blog-post-meta"><time datetime="2018-09-02T09:55:54+03:00">Sun Sep 02, 2018</time> by Alan Orth in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2018-09-02">2018-09-02</h2>
+<ul>
+<li>New <a href="https://jdbc.postgresql.org/documentation/changelog.html#version_42.2.5">PostgreSQL JDBC driver version 42.2.5</a></li>
+<li>I&rsquo;ll update the DSpace role in our <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure playbooks</a> and run the updated playbooks on CGSpace and DSpace Test</li>
+<li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
+<li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-08/">August, 2018</a></h2>
@ -380,39 +404,6 @@ dspace.log.2018-01-02:34



-
-<article class="blog-post">
-  <header>
-    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-11/">November, 2017</a></h2>
-    <p class="blog-post-meta"><time datetime="2017-11-02T09:37:54+02:00">Thu Nov 02, 2017</time> by Alan Orth in 
-<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
-
-
-</p>
-  </header>
-  <h2 id="2017-11-01">2017-11-01</h2>
-<ul>
-<li>The CORE developers responded to say they are looking into their bot not respecting our robots.txt</li>
-</ul>
-<h2 id="2017-11-02">2017-11-02</h2>
-<ul>
-<li>Today there have been no hits by CORE and no alerts from Linode (coincidence?)</li>
-</ul>
-<pre tabindex="0"><code># grep -c &quot;CORE&quot; /var/log/nginx/access.log
-0
-</code></pre><ul>
-<li>Generate list of authors on CGSpace for Peter to go through and correct:</li>
-</ul>
-<pre tabindex="0"><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
-COPY 54701
-</code></pre>
-  <a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
-</article> 
-
-
-
-
-
 <nav class="blog-pagination">
  
  <a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/page/4/" rel="prev" role="button">Previous page</a>
@ -437,6 +428,8 @@ COPY 54701
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -445,8 +438,6 @@ COPY 54701

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/categories/notes/page/6/index.html
+++ b/docs/categories/notes/page/6/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -81,6 +81,39 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-11/">November, 2017</a></h2>
+    <p class="blog-post-meta"><time datetime="2017-11-02T09:37:54+02:00">Thu Nov 02, 2017</time> by Alan Orth in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2017-11-01">2017-11-01</h2>
+<ul>
+<li>The CORE developers responded to say they are looking into their bot not respecting our robots.txt</li>
+</ul>
+<h2 id="2017-11-02">2017-11-02</h2>
+<ul>
+<li>Today there have been no hits by CORE and no alerts from Linode (coincidence?)</li>
+</ul>
+<pre tabindex="0"><code># grep -c &quot;CORE&quot; /var/log/nginx/access.log
+0
+</code></pre><ul>
+<li>Generate list of authors on CGSpace for Peter to go through and correct:</li>
+</ul>
+<pre tabindex="0"><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
+COPY 54701
+</code></pre>
+  <a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-10/">October, 2017</a></h2>
@ -150,6 +183,8 @@
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -158,8 +193,6 @@

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/cgiar-library-migration/index.html
+++ b/docs/cgiar-library-migration/index.html
@ -282,6 +282,8 @@ dspace=# select setval('handle_seq',86873);
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -290,8 +292,6 @@ dspace=# select setval('handle_seq',86873);

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/cgspace-cgcorev2-migration/index.html
+++ b/docs/cgspace-cgcorev2-migration/index.html
@ -467,6 +467,8 @@
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -475,8 +477,6 @@

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/cgspace-dspace6-upgrade/index.html
+++ b/docs/cgspace-dspace6-upgrade/index.html
@ -471,6 +471,8 @@ $ chrt -b 0 dspace solr-upgrade-statistics-6x -n 2500000 -i statistics-2018
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -479,8 +481,6 @@ $ chrt -b 0 dspace solr-upgrade-statistics-6x -n 2500000 -i statistics-2018

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/index.html
+++ b/docs/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-10-01T11:14:07+03:00",
+  "dateModified": "2021-11-01T11:14:07+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,24 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-11/">November, 2021</a></h2>
+    <p class="blog-post-meta"><time datetime="2021-11-01T11:14:07+03:00">Mon Nov 01, 2021</time> by Alan Orth in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2021-11-01">2021-11-01</h2>
+  <a href='https://alanorth.github.io/cgspace-notes/2021-11/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-10/">October, 2021</a></h2>
@ -341,45 +359,6 @@ COPY 20994



-
-<article class="blog-post">
-  <header>
-    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-02/">February, 2021</a></h2>
-    <p class="blog-post-meta"><time datetime="2021-02-01T10:13:54+02:00">Mon Feb 01, 2021</time> by Alan Orth in 
-<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
-
-
-</p>
-  </header>
-  <h2 id="2021-02-01">2021-02-01</h2>
-<ul>
-<li>Abenet said that CIP found more duplicate records in their export from AReS
-<ul>
-<li>I re-opened <a href="https://github.com/ilri/OpenRXV/issues/67">the issue</a> on OpenRXV where we had previously noticed this</li>
-<li>The shared link where the duplicates are is here: <a href="https://cgspace.cgiar.org/explorer/shared/heEOz3YBnXdK69bR2ra6">https://cgspace.cgiar.org/explorer/shared/heEOz3YBnXdK69bR2ra6</a></li>
-</ul>
-</li>
-<li>I had a call with CodeObia to discuss the work on OpenRXV</li>
-<li>Check the results of the AReS harvesting from last night:</li>
-</ul>
-<pre tabindex="0"><code class="language-console" data-lang="console">$ curl -s 'http://localhost:9200/openrxv-items-temp/_count?q=*&amp;pretty'
-{
-  &quot;count&quot; : 100875,
-  &quot;_shards&quot; : {
-    &quot;total&quot; : 1,
-    &quot;successful&quot; : 1,
-    &quot;skipped&quot; : 0,
-    &quot;failed&quot; : 0
-  }
-}
-</code></pre>
-  <a href='https://alanorth.github.io/cgspace-notes/2021-02/'>Read more →</a>
-</article> 
-
-
-
-
-
 <nav class="blog-pagination">
  
  
@ -404,6 +383,8 @@ COPY 20994
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -412,8 +393,6 @@ COPY 20994

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/index.xml
+++ b/docs/index.xml
@ -6,7 +6,16 @@
    <description>Recent content on CGSpace Notes</description>
    <generator>Hugo -- gohugo.io</generator>
    <language>en-us</language>
-    <lastBuildDate>Fri, 01 Oct 2021 11:14:07 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/index.xml" rel="self" type="application/rss+xml" />
+    <lastBuildDate>Mon, 01 Nov 2021 11:14:07 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/index.xml" rel="self" type="application/rss+xml" />
+    <item>
+      <title>November, 2021</title>
+      <link>https://alanorth.github.io/cgspace-notes/2021-11/</link>
+      <pubDate>Mon, 01 Nov 2021 11:14:07 +0300</pubDate>
+      
+      <guid>https://alanorth.github.io/cgspace-notes/2021-11/</guid>
+      <description>&lt;h2 id=&#34;2021-11-01&#34;&gt;2021-11-01&lt;/h2&gt;</description>
+    </item>
+    
    <item>
      <title>October, 2021</title>
      <link>https://alanorth.github.io/cgspace-notes/2021-10/</link>
--- a/docs/page/2/index.html
+++ b/docs/page/2/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-10-01T11:14:07+03:00",
+  "dateModified": "2021-11-01T11:14:07+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,45 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-02/">February, 2021</a></h2>
+    <p class="blog-post-meta"><time datetime="2021-02-01T10:13:54+02:00">Mon Feb 01, 2021</time> by Alan Orth in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2021-02-01">2021-02-01</h2>
+<ul>
+<li>Abenet said that CIP found more duplicate records in their export from AReS
+<ul>
+<li>I re-opened <a href="https://github.com/ilri/OpenRXV/issues/67">the issue</a> on OpenRXV where we had previously noticed this</li>
+<li>The shared link where the duplicates are is here: <a href="https://cgspace.cgiar.org/explorer/shared/heEOz3YBnXdK69bR2ra6">https://cgspace.cgiar.org/explorer/shared/heEOz3YBnXdK69bR2ra6</a></li>
+</ul>
+</li>
+<li>I had a call with CodeObia to discuss the work on OpenRXV</li>
+<li>Check the results of the AReS harvesting from last night:</li>
+</ul>
+<pre tabindex="0"><code class="language-console" data-lang="console">$ curl -s 'http://localhost:9200/openrxv-items-temp/_count?q=*&amp;pretty'
+{
+  &quot;count&quot; : 100875,
+  &quot;_shards&quot; : {
+    &quot;total&quot; : 1,
+    &quot;successful&quot; : 1,
+    &quot;skipped&quot; : 0,
+    &quot;failed&quot; : 0
+  }
+}
+</code></pre>
+  <a href='https://alanorth.github.io/cgspace-notes/2021-02/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-01/">January, 2021</a></h2>
@ -347,32 +386,6 @@



-
-<article class="blog-post">
-  <header>
-    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-05/">May, 2020</a></h2>
-    <p class="blog-post-meta"><time datetime="2020-05-02T09:52:04+03:00">Sat May 02, 2020</time> by Alan Orth in 
-<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
-
-
-</p>
-  </header>
-  <h2 id="2020-05-02">2020-05-02</h2>
-<ul>
-<li>Peter said that CTA is having problems submitting an item to CGSpace
-<ul>
-<li>Looking at the PostgreSQL stats it seems to be the same issue that Tezira was having last week, as I see the number of connections in &lsquo;idle in transaction&rsquo; and &lsquo;waiting for lock&rsquo; state are increasing again</li>
-<li>I see that CGSpace (linode18) is still using PostgreSQL JDBC driver version 42.2.11, and there were some bugs related to transactions fixed in 42.2.12 (which I had updated in the Ansible playbooks, but not deployed yet)</li>
-</ul>
-</li>
-</ul>
-  <a href='https://alanorth.github.io/cgspace-notes/2020-05/'>Read more →</a>
-</article> 
-
-
-
-
-
 <nav class="blog-pagination">
  
  <a class="btn btn-outline-primary" href="/cgspace-notes/" rel="prev" role="button">Previous page</a>
@ -397,6 +410,8 @@
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -405,8 +420,6 @@

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/page/3/index.html
+++ b/docs/page/3/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-10-01T11:14:07+03:00",
+  "dateModified": "2021-11-01T11:14:07+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,32 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-05/">May, 2020</a></h2>
+    <p class="blog-post-meta"><time datetime="2020-05-02T09:52:04+03:00">Sat May 02, 2020</time> by Alan Orth in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2020-05-02">2020-05-02</h2>
+<ul>
+<li>Peter said that CTA is having problems submitting an item to CGSpace
+<ul>
+<li>Looking at the PostgreSQL stats it seems to be the same issue that Tezira was having last week, as I see the number of connections in &lsquo;idle in transaction&rsquo; and &lsquo;waiting for lock&rsquo; state are increasing again</li>
+<li>I see that CGSpace (linode18) is still using PostgreSQL JDBC driver version 42.2.11, and there were some bugs related to transactions fixed in 42.2.12 (which I had updated in the Ansible playbooks, but not deployed yet)</li>
+</ul>
+</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2020-05/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-04/">April, 2020</a></h2>
@ -388,34 +414,6 @@



-
-<article class="blog-post">
-  <header>
-    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-07/">July, 2019</a></h2>
-    <p class="blog-post-meta"><time datetime="2019-07-01T12:13:51+03:00">Mon Jul 01, 2019</time> by Alan Orth in 
-<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
-
-
-</p>
-  </header>
-  <h2 id="2019-07-01">2019-07-01</h2>
-<ul>
-<li>Create an &ldquo;AfricaRice books and book chapters&rdquo; collection on CGSpace for AfricaRice</li>
-<li>Last month Sisay asked why the following &ldquo;most popular&rdquo; statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
-<ul>
-<li><a href="https://dspacetest.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&amp;time_filter_end_date=01%2F12%2F2018">DSpace Test</a></li>
-<li><a href="https://cgspace.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&amp;time_filter_end_date=01%2F12%2F2018">CGSpace</a></li>
-</ul>
-</li>
-<li>Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community</li>
-</ul>
-  <a href='https://alanorth.github.io/cgspace-notes/2019-07/'>Read more →</a>
-</article> 
-
-
-
-
-
 <nav class="blog-pagination">
  
  <a class="btn btn-outline-primary" href="/cgspace-notes/page/2/" rel="prev" role="button">Previous page</a>
@ -440,6 +438,8 @@
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -448,8 +448,6 @@

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/page/4/index.html
+++ b/docs/page/4/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-10-01T11:14:07+03:00",
+  "dateModified": "2021-11-01T11:14:07+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,34 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-07/">July, 2019</a></h2>
+    <p class="blog-post-meta"><time datetime="2019-07-01T12:13:51+03:00">Mon Jul 01, 2019</time> by Alan Orth in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2019-07-01">2019-07-01</h2>
+<ul>
+<li>Create an &ldquo;AfricaRice books and book chapters&rdquo; collection on CGSpace for AfricaRice</li>
+<li>Last month Sisay asked why the following &ldquo;most popular&rdquo; statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
+<ul>
+<li><a href="https://dspacetest.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&amp;time_filter_end_date=01%2F12%2F2018">DSpace Test</a></li>
+<li><a href="https://cgspace.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&amp;time_filter_end_date=01%2F12%2F2018">CGSpace</a></li>
+</ul>
+</li>
+<li>Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2019-07/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-06/">June, 2019</a></h2>
@ -382,30 +410,6 @@ sys     0m1.979s



-
-<article class="blog-post">
-  <header>
-    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-09/">September, 2018</a></h2>
-    <p class="blog-post-meta"><time datetime="2018-09-02T09:55:54+03:00">Sun Sep 02, 2018</time> by Alan Orth in 
-<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
-
-
-</p>
-  </header>
-  <h2 id="2018-09-02">2018-09-02</h2>
-<ul>
-<li>New <a href="https://jdbc.postgresql.org/documentation/changelog.html#version_42.2.5">PostgreSQL JDBC driver version 42.2.5</a></li>
-<li>I&rsquo;ll update the DSpace role in our <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure playbooks</a> and run the updated playbooks on CGSpace and DSpace Test</li>
-<li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
-<li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li>
-</ul>
-  <a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
-</article> 
-
-
-
-
-
 <nav class="blog-pagination">
  
  <a class="btn btn-outline-primary" href="/cgspace-notes/page/3/" rel="prev" role="button">Previous page</a>
@ -430,6 +434,8 @@ sys     0m1.979s
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -438,8 +444,6 @@ sys     0m1.979s

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/page/5/index.html
+++ b/docs/page/5/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-10-01T11:14:07+03:00",
+  "dateModified": "2021-11-01T11:14:07+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,30 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-09/">September, 2018</a></h2>
+    <p class="blog-post-meta"><time datetime="2018-09-02T09:55:54+03:00">Sun Sep 02, 2018</time> by Alan Orth in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2018-09-02">2018-09-02</h2>
+<ul>
+<li>New <a href="https://jdbc.postgresql.org/documentation/changelog.html#version_42.2.5">PostgreSQL JDBC driver version 42.2.5</a></li>
+<li>I&rsquo;ll update the DSpace role in our <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure playbooks</a> and run the updated playbooks on CGSpace and DSpace Test</li>
+<li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
+<li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-08/">August, 2018</a></h2>
@ -395,39 +419,6 @@ dspace.log.2018-01-02:34



-
-<article class="blog-post">
-  <header>
-    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-11/">November, 2017</a></h2>
-    <p class="blog-post-meta"><time datetime="2017-11-02T09:37:54+02:00">Thu Nov 02, 2017</time> by Alan Orth in 
-<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
-
-
-</p>
-  </header>
-  <h2 id="2017-11-01">2017-11-01</h2>
-<ul>
-<li>The CORE developers responded to say they are looking into their bot not respecting our robots.txt</li>
-</ul>
-<h2 id="2017-11-02">2017-11-02</h2>
-<ul>
-<li>Today there have been no hits by CORE and no alerts from Linode (coincidence?)</li>
-</ul>
-<pre tabindex="0"><code># grep -c &quot;CORE&quot; /var/log/nginx/access.log
-0
-</code></pre><ul>
-<li>Generate list of authors on CGSpace for Peter to go through and correct:</li>
-</ul>
-<pre tabindex="0"><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
-COPY 54701
-</code></pre>
-  <a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
-</article> 
-
-
-
-
-
 <nav class="blog-pagination">
  
  <a class="btn btn-outline-primary" href="/cgspace-notes/page/4/" rel="prev" role="button">Previous page</a>
@ -452,6 +443,8 @@ COPY 54701
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -460,8 +453,6 @@ COPY 54701

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/page/6/index.html
+++ b/docs/page/6/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-10-01T11:14:07+03:00",
+  "dateModified": "2021-11-01T11:14:07+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,39 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-11/">November, 2017</a></h2>
+    <p class="blog-post-meta"><time datetime="2017-11-02T09:37:54+02:00">Thu Nov 02, 2017</time> by Alan Orth in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2017-11-01">2017-11-01</h2>
+<ul>
+<li>The CORE developers responded to say they are looking into their bot not respecting our robots.txt</li>
+</ul>
+<h2 id="2017-11-02">2017-11-02</h2>
+<ul>
+<li>Today there have been no hits by CORE and no alerts from Linode (coincidence?)</li>
+</ul>
+<pre tabindex="0"><code># grep -c &quot;CORE&quot; /var/log/nginx/access.log
+0
+</code></pre><ul>
+<li>Generate list of authors on CGSpace for Peter to go through and correct:</li>
+</ul>
+<pre tabindex="0"><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
+COPY 54701
+</code></pre>
+  <a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-10/">October, 2017</a></h2>
@ -333,40 +366,6 @@



-
-<article class="blog-post">
-  <header>
-    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-02/">February, 2017</a></h2>
-    <p class="blog-post-meta"><time datetime="2017-02-07T07:04:52-08:00">Tue Feb 07, 2017</time> by Alan Orth in 
-
-<span class="fas fa-tag" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
-
-</p>
-  </header>
-  <h2 id="2017-02-07">2017-02-07</h2>
-<ul>
-<li>An item was mapped twice erroneously again, so I had to remove one of the mappings manually:</li>
-</ul>
-<pre tabindex="0"><code>dspace=# select * from collection2item where item_id = '80278';
-  id   | collection_id | item_id
-------+---------------+---------
- 92551 |           313 |   80278
- 92550 |           313 |   80278
- 90774 |          1051 |   80278
-(3 rows)
-dspace=# delete from collection2item where id = 92551 and item_id = 80278;
-DELETE 1
-</code></pre><ul>
-<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
-<li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
-</ul>
-  <a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a>
-</article> 
-
-
-
-
-
 <nav class="blog-pagination">
  
  <a class="btn btn-outline-primary" href="/cgspace-notes/page/5/" rel="prev" role="button">Previous page</a>
@ -391,6 +390,8 @@ DELETE 1
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -399,8 +400,6 @@ DELETE 1

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/page/7/index.html
+++ b/docs/page/7/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-10-01T11:14:07+03:00",
+  "dateModified": "2021-11-01T11:14:07+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,40 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-02/">February, 2017</a></h2>
+    <p class="blog-post-meta"><time datetime="2017-02-07T07:04:52-08:00">Tue Feb 07, 2017</time> by Alan Orth in 
+
+<span class="fas fa-tag" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
+
+</p>
+  </header>
+  <h2 id="2017-02-07">2017-02-07</h2>
+<ul>
+<li>An item was mapped twice erroneously again, so I had to remove one of the mappings manually:</li>
+</ul>
+<pre tabindex="0"><code>dspace=# select * from collection2item where item_id = '80278';
+  id   | collection_id | item_id
+-------+---------------+---------
+ 92551 |           313 |   80278
+ 92550 |           313 |   80278
+ 90774 |          1051 |   80278
+(3 rows)
+dspace=# delete from collection2item where id = 92551 and item_id = 80278;
+DELETE 1
+</code></pre><ul>
+<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
+<li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-01/">January, 2017</a></h2>
@ -341,31 +375,6 @@ dspacetest=# select text_value from  metadatavalue where metadata_field_id=3 and



-
-<article class="blog-post">
-  <header>
-    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-04/">April, 2016</a></h2>
-    <p class="blog-post-meta"><time datetime="2016-04-04T11:06:00+03:00">Mon Apr 04, 2016</time> by Alan Orth in 
-
-<span class="fas fa-tag" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
-
-</p>
-  </header>
-  <h2 id="2016-04-04">2016-04-04</h2>
-<ul>
-<li>Looking at log file use on CGSpace and notice that we need to work on our cron setup a bit</li>
-<li>We are backing up all logs in the log folder, including useless stuff like solr, cocoon, handle-plugin, etc</li>
-<li>After running DSpace for over five years I&rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year!</li>
-<li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li>
-<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
-</ul>
-  <a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a>
-</article> 
-
-
-
-
-
 <nav class="blog-pagination">
  
  <a class="btn btn-outline-primary" href="/cgspace-notes/page/6/" rel="prev" role="button">Previous page</a>
@ -390,6 +399,8 @@ dspacetest=# select text_value from  metadatavalue where metadata_field_id=3 and
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -398,8 +409,6 @@ dspacetest=# select text_value from  metadatavalue where metadata_field_id=3 and

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/page/8/index.html
+++ b/docs/page/8/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-10-01T11:14:07+03:00",
+  "dateModified": "2021-11-01T11:14:07+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,31 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-04/">April, 2016</a></h2>
+    <p class="blog-post-meta"><time datetime="2016-04-04T11:06:00+03:00">Mon Apr 04, 2016</time> by Alan Orth in 
+
+<span class="fas fa-tag" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
+
+</p>
+  </header>
+  <h2 id="2016-04-04">2016-04-04</h2>
+<ul>
+<li>Looking at log file use on CGSpace and notice that we need to work on our cron setup a bit</li>
+<li>We are backing up all logs in the log folder, including useless stuff like solr, cocoon, handle-plugin, etc</li>
+<li>After running DSpace for over five years I&rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year!</li>
+<li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li>
+<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-03/">March, 2016</a></h2>
@ -246,6 +271,8 @@
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -254,8 +281,6 @@

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/posts/index.html
+++ b/docs/posts/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-10-01T11:14:07+03:00",
+  "dateModified": "2021-11-01T11:14:07+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,24 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-11/">November, 2021</a></h2>
+    <p class="blog-post-meta"><time datetime="2021-11-01T11:14:07+03:00">Mon Nov 01, 2021</time> by Alan Orth in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2021-11-01">2021-11-01</h2>
+  <a href='https://alanorth.github.io/cgspace-notes/2021-11/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-10/">October, 2021</a></h2>
@ -341,45 +359,6 @@ COPY 20994



-
-<article class="blog-post">
-  <header>
-    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-02/">February, 2021</a></h2>
-    <p class="blog-post-meta"><time datetime="2021-02-01T10:13:54+02:00">Mon Feb 01, 2021</time> by Alan Orth in 
-<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
-
-
-</p>
-  </header>
-  <h2 id="2021-02-01">2021-02-01</h2>
-<ul>
-<li>Abenet said that CIP found more duplicate records in their export from AReS
-<ul>
-<li>I re-opened <a href="https://github.com/ilri/OpenRXV/issues/67">the issue</a> on OpenRXV where we had previously noticed this</li>
-<li>The shared link where the duplicates are is here: <a href="https://cgspace.cgiar.org/explorer/shared/heEOz3YBnXdK69bR2ra6">https://cgspace.cgiar.org/explorer/shared/heEOz3YBnXdK69bR2ra6</a></li>
-</ul>
-</li>
-<li>I had a call with CodeObia to discuss the work on OpenRXV</li>
-<li>Check the results of the AReS harvesting from last night:</li>
-</ul>
-<pre tabindex="0"><code class="language-console" data-lang="console">$ curl -s 'http://localhost:9200/openrxv-items-temp/_count?q=*&amp;pretty'
-{
-  &quot;count&quot; : 100875,
-  &quot;_shards&quot; : {
-    &quot;total&quot; : 1,
-    &quot;successful&quot; : 1,
-    &quot;skipped&quot; : 0,
-    &quot;failed&quot; : 0
-  }
-}
-</code></pre>
-  <a href='https://alanorth.github.io/cgspace-notes/2021-02/'>Read more →</a>
-</article> 
-
-
-
-
-
 <nav class="blog-pagination">
  
  
@ -404,6 +383,8 @@ COPY 20994
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -412,8 +393,6 @@ COPY 20994

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/docs/posts/index.xml
+++ b/docs/posts/index.xml
@ -6,7 +6,16 @@
    <description>Recent content in Posts on CGSpace Notes</description>
    <generator>Hugo -- gohugo.io</generator>
    <language>en-us</language>
-    <lastBuildDate>Fri, 01 Oct 2021 11:14:07 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/posts/index.xml" rel="self" type="application/rss+xml" />
+    <lastBuildDate>Mon, 01 Nov 2021 11:14:07 +0300</lastBuildDate><atom:link href="https://alanorth.github.io/cgspace-notes/posts/index.xml" rel="self" type="application/rss+xml" />
+    <item>
+      <title>November, 2021</title>
+      <link>https://alanorth.github.io/cgspace-notes/2021-11/</link>
+      <pubDate>Mon, 01 Nov 2021 11:14:07 +0300</pubDate>
+      
+      <guid>https://alanorth.github.io/cgspace-notes/2021-11/</guid>
+      <description>&lt;h2 id=&#34;2021-11-01&#34;&gt;2021-11-01&lt;/h2&gt;</description>
+    </item>
+    
    <item>
      <title>October, 2021</title>
      <link>https://alanorth.github.io/cgspace-notes/2021-10/</link>
--- a/docs/posts/page/2/index.html
+++ b/docs/posts/page/2/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2021-10-24T21:21:01+03:00" />
+<meta property="og:updated_time" content="2021-11-01T10:48:13+02:00" />



@ -31,7 +31,7 @@
    "@type": "Person",
    "name": "Alan Orth"
  },
-  "dateModified": "2021-10-01T11:14:07+03:00",
+  "dateModified": "2021-11-01T11:14:07+03:00",
  "keywords": "notes, migration, notes",
  "description":"Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
 }
@ -96,6 +96,45 @@



+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-02/">February, 2021</a></h2>
+    <p class="blog-post-meta"><time datetime="2021-02-01T10:13:54+02:00">Mon Feb 01, 2021</time> by Alan Orth in 
+<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2021-02-01">2021-02-01</h2>
+<ul>
+<li>Abenet said that CIP found more duplicate records in their export from AReS
+<ul>
+<li>I re-opened <a href="https://github.com/ilri/OpenRXV/issues/67">the issue</a> on OpenRXV where we had previously noticed this</li>
+<li>The shared link where the duplicates are is here: <a href="https://cgspace.cgiar.org/explorer/shared/heEOz3YBnXdK69bR2ra6">https://cgspace.cgiar.org/explorer/shared/heEOz3YBnXdK69bR2ra6</a></li>
+</ul>
+</li>
+<li>I had a call with CodeObia to discuss the work on OpenRXV</li>
+<li>Check the results of the AReS harvesting from last night:</li>
+</ul>
+<pre tabindex="0"><code class="language-console" data-lang="console">$ curl -s 'http://localhost:9200/openrxv-items-temp/_count?q=*&amp;pretty'
+{
+  &quot;count&quot; : 100875,
+  &quot;_shards&quot; : {
+    &quot;total&quot; : 1,
+    &quot;successful&quot; : 1,
+    &quot;skipped&quot; : 0,
+    &quot;failed&quot; : 0
+  }
+}
+</code></pre>
+  <a href='https://alanorth.github.io/cgspace-notes/2021-02/'>Read more →</a>
+</article> 
+
+
+
+
+
+
 <article class="blog-post">
  <header>
    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-01/">January, 2021</a></h2>
@ -347,32 +386,6 @@



-
-<article class="blog-post">
-  <header>
-    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-05/">May, 2020</a></h2>
-    <p class="blog-post-meta"><time datetime="2020-05-02T09:52:04+03:00">Sat May 02, 2020</time> by Alan Orth in 
-<span class="fas fa-folder" aria-hidden="true"></span>&nbsp;<a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
-
-
-</p>
-  </header>
-  <h2 id="2020-05-02">2020-05-02</h2>
-<ul>
-<li>Peter said that CTA is having problems submitting an item to CGSpace
-<ul>
-<li>Looking at the PostgreSQL stats it seems to be the same issue that Tezira was having last week, as I see the number of connections in &lsquo;idle in transaction&rsquo; and &lsquo;waiting for lock&rsquo; state are increasing again</li>
-<li>I see that CGSpace (linode18) is still using PostgreSQL JDBC driver version 42.2.11, and there were some bugs related to transactions fixed in 42.2.12 (which I had updated in the Ansible playbooks, but not deployed yet)</li>
-</ul>
-</li>
-</ul>
-  <a href='https://alanorth.github.io/cgspace-notes/2020-05/'>Read more →</a>
-</article> 
-
-
-
-
-
 <nav class="blog-pagination">
  
  <a class="btn btn-outline-primary" href="/cgspace-notes/posts/" rel="prev" role="button">Previous page</a>
@ -397,6 +410,8 @@
    <ol class="list-unstyled">


+<li><a href="/cgspace-notes/2021-11/">November, 2021</a></li>
+
 <li><a href="/cgspace-notes/2021-10/">October, 2021</a></li>

 <li><a href="/cgspace-notes/2021-09/">September, 2021</a></li>
@ -405,8 +420,6 @@

 <li><a href="/cgspace-notes/2021-07/">July, 2021</a></li>

-<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
-
    </ol>
  </section>

--- a/Show More
+++ b/Show More
Author	SHA1	Message	Date
Alan Orth	b04ec94cbe	Add 2021-11 and regenerate docs	2021-11-01 10:49:21 +02:00
Alan Orth	be72befbe2	content/posts/2021-10.md: Fix toml syntax issue	2021-11-01 10:48:13 +02:00
Alan Orth	dbff911e21	Add notes for 2021-10-31	2021-11-01 10:07:51 +02:00
Alan Orth	5bec10a872	Regenerate docs	2021-11-01 10:07:11 +02:00