Add notes for 2020-09-10

content/posts/2020-09.md

@@ -146,5 +146,49 @@ https://cgspace.cgiar.org/bitstream/handle/10568/82745/Characteristics-Silage.JP
 - So they end up getting rate limited due to the XMLUI rate limits
   - I told them to use the REST API bitstream retrieve links, because we don't have any rate limits there
 
+## 2020-09-09
+
+- Wire up the systemd service/timer for the CGSpace Country Code Tagger curation task in the [Ansible infrastructure scripts](https://github.com/ilri/rmg-ansible-public)
+  - ~~For now it won't work on DSpace 6 because the curation task invocation needs to be slightly different (minus the `-l` parameter) and for some reason the task isn't working on DSpace Test (version 6) right now~~
+  - I added DSpace 6 support to the playbook templates...
+- Run system updates on DSpace Test (linode26), re-deploy the DSpace 6 test branch, and reboot the server
+  - After rebooting I deleted old copies of the cgspace-java-helpers JAR in the DSpace lib directory and then the curation worked
+  - To my great surprise the curation worked (and completed, albeit a few times slower) on my local DSpace 6 environment as well:
+
+```
+$ ~/dspace63/bin/dspace curate -t countrycodetagger -i all -s object
+```
+
+## 2020-09-10
+
+- I checked the country code tagger on CGSpace and DSpace Test and it ran fine from the systemd timer last night... w00t
+- I started looking at Peter's changes to the CGSpace regions that were proposed in 2020-07
+  - The changes will be:
+
+```
+$ cat 2020-09-10-fix-cgspace-regions.csv
+cg.coverage.region,correct
+EAST AFRICA,EASTERN AFRICA
+WEST AFRICA,WESTERN AFRICA
+SOUTHEAST ASIA,SOUTHEASTERN ASIA
+SOUTH ASIA,SOUTHERN ASIA
+AFRICA SOUTH OF SAHARA,SUB-SAHARAN AFRICA
+NORTH AFRICA,NORTHERN AFRICA
+WEST ASIA,WESTERN ASIA
+SOUTHWEST ASIA,SOUTHWESTERN ASIA
+$ ./fix-metadata-values.py -i 2020-09-10-fix-cgspace-regions.csv -db dspace -u dspace -p 'fuuu' -f cg.coverage.region -t 'correct' -m 227 -d -n
+Connected to database.
+Would fix 12227 occurences of: EAST AFRICA
+Would fix 7996 occurences of: WEST AFRICA
+Would fix 3515 occurences of: SOUTHEAST ASIA
+Would fix 3443 occurences of: SOUTH ASIA
+Would fix 1134 occurences of: AFRICA SOUTH OF SAHARA
+Would fix 357 occurences of: NORTH AFRICA
+Would fix 81 occurences of: WEST ASIA
+Would fix 3 occurences of: SOUTHWEST ASIA
+```
+
+- I think we need to wait for the web team, though, as they need to update their mappings
+  - Not to mention that we'll need to give WLE and CCAFS time to update their harvesters as well... hmmm
 
 <!-- vim: set sw=2 ts=2: -->