Update notes for 2019-10-12

content/posts/2019-10.md

@@ -103,5 +103,29 @@ UPDATE 1
 
 - More work on identifying duplicates in the Bioversity migration data on DSpace Test
   - I mapped twenty-five more items on CGSpace and deleted them from the migration test collection on DSpace Test
+  - After a few hours I think I finished all the duplicates that were identified by Atmire's Duplicate Checker module
+  - According to my spreadsheet there were fifty-two in total
+- I was preparing to check the affiliations on the Bioversity records when I noticed that the last list of top affiliations I generated has some anomalies
+  - I made some corrections in a CSV:
+
+```
+from,to
+CIAT,International Center for Tropical Agriculture
+International Centre for Tropical Agriculture,International Center for Tropical Agriculture
+International Maize and Wheat Improvement Center (CIMMYT),International Maize and Wheat Improvement Center
+International Centre for Agricultural Research in the Dry Areas,International Center for Agricultural Research in the Dry Areas
+International Maize and Wheat Improvement Centre,International Maize and Wheat Improvement Center
+"Agricultural Information Resource Centre, Kenya.","Agricultural Information Resource Centre, Kenya"
+"Centre for Livestock and Agricultural Development, Cambodia","Centre for Livestock and Agriculture Development, Cambodia"
+```
+
+- Then I applied it with my `fix-metadata-values.py` script on CGSpace:
+
+```
+$ ./fix-metadata-values.py -i /tmp/affiliations.csv -db dspace -u dspace -p 'fuuu' -f from -m 211 -t to
+```
+
+- I did some manual curation of ~227 authors in preparation for telling Peter and Abenet that the migration is almost ready
+  - I would still like to perhaps (re)move institutional authors from `dc.contributor.author` to `cg.contributor.affiliation`, but I will have to run that by Francesca, Carol, and Abenet
 
 <!-- vim: set sw=2 ts=2: -->