Update notes for 2019-04-08

content/posts/2019-04.md

@@ -401,4 +401,31 @@ $ psql -c 'select * from pg_stat_activity' | grep -o -E '(dspaceWeb|dspaceApi|ds
 - It seems that the issue with CGSpace being "down" is actually because of CPU steal again!!!
 - I opened a ticket with support and asked them to migrate the VM to a less busy host
 
+## 2019-04-08
+
+- Start checking IITA's last round of batch uploads from [March on DSpace Test](https://dspacetest.cgiar.org/handle/10568/100333) (20193rd.xls)
+  - Lots of problems with affiliations, I had to correct about sixty of them
+  - I used lein to host the latest CSV of our affiliations for OpenRefine to reconcile against:
+
+```
+$ lein run ~/src/git/DSpace/2019-02-22-affiliations.csv name id
+```
+
+- After matching the values and creating some new matches I had trouble remembering how to copy the reconciled values to a new column
+  - The matched values can be accessed with `cell.recon.match.name`, but some of the new values don't appear, perhaps because I edited the original cell values?
+  - I ended up using this GREL expression to copy all values to a new column:
+
+```
+if(cell.recon.matched, cell.recon.match.name, value)
+```
+
+- See the [OpenRefine variables documentation](https://github.com/OpenRefine/OpenRefine/wiki/Variables#recon) for more notes about the `recon` object
+- I also noticed a handful of errors in our current list of affiliations so I corrected them:
+
+```
+$ ./fix-metadata-values.py -i 2019-04-08-fix-13-affiliations.csv -db dspace -u dspace -p 'fuuu' -f cg.contributor.affiliation -m 211 -t correct -d
+```
+
+- We should create a new list of affiliations to update our controlled vocabulary again
+
 <!-- vim: set sw=2 ts=2: -->