Add notes for 2019-05-27

content/posts/2019-05.md

@@ -418,4 +418,29 @@ $ ./delete-metadata-values.py -i /tmp/2019-05-17-delete-14-Investors.csv -db dsp
 $ dspace import -a -e me@cgiar.org -m 2019-05-25-AfricaRice.map -s /tmp/SimpleArchiveFormat
 ```
 
+## 2019-05-27
+
+- Peter sent me over two thousand corrections for the authors on CGSpace that I had dumped last month
+  - I proofed them for whitespace and invalid special characters in OpenRefine and then applied them on CGSpace and DSpace Test:
+
+```
+$ ./fix-metadata-values.py -i /tmp/2019-05-27-fix-2472-Authors.csv -db dspace -u dspace -p 'fuuu' -f dc.contributor.author -m 3 -t corrections -d
+```
+
+- Then start a full Discovery re-indexing on each server:
+
+```
+$ export JAVA_OPTS="-Dfile.encoding=UTF-8 -Xmx1024m"                                   
+$ time schedtool -B -e ionice -c2 -n7 nice -n19 dspace index-discovery -b
+```
+
+- Export new list of all authors from CGSpace database to send to Peter:
+
+```
+dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/2019-05-27-all-authors.csv with csv header;
+COPY 64871
+```
+
+- Run all system updates on DSpace Test (linode19) and reboot it
+
 <!-- vim: set sw=2 ts=2: -->