Update notes for 2018-02-14

content/post/2018-02.md

@@ -486,4 +486,40 @@ $ tidy -xml -iq -m -w 0 dspace/config/controlled-vocabularies/cg-creator-id.xml
 $ tidy -xml -utf8 -iq -m -w 0 dspace/config/controlled-vocabularies/cg-creator-id.xml
 ```
 
-- Then it preserves them and submitting them is fine
+- This preserves special accent characters
+- I tested the display and store of these in the XMLUI and PostgreSQL and it looks good
+- Sisay exported all ILRI, CIAT, etc authors from ORCID and sent a list of 600+
+- Peter combined it with mine and we have 1204 unique ORCIDs!
+
+```
+$ grep -coE '[A-Z0-9]{4}-[A-Z0-9]{4}-[A-Z0-9]{4}-[A-Z0-9]{4}' CGcenter_ORCID_ID_combined.csv
+1204
+$ grep -oE '[A-Z0-9]{4}-[A-Z0-9]{4}-[A-Z0-9]{4}-[A-Z0-9]{4}' CGcenter_ORCID_ID_combined.csv | sort | uniq | wc -l
+1204
+```
+
+- Also, save that regex for the future because it will be very useful!
+- CIAT sent a list of their authors' ORCIDs and combined with ours there are now 1227:
+
+```
+$ cat CGcenter_ORCID_ID_combined.csv ciat-orcids.txt | grep -oE '[A-Z0-9]{4}-[A-Z0-9]{4}-[A-Z0-9]{4}-[A-Z0-9]{4}' | sort | uniq | wc -l
+1227
+```
+
+- There are some formatting issues with names in Peter's list, so I should remember to re-generate the list of names from ORCID's API once we're done
+- The `dspace cleanup -v` currently fails on CGSpace with the following:
+
+```
+ - Deleting bitstream record from database (ID: 149473)
+Error: ERROR: update or delete on table "bitstream" violates foreign key constraint "bundle_primary_bitstream_id_fkey" on table "bundle"
+  Detail: Key (bitstream_id)=(149473) is still referenced from table "bundle".
+```
+
+- The solution is to update the bitstream table, as I've discovered several other times in 2016 and 2017:
+
+```
+$ psql dspace -c 'update bundle set primary_bitstream_id=NULL where primary_bitstream_id in (149473);'
+UPDATE 1
+```
+
+- Then the cleanup process will continue for awhile and hit another foreign key conflict, and eventually it will complete after you manually resolve them all