Add notes for 2020-05-31

content/posts/2020-05.md

@@ -175,4 +175,54 @@ $ ./add-orcid-identifiers-csv.py -i 2020-05-25-add-orcids.csv -db dspace -u dspa
 - Atmire got back to me about the [Solr CUA issue in the DSpace 6 upgrade](https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=706) and they cannot reproduce the error
   - The next step is for me to migrate DSpace Test (linode26) to DSpace 6 and try to reproduce the error there
 
+## 2020-05-31
+
+- Start preparing to migrate DSpace Test (linode26) to the `6_x-dev-atmire-modules` branch
+  - Run all system updates and reboot
+  - For now I will disable all yearly Solr statistics cores except the current `statistics` one
+  - Prepare PostgreSQL with a clean snapshot of CGSpace's DSpace 5.8 database:
+
+```
+$ sudo su - postgres
+$ dropdb dspacetest
+$ createdb -O dspacetest --encoding=UNICODE dspacetest
+$ psql dspacetest -c 'alter user dspacetest superuser;'
+$ pg_restore -d dspacetest -O --role=dspacetest /tmp/cgspace_2020-05-31.backup
+$ psql dspacetest -c 'alter user dspacetest nosuperuser;'
+# run DSpace 5 version of update-sequences.sql!!!
+$ psql -f /home/dspace/src/git/DSpace/dspace/etc/postgres/update-sequences.sql dspacetest
+$ psql dspacetest -c "DELETE FROM schema_version WHERE version IN ('5.8.2015.12.03.3');"
+$ psql dspacetest -c 'CREATE EXTENSION pgcrypto;'
+$ exit
+```
+
+- Now switch to the DSpace 6.x branch and start a build:
+
+```
+$ chrt -i 0 ionice -c2 -n7 nice -n19 mvn -U -Dmirage2.on=true -Dmirage2.deps.included=false package
+...
+[ERROR] Failed to execute goal on project additions: Could not resolve dependencies for project org.dspace.modules:additions:jar:6.3: Failed to collect dependencies at com.atmire:atmire-listings-and-reports-api:jar:6.x-2.10.8-0-SNAPSHOT: Failed to read artifact descriptor for com.atmire:atmire-listings-and-reports-api:jar:6.x-2.10.8-0-SNAPSHOT: Could not transfer artifact com.atmire:atmire-listings-and-reports-api:pom:6.x-2.10.8-0-SNAPSHOT from/to atmire.com-snapshots (https://atmire.com/artifactory/atmire.com-snapshots): Not authorized , ReasonPhrase:Unauthorized. -> [Help 1]
+```
+
+- Great! I will have to send Atmire a note about this... but for now I can sync over my local `~/.m2` directory and the build completes
+- After the Maven build completed successfully I installed the updated code with Ant (make sure to delete the old spring directory):
+
+```
+$ cd dspace/target/dspace-installer
+$ rm -rf /blah/dspacetest/config/spring
+$ ant update
+```
+
+- Database migrations take 10:18.287s during the first startup...
+  - perhaps when we do the production CGSpace migration I can do this in advance and tell users not to make any submissions?
+- I had a mistake in my Solr internal URL parameter so DSpace couldn't find it, but once I fixed that DSpace starts up OK!
+- Once the initial Discovery reindexing is completed I started the Solr statistics UUID migration:
+
+```
+$ export JAVA_OPTS="-Xmx1024m -Dfile.encoding=UTF-8"
+```
+
+- Experiment a bit with the Python [country-converter](https://pypi.org/project/country-converter/) library as it can convert between different formats (like ISO 3166 and UN m49)
+  - We need to eventually find a format we can use for all CGIAR DSpaces...
+
 <!-- vim: set sw=2 ts=2: -->