From 45be38f00f4488a98339349634704d4ef3efb4b8 Mon Sep 17 00:00:00 2001 From: Alan Orth Date: Mon, 18 Dec 2017 22:07:13 +0200 Subject: [PATCH] Update notes for 2017-12-18 --- content/post/2017-12.md | 26 ++++++++++++++++++++++++++ public/2017-12/index.html | 35 ++++++++++++++++++++++++++++++++--- public/sitemap.xml | 10 +++++----- 3 files changed, 63 insertions(+), 8 deletions(-) diff --git a/content/post/2017-12.md b/content/post/2017-12.md index bed6f7b9c..ae352d79e 100644 --- a/content/post/2017-12.md +++ b/content/post/2017-12.md @@ -370,3 +370,29 @@ dspace.log.2017-12-01:1601 dspace.log.2017-12-02:1274 dspace.log.2017-12-07:2769 ``` + +- I made a small fix to my `move-collections.sh` script so that it handles the case when a "to" or "from" community doesn't exist +- The script lives here: https://gist.github.com/alanorth/e60b530ed4989df0c731afbb0c640515 +- Major reorganization of four of CTA's French collections +- Basically moving their items into the English ones, then moving the English ones to the top-level of the CTA community, and deleting the old sub-communities +- Move collection 10568/51821 from 10568/42212 to 10568/42211 +- Move collection 10568/51400 from 10568/42214 to 10568/42211 +- Move collection 10568/56992 from 10568/42216 to 10568/42211 +- Move collection 10568/42218 from 10568/42217 to 10568/42211 +- Export CSV of collection 10568/63484 and move items to collection 10568/51400 +- Export CSV of collection 10568/64403 and move items to collection 10568/56992 +- Export CSV of collection 10568/56994 and move items to collection 10568/42218 +- There are blank lines in this metadata, which causes DSpace to not detect changes in the CSVs +- I had to use OpenRefine to remove all columns from the CSV except `id` and `collection`, and then update the `collection` field for the new mappings +- Remove empty sub-communities: 10568/42212, 10568/42214, 10568/42216, 10568/42217 +- I was in the middle of applying the metadata imports on CGSpace and the system ran out of PostgreSQL connections... +- There were 128 PostgreSQL connections at the time... grrrr. +- So I restarted Tomcat 7 and restarted the imports +- I assume the PostgreSQL transactions were fine but I will remove the Discovery index for their community and re-run the light-weight indexing to hopefully re-construct everything: + +``` +$ dspace index-discovery -r 10568/42211 +$ schedtool -D -e ionice -c2 -n7 nice -n19 dspace index-discovery +``` + +- The PostgreSQL issues are getting out of control, I need to figure out how to enable connection pools in Tomcat! diff --git a/public/2017-12/index.html b/public/2017-12/index.html index e350b7027..a2a3740e2 100644 --- a/public/2017-12/index.html +++ b/public/2017-12/index.html @@ -23,7 +23,7 @@ The list of connections to XMLUI and REST API for today: - + @@ -56,9 +56,9 @@ The list of connections to XMLUI and REST API for today: "@type": "BlogPosting", "headline": "December, 2017", "url": "https://alanorth.github.io/cgspace-notes/2017-12/", - "wordCount": "1972", + "wordCount": "2244", "datePublished": "2017-12-01T13:53:54+03:00", - "dateModified": "2017-12-18T15:20:37+02:00", + "dateModified": "2017-12-18T17:03:58+02:00", "author": { "@type": "Person", "name": "Alan Orth" @@ -532,6 +532,35 @@ dspace.log.2017-12-02:1274 dspace.log.2017-12-07:2769 + + +
$ dspace index-discovery -r 10568/42211
+$ schedtool -D -e ionice -c2 -n7 nice -n19 dspace index-discovery
+
+ + + diff --git a/public/sitemap.xml b/public/sitemap.xml index ae58e79e7..4876b4fde 100644 --- a/public/sitemap.xml +++ b/public/sitemap.xml @@ -4,7 +4,7 @@ https://alanorth.github.io/cgspace-notes/2017-12/ - 2017-12-18T15:20:37+02:00 + 2017-12-18T17:03:58+02:00 @@ -139,7 +139,7 @@ https://alanorth.github.io/cgspace-notes/ - 2017-12-18T15:20:37+02:00 + 2017-12-18T17:03:58+02:00 0 @@ -150,7 +150,7 @@ https://alanorth.github.io/cgspace-notes/tags/notes/ - 2017-12-18T15:20:37+02:00 + 2017-12-18T17:03:58+02:00 0 @@ -162,13 +162,13 @@ https://alanorth.github.io/cgspace-notes/post/ - 2017-12-18T15:20:37+02:00 + 2017-12-18T17:03:58+02:00 0 https://alanorth.github.io/cgspace-notes/tags/ - 2017-12-18T15:20:37+02:00 + 2017-12-18T17:03:58+02:00 0