From 41476b9c639ce5a5f46e6344492504b9d7c8ac9f Mon Sep 17 00:00:00 2001 From: Alan Orth Date: Mon, 25 Jul 2022 22:33:25 +0300 Subject: [PATCH] Add notes for 2022-07-25 --- content/posts/2022-07.md | 55 ++++++++++++++++++++ docs/2022-07/index.html | 68 +++++++++++++++++++++++-- docs/categories/index.html | 2 +- docs/categories/notes/index.html | 2 +- docs/categories/notes/page/2/index.html | 2 +- docs/categories/notes/page/3/index.html | 2 +- docs/categories/notes/page/4/index.html | 2 +- docs/categories/notes/page/5/index.html | 2 +- docs/categories/notes/page/6/index.html | 2 +- docs/categories/notes/page/7/index.html | 2 +- docs/index.html | 2 +- docs/page/2/index.html | 2 +- docs/page/3/index.html | 2 +- docs/page/4/index.html | 2 +- docs/page/5/index.html | 2 +- docs/page/6/index.html | 2 +- docs/page/7/index.html | 2 +- docs/page/8/index.html | 2 +- docs/page/9/index.html | 2 +- docs/posts/index.html | 2 +- docs/posts/page/2/index.html | 2 +- docs/posts/page/3/index.html | 2 +- docs/posts/page/4/index.html | 2 +- docs/posts/page/5/index.html | 2 +- docs/posts/page/6/index.html | 2 +- docs/posts/page/7/index.html | 2 +- docs/posts/page/8/index.html | 2 +- docs/posts/page/9/index.html | 2 +- docs/sitemap.xml | 10 ++-- 29 files changed, 151 insertions(+), 34 deletions(-) diff --git a/content/posts/2022-07.md b/content/posts/2022-07.md index 6d6fea968..3b8506649 100644 --- a/content/posts/2022-07.md +++ b/content/posts/2022-07.md @@ -415,4 +415,59 @@ $ dspace import -a -e fuuu@example.com -m 2022-07-20-africarice.map -s /tmp/Simp - I re-created the tip-submit and tip-approve DSpace user accounts for Alliance's new TIP submit tool and added them to the Alliance submitters and Alliance admins accounts respectively - Start working on updating the Ansible infrastructure playbooks for DSpace 7 stuff +## 2022-07-23 + +- Start a harvest on AReS +- More work on DSpace 7 related issues in the [Ansible infrastructure playbooks](https://github.com/ilri/rmg-ansible-public) + +## 2022-07-24 + +- More work on DSpace 7 related issues in the [Ansible infrastructure playbooks](https://github.com/ilri/rmg-ansible-public) + +## 2022-07-25 + +- More work on DSpace 7 related issues in the [Ansible infrastructure playbooks](https://github.com/ilri/rmg-ansible-public) + - I see that, for Solr, we will need to copy the DSpace configsets to the writable data directory rather than the default home dir + - The [Taking Solr to production guide](https://solr.apache.org/guide/8_11/taking-solr-to-production.html) recommends keeping the unzipped code separate from the data, which we do in our Solr role already + - So that means we keep the unzipped code in `/opt/solr-8.11.2`, but the data directory in `/var/solr/data`, with the DSpace Solr cores here `/var/solr/data/configsets` + - I'm not sure how to integrate that into my playbooks yet +- Much to my surprise, Discovery indexing on DSpace 7 was really fast when I did it just now, apparently taking 40 minutes of wall clock time?!: + +```console +$ /usr/bin/time -v /home/dspace7/bin/dspace index-discovery -b +The script has started +(Re)building index from scratch. +Done with indexing +The script has completed + Command being timed: "/home/dspace7/bin/dspace index-discovery -b" + User time (seconds): 588.18 + System time (seconds): 91.26 + Percent of CPU this job got: 28% + Elapsed (wall clock) time (h:mm:ss or m:ss): 40:05.79 + Average shared text size (kbytes): 0 + Average unshared data size (kbytes): 0 + Average stack size (kbytes): 0 + Average total size (kbytes): 0 + Maximum resident set size (kbytes): 635380 + Average resident set size (kbytes): 0 + Major (requiring I/O) page faults: 1513 + Minor (reclaiming a frame) page faults: 216412 + Voluntary context switches: 1671092 + Involuntary context switches: 744007 + Swaps: 0 + File system inputs: 4396880 + File system outputs: 74312 + Socket messages sent: 0 + Socket messages received: 0 + Signals delivered: 0 + Page size (bytes): 4096 + Exit status: 0 +``` + +- Leroy from the Alliance wrote to say that the CIAT Library is back up so I might be able to download all the PDFs + - It had been shut down for a security reason a few months ago and we were planning to download them all and attach them to their relevant items on CGSpace + - I noticed one item that had the PDF already on CGSpace so I'll need to consider that when I eventually do the import +- I had to re-create the tip-submit and tip-approve accounts for Alliance on DSpace Test again + - After I created them last week they somehow got deleted...?!... I couldn't find them or the mel-submit account either! + diff --git a/docs/2022-07/index.html b/docs/2022-07/index.html index c13e3aa9b..0ddd90343 100644 --- a/docs/2022-07/index.html +++ b/docs/2022-07/index.html @@ -19,7 +19,7 @@ Also, the trgm functions I’ve used before are case insensitive, but Levens - + @@ -44,9 +44,9 @@ Also, the trgm functions I’ve used before are case insensitive, but Levens "@type": "BlogPosting", "headline": "July, 2022", "url": "https://alanorth.github.io/cgspace-notes/2022-07/", - "wordCount": "2835", + "wordCount": "3230", "datePublished": "2022-07-02T14:07:36+03:00", - "dateModified": "2022-07-22T16:42:06+03:00", + "dateModified": "2022-07-22T22:28:51+03:00", "author": { "@type": "Person", "name": "Alan Orth" @@ -603,6 +603,68 @@ Also, the trgm functions I’ve used before are case insensitive, but Levens
  • I re-created the tip-submit and tip-approve DSpace user accounts for Alliance’s new TIP submit tool and added them to the Alliance submitters and Alliance admins accounts respectively
  • Start working on updating the Ansible infrastructure playbooks for DSpace 7 stuff
    • +

    2022-07-23

    + +

    2022-07-24

    + +

    2022-07-25

    + +
    $ /usr/bin/time -v /home/dspace7/bin/dspace index-discovery -b
+The script has started
+(Re)building index from scratch.
+Done with indexing
+The script has completed
+        Command being timed: "/home/dspace7/bin/dspace index-discovery -b"
+        User time (seconds): 588.18
+        System time (seconds): 91.26
+        Percent of CPU this job got: 28%
+        Elapsed (wall clock) time (h:mm:ss or m:ss): 40:05.79
+        Average shared text size (kbytes): 0
+        Average unshared data size (kbytes): 0
+        Average stack size (kbytes): 0
+        Average total size (kbytes): 0
+        Maximum resident set size (kbytes): 635380
+        Average resident set size (kbytes): 0
+        Major (requiring I/O) page faults: 1513
+        Minor (reclaiming a frame) page faults: 216412
+        Voluntary context switches: 1671092
+        Involuntary context switches: 744007
+        Swaps: 0
+        File system inputs: 4396880
+        File system outputs: 74312
+        Socket messages sent: 0
+        Socket messages received: 0
+        Signals delivered: 0
+        Page size (bytes): 4096
+        Exit status: 0
+
    diff --git a/docs/categories/index.html b/docs/categories/index.html index 1b103f93a..00819cd80 100644 --- a/docs/categories/index.html +++ b/docs/categories/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/categories/notes/index.html b/docs/categories/notes/index.html index 7d6189b85..cf078ca2e 100644 --- a/docs/categories/notes/index.html +++ b/docs/categories/notes/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/categories/notes/page/2/index.html b/docs/categories/notes/page/2/index.html index d5bf1756d..5210d97b6 100644 --- a/docs/categories/notes/page/2/index.html +++ b/docs/categories/notes/page/2/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/categories/notes/page/3/index.html b/docs/categories/notes/page/3/index.html index 3d1cd7a22..fd6bae9f7 100644 --- a/docs/categories/notes/page/3/index.html +++ b/docs/categories/notes/page/3/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/categories/notes/page/4/index.html b/docs/categories/notes/page/4/index.html index 9894fc85a..c7a6d3797 100644 --- a/docs/categories/notes/page/4/index.html +++ b/docs/categories/notes/page/4/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/categories/notes/page/5/index.html b/docs/categories/notes/page/5/index.html index 49277ab52..ad49b49b0 100644 --- a/docs/categories/notes/page/5/index.html +++ b/docs/categories/notes/page/5/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/categories/notes/page/6/index.html b/docs/categories/notes/page/6/index.html index 10096418c..2d09faf13 100644 --- a/docs/categories/notes/page/6/index.html +++ b/docs/categories/notes/page/6/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/categories/notes/page/7/index.html b/docs/categories/notes/page/7/index.html index c4a12f488..8427e73eb 100644 --- a/docs/categories/notes/page/7/index.html +++ b/docs/categories/notes/page/7/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/index.html b/docs/index.html index adc829322..6b22a8c72 100644 --- a/docs/index.html +++ b/docs/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/page/2/index.html b/docs/page/2/index.html index 590175e96..c9bc719f7 100644 --- a/docs/page/2/index.html +++ b/docs/page/2/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/page/3/index.html b/docs/page/3/index.html index 97ec07532..0b5d56756 100644 --- a/docs/page/3/index.html +++ b/docs/page/3/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/page/4/index.html b/docs/page/4/index.html index b3d1f6f28..671bf3c1b 100644 --- a/docs/page/4/index.html +++ b/docs/page/4/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/page/5/index.html b/docs/page/5/index.html index 990c24d36..42a896017 100644 --- a/docs/page/5/index.html +++ b/docs/page/5/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/page/6/index.html b/docs/page/6/index.html index 6a7903c06..25a9100dd 100644 --- a/docs/page/6/index.html +++ b/docs/page/6/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/page/7/index.html b/docs/page/7/index.html index f816d9372..23af92c2c 100644 --- a/docs/page/7/index.html +++ b/docs/page/7/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/page/8/index.html b/docs/page/8/index.html index 185585782..987da0bd9 100644 --- a/docs/page/8/index.html +++ b/docs/page/8/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/page/9/index.html b/docs/page/9/index.html index 86015bb1c..dc473c967 100644 --- a/docs/page/9/index.html +++ b/docs/page/9/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/index.html b/docs/posts/index.html index 7474e99d2..53eac6afc 100644 --- a/docs/posts/index.html +++ b/docs/posts/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/page/2/index.html b/docs/posts/page/2/index.html index db82f0df8..e4ebed16b 100644 --- a/docs/posts/page/2/index.html +++ b/docs/posts/page/2/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/page/3/index.html b/docs/posts/page/3/index.html index 03edacbce..00759ba0a 100644 --- a/docs/posts/page/3/index.html +++ b/docs/posts/page/3/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/page/4/index.html b/docs/posts/page/4/index.html index 54a51e8b9..b957fc897 100644 --- a/docs/posts/page/4/index.html +++ b/docs/posts/page/4/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/page/5/index.html b/docs/posts/page/5/index.html index 001853b50..fcc8adb26 100644 --- a/docs/posts/page/5/index.html +++ b/docs/posts/page/5/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/page/6/index.html b/docs/posts/page/6/index.html index c5ac9bb44..18495b9da 100644 --- a/docs/posts/page/6/index.html +++ b/docs/posts/page/6/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/page/7/index.html b/docs/posts/page/7/index.html index 480e8d0a7..b8391f6fa 100644 --- a/docs/posts/page/7/index.html +++ b/docs/posts/page/7/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/page/8/index.html b/docs/posts/page/8/index.html index 2363d59b2..2ecd35210 100644 --- a/docs/posts/page/8/index.html +++ b/docs/posts/page/8/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/page/9/index.html b/docs/posts/page/9/index.html index 30cbe7467..4cf27b04b 100644 --- a/docs/posts/page/9/index.html +++ b/docs/posts/page/9/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/sitemap.xml b/docs/sitemap.xml index 41e557224..b8626e847 100644 --- a/docs/sitemap.xml +++ b/docs/sitemap.xml @@ -3,19 +3,19 @@ xmlns:xhtml="http://www.w3.org/1999/xhtml"> https://alanorth.github.io/cgspace-notes/categories/ - 2022-07-22T16:42:06+03:00 + 2022-07-22T22:28:51+03:00 https://alanorth.github.io/cgspace-notes/ - 2022-07-22T16:42:06+03:00 + 2022-07-22T22:28:51+03:00 https://alanorth.github.io/cgspace-notes/2022-07/ - 2022-07-22T16:42:06+03:00 + 2022-07-22T22:28:51+03:00 https://alanorth.github.io/cgspace-notes/categories/notes/ - 2022-07-22T16:42:06+03:00 + 2022-07-22T22:28:51+03:00 https://alanorth.github.io/cgspace-notes/posts/ - 2022-07-22T16:42:06+03:00 + 2022-07-22T22:28:51+03:00 https://alanorth.github.io/cgspace-notes/2022-06/ 2022-07-04T09:25:14+03:00