Add notes for 2020-11-24

2024-11-22 06:35:03 +01:00 · 2020-11-24 21:47:24 +02:00 · 2020-11-24 21:47:24 +02:00 · a9b86c7f64
commit a9b86c7f64
parent 3e3f80c1dc
27 changed files with 85 additions and 36 deletions
--- a/content/posts/2020-11.md
+++ b/content/posts/2020-11.md
@ -463,4 +463,17 @@ facet=true&f.owningComm.facet.limit=5&f.owningComm.facet.offset=5&f.countryCode.

 - I created the sub-communities and collections for IWMI's Strategic Priorities and Research Groups on CGSpace: https://cgspace.cgiar.org/handle/10568/110259

+## 2020-11-24
+
+- Yesterday Abenet asked me to investigate why AReS only shows 9,000 "livestock" terms in the ILRI community on AReS, but on CGSpace we have over 10,000
+  - I added the lowercase formatter to all center and CRP subjects fields and re-harvested
+  - Now I see there are 9,999, which seems suspicious
+  - I filed a bug on GitHub: https://github.com/ilri/OpenRXV/issues/61
+- Help Abenet map an item on CGSpace for CIAT
+  - If I search for the entire item title I don't get any results, but I notice this item had a ":" in the title, so I tried searching for part of the title without the colon and it worked
+  - It is a mystery to me that you can't map an item using its Handle...
+- I started processing the statistics-2011 core with Atmire's AtomicStatisticsUpdateCLI tool
+- I called Moayad and we worked on the views/downloads issue on OpenRXV
+  - It turns out to be a mapping (schema) issue in Elasticsearch due to DSpace 6 UUIDs (LOL!!)
+
 <!-- vim: set sw=2 ts=2: -->
--- a/content/posts/cgspace-dspace6-upgrade.md
+++ b/content/posts/cgspace-dspace6-upgrade.md
@ -431,3 +431,13 @@ $ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisti
 ```

 It took ~32 hours to finish processing this core.
+
+## statistics-2018
+
+The statistics-2018 core, in 12-hour batches:
+
+```
+$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2018
+```
+
+It took ~28 hours to finish processing this core.
--- a/docs/2020-11/index.html
+++ b/docs/2020-11/index.html
@ -17,7 +17,7 @@ So far we&rsquo;ve spent at least fifty hours to process the statistics and stat
 <meta property="og:type" content="article" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2020-11/" />
 <meta property="article:published_time" content="2020-11-01T13:11:54+02:00" />
-<meta property="article:modified_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="article:modified_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="November, 2020"/>
@ -39,9 +39,9 @@ So far we&rsquo;ve spent at least fifty hours to process the statistics and stat
  "@type": "BlogPosting",
  "headline": "November, 2020",
  "url": "https://alanorth.github.io/cgspace-notes/2020-11/",
-  "wordCount": "3056",
+  "wordCount": "3215",
  "datePublished": "2020-11-01T13:11:54+02:00",
-  "dateModified": "2020-11-22T23:08:49+02:00",
+  "dateModified": "2020-11-23T22:44:29+02:00",
  "author": {
    "@type": "Person",
    "name": "Alan Orth"
@ -623,6 +623,28 @@ COPY 87411
 <ul>
 <li>I created the sub-communities and collections for IWMI&rsquo;s Strategic Priorities and Research Groups on CGSpace: <a href="https://cgspace.cgiar.org/handle/10568/110259">https://cgspace.cgiar.org/handle/10568/110259</a></li>
 </ul>
+<h2 id="2020-11-24">2020-11-24</h2>
+<ul>
+<li>Yesterday Abenet asked me to investigate why AReS only shows 9,000 &ldquo;livestock&rdquo; terms in the ILRI community on AReS, but on CGSpace we have over 10,000
+<ul>
+<li>I added the lowercase formatter to all center and CRP subjects fields and re-harvested</li>
+<li>Now I see there are 9,999, which seems suspicious</li>
+<li>I filed a bug on GitHub: <a href="https://github.com/ilri/OpenRXV/issues/61">https://github.com/ilri/OpenRXV/issues/61</a></li>
+</ul>
+</li>
+<li>Help Abenet map an item on CGSpace for CIAT
+<ul>
+<li>If I search for the entire item title I don&rsquo;t get any results, but I notice this item had a &ldquo;:&rdquo; in the title, so I tried searching for part of the title without the colon and it worked</li>
+<li>It is a mystery to me that you can&rsquo;t map an item using its Handle&hellip;</li>
+</ul>
+</li>
+<li>I started processing the statistics-2011 core with Atmire&rsquo;s AtomicStatisticsUpdateCLI tool</li>
+<li>I called Moayad and we worked on the views/downloads issue on OpenRXV
+<ul>
+<li>It turns out to be a mapping (schema) issue in Elasticsearch due to DSpace 6 UUIDs (LOL!!)</li>
+</ul>
+</li>
+</ul>
 <!-- raw HTML omitted -->

  
--- a/docs/categories/index.html
+++ b/docs/categories/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Categories"/>
--- a/docs/categories/notes/index.html
+++ b/docs/categories/notes/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Notes"/>
--- a/docs/categories/notes/page/2/index.html
+++ b/docs/categories/notes/page/2/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Notes"/>
--- a/docs/categories/notes/page/3/index.html
+++ b/docs/categories/notes/page/3/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Notes"/>
--- a/docs/categories/notes/page/4/index.html
+++ b/docs/categories/notes/page/4/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Notes"/>
--- a/docs/categories/notes/page/5/index.html
+++ b/docs/categories/notes/page/5/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Notes"/>
--- a/docs/cgspace-dspace6-upgrade/index.html
+++ b/docs/cgspace-dspace6-upgrade/index.html
@ -10,7 +10,7 @@
 <meta property="og:type" content="article" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/cgspace-dspace6-upgrade/" />
 <meta property="article:published_time" content="2020-11-15T13:27:35+02:00" />
-<meta property="article:modified_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="article:modified_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="CGSpace DSpace 6 Upgrade"/>
@ -25,9 +25,9 @@
  "@type": "BlogPosting",
  "headline": "CGSpace DSpace 6 Upgrade",
  "url": "https://alanorth.github.io/cgspace-notes/cgspace-dspace6-upgrade/",
-  "wordCount": "1327",
+  "wordCount": "1354",
  "datePublished": "2020-11-15T13:27:35+02:00",
-  "dateModified": "2020-11-22T23:08:49+02:00",
+  "dateModified": "2020-11-23T22:44:29+02:00",
  "author": {
    "@type": "Person",
    "name": "Alan Orth"
@ -412,6 +412,10 @@ $ chrt -b 0 dspace solr-upgrade-statistics-6x -n 2500000 -i statistics-2018
 <p>The statistics-2019 core, in 12-hour batches:</p>
 <pre><code>$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2019
 </code></pre><p>It took ~32 hours to finish processing this core.</p>
+<h2 id="statistics-2018-1">statistics-2018</h2>
+<p>The statistics-2018 core, in 12-hour batches:</p>
+<pre><code>$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2018
+</code></pre><p>It took ~28 hours to finish processing this core.</p>

  

--- a/docs/index.html
+++ b/docs/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="CGSpace Notes"/>
--- a/docs/page/2/index.html
+++ b/docs/page/2/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="CGSpace Notes"/>
--- a/docs/page/3/index.html
+++ b/docs/page/3/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="CGSpace Notes"/>
--- a/docs/page/4/index.html
+++ b/docs/page/4/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="CGSpace Notes"/>
--- a/docs/page/5/index.html
+++ b/docs/page/5/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="CGSpace Notes"/>
--- a/docs/page/6/index.html
+++ b/docs/page/6/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="CGSpace Notes"/>
--- a/docs/page/7/index.html
+++ b/docs/page/7/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="CGSpace Notes"/>
--- a/docs/posts/index.html
+++ b/docs/posts/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Posts"/>
--- a/docs/posts/page/2/index.html
+++ b/docs/posts/page/2/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Posts"/>
--- a/docs/posts/page/3/index.html
+++ b/docs/posts/page/3/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Posts"/>
--- a/docs/posts/page/4/index.html
+++ b/docs/posts/page/4/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Posts"/>
--- a/docs/posts/page/5/index.html
+++ b/docs/posts/page/5/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Posts"/>
--- a/docs/posts/page/6/index.html
+++ b/docs/posts/page/6/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Posts"/>
--- a/docs/posts/page/7/index.html
+++ b/docs/posts/page/7/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Posts"/>
--- a/docs/sitemap.xml
+++ b/docs/sitemap.xml
@ -4,42 +4,42 @@
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/categories/</loc>
-    <lastmod>2020-11-22T23:08:49+02:00</lastmod>
+    <lastmod>2020-11-23T22:44:29+02:00</lastmod>
  </url>
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/cgspace-dspace6-upgrade/</loc>
-    <lastmod>2020-11-22T23:08:49+02:00</lastmod>
+    <lastmod>2020-11-23T22:44:29+02:00</lastmod>
  </url>
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/</loc>
-    <lastmod>2020-11-22T23:08:49+02:00</lastmod>
+    <lastmod>2020-11-23T22:44:29+02:00</lastmod>
  </url>
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/tags/migration/</loc>
-    <lastmod>2020-11-22T23:08:49+02:00</lastmod>
+    <lastmod>2020-11-23T22:44:29+02:00</lastmod>
  </url>
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
-    <lastmod>2020-11-22T23:08:49+02:00</lastmod>
+    <lastmod>2020-11-23T22:44:29+02:00</lastmod>
  </url>
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
-    <lastmod>2020-11-22T23:08:49+02:00</lastmod>
+    <lastmod>2020-11-23T22:44:29+02:00</lastmod>
  </url>
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
-    <lastmod>2020-11-22T23:08:49+02:00</lastmod>
+    <lastmod>2020-11-23T22:44:29+02:00</lastmod>
  </url>
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/2020-11/</loc>
-    <lastmod>2020-11-22T23:08:49+02:00</lastmod>
+    <lastmod>2020-11-23T22:44:29+02:00</lastmod>
  </url>
  
  <url>
--- a/docs/tags/index.html
+++ b/docs/tags/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/tags/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Tags"/>
--- a/docs/tags/migration/index.html
+++ b/docs/tags/migration/index.html
@ -9,7 +9,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/tags/migration/" />
-<meta property="og:updated_time" content="2020-11-22T23:08:49+02:00" />
+<meta property="og:updated_time" content="2020-11-23T22:44:29+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="Migration"/>