Add notes for 2022-03-31

2024-11-22 06:35:03 +01:00 · 2022-03-31 16:09:14 +03:00 · 2022-03-31 16:09:14 +03:00 · 054d666fe0
commit 054d666fe0
parent 79b5f023e1
26 changed files with 90 additions and 31 deletions
--- a/content/posts/2022-03.md
+++ b/content/posts/2022-03.md
@ -271,4 +271,31 @@ $ chrt -b 0 dspace filter-media -p "ImageMagick PDF Thumbnail" -i 10947/50
 - After that I did some normalization on the `cg.subject.system` metadata and extracted a few dozen countries to the country field
 - Start a harvest on AReS

+## 2022-03-30
+
+- Yesterday Rafael from CIAT asked me to re-create his approver account on DSpace Test as well
+
+```console
+$ dspace user -a -m tip-approve@cgiar.org -g Rafael -s Rodriguez -p 'fuuuu'
+```
+
+- I started looking into the request regarding the CIAT Library PDFs
+  - There are over 4,000 links to PDFs hosted on that server in CGSpace metadata
+  - The links seem to be down though! I emailed Paola to ask
+
+## 2022-03-31
+
+- Switch DSpace Test (linode26) back to CMS GC so I can do some monitoring and evaluation of GC before switching to G1GC
+- Leroy from CIAT said that the CIAT Library server has security issues so was limited to internal traffic
+  - I extracted a list of URLs from CGSpace to send him:
+
+```console
+localhost/dspacetest= ☘ \COPY (SELECT DISTINCT(text_value) FROM metadatavalue WHERE metadata_field_id=219 AND text_value ~ 'https?://ciat-library') to /tmp/2022-03-31-ciat-library-urls.csv WITH CSV HEADER;
+COPY 4552
+```
+
+- I did some checks and cleanups in OpenRefine because there are some values with "#page" etc
+  - Once I sorted them there were only ~2,700, which means there are going to be almost two thousand items with duplicate PDFs
+  - I suggested that we might want to handle those cases specially and extract the chapters or whatever page range since they are probably books
+
 <!-- vim: set sw=2 ts=2: -->
--- a/docs/2022-03/index.html
+++ b/docs/2022-03/index.html
@ -19,7 +19,7 @@ $ csvjoin -c id /tmp/2022-03-01-tac-batch4-701-980.csv /tmp/tac4-filenames.csv &
 <meta property="og:type" content="article" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2022-03/" />
 <meta property="article:published_time" content="2022-03-01T16:46:54+03:00" />
-<meta property="article:modified_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="article:modified_time" content="2022-03-29T21:26:07+03:00" />



@ -44,9 +44,9 @@ $ csvjoin -c id /tmp/2022-03-01-tac-batch4-701-980.csv /tmp/tac4-filenames.csv &
  "@type": "BlogPosting",
  "headline": "March, 2022",
  "url": "https://alanorth.github.io/cgspace-notes/2022-03/",
-  "wordCount": "1589",
+  "wordCount": "1789",
  "datePublished": "2022-03-01T16:46:54+03:00",
-  "dateModified": "2022-03-29T16:01:48+03:00",
+  "dateModified": "2022-03-29T21:26:07+03:00",
  "author": {
    "@type": "Person",
    "name": "Alan Orth"
@ -406,6 +406,38 @@ isNotNull(value.match(&#39;889&#39;))
 <li>After that I did some normalization on the <code>cg.subject.system</code> metadata and extracted a few dozen countries to the country field</li>
 <li>Start a harvest on AReS</li>
 </ul>
+<h2 id="2022-03-30">2022-03-30</h2>
+<ul>
+<li>Yesterday Rafael from CIAT asked me to re-create his approver account on DSpace Test as well</li>
+</ul>
+<div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-console" data-lang="console"><span style="display:flex;"><span>$ dspace user -a -m tip-approve@cgiar.org -g Rafael -s Rodriguez -p <span style="color:#e6db74">&#39;fuuuu&#39;</span>
+</span></span></code></pre></div><ul>
+<li>I started looking into the request regarding the CIAT Library PDFs
+<ul>
+<li>There are over 4,000 links to PDFs hosted on that server in CGSpace metadata</li>
+<li>The links seem to be down though! I emailed Paola to ask</li>
+</ul>
+</li>
+</ul>
+<h2 id="2022-03-31">2022-03-31</h2>
+<ul>
+<li>Switch DSpace Test (linode26) back to CMS GC so I can do some monitoring and evaluation of GC before switching to G1GC</li>
+<li>Leroy from CIAT said that the CIAT Library server has security issues so was limited to internal traffic
+<ul>
+<li>I extracted a list of URLs from CGSpace to send him:</li>
+</ul>
+</li>
+</ul>
+<div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-console" data-lang="console"><span style="display:flex;"><span>localhost/dspacetest= ☘ \COPY (SELECT DISTINCT(text_value) FROM metadatavalue WHERE metadata_field_id=219 AND text_value ~ &#39;https?://ciat-library&#39;) to /tmp/2022-03-31-ciat-library-urls.csv WITH CSV HEADER;
+</span></span><span style="display:flex;"><span>COPY 4552
+</span></span></code></pre></div><ul>
+<li>I did some checks and cleanups in OpenRefine because there are some values with &ldquo;#page&rdquo; etc
+<ul>
+<li>Once I sorted them there were only ~2,700, which means there are going to be almost two thousand items with duplicate PDFs</li>
+<li>I suggested that we might want to handle those cases specially and extract the chapters or whatever page range since they are probably books</li>
+</ul>
+</li>
+</ul>
 <!-- raw HTML omitted -->

  
--- a/docs/categories/index.html
+++ b/docs/categories/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/categories/notes/index.html
+++ b/docs/categories/notes/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/categories/notes/page/2/index.html
+++ b/docs/categories/notes/page/2/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/categories/notes/page/3/index.html
+++ b/docs/categories/notes/page/3/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/categories/notes/page/4/index.html
+++ b/docs/categories/notes/page/4/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/categories/notes/page/5/index.html
+++ b/docs/categories/notes/page/5/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/categories/notes/page/6/index.html
+++ b/docs/categories/notes/page/6/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/index.html
+++ b/docs/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/page/2/index.html
+++ b/docs/page/2/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/page/3/index.html
+++ b/docs/page/3/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/page/4/index.html
+++ b/docs/page/4/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/page/5/index.html
+++ b/docs/page/5/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/page/6/index.html
+++ b/docs/page/6/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/page/7/index.html
+++ b/docs/page/7/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/page/8/index.html
+++ b/docs/page/8/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/posts/index.html
+++ b/docs/posts/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/posts/page/2/index.html
+++ b/docs/posts/page/2/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/posts/page/3/index.html
+++ b/docs/posts/page/3/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/posts/page/4/index.html
+++ b/docs/posts/page/4/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/posts/page/5/index.html
+++ b/docs/posts/page/5/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/posts/page/6/index.html
+++ b/docs/posts/page/6/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/posts/page/7/index.html
+++ b/docs/posts/page/7/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/posts/page/8/index.html
+++ b/docs/posts/page/8/index.html
@ -10,7 +10,7 @@
 <meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
 <meta property="og:type" content="website" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
-<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
+<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />



--- a/docs/sitemap.xml
+++ b/docs/sitemap.xml
@ -3,19 +3,19 @@
  xmlns:xhtml="http://www.w3.org/1999/xhtml">
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/categories/</loc>
-    <lastmod>2022-03-29T16:01:48+03:00</lastmod>
+    <lastmod>2022-03-29T21:26:07+03:00</lastmod>
  </url><url>
    <loc>https://alanorth.github.io/cgspace-notes/</loc>
-    <lastmod>2022-03-29T16:01:48+03:00</lastmod>
+    <lastmod>2022-03-29T21:26:07+03:00</lastmod>
  </url><url>
    <loc>https://alanorth.github.io/cgspace-notes/2022-03/</loc>
-    <lastmod>2022-03-29T16:01:48+03:00</lastmod>
+    <lastmod>2022-03-29T21:26:07+03:00</lastmod>
  </url><url>
    <loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
-    <lastmod>2022-03-29T16:01:48+03:00</lastmod>
+    <lastmod>2022-03-29T21:26:07+03:00</lastmod>
  </url><url>
    <loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
-    <lastmod>2022-03-29T16:01:48+03:00</lastmod>
+    <lastmod>2022-03-29T21:26:07+03:00</lastmod>
  </url><url>
    <loc>https://alanorth.github.io/cgspace-notes/2022-02/</loc>
    <lastmod>2022-03-01T17:17:27+03:00</lastmod>