Add notes for 2019-08-05

content/posts/2019-08.md

@@ -19,4 +19,46 @@ tags: ["Notes"]
 
 <!--more-->
 
+## 2019-08-05
+
+- Update Tomcat to 7.0.96 in the [Ansible infrastructure playbooks](https://github.com/ilri/rmg-ansible-public)
+- Update PostgreSQL JDBC driver to 42.2.6 in the [Ansible infrastrucutre playbooks](https://github.com/ilri/rmg-ansible-public)
+- Deploy both on DSpace Test (linode19)
+- Looking at the 1429 records for Bioversity migration again
+  - The following items use the same exact PDF and seem to be duplicates:
+    - https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=10191
+    - https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=342
+  - The following items use the same exact PDF, but one seems to be incorrect:
+    - https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=5347
+    - https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=5340
+  - The following PDFs are used by several items incorrectly:
+    - `Report_of_a_Working_Group_on_Allium_7.pdf`
+    - `Report_of_a_Working_Group_on_Allium_Fourth_meeting_1696.pdf`
+  - The following items use the same PDF with a different name, but seem to be duplicates (pick one?):
+    - https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=433
+    - https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=10189
+  - The following items use the same PDF with a different name, but seem to be duplicates (pick one?):
+    - https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=332
+    - https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=10187
+  - There are about thirty PDFs that have French or Spanish filenames and there seems to be an encoding issue
+    - I asked Francesco if he can give me a PDF URL column instead of a "filename" column so I can download the files myself
+    - At *least* the ~50 filenames identified by the following GREL will have issues:
+
+```
+or(
+  isNotNull(value.match(/^.*’.*$/)),
+  isNotNull(value.match(/^.*é.*$/)),
+  isNotNull(value.match(/^.*á.*$/)),
+  isNotNull(value.match(/^.*è.*$/)),
+  isNotNull(value.match(/^.*í.*$/)),
+  isNotNull(value.match(/^.*ó.*$/)),
+  isNotNull(value.match(/^.*ú.*$/)),
+  isNotNull(value.match(/^.*à.*$/)),
+  isNotNull(value.match(/^.*û.*$/))
+).toString()
+```
+
+- I tried to extract the filenames and construct a URL to download the PDFs with my `generate-thumbnails.py` script, but there seem to be several paths for PDFs so I can't guess it properly
+- I will have to wait for Francesco to respond about the PDFs, or perhaps proceed with a metadata-only upload so we can do other checks on DSpace Test
+
 <!-- vim: set sw=2 ts=2: -->

docs/2019-08/index.html

@@ -27,7 +27,7 @@ Run system updates on DSpace Test (linode19) and reboot it
 <meta property="og:type" content="article" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2019-08/" />
 <meta property="article:published_time" content="2019-08-03T12:39:51&#43;03:00"/>
-<meta property="article:modified_time" content="2019-08-03T12:39:51&#43;03:00"/>
+<meta property="article:modified_time" content="2019-08-04T22:49:04&#43;03:00"/>
 
 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="August, 2019"/>
@@ -59,9 +59,9 @@ Run system updates on DSpace Test (linode19) and reboot it
   "@type": "BlogPosting",
   "headline": "August, 2019",
   "url": "https:\/\/alanorth.github.io\/cgspace-notes\/2019-08\/",
-  "wordCount": "95",
+  "wordCount": "341",
   "datePublished": "2019-08-03T12:39:51\x2b03:00",
-  "dateModified": "2019-08-03T12:39:51\x2b03:00",
+  "dateModified": "2019-08-04T22:49:04\x2b03:00",
   "author": {
     "@type": "Person",
     "name": "Alan Orth"
@@ -147,6 +147,55 @@ Run system updates on DSpace Test (linode19) and reboot it
 <li>Run system updates on DSpace Test (linode19) and reboot it</li>
 </ul>
 
+<h2 id="2019-08-05">2019-08-05</h2>
+
+<ul>
+<li>Update Tomcat to 7.0.96 in the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure playbooks</a></li>
+<li>Update PostgreSQL JDBC driver to 42.2.6 in the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastrucutre playbooks</a></li>
+<li>Deploy both on DSpace Test (linode19)</li>
+
+<li><p>Looking at the 1429 records for Bioversity migration again</p>
+
+<ul>
+<li>The following items use the same exact PDF and seem to be duplicates:</li>
+<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=10191">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=10191</a></li>
+<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=342">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=342</a></li>
+<li>The following items use the same exact PDF, but one seems to be incorrect:</li>
+<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=5347">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=5347</a></li>
+<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=5340">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=5340</a></li>
+<li>The following PDFs are used by several items incorrectly:</li>
+<li><code>Report_of_a_Working_Group_on_Allium_7.pdf</code></li>
+<li><code>Report_of_a_Working_Group_on_Allium_Fourth_meeting_1696.pdf</code></li>
+<li>The following items use the same PDF with a different name, but seem to be duplicates (pick one?):</li>
+<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=433">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=433</a></li>
+<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=10189">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=10189</a></li>
+<li>The following items use the same PDF with a different name, but seem to be duplicates (pick one?):</li>
+<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=332">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=332</a></li>
+<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=10187">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=10187</a></li>
+<li>There are about thirty PDFs that have French or Spanish filenames and there seems to be an encoding issue</li>
+<li>I asked Francesco if he can give me a PDF URL column instead of a &ldquo;filename&rdquo; column so I can download the files myself</li>
+
+<li><p>At <em>least</em> the ~50 filenames identified by the following GREL will have issues:</p>
+
+<pre><code>or(
+isNotNull(value.match(/^.*’.*$/)),
+isNotNull(value.match(/^.*é.*$/)),
+isNotNull(value.match(/^.*á.*$/)),
+isNotNull(value.match(/^.*è.*$/)),
+isNotNull(value.match(/^.*í.*$/)),
+isNotNull(value.match(/^.*ó.*$/)),
+isNotNull(value.match(/^.*ú.*$/)),
+isNotNull(value.match(/^.*à.*$/)),
+isNotNull(value.match(/^.*û.*$/))
+).toString()
+</code></pre></li>
+</ul></li>
+
+<li><p>I tried to extract the filenames and construct a URL to download the PDFs with my <code>generate-thumbnails.py</code> script, but there seem to be several paths for PDFs so I can&rsquo;t guess it properly</p></li>
+
+<li><p>I will have to wait for Francesco to respond about the PDFs, or perhaps proceed with a metadata-only upload so we can do other checks on DSpace Test</p></li>
+</ul>
+
 <!-- vim: set sw=2 ts=2: -->
 
   

docs/sitemap.xml

@@ -4,30 +4,30 @@
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/2019-08/</loc>
-    <lastmod>2019-08-03T12:39:51+03:00</lastmod>
+    <lastmod>2019-08-04T22:49:04+03:00</lastmod>
   </url>
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/</loc>
-    <lastmod>2019-08-03T12:39:51+03:00</lastmod>
+    <lastmod>2019-08-04T22:49:04+03:00</lastmod>
     <priority>0</priority>
   </url>
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
-    <lastmod>2019-08-03T12:39:51+03:00</lastmod>
+    <lastmod>2019-08-04T22:49:04+03:00</lastmod>
     <priority>0</priority>
   </url>
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
-    <lastmod>2019-08-03T12:39:51+03:00</lastmod>
+    <lastmod>2019-08-04T22:49:04+03:00</lastmod>
     <priority>0</priority>
   </url>
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
-    <lastmod>2019-08-03T12:39:51+03:00</lastmod>
+    <lastmod>2019-08-04T22:49:04+03:00</lastmod>
     <priority>0</priority>
   </url>