Add notes for 2019-08-05

This commit is contained in:
Alan Orth 2019-08-05 16:49:31 +03:00
parent 36afd4c077
commit 833aa58bac
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
3 changed files with 99 additions and 8 deletions

View File

@ -19,4 +19,46 @@ tags: ["Notes"]
<!--more--> <!--more-->
## 2019-08-05
- Update Tomcat to 7.0.96 in the [Ansible infrastructure playbooks](https://github.com/ilri/rmg-ansible-public)
- Update PostgreSQL JDBC driver to 42.2.6 in the [Ansible infrastrucutre playbooks](https://github.com/ilri/rmg-ansible-public)
- Deploy both on DSpace Test (linode19)
- Looking at the 1429 records for Bioversity migration again
- The following items use the same exact PDF and seem to be duplicates:
- https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=10191
- https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=342
- The following items use the same exact PDF, but one seems to be incorrect:
- https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=5347
- https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=5340
- The following PDFs are used by several items incorrectly:
- `Report_of_a_Working_Group_on_Allium_7.pdf`
- `Report_of_a_Working_Group_on_Allium_Fourth_meeting_1696.pdf`
- The following items use the same PDF with a different name, but seem to be duplicates (pick one?):
- https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=433
- https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=10189
- The following items use the same PDF with a different name, but seem to be duplicates (pick one?):
- https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=332
- https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=10187
- There are about thirty PDFs that have French or Spanish filenames and there seems to be an encoding issue
- I asked Francesco if he can give me a PDF URL column instead of a "filename" column so I can download the files myself
- At *least* the ~50 filenames identified by the following GREL will have issues:
```
or(
isNotNull(value.match(/^.*.*$/)),
isNotNull(value.match(/^.*é.*$/)),
isNotNull(value.match(/^.*á.*$/)),
isNotNull(value.match(/^.*è.*$/)),
isNotNull(value.match(/^.*í.*$/)),
isNotNull(value.match(/^.*ó.*$/)),
isNotNull(value.match(/^.*ú.*$/)),
isNotNull(value.match(/^.*à.*$/)),
isNotNull(value.match(/^.*û.*$/))
).toString()
```
- I tried to extract the filenames and construct a URL to download the PDFs with my `generate-thumbnails.py` script, but there seem to be several paths for PDFs so I can't guess it properly
- I will have to wait for Francesco to respond about the PDFs, or perhaps proceed with a metadata-only upload so we can do other checks on DSpace Test
<!-- vim: set sw=2 ts=2: --> <!-- vim: set sw=2 ts=2: -->

View File

@ -27,7 +27,7 @@ Run system updates on DSpace Test (linode19) and reboot it
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2019-08/" /> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2019-08/" />
<meta property="article:published_time" content="2019-08-03T12:39:51&#43;03:00"/> <meta property="article:published_time" content="2019-08-03T12:39:51&#43;03:00"/>
<meta property="article:modified_time" content="2019-08-03T12:39:51&#43;03:00"/> <meta property="article:modified_time" content="2019-08-04T22:49:04&#43;03:00"/>
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="August, 2019"/> <meta name="twitter:title" content="August, 2019"/>
@ -59,9 +59,9 @@ Run system updates on DSpace Test (linode19) and reboot it
"@type": "BlogPosting", "@type": "BlogPosting",
"headline": "August, 2019", "headline": "August, 2019",
"url": "https:\/\/alanorth.github.io\/cgspace-notes\/2019-08\/", "url": "https:\/\/alanorth.github.io\/cgspace-notes\/2019-08\/",
"wordCount": "95", "wordCount": "341",
"datePublished": "2019-08-03T12:39:51\x2b03:00", "datePublished": "2019-08-03T12:39:51\x2b03:00",
"dateModified": "2019-08-03T12:39:51\x2b03:00", "dateModified": "2019-08-04T22:49:04\x2b03:00",
"author": { "author": {
"@type": "Person", "@type": "Person",
"name": "Alan Orth" "name": "Alan Orth"
@ -147,6 +147,55 @@ Run system updates on DSpace Test (linode19) and reboot it
<li>Run system updates on DSpace Test (linode19) and reboot it</li> <li>Run system updates on DSpace Test (linode19) and reboot it</li>
</ul> </ul>
<h2 id="2019-08-05">2019-08-05</h2>
<ul>
<li>Update Tomcat to 7.0.96 in the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure playbooks</a></li>
<li>Update PostgreSQL JDBC driver to 42.2.6 in the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastrucutre playbooks</a></li>
<li>Deploy both on DSpace Test (linode19)</li>
<li><p>Looking at the 1429 records for Bioversity migration again</p>
<ul>
<li>The following items use the same exact PDF and seem to be duplicates:</li>
<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=10191">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=10191</a></li>
<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=342">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=342</a></li>
<li>The following items use the same exact PDF, but one seems to be incorrect:</li>
<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=5347">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=5347</a></li>
<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=5340">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=5340</a></li>
<li>The following PDFs are used by several items incorrectly:</li>
<li><code>Report_of_a_Working_Group_on_Allium_7.pdf</code></li>
<li><code>Report_of_a_Working_Group_on_Allium_Fourth_meeting_1696.pdf</code></li>
<li>The following items use the same PDF with a different name, but seem to be duplicates (pick one?):</li>
<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=433">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=433</a></li>
<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=10189">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=10189</a></li>
<li>The following items use the same PDF with a different name, but seem to be duplicates (pick one?):</li>
<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=332">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=332</a></li>
<li><a href="https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=10187">https://www.bioversityinternational.org/index.php?id=244&amp;tx_news_pi1[news]=10187</a></li>
<li>There are about thirty PDFs that have French or Spanish filenames and there seems to be an encoding issue</li>
<li>I asked Francesco if he can give me a PDF URL column instead of a &ldquo;filename&rdquo; column so I can download the files myself</li>
<li><p>At <em>least</em> the ~50 filenames identified by the following GREL will have issues:</p>
<pre><code>or(
isNotNull(value.match(/^.*.*$/)),
isNotNull(value.match(/^.*é.*$/)),
isNotNull(value.match(/^.*á.*$/)),
isNotNull(value.match(/^.*è.*$/)),
isNotNull(value.match(/^.*í.*$/)),
isNotNull(value.match(/^.*ó.*$/)),
isNotNull(value.match(/^.*ú.*$/)),
isNotNull(value.match(/^.*à.*$/)),
isNotNull(value.match(/^.*û.*$/))
).toString()
</code></pre></li>
</ul></li>
<li><p>I tried to extract the filenames and construct a URL to download the PDFs with my <code>generate-thumbnails.py</code> script, but there seem to be several paths for PDFs so I can&rsquo;t guess it properly</p></li>
<li><p>I will have to wait for Francesco to respond about the PDFs, or perhaps proceed with a metadata-only upload so we can do other checks on DSpace Test</p></li>
</ul>
<!-- vim: set sw=2 ts=2: --> <!-- vim: set sw=2 ts=2: -->

View File

@ -4,30 +4,30 @@
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/2019-08/</loc> <loc>https://alanorth.github.io/cgspace-notes/2019-08/</loc>
<lastmod>2019-08-03T12:39:51+03:00</lastmod> <lastmod>2019-08-04T22:49:04+03:00</lastmod>
</url> </url>
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/</loc> <loc>https://alanorth.github.io/cgspace-notes/</loc>
<lastmod>2019-08-03T12:39:51+03:00</lastmod> <lastmod>2019-08-04T22:49:04+03:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc> <loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
<lastmod>2019-08-03T12:39:51+03:00</lastmod> <lastmod>2019-08-04T22:49:04+03:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc> <loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
<lastmod>2019-08-03T12:39:51+03:00</lastmod> <lastmod>2019-08-04T22:49:04+03:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc> <loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
<lastmod>2019-08-03T12:39:51+03:00</lastmod> <lastmod>2019-08-04T22:49:04+03:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>