mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-11-18 20:57:03 +01:00
272 lines
9.5 KiB
HTML
272 lines
9.5 KiB
HTML
<!DOCTYPE html>
|
||
<html lang="en">
|
||
|
||
<head>
|
||
<meta charset="utf-8">
|
||
<meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">
|
||
|
||
<meta property="og:title" content="August, 2019" />
|
||
<meta property="og:description" content="2019-08-03
|
||
|
||
|
||
Look at Bioversity’s latest migration CSV and now I see that Francesco has cleaned up the extra columns and the newline at the end of the file, but many of the column headers have an extra space in the name…
|
||
|
||
|
||
2019-08-04
|
||
|
||
|
||
Deploy ORCID identifier updates requested by Bioversity to CGSpace
|
||
Run system updates on CGSpace (linode18) and reboot it
|
||
|
||
|
||
Before updating it I checked Solr and verified that all statistics cores were loaded properly…
|
||
After rebooting, all statistics cores were loaded… wow, that’s lucky.
|
||
|
||
Run system updates on DSpace Test (linode19) and reboot it
|
||
" />
|
||
<meta property="og:type" content="article" />
|
||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2019-08/" />
|
||
<meta property="article:published_time" content="2019-08-03T12:39:51+03:00"/>
|
||
<meta property="article:modified_time" content="2019-08-04T22:49:04+03:00"/>
|
||
|
||
<meta name="twitter:card" content="summary"/>
|
||
<meta name="twitter:title" content="August, 2019"/>
|
||
<meta name="twitter:description" content="2019-08-03
|
||
|
||
|
||
Look at Bioversity’s latest migration CSV and now I see that Francesco has cleaned up the extra columns and the newline at the end of the file, but many of the column headers have an extra space in the name…
|
||
|
||
|
||
2019-08-04
|
||
|
||
|
||
Deploy ORCID identifier updates requested by Bioversity to CGSpace
|
||
Run system updates on CGSpace (linode18) and reboot it
|
||
|
||
|
||
Before updating it I checked Solr and verified that all statistics cores were loaded properly…
|
||
After rebooting, all statistics cores were loaded… wow, that’s lucky.
|
||
|
||
Run system updates on DSpace Test (linode19) and reboot it
|
||
"/>
|
||
<meta name="generator" content="Hugo 0.55.6" />
|
||
|
||
|
||
|
||
<script type="application/ld+json">
|
||
{
|
||
"@context": "http://schema.org",
|
||
"@type": "BlogPosting",
|
||
"headline": "August, 2019",
|
||
"url": "https:\/\/alanorth.github.io\/cgspace-notes\/2019-08\/",
|
||
"wordCount": "341",
|
||
"datePublished": "2019-08-03T12:39:51\x2b03:00",
|
||
"dateModified": "2019-08-04T22:49:04\x2b03:00",
|
||
"author": {
|
||
"@type": "Person",
|
||
"name": "Alan Orth"
|
||
},
|
||
"keywords": "Notes"
|
||
}
|
||
</script>
|
||
|
||
|
||
|
||
<link rel="canonical" href="https://alanorth.github.io/cgspace-notes/2019-08/">
|
||
|
||
<title>August, 2019 | CGSpace Notes</title>
|
||
|
||
<!-- combined, minified CSS -->
|
||
<link href="https://alanorth.github.io/cgspace-notes/css/style.css" rel="stylesheet" integrity="sha384-G5B34w7DFTumWTswxYzTX7NWfbvQEg1HbFFEg6ItN03uTAAoS2qkPS/fu3LhuuSA" crossorigin="anonymous">
|
||
|
||
<!-- RSS 2.0 feed -->
|
||
|
||
|
||
|
||
|
||
|
||
|
||
</head>
|
||
|
||
<body>
|
||
|
||
|
||
<div class="blog-masthead">
|
||
<div class="container">
|
||
<nav class="nav blog-nav">
|
||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||
</nav>
|
||
</div>
|
||
</div>
|
||
|
||
|
||
|
||
|
||
<header class="blog-header">
|
||
<div class="container">
|
||
<h1 class="blog-title"><a href="https://alanorth.github.io/cgspace-notes/" rel="home">CGSpace Notes</a></h1>
|
||
<p class="lead blog-description">Documenting day-to-day work on the <a href="https://cgspace.cgiar.org">CGSpace</a> repository.</p>
|
||
</div>
|
||
</header>
|
||
|
||
|
||
|
||
|
||
<div class="container">
|
||
<div class="row">
|
||
<div class="col-sm-8 blog-main">
|
||
|
||
|
||
|
||
|
||
<article class="blog-post">
|
||
<header>
|
||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2019-08/">August, 2019</a></h2>
|
||
<p class="blog-post-meta"><time datetime="2019-08-03T12:39:51+03:00">Sat Aug 03, 2019</time> by Alan Orth in
|
||
|
||
<i class="fa fa-tag" aria-hidden="true"></i> <a href="/cgspace-notes/tags/notes" rel="tag">Notes</a>
|
||
|
||
</p>
|
||
</header>
|
||
<h2 id="2019-08-03">2019-08-03</h2>
|
||
|
||
<ul>
|
||
<li>Look at Bioversity’s latest migration CSV and now I see that Francesco has cleaned up the extra columns and the newline at the end of the file, but many of the column headers have an extra space in the name…</li>
|
||
</ul>
|
||
|
||
<h2 id="2019-08-04">2019-08-04</h2>
|
||
|
||
<ul>
|
||
<li>Deploy ORCID identifier updates requested by Bioversity to CGSpace</li>
|
||
<li>Run system updates on CGSpace (linode18) and reboot it
|
||
|
||
<ul>
|
||
<li>Before updating it I checked Solr and verified that all statistics cores were loaded properly…</li>
|
||
<li>After rebooting, all statistics cores were loaded… wow, that’s lucky.</li>
|
||
</ul></li>
|
||
<li>Run system updates on DSpace Test (linode19) and reboot it</li>
|
||
</ul>
|
||
|
||
<h2 id="2019-08-05">2019-08-05</h2>
|
||
|
||
<ul>
|
||
<li>Update Tomcat to 7.0.96 in the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure playbooks</a></li>
|
||
<li>Update PostgreSQL JDBC driver to 42.2.6 in the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastrucutre playbooks</a></li>
|
||
<li>Deploy both on DSpace Test (linode19)</li>
|
||
|
||
<li><p>Looking at the 1429 records for Bioversity migration again</p>
|
||
|
||
<ul>
|
||
<li>The following items use the same exact PDF and seem to be duplicates:</li>
|
||
<li><a href="https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=10191">https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=10191</a></li>
|
||
<li><a href="https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=342">https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=342</a></li>
|
||
<li>The following items use the same exact PDF, but one seems to be incorrect:</li>
|
||
<li><a href="https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=5347">https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=5347</a></li>
|
||
<li><a href="https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=5340">https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=5340</a></li>
|
||
<li>The following PDFs are used by several items incorrectly:</li>
|
||
<li><code>Report_of_a_Working_Group_on_Allium_7.pdf</code></li>
|
||
<li><code>Report_of_a_Working_Group_on_Allium_Fourth_meeting_1696.pdf</code></li>
|
||
<li>The following items use the same PDF with a different name, but seem to be duplicates (pick one?):</li>
|
||
<li><a href="https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=433">https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=433</a></li>
|
||
<li><a href="https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=10189">https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=10189</a></li>
|
||
<li>The following items use the same PDF with a different name, but seem to be duplicates (pick one?):</li>
|
||
<li><a href="https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=332">https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=332</a></li>
|
||
<li><a href="https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=10187">https://www.bioversityinternational.org/index.php?id=244&tx_news_pi1[news]=10187</a></li>
|
||
<li>There are about thirty PDFs that have French or Spanish filenames and there seems to be an encoding issue</li>
|
||
<li>I asked Francesco if he can give me a PDF URL column instead of a “filename” column so I can download the files myself</li>
|
||
|
||
<li><p>At <em>least</em> the ~50 filenames identified by the following GREL will have issues:</p>
|
||
|
||
<pre><code>or(
|
||
isNotNull(value.match(/^.*’.*$/)),
|
||
isNotNull(value.match(/^.*é.*$/)),
|
||
isNotNull(value.match(/^.*á.*$/)),
|
||
isNotNull(value.match(/^.*è.*$/)),
|
||
isNotNull(value.match(/^.*í.*$/)),
|
||
isNotNull(value.match(/^.*ó.*$/)),
|
||
isNotNull(value.match(/^.*ú.*$/)),
|
||
isNotNull(value.match(/^.*à.*$/)),
|
||
isNotNull(value.match(/^.*û.*$/))
|
||
).toString()
|
||
</code></pre></li>
|
||
</ul></li>
|
||
|
||
<li><p>I tried to extract the filenames and construct a URL to download the PDFs with my <code>generate-thumbnails.py</code> script, but there seem to be several paths for PDFs so I can’t guess it properly</p></li>
|
||
|
||
<li><p>I will have to wait for Francesco to respond about the PDFs, or perhaps proceed with a metadata-only upload so we can do other checks on DSpace Test</p></li>
|
||
</ul>
|
||
|
||
<!-- vim: set sw=2 ts=2: -->
|
||
|
||
|
||
|
||
|
||
|
||
</article>
|
||
|
||
|
||
|
||
</div> <!-- /.blog-main -->
|
||
|
||
<aside class="col-sm-3 ml-auto blog-sidebar">
|
||
|
||
|
||
|
||
<section class="sidebar-module">
|
||
<h4>Recent Posts</h4>
|
||
<ol class="list-unstyled">
|
||
|
||
|
||
<li><a href="/cgspace-notes/2019-08/">August, 2019</a></li>
|
||
|
||
<li><a href="/cgspace-notes/posts/">Posts</a></li>
|
||
|
||
<li><a href="/cgspace-notes/2019-07/">July, 2019</a></li>
|
||
|
||
<li><a href="/cgspace-notes/2019-06/">June, 2019</a></li>
|
||
|
||
<li><a href="/cgspace-notes/2019-05/">May, 2019</a></li>
|
||
|
||
</ol>
|
||
</section>
|
||
|
||
|
||
|
||
|
||
<section class="sidebar-module">
|
||
<h4>Links</h4>
|
||
<ol class="list-unstyled">
|
||
|
||
<li><a href="https://cgspace.cgiar.org">CGSpace</a></li>
|
||
|
||
<li><a href="https://dspacetest.cgiar.org">DSpace Test</a></li>
|
||
|
||
<li><a href="https://github.com/ilri/DSpace">CGSpace @ GitHub</a></li>
|
||
|
||
</ol>
|
||
</section>
|
||
|
||
</aside>
|
||
|
||
|
||
</div> <!-- /.row -->
|
||
</div> <!-- /.container -->
|
||
|
||
|
||
|
||
<footer class="blog-footer">
|
||
<p>
|
||
|
||
Blog template created by <a href="https://twitter.com/mdo">@mdo</a>, ported to Hugo by <a href='https://twitter.com/mralanorth'>@mralanorth</a>.
|
||
|
||
</p>
|
||
<p>
|
||
<a href="#">Back to top</a>
|
||
</p>
|
||
</footer>
|
||
|
||
|
||
</body>
|
||
|
||
</html>
|