mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2025-01-27 05:49:12 +01:00
Add notes for 2018-01-02
This commit is contained in:
@ -12,7 +12,7 @@
|
||||
|
||||
|
||||
|
||||
<meta property="og:updated_time" content="2017-12-01T13:53:54+03:00"/>
|
||||
<meta property="og:updated_time" content="2018-01-02T08:35:54-08:00"/>
|
||||
|
||||
|
||||
|
||||
@ -39,7 +39,7 @@
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
},
|
||||
"dateModified": "2017-12-01T13:53:54+03:00",
|
||||
"dateModified": "2018-01-02T08:35:54-08:00",
|
||||
"keywords": "notes,notes,",
|
||||
"description": "Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
|
||||
}
|
||||
@ -97,6 +97,91 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2018-01/">January, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-01-02T08:35:54-08:00">Tue Jan 02, 2018</time> by Alan Orth in
|
||||
|
||||
<i class="fa fa-tag" aria-hidden="true"></i> <a href="/cgspace-notes/tags/notes" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-01-02">2018-01-02</h2>
|
||||
|
||||
<ul>
|
||||
<li>Uptime Robot noticed that CGSpace went down and up a few times last night, for a few minutes each time</li>
|
||||
<li>I didn’t get any load alerts from Linode and the REST and XMLUI logs don’t show anything out of the ordinary</li>
|
||||
<li>So I don’t know WHY Uptime Robot thought it was down so many times</li>
|
||||
<li>I notice this error quite a few times in dspace.log:</li>
|
||||
</ul>
|
||||
|
||||
<pre><code>2018-01-02 01:21:19,137 ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ Error while searching for sidebar facets
|
||||
org.dspace.discovery.SearchServiceException: org.apache.solr.search.SyntaxError: Cannot parse 'dateIssued_keyword:[1976+TO+1979]': Encountered " "]" "] "" at line 1, column 32.
|
||||
</code></pre>
|
||||
|
||||
<ul>
|
||||
<li>And there are many of these errors every day for the past month:</li>
|
||||
</ul>
|
||||
|
||||
<pre><code>$ grep -c "Error while searching for sidebar facets" dspace.log.*
|
||||
dspace.log.2017-11-21:4
|
||||
dspace.log.2017-11-22:1
|
||||
dspace.log.2017-11-23:4
|
||||
dspace.log.2017-11-24:11
|
||||
dspace.log.2017-11-25:0
|
||||
dspace.log.2017-11-26:1
|
||||
dspace.log.2017-11-27:7
|
||||
dspace.log.2017-11-28:21
|
||||
dspace.log.2017-11-29:31
|
||||
dspace.log.2017-11-30:15
|
||||
dspace.log.2017-12-01:15
|
||||
dspace.log.2017-12-02:20
|
||||
dspace.log.2017-12-03:38
|
||||
dspace.log.2017-12-04:65
|
||||
dspace.log.2017-12-05:43
|
||||
dspace.log.2017-12-06:72
|
||||
dspace.log.2017-12-07:27
|
||||
dspace.log.2017-12-08:15
|
||||
dspace.log.2017-12-09:29
|
||||
dspace.log.2017-12-10:35
|
||||
dspace.log.2017-12-11:20
|
||||
dspace.log.2017-12-12:44
|
||||
dspace.log.2017-12-13:36
|
||||
dspace.log.2017-12-14:59
|
||||
dspace.log.2017-12-15:104
|
||||
dspace.log.2017-12-16:53
|
||||
dspace.log.2017-12-17:66
|
||||
dspace.log.2017-12-18:83
|
||||
dspace.log.2017-12-19:101
|
||||
dspace.log.2017-12-20:74
|
||||
dspace.log.2017-12-21:55
|
||||
dspace.log.2017-12-22:66
|
||||
dspace.log.2017-12-23:50
|
||||
dspace.log.2017-12-24:85
|
||||
dspace.log.2017-12-25:62
|
||||
dspace.log.2017-12-26:49
|
||||
dspace.log.2017-12-27:30
|
||||
dspace.log.2017-12-28:54
|
||||
dspace.log.2017-12-29:68
|
||||
dspace.log.2017-12-30:89
|
||||
dspace.log.2017-12-31:53
|
||||
dspace.log.2018-01-01:45
|
||||
dspace.log.2018-01-02:34
|
||||
</code></pre>
|
||||
|
||||
<ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2017-12/">December, 2017</a></h2>
|
||||
@ -357,41 +442,6 @@ COPY 54701
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2017-04/">April, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-04-02T17:08:52+02:00">Sun Apr 02, 2017</time> by Alan Orth in
|
||||
|
||||
<i class="fa fa-tag" aria-hidden="true"></i> <a href="/cgspace-notes/tags/notes" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-04-02">2017-04-02</h2>
|
||||
|
||||
<ul>
|
||||
<li>Merge one change to CCAFS flagships that I had forgotten to remove last month (“MANAGING CLIMATE RISK”): <a href="https://github.com/ilri/DSpace/pull/317">https://github.com/ilri/DSpace/pull/317</a></li>
|
||||
<li>Quick proof-of-concept hack to add <code>dc.rights</code> to the input form, including some inline instructions/hints:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="/cgspace-notes/2017/04/dc-rights.png" alt="dc.rights in the submission form" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Remove redundant/duplicate text in the DSpace submission license</li>
|
||||
<li>Testing the CMYK patch on a collection with 650 items:</li>
|
||||
</ul>
|
||||
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
|
||||
@ -415,6 +465,8 @@ COPY 54701
|
||||
<ol class="list-unstyled">
|
||||
|
||||
|
||||
<li><a href="/cgspace-notes/2018-01/">January, 2018</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-12/">December, 2017</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-11/">November, 2017</a></li>
|
||||
@ -423,8 +475,6 @@ COPY 54701
|
||||
|
||||
<li><a href="/cgspace-notes/cgiar-library-migration/">CGIAR Library Migration</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-09/">September, 2017</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -6,11 +6,87 @@
|
||||
<description>Recent content in Posts on CGSpace Notes</description>
|
||||
<generator>Hugo -- gohugo.io</generator>
|
||||
<language>en-us</language>
|
||||
<lastBuildDate>Fri, 01 Dec 2017 13:53:54 +0300</lastBuildDate>
|
||||
<lastBuildDate>Tue, 02 Jan 2018 08:35:54 -0800</lastBuildDate>
|
||||
|
||||
<atom:link href="https://alanorth.github.io/cgspace-notes/post/index.xml" rel="self" type="application/rss+xml" />
|
||||
|
||||
|
||||
<item>
|
||||
<title>January, 2018</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2018-01/</link>
|
||||
<pubDate>Tue, 02 Jan 2018 08:35:54 -0800</pubDate>
|
||||
|
||||
<guid>https://alanorth.github.io/cgspace-notes/2018-01/</guid>
|
||||
<description><h2 id="2018-01-02">2018-01-02</h2>
|
||||
|
||||
<ul>
|
||||
<li>Uptime Robot noticed that CGSpace went down and up a few times last night, for a few minutes each time</li>
|
||||
<li>I didn&rsquo;t get any load alerts from Linode and the REST and XMLUI logs don&rsquo;t show anything out of the ordinary</li>
|
||||
<li>So I don&rsquo;t know WHY Uptime Robot thought it was down so many times</li>
|
||||
<li>I notice this error quite a few times in dspace.log:</li>
|
||||
</ul>
|
||||
|
||||
<pre><code>2018-01-02 01:21:19,137 ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ Error while searching for sidebar facets
|
||||
org.dspace.discovery.SearchServiceException: org.apache.solr.search.SyntaxError: Cannot parse 'dateIssued_keyword:[1976+TO+1979]': Encountered &quot; &quot;]&quot; &quot;] &quot;&quot; at line 1, column 32.
|
||||
</code></pre>
|
||||
|
||||
<ul>
|
||||
<li>And there are many of these errors every day for the past month:</li>
|
||||
</ul>
|
||||
|
||||
<pre><code>$ grep -c &quot;Error while searching for sidebar facets&quot; dspace.log.*
|
||||
dspace.log.2017-11-21:4
|
||||
dspace.log.2017-11-22:1
|
||||
dspace.log.2017-11-23:4
|
||||
dspace.log.2017-11-24:11
|
||||
dspace.log.2017-11-25:0
|
||||
dspace.log.2017-11-26:1
|
||||
dspace.log.2017-11-27:7
|
||||
dspace.log.2017-11-28:21
|
||||
dspace.log.2017-11-29:31
|
||||
dspace.log.2017-11-30:15
|
||||
dspace.log.2017-12-01:15
|
||||
dspace.log.2017-12-02:20
|
||||
dspace.log.2017-12-03:38
|
||||
dspace.log.2017-12-04:65
|
||||
dspace.log.2017-12-05:43
|
||||
dspace.log.2017-12-06:72
|
||||
dspace.log.2017-12-07:27
|
||||
dspace.log.2017-12-08:15
|
||||
dspace.log.2017-12-09:29
|
||||
dspace.log.2017-12-10:35
|
||||
dspace.log.2017-12-11:20
|
||||
dspace.log.2017-12-12:44
|
||||
dspace.log.2017-12-13:36
|
||||
dspace.log.2017-12-14:59
|
||||
dspace.log.2017-12-15:104
|
||||
dspace.log.2017-12-16:53
|
||||
dspace.log.2017-12-17:66
|
||||
dspace.log.2017-12-18:83
|
||||
dspace.log.2017-12-19:101
|
||||
dspace.log.2017-12-20:74
|
||||
dspace.log.2017-12-21:55
|
||||
dspace.log.2017-12-22:66
|
||||
dspace.log.2017-12-23:50
|
||||
dspace.log.2017-12-24:85
|
||||
dspace.log.2017-12-25:62
|
||||
dspace.log.2017-12-26:49
|
||||
dspace.log.2017-12-27:30
|
||||
dspace.log.2017-12-28:54
|
||||
dspace.log.2017-12-29:68
|
||||
dspace.log.2017-12-30:89
|
||||
dspace.log.2017-12-31:53
|
||||
dspace.log.2018-01-01:45
|
||||
dspace.log.2018-01-02:34
|
||||
</code></pre>
|
||||
|
||||
<ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
<title>December, 2017</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2017-12/</link>
|
||||
|
||||
@ -12,7 +12,7 @@
|
||||
|
||||
|
||||
|
||||
<meta property="og:updated_time" content="2017-03-01T17:08:52+02:00"/>
|
||||
<meta property="og:updated_time" content="2017-04-02T17:08:52+02:00"/>
|
||||
|
||||
|
||||
|
||||
@ -39,7 +39,7 @@
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
},
|
||||
"dateModified": "2017-03-01T17:08:52+02:00",
|
||||
"dateModified": "2017-04-02T17:08:52+02:00",
|
||||
"keywords": "notes,notes,",
|
||||
"description": "Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
|
||||
}
|
||||
@ -97,6 +97,41 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2017-04/">April, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-04-02T17:08:52+02:00">Sun Apr 02, 2017</time> by Alan Orth in
|
||||
|
||||
<i class="fa fa-tag" aria-hidden="true"></i> <a href="/cgspace-notes/tags/notes" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-04-02">2017-04-02</h2>
|
||||
|
||||
<ul>
|
||||
<li>Merge one change to CCAFS flagships that I had forgotten to remove last month (“MANAGING CLIMATE RISK”): <a href="https://github.com/ilri/DSpace/pull/317">https://github.com/ilri/DSpace/pull/317</a></li>
|
||||
<li>Quick proof-of-concept hack to add <code>dc.rights</code> to the input form, including some inline instructions/hints:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="/cgspace-notes/2017/04/dc-rights.png" alt="dc.rights in the submission form" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Remove redundant/duplicate text in the DSpace submission license</li>
|
||||
<li>Testing the CMYK patch on a collection with 650 items:</li>
|
||||
</ul>
|
||||
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2017-03/">March, 2017</a></h2>
|
||||
@ -403,35 +438,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2016-06/">June, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-06-01T10:53:00+03:00">Wed Jun 01, 2016</time> by Alan Orth in
|
||||
|
||||
<i class="fa fa-tag" aria-hidden="true"></i> <a href="/cgspace-notes/tags/notes" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-06-01">2016-06-01</h2>
|
||||
|
||||
<ul>
|
||||
<li>Experimenting with IFPRI OAI (we want to harvest their publications)</li>
|
||||
<li>After reading the <a href="https://www.oclc.org/support/services/contentdm/help/server-admin-help/oai-support.en.html">ContentDM documentation</a> I found IFPRI’s OAI endpoint: <a href="http://ebrary.ifpri.org/oai/oai.php">http://ebrary.ifpri.org/oai/oai.php</a></li>
|
||||
<li>After reading the <a href="https://www.openarchives.org/OAI/openarchivesprotocol.html">OAI documentation</a> and testing with an <a href="http://validator.oaipmh.com/">OAI validator</a> I found out how to get their publications</li>
|
||||
<li>This is their publications set: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc">http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc</a></li>
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/post/" rel="prev" role="button">Previous page</a>
|
||||
@ -455,6 +461,8 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<ol class="list-unstyled">
|
||||
|
||||
|
||||
<li><a href="/cgspace-notes/2018-01/">January, 2018</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-12/">December, 2017</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-11/">November, 2017</a></li>
|
||||
@ -463,8 +471,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<li><a href="/cgspace-notes/cgiar-library-migration/">CGIAR Library Migration</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-09/">September, 2017</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -12,7 +12,7 @@
|
||||
|
||||
|
||||
|
||||
<meta property="og:updated_time" content="2016-05-01T23:06:00+03:00"/>
|
||||
<meta property="og:updated_time" content="2016-06-01T10:53:00+03:00"/>
|
||||
|
||||
|
||||
|
||||
@ -39,7 +39,7 @@
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
},
|
||||
"dateModified": "2016-05-01T23:06:00+03:00",
|
||||
"dateModified": "2016-06-01T10:53:00+03:00",
|
||||
"keywords": "notes,notes,",
|
||||
"description": "Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
|
||||
}
|
||||
@ -97,6 +97,35 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2016-06/">June, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-06-01T10:53:00+03:00">Wed Jun 01, 2016</time> by Alan Orth in
|
||||
|
||||
<i class="fa fa-tag" aria-hidden="true"></i> <a href="/cgspace-notes/tags/notes" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-06-01">2016-06-01</h2>
|
||||
|
||||
<ul>
|
||||
<li>Experimenting with IFPRI OAI (we want to harvest their publications)</li>
|
||||
<li>After reading the <a href="https://www.oclc.org/support/services/contentdm/help/server-admin-help/oai-support.en.html">ContentDM documentation</a> I found IFPRI’s OAI endpoint: <a href="http://ebrary.ifpri.org/oai/oai.php">http://ebrary.ifpri.org/oai/oai.php</a></li>
|
||||
<li>After reading the <a href="https://www.openarchives.org/OAI/openarchivesprotocol.html">OAI documentation</a> and testing with an <a href="http://validator.oaipmh.com/">OAI validator</a> I found out how to get their publications</li>
|
||||
<li>This is their publications set: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc">http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc</a></li>
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2016-05/">May, 2016</a></h2>
|
||||
@ -323,6 +352,8 @@
|
||||
<ol class="list-unstyled">
|
||||
|
||||
|
||||
<li><a href="/cgspace-notes/2018-01/">January, 2018</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-12/">December, 2017</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-11/">November, 2017</a></li>
|
||||
@ -331,8 +362,6 @@
|
||||
|
||||
<li><a href="/cgspace-notes/cgiar-library-migration/">CGIAR Library Migration</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-09/">September, 2017</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
Reference in New Issue
Block a user