mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2025-01-27 05:49:12 +01:00
Add notes for 2019-12-17
This commit is contained in:
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.60.1" />
|
||||
<meta name="generator" content="Hugo 0.61.0" />
|
||||
|
||||
|
||||
|
||||
@ -99,7 +99,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20190301">2019-03-01</h2>
|
||||
<h2 id="2019-03-01">2019-03-01</h2>
|
||||
<ul>
|
||||
<li>I checked IITA's 259 Feb 14 records from last month for duplicates using Atmire's Duplicate Checker on a fresh snapshot of CGSpace on my local machine and everything looks good</li>
|
||||
<li>I am now only waiting to hear from her about where the items should go, though I assume Journal Articles go to IITA Journal Articles collection, etc…</li>
|
||||
@ -131,7 +131,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20190201">2019-02-01</h2>
|
||||
<h2 id="2019-02-01">2019-02-01</h2>
|
||||
<ul>
|
||||
<li>Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!</li>
|
||||
<li>The top IPs before, during, and after this latest alert tonight were:</li>
|
||||
@ -176,7 +176,7 @@ sys 0m1.979s
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20190102">2019-01-02</h2>
|
||||
<h2 id="2019-01-02">2019-01-02</h2>
|
||||
<ul>
|
||||
<li>Linode alerted that CGSpace (linode18) had a higher outbound traffic rate than normal early this morning</li>
|
||||
<li>I don't see anything interesting in the web server logs around that time though:</li>
|
||||
@ -210,13 +210,13 @@ sys 0m1.979s
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20181201">2018-12-01</h2>
|
||||
<h2 id="2018-12-01">2018-12-01</h2>
|
||||
<ul>
|
||||
<li>Switch CGSpace (linode18) to use OpenJDK instead of Oracle JDK</li>
|
||||
<li>I manually installed OpenJDK, then removed Oracle JDK, then re-ran the <a href="http://github.com/ilri/rmg-ansible-public">Ansible playbook</a> to update all configuration files, etc</li>
|
||||
<li>Then I ran all system updates and restarted the server</li>
|
||||
</ul>
|
||||
<h2 id="20181202">2018-12-02</h2>
|
||||
<h2 id="2018-12-02">2018-12-02</h2>
|
||||
<ul>
|
||||
<li>I noticed that there is another issue with PDF thumbnails on CGSpace, and I see there was another <a href="https://usn.ubuntu.com/3831-1/">Ghostscript vulnerability last week</a></li>
|
||||
</ul>
|
||||
@ -237,12 +237,12 @@ sys 0m1.979s
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20181101">2018-11-01</h2>
|
||||
<h2 id="2018-11-01">2018-11-01</h2>
|
||||
<ul>
|
||||
<li>Finalize AReS Phase I and Phase II ToRs</li>
|
||||
<li>Send a note about my <a href="https://github.com/ilri/dspace-statistics-api">dspace-statistics-api</a> to the dspace-tech mailing list</li>
|
||||
</ul>
|
||||
<h2 id="20181103">2018-11-03</h2>
|
||||
<h2 id="2018-11-03">2018-11-03</h2>
|
||||
<ul>
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
@ -264,7 +264,7 @@ sys 0m1.979s
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20181001">2018-10-01</h2>
|
||||
<h2 id="2018-10-01">2018-10-01</h2>
|
||||
<ul>
|
||||
<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
|
||||
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I'm super busy in Nairobi right now</li>
|
||||
@ -286,7 +286,7 @@ sys 0m1.979s
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20180902">2018-09-02</h2>
|
||||
<h2 id="2018-09-02">2018-09-02</h2>
|
||||
<ul>
|
||||
<li>New <a href="https://jdbc.postgresql.org/documentation/changelog.html#version_42.2.5">PostgreSQL JDBC driver version 42.2.5</a></li>
|
||||
<li>I'll update the DSpace role in our <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure playbooks</a> and run the updated playbooks on CGSpace and DSpace Test</li>
|
||||
@ -310,7 +310,7 @@ sys 0m1.979s
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20180801">2018-08-01</h2>
|
||||
<h2 id="2018-08-01">2018-08-01</h2>
|
||||
<ul>
|
||||
<li>DSpace Test had crashed at some point yesterday morning and I see the following in <code>dmesg</code>:</li>
|
||||
</ul>
|
||||
@ -342,7 +342,7 @@ sys 0m1.979s
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20180701">2018-07-01</h2>
|
||||
<h2 id="2018-07-01">2018-07-01</h2>
|
||||
<ul>
|
||||
<li>I want to upgrade DSpace Test to DSpace 5.8 so I took a backup of its current database just in case:</li>
|
||||
</ul>
|
||||
@ -369,7 +369,7 @@ sys 0m1.979s
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20180604">2018-06-04</h2>
|
||||
<h2 id="2018-06-04">2018-06-04</h2>
|
||||
<ul>
|
||||
<li>Test the <a href="https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=560">DSpace 5.8 module upgrades from Atmire</a> (<a href="https://github.com/ilri/DSpace/pull/378">#378</a>)
|
||||
<ul>
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.60.1" />
|
||||
<meta name="generator" content="Hugo 0.61.0" />
|
||||
|
||||
|
||||
|
||||
@ -99,7 +99,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20180501">2018-05-01</h2>
|
||||
<h2 id="2018-05-01">2018-05-01</h2>
|
||||
<ul>
|
||||
<li>I cleared the Solr statistics core on DSpace Test by issuing two commands directly to the Solr admin interface:
|
||||
<ul>
|
||||
@ -127,7 +127,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20180401">2018-04-01</h2>
|
||||
<h2 id="2018-04-01">2018-04-01</h2>
|
||||
<ul>
|
||||
<li>I tried to test something on DSpace Test but noticed that it's down since god knows when</li>
|
||||
<li>Catalina logs at least show some memory errors yesterday:</li>
|
||||
@ -149,7 +149,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20180302">2018-03-02</h2>
|
||||
<h2 id="2018-03-02">2018-03-02</h2>
|
||||
<ul>
|
||||
<li>Export a CSV of the IITA community metadata for Martin Mueller</li>
|
||||
</ul>
|
||||
@ -170,7 +170,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20180201">2018-02-01</h2>
|
||||
<h2 id="2018-02-01">2018-02-01</h2>
|
||||
<ul>
|
||||
<li>Peter gave feedback on the <code>dc.rights</code> proof of concept that I had sent him last week</li>
|
||||
<li>We don't need to distinguish between internal and external works, so that makes it just a simple list</li>
|
||||
@ -194,7 +194,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20180102">2018-01-02</h2>
|
||||
<h2 id="2018-01-02">2018-01-02</h2>
|
||||
<ul>
|
||||
<li>Uptime Robot noticed that CGSpace went down and up a few times last night, for a few minutes each time</li>
|
||||
<li>I didn't get any load alerts from Linode and the REST and XMLUI logs don't show anything out of the ordinary</li>
|
||||
@ -278,7 +278,7 @@ dspace.log.2018-01-02:34
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20171201">2017-12-01</h2>
|
||||
<h2 id="2017-12-01">2017-12-01</h2>
|
||||
<ul>
|
||||
<li>Uptime Robot noticed that CGSpace went down</li>
|
||||
<li>The logs say “Timeout waiting for idle object”</li>
|
||||
@ -302,11 +302,11 @@ dspace.log.2018-01-02:34
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20171101">2017-11-01</h2>
|
||||
<h2 id="2017-11-01">2017-11-01</h2>
|
||||
<ul>
|
||||
<li>The CORE developers responded to say they are looking into their bot not respecting our robots.txt</li>
|
||||
</ul>
|
||||
<h2 id="20171102">2017-11-02</h2>
|
||||
<h2 id="2017-11-02">2017-11-02</h2>
|
||||
<ul>
|
||||
<li>Today there have been no hits by CORE and no alerts from Linode (coincidence?)</li>
|
||||
</ul>
|
||||
@ -335,7 +335,7 @@ COPY 54701
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20171001">2017-10-01</h2>
|
||||
<h2 id="2017-10-01">2017-10-01</h2>
|
||||
<ul>
|
||||
<li>Peter emailed to point out that many items in the <a href="https://cgspace.cgiar.org/handle/10568/2703">ILRI archive collection</a> have multiple handles:</li>
|
||||
</ul>
|
||||
@ -381,11 +381,11 @@ COPY 54701
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20170906">2017-09-06</h2>
|
||||
<h2 id="2017-09-06">2017-09-06</h2>
|
||||
<ul>
|
||||
<li>Linode sent an alert that CGSpace (linode18) was using 261% CPU for the past two hours</li>
|
||||
</ul>
|
||||
<h2 id="20170907">2017-09-07</h2>
|
||||
<h2 id="2017-09-07">2017-09-07</h2>
|
||||
<ul>
|
||||
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne's user account is both in the approvers step as well as the group</li>
|
||||
</ul>
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.60.1" />
|
||||
<meta name="generator" content="Hugo 0.61.0" />
|
||||
|
||||
|
||||
|
||||
@ -99,7 +99,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20170801">2017-08-01</h2>
|
||||
<h2 id="2017-08-01">2017-08-01</h2>
|
||||
<ul>
|
||||
<li>Linode sent an alert that CGSpace (linode18) was using 350% CPU for the past two hours</li>
|
||||
<li>I looked in the Activity pane of the Admin Control Panel and it seems that Google, Baidu, Yahoo, and Bing are all crawling with massive numbers of bots concurrently (~100 total, mostly Baidu and Google)</li>
|
||||
@ -138,11 +138,11 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20170701">2017-07-01</h2>
|
||||
<h2 id="2017-07-01">2017-07-01</h2>
|
||||
<ul>
|
||||
<li>Run system updates and reboot DSpace Test</li>
|
||||
</ul>
|
||||
<h2 id="20170704">2017-07-04</h2>
|
||||
<h2 id="2017-07-04">2017-07-04</h2>
|
||||
<ul>
|
||||
<li>Merge changes for WLE Phase II theme rename (<a href="https://github.com/ilri/DSpace/pull/329">#329</a>)</li>
|
||||
<li>Looking at extracting the metadata registries from ICARDA's MEL DSpace database so we can compare fields with CGSpace</li>
|
||||
@ -201,7 +201,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20170402">2017-04-02</h2>
|
||||
<h2 id="2017-04-02">2017-04-02</h2>
|
||||
<ul>
|
||||
<li>Merge one change to CCAFS flagships that I had forgotten to remove last month (“MANAGING CLIMATE RISK”): <a href="https://github.com/ilri/DSpace/pull/317">https://github.com/ilri/DSpace/pull/317</a></li>
|
||||
<li>Quick proof-of-concept hack to add <code>dc.rights</code> to the input form, including some inline instructions/hints:</li>
|
||||
@ -230,11 +230,11 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20170301">2017-03-01</h2>
|
||||
<h2 id="2017-03-01">2017-03-01</h2>
|
||||
<ul>
|
||||
<li>Run the 279 CIAT author corrections on CGSpace</li>
|
||||
</ul>
|
||||
<h2 id="20170302">2017-03-02</h2>
|
||||
<h2 id="2017-03-02">2017-03-02</h2>
|
||||
<ul>
|
||||
<li>Skype with Michael and Peter, discussing moving the CGIAR Library to CGSpace</li>
|
||||
<li>CGIAR people possibly open to moving content, redirecting library.cgiar.org to CGSpace and letting CGSpace resolve their handles</li>
|
||||
@ -266,7 +266,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20170207">2017-02-07</h2>
|
||||
<h2 id="2017-02-07">2017-02-07</h2>
|
||||
<ul>
|
||||
<li>An item was mapped twice erroneously again, so I had to remove one of the mappings manually:</li>
|
||||
</ul>
|
||||
@ -300,7 +300,7 @@ DELETE 1
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20170102">2017-01-02</h2>
|
||||
<h2 id="2017-01-02">2017-01-02</h2>
|
||||
<ul>
|
||||
<li>I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error</li>
|
||||
<li>I tested on DSpace Test as well and it doesn't work there either</li>
|
||||
@ -323,7 +323,7 @@ DELETE 1
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20161202">2016-12-02</h2>
|
||||
<h2 id="2016-12-02">2016-12-02</h2>
|
||||
<ul>
|
||||
<li>CGSpace was down for five hours in the morning while I was sleeping</li>
|
||||
<li>While looking in the logs for errors, I see tons of warnings about Atmire MQM:</li>
|
||||
@ -355,7 +355,7 @@ DELETE 1
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20161101">2016-11-01</h2>
|
||||
<h2 id="2016-11-01">2016-11-01</h2>
|
||||
<ul>
|
||||
<li>Add <code>dc.type</code> to the output options for Atmire's Listings and Reports module (<a href="https://github.com/ilri/DSpace/pull/286">#286</a>)</li>
|
||||
</ul>
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.60.1" />
|
||||
<meta name="generator" content="Hugo 0.61.0" />
|
||||
|
||||
|
||||
|
||||
@ -99,7 +99,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20161003">2016-10-03</h2>
|
||||
<h2 id="2016-10-03">2016-10-03</h2>
|
||||
<ul>
|
||||
<li>Testing adding <a href="https://wiki.duraspace.org/display/DSDOC5x/ORCID+Integration#ORCIDIntegration-EditingexistingitemsusingBatchCSVEditing">ORCIDs to a CSV</a> file for a single item to see if the author orders get messed up</li>
|
||||
<li>Need to test the following scenarios to see how author order is affected:
|
||||
@ -129,7 +129,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20160901">2016-09-01</h2>
|
||||
<h2 id="2016-09-01">2016-09-01</h2>
|
||||
<ul>
|
||||
<li>Discuss helping CCAFS with some batch tagging of ORCID IDs for their authors</li>
|
||||
<li>Discuss how the migration of CGIAR's Active Directory to a flat structure will break our LDAP groups in DSpace</li>
|
||||
@ -155,7 +155,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20160801">2016-08-01</h2>
|
||||
<h2 id="2016-08-01">2016-08-01</h2>
|
||||
<ul>
|
||||
<li>Add updated distribution license from Sisay (<a href="https://github.com/ilri/DSpace/issues/259">#259</a>)</li>
|
||||
<li>Play with upgrading Mirage 2 dependencies in <code>bower.json</code> because most are several versions of out date</li>
|
||||
@ -185,7 +185,7 @@ $ git rebase -i dspace-5.5
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20160701">2016-07-01</h2>
|
||||
<h2 id="2016-07-01">2016-07-01</h2>
|
||||
<ul>
|
||||
<li>Add <code>dc.description.sponsorship</code> to Discovery sidebar facets and make investors clickable in item view (<a href="https://github.com/ilri/DSpace/issues/232">#232</a>)</li>
|
||||
<li>I think this query should find and replace all authors that have “,” at the end of their names:</li>
|
||||
@ -216,7 +216,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20160601">2016-06-01</h2>
|
||||
<h2 id="2016-06-01">2016-06-01</h2>
|
||||
<ul>
|
||||
<li>Experimenting with IFPRI OAI (we want to harvest their publications)</li>
|
||||
<li>After reading the <a href="https://www.oclc.org/support/services/contentdm/help/server-admin-help/oai-support.en.html">ContentDM documentation</a> I found IFPRI's OAI endpoint: <a href="http://ebrary.ifpri.org/oai/oai.php">http://ebrary.ifpri.org/oai/oai.php</a></li>
|
||||
@ -242,7 +242,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20160501">2016-05-01</h2>
|
||||
<h2 id="2016-05-01">2016-05-01</h2>
|
||||
<ul>
|
||||
<li>Since yesterday there have been 10,000 REST errors and the site has been unstable again</li>
|
||||
<li>I have blocked access to the API now</li>
|
||||
@ -268,7 +268,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20160404">2016-04-04</h2>
|
||||
<h2 id="2016-04-04">2016-04-04</h2>
|
||||
<ul>
|
||||
<li>Looking at log file use on CGSpace and notice that we need to work on our cron setup a bit</li>
|
||||
<li>We are backing up all logs in the log folder, including useless stuff like solr, cocoon, handle-plugin, etc</li>
|
||||
@ -293,7 +293,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20160302">2016-03-02</h2>
|
||||
<h2 id="2016-03-02">2016-03-02</h2>
|
||||
<ul>
|
||||
<li>Looking at issues with author authorities on CGSpace</li>
|
||||
<li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I'm pretty sure we don't need it as of the latest few versions of Atmire's Listings and Reports module</li>
|
||||
@ -316,7 +316,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20160205">2016-02-05</h2>
|
||||
<h2 id="2016-02-05">2016-02-05</h2>
|
||||
<ul>
|
||||
<li>Looking at some DAGRIS data for Abenet Yabowork</li>
|
||||
<li>Lots of issues with spaces, newlines, etc causing the import to fail</li>
|
||||
@ -344,7 +344,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20160113">2016-01-13</h2>
|
||||
<h2 id="2016-01-13">2016-01-13</h2>
|
||||
<ul>
|
||||
<li>Move ILRI collection <code>10568/12503</code> from <code>10568/27869</code> to <code>10568/27629</code> using the <a href="https://gist.github.com/alanorth/392c4660e8b022d99dfa">move_collections.sh</a> script I wrote last year.</li>
|
||||
<li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li>
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.60.1" />
|
||||
<meta name="generator" content="Hugo 0.61.0" />
|
||||
|
||||
|
||||
|
||||
@ -99,7 +99,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20151202">2015-12-02</h2>
|
||||
<h2 id="2015-12-02">2015-12-02</h2>
|
||||
<ul>
|
||||
<li>Replace <code>lzop</code> with <code>xz</code> in log compression cron jobs on DSpace Test—it uses less space:</li>
|
||||
</ul>
|
||||
@ -126,7 +126,7 @@
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="20151122">2015-11-22</h2>
|
||||
<h2 id="2015-11-22">2015-11-22</h2>
|
||||
<ul>
|
||||
<li>CGSpace went down</li>
|
||||
<li>Looks like DSpace exhausted its PostgreSQL connection pool</li>
|
||||
|
||||
Reference in New Issue
Block a user