mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-11-22 06:35:03 +01:00
Update notes for 2018-11-08
This commit is contained in:
parent
fecac58ec8
commit
51aa83e6c3
GPG Key ID:
0FB860CC9C45B1B9
@ -274,4 +274,10 @@ $ time ./rest-find-collections.py 10568/27629 --rest-url https://dspacetest.cgia
|
||||
- Update my [dspace-statistics-api](https://github.com/ilri/dspace-statistics-api) to use a database management class with Python contexts so that connections and cursors are automatically opened and closed
|
||||
- Tag version 0.7.0 of the dspace-statistics-api
|
||||
|
||||
## 2018-11-08
|
||||
|
||||
- I deployed verison 0.7.0 of the dspace-statistics-api on DSpace Test (linode19) so I can test it for a few days (and check the Munin stats to see the change in database connections) before deploying on CGSpace
|
||||
- I also enabled systemd's persistent journal by setting [`Storage=persistent` in *journald.conf*](https://www.freedesktop.org/software/systemd/man/journald.conf.html)
|
||||
- Apparently [Ubuntu 16.04 defaulted to using rsyslog for boot records until early 2018](https://www.freedesktop.org/software/systemd/man/journald.conf.html), so I removed `rsyslog` too
|
||||
|
||||
<!-- vim: set sw=2 ts=2: -->
|
||||
|
||||
@ -16,8 +16,6 @@ Last week I had increased the limit from 30 to 60, which seemed to help, but now
|
||||
|
||||
$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
|
||||
78
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2015-11/" /><meta property="article:published_time" content="2015-11-23T17:00:57+03:00"/>
|
||||
@ -35,10 +33,8 @@ Last week I had increased the limit from 30 to 60, which seemed to help, but now
|
||||
|
||||
$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
|
||||
78
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -128,8 +124,6 @@ $ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspac
|
||||
78
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
|
||||
<ul>
|
||||
<li>For now I have increased the limit from 60 to 90, run updates, and rebooted the server</li>
|
||||
</ul>
|
||||
|
||||
@ -17,8 +17,6 @@ Replace lzop with xz in log compression cron jobs on DSpace Test—it uses less
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2015-12/" /><meta property="article:published_time" content="2015-12-02T13:18:00+03:00"/>
|
||||
@ -37,10 +35,8 @@ Replace lzop with xz in log compression cron jobs on DSpace Test—it uses less
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -131,8 +127,6 @@ Replace lzop with xz in log compression cron jobs on DSpace Test—it uses less
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
|
||||
<ul>
|
||||
<li>I had used lrzip once, but it needs more memory and is harder to use as it requires the lrztar wrapper</li>
|
||||
<li>Need to remember to go check if everything is ok in a few days and then change CGSpace</li>
|
||||
|
||||
@ -12,8 +12,6 @@
|
||||
Move ILRI collection 10568/12503 from 10568/27869 to 10568/27629 using the move_collections.sh script I wrote last year.
|
||||
I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.
|
||||
Update GitHub wiki for documentation of maintenance tasks.
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-01/" /><meta property="article:published_time" content="2016-01-13T13:18:00+03:00"/>
|
||||
@ -27,10 +25,8 @@ Update GitHub wiki for documentation of maintenance tasks.
|
||||
Move ILRI collection 10568/12503 from 10568/27869 to 10568/27629 using the move_collections.sh script I wrote last year.
|
||||
I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.
|
||||
Update GitHub wiki for documentation of maintenance tasks.
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -116,8 +112,6 @@ Update GitHub wiki for documentation of maintenance tasks.
|
||||
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2016-01-14">2016-01-14</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -19,8 +19,6 @@ I noticed we have a very interesting list of countries on CGSpace:
|
||||
|
||||
Not only are there 49,000 countries, we have some blanks (25)…
|
||||
Also, lots of things like “COTE D`LVOIRE” and “COTE D IVOIRE”
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-02/" /><meta property="article:published_time" content="2016-02-05T13:18:00+03:00"/>
|
||||
@ -41,10 +39,8 @@ I noticed we have a very interesting list of countries on CGSpace:
|
||||
|
||||
Not only are there 49,000 countries, we have some blanks (25)…
|
||||
Also, lots of things like “COTE D`LVOIRE” and “COTE D IVOIRE”
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -137,8 +133,6 @@ Also, lots of things like “COTE D`LVOIRE” and “COTE D IVOIRE&r
|
||||
<li>Also, lots of things like “COTE D`LVOIRE” and “COTE D IVOIRE”</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2016-02-06">2016-02-06</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -12,8 +12,6 @@
|
||||
Looking at issues with author authorities on CGSpace
|
||||
For some reason we still have the index-lucene-update cron job active on CGSpace, but I’m pretty sure we don’t need it as of the latest few versions of Atmire’s Listings and Reports module
|
||||
Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-03/" /><meta property="article:published_time" content="2016-03-02T16:50:00+03:00"/>
|
||||
@ -27,10 +25,8 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
|
||||
Looking at issues with author authorities on CGSpace
|
||||
For some reason we still have the index-lucene-update cron job active on CGSpace, but I’m pretty sure we don’t need it as of the latest few versions of Atmire’s Listings and Reports module
|
||||
Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -116,8 +112,6 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
|
||||
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2016-03-07">2016-03-07</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -14,8 +14,6 @@ We are backing up all logs in the log folder, including useless stuff like solr,
|
||||
After running DSpace for over five years I’ve never needed to look in any other log file than dspace.log, leave alone one from last year!
|
||||
This will save us a few gigs of backup space we’re paying for on S3
|
||||
Also, I noticed the checker log has some errors we should pay attention to:
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-04/" /><meta property="article:published_time" content="2016-04-04T11:06:00+03:00"/>
|
||||
@ -31,10 +29,8 @@ We are backing up all logs in the log folder, including useless stuff like solr,
|
||||
After running DSpace for over five years I’ve never needed to look in any other log file than dspace.log, leave alone one from last year!
|
||||
This will save us a few gigs of backup space we’re paying for on S3
|
||||
Also, I noticed the checker log has some errors we should pay attention to:
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -122,8 +118,6 @@ Also, I noticed the checker log has some errors we should pay attention to:
|
||||
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<pre><code>Run start time: 03/06/2016 04:00:22
|
||||
Error retrieving bitstream ID 71274 from asset store.
|
||||
java.io.FileNotFoundException: /home/cgspace.cgiar.org/assetstore/64/29/06/64290601546459645925328536011917633626 (Too many open files)
|
||||
|
||||
@ -16,8 +16,6 @@ There are 3,000 IPs accessing the REST API in a 24-hour period!
|
||||
|
||||
# awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
|
||||
3168
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-05/" /><meta property="article:published_time" content="2016-05-01T23:06:00+03:00"/>
|
||||
@ -35,10 +33,8 @@ There are 3,000 IPs accessing the REST API in a 24-hour period!
|
||||
|
||||
# awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
|
||||
3168
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -128,8 +124,6 @@ There are 3,000 IPs accessing the REST API in a 24-hour period!
|
||||
3168
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
|
||||
<ul>
|
||||
<li>The two most often requesters are in Ethiopia and Colombia: 213.55.99.121 and 181.118.144.29</li>
|
||||
<li>100% of the requests coming from Ethiopia are like this and result in an HTTP 500:</li>
|
||||
|
||||
@ -15,8 +15,6 @@ After reading the OAI documentation and testing with an OAI validator I found ou
|
||||
This is their publications set: http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc
|
||||
You can see the others by using the OAI ListSets verb: http://ebrary.ifpri.org/oai/oai.php?verb=ListSets
|
||||
Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in dc.identifier.fund to cg.identifier.cpwfproject and then the rest to dc.description.sponsorship
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-06/" /><meta property="article:published_time" content="2016-06-01T10:53:00+03:00"/>
|
||||
@ -33,10 +31,8 @@ After reading the OAI documentation and testing with an OAI validator I found ou
|
||||
This is their publications set: http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc
|
||||
You can see the others by using the OAI ListSets verb: http://ebrary.ifpri.org/oai/oai.php?verb=ListSets
|
||||
Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in dc.identifier.fund to cg.identifier.cpwfproject and then the rest to dc.description.sponsorship
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -125,8 +121,6 @@ Working on second phase of metadata migration, looks like this will work for mov
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<pre><code>dspacetest=# update metadatavalue set metadata_field_id=130 where metadata_field_id=75 and (text_value like 'PN%' or text_value like 'PHASE%' or text_value = 'CBA' or text_value = 'IA');
|
||||
UPDATE 497
|
||||
dspacetest=# update metadatavalue set metadata_field_id=29 where metadata_field_id=75;
|
||||
|
||||
@ -23,8 +23,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
|
||||
In this case the select query was showing 95 results before the update
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-07/" /><meta property="article:published_time" content="2016-07-01T10:53:00+03:00"/>
|
||||
@ -49,10 +47,8 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
|
||||
In this case the select query was showing 95 results before the update
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -149,8 +145,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<li>In this case the select query was showing 95 results before the update</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2016-07-02">2016-07-02</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -20,8 +20,6 @@ Start working on DSpace 5.1 → 5.5 port:
|
||||
$ git checkout -b 55new 5_x-prod
|
||||
$ git reset --hard ilri/5_x-prod
|
||||
$ git rebase -i dspace-5.5
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-08/" /><meta property="article:published_time" content="2016-08-01T15:53:00+03:00"/>
|
||||
@ -43,10 +41,8 @@ Start working on DSpace 5.1 → 5.5 port:
|
||||
$ git checkout -b 55new 5_x-prod
|
||||
$ git reset --hard ilri/5_x-prod
|
||||
$ git rebase -i dspace-5.5
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -140,8 +136,6 @@ $ git reset --hard ilri/5_x-prod
|
||||
$ git rebase -i dspace-5.5
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
|
||||
<ul>
|
||||
<li>Lots of conflicts that don’t make sense (ie, shouldn’t conflict!)</li>
|
||||
<li>This file in particular conflicts almost 10 times: <code>dspace/modules/xmlui-mirage2/src/main/webapp/themes/CGIAR/styles/_style.scss</code></li>
|
||||
|
||||
@ -16,8 +16,6 @@ It looks like we might be able to use OUs now, instead of DCs:
|
||||
|
||||
|
||||
$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b "dc=cgiarad,dc=org" -D "admigration1@cgiarad.org" -W "(sAMAccountName=admigration1)"
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-09/" /><meta property="article:published_time" content="2016-09-01T15:53:00+03:00"/>
|
||||
@ -35,10 +33,8 @@ It looks like we might be able to use OUs now, instead of DCs:
|
||||
|
||||
|
||||
$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b "dc=cgiarad,dc=org" -D "admigration1@cgiarad.org" -W "(sAMAccountName=admigration1)"
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -128,8 +124,6 @@ $ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b "dc=cgiarad,dc=or
|
||||
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b "dc=cgiarad,dc=org" -D "admigration1@cgiarad.org" -W "(sAMAccountName=admigration1)"
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
|
||||
<ul>
|
||||
<li>User who has been migrated to the root vs user still in the hierarchical structure:</li>
|
||||
</ul>
|
||||
|
||||
@ -20,8 +20,6 @@ I exported a random item’s metadata as CSV, deleted all columns except id
|
||||
|
||||
|
||||
0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-10/" /><meta property="article:published_time" content="2016-10-03T15:53:00+03:00"/>
|
||||
@ -43,10 +41,8 @@ I exported a random item’s metadata as CSV, deleted all columns except id
|
||||
|
||||
|
||||
0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -140,8 +136,6 @@ I exported a random item’s metadata as CSV, deleted all columns except id
|
||||
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
|
||||
<ul>
|
||||
<li>Hmm, with the <code>dc.contributor.author</code> column removed, DSpace doesn’t detect any changes</li>
|
||||
<li>With a blank <code>dc.contributor.author</code> column, DSpace wants to remove all non-ORCID authors and add the new ORCID authors</li>
|
||||
|
||||
@ -12,8 +12,6 @@
|
||||
Add dc.type to the output options for Atmire’s Listings and Reports module (#286)
|
||||
|
||||
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-11/" /><meta property="article:published_time" content="2016-11-01T09:21:00+03:00"/>
|
||||
@ -27,10 +25,8 @@ Add dc.type to the output options for Atmire’s Listings and Reports module
|
||||
Add dc.type to the output options for Atmire’s Listings and Reports module (#286)
|
||||
|
||||
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -116,8 +112,6 @@ Add dc.type to the output options for Atmire’s Listings and Reports module
|
||||
|
||||
<p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2016-11-02">2016-11-02</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -24,8 +24,6 @@ While looking in the logs for errors, I see tons of warnings about Atmire MQM:
|
||||
I see thousands of them in the logs for the last few months, so it’s not related to the DSpace 5.5 upgrade
|
||||
I’ve raised a ticket with Atmire to ask
|
||||
Another worrying error from dspace.log is:
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-12/" /><meta property="article:published_time" content="2016-12-02T10:43:00+03:00"/>
|
||||
@ -51,10 +49,8 @@ While looking in the logs for errors, I see tons of warnings about Atmire MQM:
|
||||
I see thousands of them in the logs for the last few months, so it’s not related to the DSpace 5.5 upgrade
|
||||
I’ve raised a ticket with Atmire to ask
|
||||
Another worrying error from dspace.log is:
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -152,8 +148,6 @@ Another worrying error from dspace.log is:
|
||||
<li>Another worrying error from dspace.log is:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<pre><code>org.springframework.web.util.NestedServletException: Handler processing failed; nested exception is java.lang.NoSuchMethodError: com.atmire.statistics.generator.DSpaceObjectDatasetGenerator.toDatasetQuery(Lorg/dspace/core/Context;)Lcom/atmire/statistics/content/DatasetQuery;
|
||||
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:972)
|
||||
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
|
||||
|
||||
@ -12,8 +12,6 @@
|
||||
I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error
|
||||
I tested on DSpace Test as well and it doesn’t work there either
|
||||
I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-01/" /><meta property="article:published_time" content="2017-01-02T10:43:00+03:00"/>
|
||||
@ -27,10 +25,8 @@ I asked on the dspace-tech mailing list because it seems to be broken, and actua
|
||||
I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error
|
||||
I tested on DSpace Test as well and it doesn’t work there either
|
||||
I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -116,8 +112,6 @@ I asked on the dspace-tech mailing list because it seems to be broken, and actua
|
||||
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2017-01-04">2017-01-04</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -26,8 +26,6 @@ DELETE 1
|
||||
|
||||
Create issue on GitHub to track the addition of CCAFS Phase II project tags (#301)
|
||||
Looks like we’ll be using cg.identifier.ccafsprojectpii as the field name
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-02/" /><meta property="article:published_time" content="2017-02-07T07:04:52-08:00"/>
|
||||
@ -55,10 +53,8 @@ DELETE 1
|
||||
|
||||
Create issue on GitHub to track the addition of CCAFS Phase II project tags (#301)
|
||||
Looks like we’ll be using cg.identifier.ccafsprojectpii as the field name
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -158,8 +154,6 @@ DELETE 1
|
||||
<li>Looks like we’ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2017-02-08">2017-02-08</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -28,8 +28,6 @@ Interestingly, it seems DSpace 4.x’s thumbnails were sRGB, but forcing reg
|
||||
|
||||
$ identify ~/Desktop/alc_contrastes_desafios.jpg
|
||||
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-03/" /><meta property="article:published_time" content="2017-03-01T17:08:52+02:00"/>
|
||||
@ -59,10 +57,8 @@ Interestingly, it seems DSpace 4.x’s thumbnails were sRGB, but forcing reg
|
||||
|
||||
$ identify ~/Desktop/alc_contrastes_desafios.jpg
|
||||
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -164,8 +160,6 @@ $ identify ~/Desktop/alc_contrastes_desafios.jpg
|
||||
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
|
||||
<ul>
|
||||
<li>This results in discolored thumbnails when compared to the original PDF, for example sRGB and CMYK:</li>
|
||||
</ul>
|
||||
|
||||
@ -21,8 +21,6 @@ Testing the CMYK patch on a collection with 650 items:
|
||||
|
||||
|
||||
$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-04/" /><meta property="article:published_time" content="2017-04-02T17:08:52+02:00"/>
|
||||
@ -45,10 +43,8 @@ Testing the CMYK patch on a collection with 650 items:
|
||||
|
||||
|
||||
$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -143,8 +139,6 @@ $ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Th
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2017-04-03">2017-04-03</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="May, 2017"/>
|
||||
<meta name="twitter:description" content="2017-05-01 ICARDA apparently started working on CG Core on their MEL repository They have done a few cg.* fields, but not very consistent and even copy some of CGSpace items: https://mel.cgiar.org/xmlui/handle/20.500.11766/6911?show=full https://cgspace.cgiar.org/handle/10568/73683 2017-05-02 Atmire got back about the Workflow Statistics issue, and apparently it’s a bug in the CUA module so they will send us a pull request 2017-05-04 Sync DSpace Test with database and assetstore from CGSpace Re-deploy DSpace Test with Atmire’s CUA patch for workflow statistics, run system updates, and restart the server Now I can see the workflow statistics and am able to select users, but everything returns 0 items Megan says there are still some mapped items are not appearing since last week, so I forced a full index-discovery -b Need to remember to check if the collection has more items (currently 39 on CGSpace, but 118 on the freshly reindexed DSPace Test) tomorrow: https://cgspace."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="June, 2017"/>
|
||||
<meta name="twitter:description" content="2017-06-01 After discussion with WLE and CGSpace content people, we decided to just add one metadata field for the WLE Research Themes The cg.identifier.wletheme field will be used for both Phase I and Phase II Research Themes Then we’ll create a new sub-community for Phase II and create collections for the research themes there The current “Research Themes” community will be renamed to “WLE Phase I Research Themes” Tagged all items in the current Phase I collections with their appropriate themes Create pull request to add Phase II research themes to the submission form: #328 Add cg."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -18,8 +18,6 @@ Run system updates and reboot DSpace Test
|
||||
Merge changes for WLE Phase II theme rename (#329)
|
||||
Looking at extracting the metadata registries from ICARDA’s MEL DSpace database so we can compare fields with CGSpace
|
||||
We can use PostgreSQL’s extended output format (-x) plus sed to format the output into quasi XML:
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-07/" /><meta property="article:published_time" content="2017-07-01T18:03:52+03:00"/>
|
||||
@ -39,10 +37,8 @@ Run system updates and reboot DSpace Test
|
||||
Merge changes for WLE Phase II theme rename (#329)
|
||||
Looking at extracting the metadata registries from ICARDA’s MEL DSpace database so we can compare fields with CGSpace
|
||||
We can use PostgreSQL’s extended output format (-x) plus sed to format the output into quasi XML:
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -134,8 +130,6 @@ We can use PostgreSQL’s extended output format (-x) plus sed to format the
|
||||
<li>We can use PostgreSQL’s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<pre><code>$ psql dspacenew -x -c 'select element, qualifier, scope_note from metadatafieldregistry where metadata_schema_id=5 order by element, qualifier;' | sed -r 's:^-\[ RECORD (.*) \]-+$:</dc-type>\n<dc-type>\n<schema>cg</schema>:;s:([^ ]*) +\| (.*): <\1>\2</\1>:;s:^$:</dc-type>:;1s:</dc-type>\n::'
|
||||
</code></pre>
|
||||
|
||||
|
||||
@ -28,8 +28,6 @@ Abenet pointed out that the CGIAR Library Historical Archive collection I sent J
|
||||
This was due to newline characters in the dc.description.abstract column, which caused OpenRefine to choke when exporting the CSV
|
||||
I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using g/^$/d
|
||||
Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-08/" /><meta property="article:published_time" content="2017-08-01T11:51:52+03:00"/>
|
||||
@ -59,10 +57,8 @@ Abenet pointed out that the CGIAR Library Historical Archive collection I sent J
|
||||
This was due to newline characters in the dc.description.abstract column, which caused OpenRefine to choke when exporting the CSV
|
||||
I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using g/^$/d
|
||||
Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -164,8 +160,6 @@ Then I cleaned up the author authorities and HTML characters in OpenRefine and s
|
||||
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2017-08-02">2017-08-02</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -16,8 +16,6 @@ Linode sent an alert that CGSpace (linode18) was using 261% CPU for the past two
|
||||
|
||||
|
||||
Ask Sisay to clean up the WLE approvers a bit, as Marianne’s user account is both in the approvers step as well as the group
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-09/" /><meta property="article:published_time" content="2017-09-07T16:54:52+07:00"/>
|
||||
@ -35,10 +33,8 @@ Linode sent an alert that CGSpace (linode18) was using 261% CPU for the past two
|
||||
|
||||
|
||||
Ask Sisay to clean up the WLE approvers a bit, as Marianne’s user account is both in the approvers step as well as the group
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -128,8 +124,6 @@ Ask Sisay to clean up the WLE approvers a bit, as Marianne’s user account
|
||||
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne’s user account is both in the approvers step as well as the group</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2017-09-10">2017-09-10</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -18,8 +18,6 @@ http://hdl.handle.net/10568/78495||http://hdl.handle.net/10568/79336
|
||||
|
||||
There appears to be a pattern but I’ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine
|
||||
Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-10/" /><meta property="article:published_time" content="2017-10-01T08:07:54+03:00"/>
|
||||
@ -39,10 +37,8 @@ http://hdl.handle.net/10568/78495||http://hdl.handle.net/10568/79336
|
||||
|
||||
There appears to be a pattern but I’ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine
|
||||
Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -134,8 +130,6 @@ Add Katherine Lutz to the groups for content submission and edit steps of the CG
|
||||
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2017-10-02">2017-10-02</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -28,8 +28,6 @@ Generate list of authors on CGSpace for Peter to go through and correct:
|
||||
|
||||
dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
|
||||
COPY 54701
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-11/" /><meta property="article:published_time" content="2017-11-02T09:37:54+02:00"/>
|
||||
@ -59,10 +57,8 @@ Generate list of authors on CGSpace for Peter to go through and correct:
|
||||
|
||||
dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
|
||||
COPY 54701
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -164,8 +160,6 @@ COPY 54701
|
||||
COPY 54701
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
|
||||
<ul>
|
||||
<li>Abenet asked if it would be possible to generate a report of items in Listing and Reports that had “International Fund for Agricultural Development” as the <em>only</em> investor</li>
|
||||
<li>I opened a ticket with Atmire to ask if this was possible: <a href="https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=540">https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=540</a></li>
|
||||
|
||||
@ -13,8 +13,6 @@ Uptime Robot noticed that CGSpace went down
|
||||
The logs say “Timeout waiting for idle object”
|
||||
PostgreSQL activity says there are 115 connections currently
|
||||
The list of connections to XMLUI and REST API for today:
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-12/" /><meta property="article:published_time" content="2017-12-01T13:53:54+03:00"/>
|
||||
@ -29,10 +27,8 @@ Uptime Robot noticed that CGSpace went down
|
||||
The logs say “Timeout waiting for idle object”
|
||||
PostgreSQL activity says there are 115 connections currently
|
||||
The list of connections to XMLUI and REST API for today:
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -119,8 +115,6 @@ The list of connections to XMLUI and REST API for today:
|
||||
<li>The list of connections to XMLUI and REST API for today:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<pre><code># cat /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/access.log /var/log/nginx/access.log.1 /var/log/nginx/library-access.log /var/log/nginx/library-access.log.1 | grep -E "1/Dec/2017" | awk '{print $1}' | sort -n | uniq -c | sort -h | tail
|
||||
763 2.86.122.76
|
||||
907 207.46.13.94
|
||||
|
||||
@ -82,8 +82,6 @@ dspace.log.2018-01-02:34
|
||||
|
||||
|
||||
Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-01/" /><meta property="article:published_time" content="2018-01-02T08:35:54-08:00"/>
|
||||
@ -167,10 +165,8 @@ dspace.log.2018-01-02:34
|
||||
|
||||
|
||||
Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -326,8 +322,6 @@ dspace.log.2018-01-02:34
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2018-01-03">2018-01-03</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -13,8 +13,6 @@ Peter gave feedback on the dc.rights proof of concept that I had sent him last w
|
||||
We don’t need to distinguish between internal and external works, so that makes it just a simple list
|
||||
Yesterday I figured out how to monitor DSpace sessions using JMX
|
||||
I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu’s munin-plugins-java package and used the stuff I discovered about JMX in 2018-01
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-02/" /><meta property="article:published_time" content="2018-02-01T16:28:54+02:00"/>
|
||||
@ -29,10 +27,8 @@ Peter gave feedback on the dc.rights proof of concept that I had sent him last w
|
||||
We don’t need to distinguish between internal and external works, so that makes it just a simple list
|
||||
Yesterday I figured out how to monitor DSpace sessions using JMX
|
||||
I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu’s munin-plugins-java package and used the stuff I discovered about JMX in 2018-01
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -119,8 +115,6 @@ I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu’s munin-pl
|
||||
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu’s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<p><img src="/cgspace-notes/2018/02/jmx_dspace_sessions-day.png" alt="DSpace Sessions" /></p>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -10,8 +10,6 @@
|
||||
|
||||
|
||||
Export a CSV of the IITA community metadata for Martin Mueller
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-03/" /><meta property="article:published_time" content="2018-03-02T16:07:54+02:00"/>
|
||||
@ -23,10 +21,8 @@ Export a CSV of the IITA community metadata for Martin Mueller
|
||||
|
||||
|
||||
Export a CSV of the IITA community metadata for Martin Mueller
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -110,8 +106,6 @@ Export a CSV of the IITA community metadata for Martin Mueller
|
||||
<li>Export a CSV of the IITA community metadata for Martin Mueller</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2018-03-06">2018-03-06</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -11,8 +11,6 @@
|
||||
|
||||
I tried to test something on DSpace Test but noticed that it’s down since god knows when
|
||||
Catalina logs at least show some memory errors yesterday:
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-04/" /><meta property="article:published_time" content="2018-04-01T16:13:54+02:00"/>
|
||||
@ -25,10 +23,8 @@ Catalina logs at least show some memory errors yesterday:
|
||||
|
||||
I tried to test something on DSpace Test but noticed that it’s down since god knows when
|
||||
Catalina logs at least show some memory errors yesterday:
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -113,8 +109,6 @@ Catalina logs at least show some memory errors yesterday:
|
||||
<li>Catalina logs at least show some memory errors yesterday:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<pre><code>Mar 31, 2018 10:26:42 PM org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor run
|
||||
SEVERE: Unexpected death of background thread ContainerBackgroundProcessor[StandardEngine[Catalina]]
|
||||
java.lang.OutOfMemoryError: Java heap space
|
||||
|
||||
@ -17,8 +17,6 @@ http://localhost:3000/solr/statistics/update?stream.body=%3Ccommit/%3E
|
||||
|
||||
Then I reduced the JVM heap size from 6144 back to 5120m
|
||||
Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the Ansible infrastructure scripts to support hosts choosing which distribution they want to use
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-05/" /><meta property="article:published_time" content="2018-05-01T16:43:54+03:00"/>
|
||||
@ -37,10 +35,8 @@ http://localhost:3000/solr/statistics/update?stream.body=%3Ccommit/%3E
|
||||
|
||||
Then I reduced the JVM heap size from 6144 back to 5120m
|
||||
Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the Ansible infrastructure scripts to support hosts choosing which distribution they want to use
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -131,8 +127,6 @@ Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2018-05-02">2018-05-02</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -31,8 +31,6 @@ $ time schedtool -D -e ionice -c2 -n7 nice -n19 [dspace]/bin/dspace index-discov
|
||||
real 74m42.646s
|
||||
user 8m5.056s
|
||||
sys 2m7.289s
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-06/" /><meta property="article:published_time" content="2018-06-04T19:49:54-07:00"/>
|
||||
@ -65,10 +63,8 @@ $ time schedtool -D -e ionice -c2 -n7 nice -n19 [dspace]/bin/dspace index-discov
|
||||
real 74m42.646s
|
||||
user 8m5.056s
|
||||
sys 2m7.289s
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -173,8 +169,6 @@ user 8m5.056s
|
||||
sys 2m7.289s
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2018-06-06">2018-06-06</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -20,8 +20,6 @@ During the mvn package stage on the 5.8 branch I kept getting issues with java r
|
||||
|
||||
|
||||
There is insufficient memory for the Java Runtime Environment to continue.
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-07/" /><meta property="article:published_time" content="2018-07-01T12:56:54+03:00"/>
|
||||
@ -43,10 +41,8 @@ During the mvn package stage on the 5.8 branch I kept getting issues with java r
|
||||
|
||||
|
||||
There is insufficient memory for the Java Runtime Environment to continue.
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -140,8 +136,6 @@ There is insufficient memory for the Java Runtime Environment to continue.
|
||||
<pre><code>There is insufficient memory for the Java Runtime Environment to continue.
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
|
||||
<ul>
|
||||
<li>As the machine only has 8GB of RAM, I reduced the Tomcat memory heap from 5120m to 4096m so I could try to allocate more to the build process:</li>
|
||||
</ul>
|
||||
|
||||
@ -24,8 +24,6 @@ I’m not sure why Tomcat didn’t crash with an OutOfMemoryError&hellip
|
||||
Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core
|
||||
The server only has 8GB of RAM so we’ll eventually need to upgrade to a larger one because we’ll start starving the OS, PostgreSQL, and command line batch processes
|
||||
I ran all system updates on DSpace Test and rebooted it
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-08/" /><meta property="article:published_time" content="2018-08-01T11:52:54+03:00"/>
|
||||
@ -51,10 +49,8 @@ I’m not sure why Tomcat didn’t crash with an OutOfMemoryError&hellip
|
||||
Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core
|
||||
The server only has 8GB of RAM so we’ll eventually need to upgrade to a larger one because we’ll start starving the OS, PostgreSQL, and command line batch processes
|
||||
I ran all system updates on DSpace Test and rebooted it
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -152,8 +148,6 @@ I ran all system updates on DSpace Test and rebooted it
|
||||
<li>I ran all system updates on DSpace Test and rebooted it</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<ul>
|
||||
<li>I started looking over the latest round of IITA batch records from Sisay on DSpace Test: <a href="https://dspacetest.cgiar.org/handle/10568/103250">IITA July_30</a>
|
||||
|
||||
|
||||
@ -13,8 +13,6 @@ New PostgreSQL JDBC driver version 42.2.5
|
||||
I’ll update the DSpace role in our Ansible infrastructure playbooks and run the updated playbooks on CGSpace and DSpace Test
|
||||
Also, I’ll re-run the postgresql tasks because the custom PostgreSQL variables are dynamic according to the system’s RAM, and we never re-ran them after migrating to larger Linodes last month
|
||||
I’m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I’m getting those autowire errors in Tomcat 8.5.30 again:
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-09/" /><meta property="article:published_time" content="2018-09-02T09:55:54+03:00"/>
|
||||
@ -29,10 +27,8 @@ New PostgreSQL JDBC driver version 42.2.5
|
||||
I’ll update the DSpace role in our Ansible infrastructure playbooks and run the updated playbooks on CGSpace and DSpace Test
|
||||
Also, I’ll re-run the postgresql tasks because the custom PostgreSQL variables are dynamic according to the system’s RAM, and we never re-ran them after migrating to larger Linodes last month
|
||||
I’m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I’m getting those autowire errors in Tomcat 8.5.30 again:
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -119,8 +115,6 @@ I’m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I
|
||||
<li>I’m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I’m getting those autowire errors in Tomcat 8.5.30 again:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<pre><code>02-Sep-2018 11:18:52.678 SEVERE [localhost-startStop-1] org.apache.catalina.core.StandardContext.listenerStart Exception sending context initialized event to listener instance of class [org.dspace.servicemanager.servlet.DSpaceKernelServletContextListener]
|
||||
java.lang.RuntimeException: Failure during filter init: Failed to startup the DSpace Service Manager: failure starting up spring service manager: Error creating bean with name 'conversionService' defined in file [/home/dspacetest.cgiar.org/config/spring/xmlui/spring-dspace-addon-cua-services.xml]: Cannot create inner bean 'com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$ColumnsConverter#4c5d5a2' of type [com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$ColumnsConverter] while setting bean property 'converters' with key [1]; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$ColumnsConverter#4c5d5a2': Injection of autowired dependencies failed; nested exception is org.springframework.beans.factory.BeanCreationException: Could not autowire field: private com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$FilterConverter com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$ColumnsConverter.filterConverter; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No matching bean of type [com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$FilterConverter] found for dependency: expected at least 1 bean which qualifies as autowire candidate for this dependency. Dependency annotations: {@org.springframework.beans.factory.annotation.Autowired(required=true)}
|
||||
at org.dspace.servicemanager.servlet.DSpaceKernelServletContextListener.contextInitialized(DSpaceKernelServletContextListener.java:92)
|
||||
|
||||
@ -11,8 +11,6 @@
|
||||
|
||||
Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items
|
||||
I created a GitHub issue to track this #389, because I’m super busy in Nairobi right now
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-10/" /><meta property="article:published_time" content="2018-10-01T22:31:54+03:00"/>
|
||||
@ -25,10 +23,8 @@ I created a GitHub issue to track this #389, because I’m super busy in Nai
|
||||
|
||||
Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items
|
||||
I created a GitHub issue to track this #389, because I’m super busy in Nairobi right now
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -113,8 +109,6 @@ I created a GitHub issue to track this #389, because I’m super busy in Nai
|
||||
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I’m super busy in Nairobi right now</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="2018-10-03">2018-10-03</h2>
|
||||
|
||||
<ul>
|
||||
|
||||
@ -18,12 +18,10 @@ Send a note about my dspace-statistics-api to the dspace-tech mailing list
|
||||
|
||||
Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage
|
||||
Today these are the top 10 IPs:
|
||||
|
||||
|
||||
" />
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-11/" /><meta property="article:published_time" content="2018-11-01T16:41:30+02:00"/>
|
||||
<meta property="article:modified_time" content="2018-11-06T18:03:44+02:00"/>
|
||||
<meta property="article:modified_time" content="2018-11-07T19:20:25+02:00"/>
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="November, 2018"/>
|
||||
@ -39,10 +37,8 @@ Send a note about my dspace-statistics-api to the dspace-tech mailing list
|
||||
|
||||
Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage
|
||||
Today these are the top 10 IPs:
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -52,9 +48,9 @@ Today these are the top 10 IPs:
|
||||
"@type": "BlogPosting",
|
||||
"headline": "November, 2018",
|
||||
"url": "https://alanorth.github.io/cgspace-notes/2018-11/",
|
||||
"wordCount": "1244",
|
||||
"wordCount": "1310",
|
||||
"datePublished": "2018-11-01T16:41:30+02:00",
|
||||
"dateModified": "2018-11-06T18:03:44+02:00",
|
||||
"dateModified": "2018-11-07T19:20:25+02:00",
|
||||
"author": {
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
@ -134,8 +130,6 @@ Today these are the top 10 IPs:
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
|
||||
<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "03/Nov/2018" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
1300 66.249.64.63
|
||||
1384 35.237.175.180
|
||||
@ -420,6 +414,14 @@ Today these are the top 10 IPs:
|
||||
<li>Tag version 0.7.0 of the dspace-statistics-api</li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2018-11-08">2018-11-08</h2>
|
||||
|
||||
<ul>
|
||||
<li>I deployed verison 0.7.0 of the dspace-statistics-api on DSpace Test (linode19) so I can test it for a few days (and check the Munin stats to see the change in database connections) before deploying on CGSpace</li>
|
||||
<li>I also enabled systemd’s persistent journal by setting <a href="https://www.freedesktop.org/software/systemd/man/journald.conf.html"><code>Storage=persistent</code> in <em>journald.conf</em></a></li>
|
||||
<li>Apparently <a href="https://www.freedesktop.org/software/systemd/man/journald.conf.html">Ubuntu 16.04 defaulted to using rsyslog for boot records until early 2018</a>, so I removed <code>rsyslog</code> too</li>
|
||||
</ul>
|
||||
|
||||
<!-- vim: set sw=2 ts=2: -->
|
||||
|
||||
|
||||
|
||||
@ -13,7 +13,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="404 Page not found"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -13,7 +13,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Categories"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -109,8 +109,6 @@
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -134,8 +132,6 @@
|
||||
<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
|
||||
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I’m super busy in Nairobi right now</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -161,8 +157,6 @@
|
||||
<li>Also, I’ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system’s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
|
||||
<li>I’m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I’m getting those autowire errors in Tomcat 8.5.30 again:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -199,8 +193,6 @@
|
||||
<li>The server only has 8GB of RAM so we’ll eventually need to upgrade to a larger one because we’ll start starving the OS, PostgreSQL, and command line batch processes</li>
|
||||
<li>I ran all system updates on DSpace Test and rebooted it</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -233,8 +225,6 @@
|
||||
|
||||
<pre><code>There is insufficient memory for the Java Runtime Environment to continue.
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -278,8 +268,6 @@ real 74m42.646s
|
||||
user 8m5.056s
|
||||
sys 2m7.289s
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -309,8 +297,6 @@ sys 2m7.289s
|
||||
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -334,8 +320,6 @@ sys 2m7.289s
|
||||
<li>I tried to test something on DSpace Test but noticed that it’s down since god knows when</li>
|
||||
<li>Catalina logs at least show some memory errors yesterday:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -358,8 +342,6 @@ sys 2m7.289s
|
||||
<ul>
|
||||
<li>Export a CSV of the IITA community metadata for Martin Mueller</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -385,8 +367,6 @@ sys 2m7.289s
|
||||
<li>Yesterday I figured out how to monitor DSpace sessions using JMX</li>
|
||||
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu’s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -84,8 +84,6 @@
|
||||
</p>
|
||||
</header>
|
||||
<p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -17,9 +17,7 @@
|
||||
<pubDate>Mon, 18 Sep 2017 16:38:35 +0300</pubDate>
|
||||
|
||||
<guid>https://alanorth.github.io/cgspace-notes/cgiar-library-migration/</guid>
|
||||
<description><p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
|
||||
|
||||
<p></p></description>
|
||||
<description><p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p></description>
|
||||
</item>
|
||||
|
||||
</channel>
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Categories"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -175,8 +175,6 @@ dspace.log.2018-01-02:34
|
||||
<ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -202,8 +200,6 @@ dspace.log.2018-01-02:34
|
||||
<li>PostgreSQL activity says there are 115 connections currently</li>
|
||||
<li>The list of connections to XMLUI and REST API for today:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -244,8 +240,6 @@ dspace.log.2018-01-02:34
|
||||
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
|
||||
COPY 54701
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -276,8 +270,6 @@ COPY 54701
|
||||
<li>There appears to be a pattern but I’ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li>
|
||||
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -296,8 +288,6 @@ COPY 54701
|
||||
</p>
|
||||
</header>
|
||||
<p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -326,8 +316,6 @@ COPY 54701
|
||||
<ul>
|
||||
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne’s user account is both in the approvers step as well as the group</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -368,8 +356,6 @@ COPY 54701
|
||||
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
|
||||
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -400,8 +386,6 @@ COPY 54701
|
||||
<li>Looking at extracting the metadata registries from ICARDA’s MEL DSpace database so we can compare fields with CGSpace</li>
|
||||
<li>We can use PostgreSQL’s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Categories"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -114,8 +114,6 @@
|
||||
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -156,8 +154,6 @@
|
||||
<pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg
|
||||
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -196,8 +192,6 @@ DELETE 1
|
||||
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
|
||||
<li>Looks like we’ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -222,8 +216,6 @@ DELETE 1
|
||||
<li>I tested on DSpace Test as well and it doesn’t work there either</li>
|
||||
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -260,8 +252,6 @@ DELETE 1
|
||||
<li>I’ve raised a ticket with Atmire to ask</li>
|
||||
<li>Another worrying error from dspace.log is:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -286,8 +276,6 @@ DELETE 1
|
||||
</ul>
|
||||
|
||||
<p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -320,8 +308,6 @@ DELETE 1
|
||||
|
||||
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -350,8 +336,6 @@ DELETE 1
|
||||
|
||||
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b "dc=cgiarad,dc=org" -D "admigration1@cgiarad.org" -W "(sAMAccountName=admigration1)"
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -384,8 +368,6 @@ DELETE 1
|
||||
$ git reset --hard ilri/5_x-prod
|
||||
$ git rebase -i dspace-5.5
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -421,8 +403,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<ul>
|
||||
<li>In this case the select query was showing 95 results before the update</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Categories"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -108,8 +108,6 @@
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -138,8 +136,6 @@
|
||||
<pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
|
||||
3168
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -166,8 +162,6 @@
|
||||
<li>This will save us a few gigs of backup space we’re paying for on S3</li>
|
||||
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -192,8 +186,6 @@
|
||||
<li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I’m pretty sure we don’t need it as of the latest few versions of Atmire’s Listings and Reports module</li>
|
||||
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -225,8 +217,6 @@
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)…</li>
|
||||
<li>Also, lots of things like “COTE D`LVOIRE” and “COTE D IVOIRE”</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -251,8 +241,6 @@
|
||||
<li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li>
|
||||
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -282,8 +270,6 @@
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -312,8 +298,6 @@
|
||||
<pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
|
||||
78
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGIAR Library Migration"/>
|
||||
<meta name="twitter:description" content="Notes on the migration of the CGIAR Library to CGSpace"/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -95,8 +95,6 @@
|
||||
</header>
|
||||
<p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
|
||||
|
||||
<p></p>
|
||||
|
||||
<h2 id="pre-migration-technical-todos">Pre-migration Technical TODOs</h2>
|
||||
|
||||
<p>Things that need to happen before the migration:</p>
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -111,8 +111,6 @@
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -136,8 +134,6 @@
|
||||
<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
|
||||
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I’m super busy in Nairobi right now</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -163,8 +159,6 @@
|
||||
<li>Also, I’ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system’s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
|
||||
<li>I’m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I’m getting those autowire errors in Tomcat 8.5.30 again:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -201,8 +195,6 @@
|
||||
<li>The server only has 8GB of RAM so we’ll eventually need to upgrade to a larger one because we’ll start starving the OS, PostgreSQL, and command line batch processes</li>
|
||||
<li>I ran all system updates on DSpace Test and rebooted it</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -235,8 +227,6 @@
|
||||
|
||||
<pre><code>There is insufficient memory for the Java Runtime Environment to continue.
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -280,8 +270,6 @@ real 74m42.646s
|
||||
user 8m5.056s
|
||||
sys 2m7.289s
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -311,8 +299,6 @@ sys 2m7.289s
|
||||
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -336,8 +322,6 @@ sys 2m7.289s
|
||||
<li>I tried to test something on DSpace Test but noticed that it’s down since god knows when</li>
|
||||
<li>Catalina logs at least show some memory errors yesterday:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -360,8 +344,6 @@ sys 2m7.289s
|
||||
<ul>
|
||||
<li>Export a CSV of the IITA community metadata for Martin Mueller</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -387,8 +369,6 @@ sys 2m7.289s
|
||||
<li>Yesterday I figured out how to monitor DSpace sessions using JMX</li>
|
||||
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu’s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
144
docs/index.xml
144
docs/index.xml
@ -29,9 +29,7 @@
|
||||
<ul>
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -45,9 +43,7 @@
|
||||
<ul>
|
||||
<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
|
||||
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -63,9 +59,7 @@
|
||||
<li>I&rsquo;ll update the DSpace role in our <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure playbooks</a> and run the updated playbooks on CGSpace and DSpace Test</li>
|
||||
<li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
|
||||
<li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -92,9 +86,7 @@
|
||||
<li>Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core</li>
|
||||
<li>The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes</li>
|
||||
<li>I ran all system updates on DSpace Test and rebooted it</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -117,9 +109,7 @@
|
||||
</ul>
|
||||
|
||||
<pre><code>There is insufficient memory for the Java Runtime Environment to continue.
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -153,9 +143,7 @@
|
||||
real 74m42.646s
|
||||
user 8m5.056s
|
||||
sys 2m7.289s
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -175,9 +163,7 @@ sys 2m7.289s
|
||||
</ul></li>
|
||||
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -191,9 +177,7 @@ sys 2m7.289s
|
||||
<ul>
|
||||
<li>I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when</li>
|
||||
<li>Catalina logs at least show some memory errors yesterday:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -206,9 +190,7 @@ sys 2m7.289s
|
||||
|
||||
<ul>
|
||||
<li>Export a CSV of the IITA community metadata for Martin Mueller</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -224,9 +206,7 @@ sys 2m7.289s
|
||||
<li>We don&rsquo;t need to distinguish between internal and external works, so that makes it just a simple list</li>
|
||||
<li>Yesterday I figured out how to monitor DSpace sessions using JMX</li>
|
||||
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="https://alanorth.github.io/cgspace-notes/cgspace-notes/2018-01/">in 2018-01</a></li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -311,9 +291,7 @@ dspace.log.2018-01-02:34
|
||||
|
||||
<ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -329,9 +307,7 @@ dspace.log.2018-01-02:34
|
||||
<li>The logs say &ldquo;Timeout waiting for idle object&rdquo;</li>
|
||||
<li>PostgreSQL activity says there are 115 connections currently</li>
|
||||
<li>The list of connections to XMLUI and REST API for today:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -362,9 +338,7 @@ dspace.log.2018-01-02:34
|
||||
|
||||
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
|
||||
COPY 54701
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -385,9 +359,7 @@ COPY 54701
|
||||
<ul>
|
||||
<li>There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li>
|
||||
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -396,9 +368,7 @@ COPY 54701
|
||||
<pubDate>Mon, 18 Sep 2017 16:38:35 +0300</pubDate>
|
||||
|
||||
<guid>https://alanorth.github.io/cgspace-notes/cgiar-library-migration/</guid>
|
||||
<description><p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
|
||||
|
||||
<p></p></description>
|
||||
<description><p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -417,9 +387,7 @@ COPY 54701
|
||||
|
||||
<ul>
|
||||
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -450,9 +418,7 @@ COPY 54701
|
||||
<li>This was due to newline characters in the <code>dc.description.abstract</code> column, which caused OpenRefine to choke when exporting the CSV</li>
|
||||
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
|
||||
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -473,9 +439,7 @@ COPY 54701
|
||||
<li>Merge changes for WLE Phase II theme rename (<a href="https://github.com/ilri/DSpace/pull/329">#329</a>)</li>
|
||||
<li>Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace</li>
|
||||
<li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -517,9 +481,7 @@ COPY 54701
|
||||
</ul>
|
||||
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -550,9 +512,7 @@ COPY 54701
|
||||
|
||||
<pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg
|
||||
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -581,9 +541,7 @@ DELETE 1
|
||||
<ul>
|
||||
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
|
||||
<li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -598,9 +556,7 @@ DELETE 1
|
||||
<li>I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error</li>
|
||||
<li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li>
|
||||
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -627,9 +583,7 @@ DELETE 1
|
||||
<li>I see thousands of them in the logs for the last few months, so it&rsquo;s not related to the DSpace 5.5 upgrade</li>
|
||||
<li>I&rsquo;ve raised a ticket with Atmire to ask</li>
|
||||
<li>Another worrying error from dspace.log is:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -644,9 +598,7 @@ DELETE 1
|
||||
<li>Add <code>dc.type</code> to the output options for Atmire&rsquo;s Listings and Reports module (<a href="https://github.com/ilri/DSpace/pull/286">#286</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
|
||||
<p></p></description>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -669,9 +621,7 @@ DELETE 1
|
||||
</ul>
|
||||
|
||||
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -690,9 +640,7 @@ DELETE 1
|
||||
</ul>
|
||||
|
||||
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot;
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -715,9 +663,7 @@ DELETE 1
|
||||
<pre><code>$ git checkout -b 55new 5_x-prod
|
||||
$ git reset --hard ilri/5_x-prod
|
||||
$ git rebase -i dspace-5.5
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -743,9 +689,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<ul>
|
||||
<li>In this case the select query was showing 95 results before the update</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -763,9 +707,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<li>This is their publications set: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;from=2016-01-01&amp;set=p15738coll2&amp;metadataPrefix=oai_dc">http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;from=2016-01-01&amp;set=p15738coll2&amp;metadataPrefix=oai_dc</a></li>
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -784,9 +726,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
|
||||
3168
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -803,9 +743,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<li>After running DSpace for over five years I&rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year!</li>
|
||||
<li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li>
|
||||
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -820,9 +758,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<li>Looking at issues with author authorities on CGSpace</li>
|
||||
<li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module</li>
|
||||
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -844,9 +780,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<ul>
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li>
|
||||
<li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -861,9 +795,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<li>Move ILRI collection <code>10568/12503</code> from <code>10568/27869</code> to <code>10568/27629</code> using the <a href="https://gist.github.com/alanorth/392c4660e8b022d99dfa">move_collections.sh</a> script I wrote last year.</li>
|
||||
<li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li>
|
||||
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -883,9 +815,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -904,9 +834,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
|
||||
78
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
</channel>
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -175,8 +175,6 @@ dspace.log.2018-01-02:34
|
||||
<ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -202,8 +200,6 @@ dspace.log.2018-01-02:34
|
||||
<li>PostgreSQL activity says there are 115 connections currently</li>
|
||||
<li>The list of connections to XMLUI and REST API for today:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -244,8 +240,6 @@ dspace.log.2018-01-02:34
|
||||
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
|
||||
COPY 54701
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -276,8 +270,6 @@ COPY 54701
|
||||
<li>There appears to be a pattern but I’ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li>
|
||||
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -296,8 +288,6 @@ COPY 54701
|
||||
</p>
|
||||
</header>
|
||||
<p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -326,8 +316,6 @@ COPY 54701
|
||||
<ul>
|
||||
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne’s user account is both in the approvers step as well as the group</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -368,8 +356,6 @@ COPY 54701
|
||||
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
|
||||
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -400,8 +386,6 @@ COPY 54701
|
||||
<li>Looking at extracting the metadata registries from ICARDA’s MEL DSpace database so we can compare fields with CGSpace</li>
|
||||
<li>We can use PostgreSQL’s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -114,8 +114,6 @@
|
||||
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -156,8 +154,6 @@
|
||||
<pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg
|
||||
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -196,8 +192,6 @@ DELETE 1
|
||||
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
|
||||
<li>Looks like we’ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -222,8 +216,6 @@ DELETE 1
|
||||
<li>I tested on DSpace Test as well and it doesn’t work there either</li>
|
||||
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -260,8 +252,6 @@ DELETE 1
|
||||
<li>I’ve raised a ticket with Atmire to ask</li>
|
||||
<li>Another worrying error from dspace.log is:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -286,8 +276,6 @@ DELETE 1
|
||||
</ul>
|
||||
|
||||
<p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -320,8 +308,6 @@ DELETE 1
|
||||
|
||||
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -350,8 +336,6 @@ DELETE 1
|
||||
|
||||
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b "dc=cgiarad,dc=org" -D "admigration1@cgiarad.org" -W "(sAMAccountName=admigration1)"
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -384,8 +368,6 @@ DELETE 1
|
||||
$ git reset --hard ilri/5_x-prod
|
||||
$ git rebase -i dspace-5.5
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -421,8 +403,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<ul>
|
||||
<li>In this case the select query was showing 95 results before the update</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -108,8 +108,6 @@
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -138,8 +136,6 @@
|
||||
<pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
|
||||
3168
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -166,8 +162,6 @@
|
||||
<li>This will save us a few gigs of backup space we’re paying for on S3</li>
|
||||
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -192,8 +186,6 @@
|
||||
<li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I’m pretty sure we don’t need it as of the latest few versions of Atmire’s Listings and Reports module</li>
|
||||
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -225,8 +217,6 @@
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)…</li>
|
||||
<li>Also, lots of things like “COTE D`LVOIRE” and “COTE D IVOIRE”</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -251,8 +241,6 @@
|
||||
<li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li>
|
||||
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -282,8 +270,6 @@
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -312,8 +298,6 @@
|
||||
<pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
|
||||
78
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -111,8 +111,6 @@
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -136,8 +134,6 @@
|
||||
<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
|
||||
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I’m super busy in Nairobi right now</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -163,8 +159,6 @@
|
||||
<li>Also, I’ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system’s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
|
||||
<li>I’m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I’m getting those autowire errors in Tomcat 8.5.30 again:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -201,8 +195,6 @@
|
||||
<li>The server only has 8GB of RAM so we’ll eventually need to upgrade to a larger one because we’ll start starving the OS, PostgreSQL, and command line batch processes</li>
|
||||
<li>I ran all system updates on DSpace Test and rebooted it</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -235,8 +227,6 @@
|
||||
|
||||
<pre><code>There is insufficient memory for the Java Runtime Environment to continue.
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -280,8 +270,6 @@ real 74m42.646s
|
||||
user 8m5.056s
|
||||
sys 2m7.289s
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -311,8 +299,6 @@ sys 2m7.289s
|
||||
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -336,8 +322,6 @@ sys 2m7.289s
|
||||
<li>I tried to test something on DSpace Test but noticed that it’s down since god knows when</li>
|
||||
<li>Catalina logs at least show some memory errors yesterday:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -360,8 +344,6 @@ sys 2m7.289s
|
||||
<ul>
|
||||
<li>Export a CSV of the IITA community metadata for Martin Mueller</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -387,8 +369,6 @@ sys 2m7.289s
|
||||
<li>Yesterday I figured out how to monitor DSpace sessions using JMX</li>
|
||||
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu’s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -29,9 +29,7 @@
|
||||
<ul>
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -45,9 +43,7 @@
|
||||
<ul>
|
||||
<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
|
||||
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -63,9 +59,7 @@
|
||||
<li>I&rsquo;ll update the DSpace role in our <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure playbooks</a> and run the updated playbooks on CGSpace and DSpace Test</li>
|
||||
<li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
|
||||
<li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -92,9 +86,7 @@
|
||||
<li>Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core</li>
|
||||
<li>The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes</li>
|
||||
<li>I ran all system updates on DSpace Test and rebooted it</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -117,9 +109,7 @@
|
||||
</ul>
|
||||
|
||||
<pre><code>There is insufficient memory for the Java Runtime Environment to continue.
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -153,9 +143,7 @@
|
||||
real 74m42.646s
|
||||
user 8m5.056s
|
||||
sys 2m7.289s
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -175,9 +163,7 @@ sys 2m7.289s
|
||||
</ul></li>
|
||||
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -191,9 +177,7 @@ sys 2m7.289s
|
||||
<ul>
|
||||
<li>I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when</li>
|
||||
<li>Catalina logs at least show some memory errors yesterday:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -206,9 +190,7 @@ sys 2m7.289s
|
||||
|
||||
<ul>
|
||||
<li>Export a CSV of the IITA community metadata for Martin Mueller</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -224,9 +206,7 @@ sys 2m7.289s
|
||||
<li>We don&rsquo;t need to distinguish between internal and external works, so that makes it just a simple list</li>
|
||||
<li>Yesterday I figured out how to monitor DSpace sessions using JMX</li>
|
||||
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="https://alanorth.github.io/cgspace-notes/cgspace-notes/2018-01/">in 2018-01</a></li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -311,9 +291,7 @@ dspace.log.2018-01-02:34
|
||||
|
||||
<ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -329,9 +307,7 @@ dspace.log.2018-01-02:34
|
||||
<li>The logs say &ldquo;Timeout waiting for idle object&rdquo;</li>
|
||||
<li>PostgreSQL activity says there are 115 connections currently</li>
|
||||
<li>The list of connections to XMLUI and REST API for today:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -362,9 +338,7 @@ dspace.log.2018-01-02:34
|
||||
|
||||
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
|
||||
COPY 54701
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -385,9 +359,7 @@ COPY 54701
|
||||
<ul>
|
||||
<li>There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li>
|
||||
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -396,9 +368,7 @@ COPY 54701
|
||||
<pubDate>Mon, 18 Sep 2017 16:38:35 +0300</pubDate>
|
||||
|
||||
<guid>https://alanorth.github.io/cgspace-notes/cgiar-library-migration/</guid>
|
||||
<description><p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
|
||||
|
||||
<p></p></description>
|
||||
<description><p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -417,9 +387,7 @@ COPY 54701
|
||||
|
||||
<ul>
|
||||
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -450,9 +418,7 @@ COPY 54701
|
||||
<li>This was due to newline characters in the <code>dc.description.abstract</code> column, which caused OpenRefine to choke when exporting the CSV</li>
|
||||
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
|
||||
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -473,9 +439,7 @@ COPY 54701
|
||||
<li>Merge changes for WLE Phase II theme rename (<a href="https://github.com/ilri/DSpace/pull/329">#329</a>)</li>
|
||||
<li>Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace</li>
|
||||
<li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -517,9 +481,7 @@ COPY 54701
|
||||
</ul>
|
||||
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -550,9 +512,7 @@ COPY 54701
|
||||
|
||||
<pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg
|
||||
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -581,9 +541,7 @@ DELETE 1
|
||||
<ul>
|
||||
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
|
||||
<li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -598,9 +556,7 @@ DELETE 1
|
||||
<li>I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error</li>
|
||||
<li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li>
|
||||
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -627,9 +583,7 @@ DELETE 1
|
||||
<li>I see thousands of them in the logs for the last few months, so it&rsquo;s not related to the DSpace 5.5 upgrade</li>
|
||||
<li>I&rsquo;ve raised a ticket with Atmire to ask</li>
|
||||
<li>Another worrying error from dspace.log is:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -644,9 +598,7 @@ DELETE 1
|
||||
<li>Add <code>dc.type</code> to the output options for Atmire&rsquo;s Listings and Reports module (<a href="https://github.com/ilri/DSpace/pull/286">#286</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
|
||||
<p></p></description>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -669,9 +621,7 @@ DELETE 1
|
||||
</ul>
|
||||
|
||||
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -690,9 +640,7 @@ DELETE 1
|
||||
</ul>
|
||||
|
||||
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot;
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -715,9 +663,7 @@ DELETE 1
|
||||
<pre><code>$ git checkout -b 55new 5_x-prod
|
||||
$ git reset --hard ilri/5_x-prod
|
||||
$ git rebase -i dspace-5.5
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -743,9 +689,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<ul>
|
||||
<li>In this case the select query was showing 95 results before the update</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -763,9 +707,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<li>This is their publications set: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;from=2016-01-01&amp;set=p15738coll2&amp;metadataPrefix=oai_dc">http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;from=2016-01-01&amp;set=p15738coll2&amp;metadataPrefix=oai_dc</a></li>
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -784,9 +726,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
|
||||
3168
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -803,9 +743,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<li>After running DSpace for over five years I&rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year!</li>
|
||||
<li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li>
|
||||
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -820,9 +758,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<li>Looking at issues with author authorities on CGSpace</li>
|
||||
<li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module</li>
|
||||
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -844,9 +780,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<ul>
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li>
|
||||
<li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -861,9 +795,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<li>Move ILRI collection <code>10568/12503</code> from <code>10568/27869</code> to <code>10568/27629</code> using the <a href="https://gist.github.com/alanorth/392c4660e8b022d99dfa">move_collections.sh</a> script I wrote last year.</li>
|
||||
<li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li>
|
||||
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -883,9 +815,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -904,9 +834,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
|
||||
78
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
</channel>
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -175,8 +175,6 @@ dspace.log.2018-01-02:34
|
||||
<ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -202,8 +200,6 @@ dspace.log.2018-01-02:34
|
||||
<li>PostgreSQL activity says there are 115 connections currently</li>
|
||||
<li>The list of connections to XMLUI and REST API for today:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -244,8 +240,6 @@ dspace.log.2018-01-02:34
|
||||
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
|
||||
COPY 54701
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -276,8 +270,6 @@ COPY 54701
|
||||
<li>There appears to be a pattern but I’ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li>
|
||||
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -296,8 +288,6 @@ COPY 54701
|
||||
</p>
|
||||
</header>
|
||||
<p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -326,8 +316,6 @@ COPY 54701
|
||||
<ul>
|
||||
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne’s user account is both in the approvers step as well as the group</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -368,8 +356,6 @@ COPY 54701
|
||||
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
|
||||
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -400,8 +386,6 @@ COPY 54701
|
||||
<li>Looking at extracting the metadata registries from ICARDA’s MEL DSpace database so we can compare fields with CGSpace</li>
|
||||
<li>We can use PostgreSQL’s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -114,8 +114,6 @@
|
||||
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -156,8 +154,6 @@
|
||||
<pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg
|
||||
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -196,8 +192,6 @@ DELETE 1
|
||||
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
|
||||
<li>Looks like we’ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -222,8 +216,6 @@ DELETE 1
|
||||
<li>I tested on DSpace Test as well and it doesn’t work there either</li>
|
||||
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -260,8 +252,6 @@ DELETE 1
|
||||
<li>I’ve raised a ticket with Atmire to ask</li>
|
||||
<li>Another worrying error from dspace.log is:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -286,8 +276,6 @@ DELETE 1
|
||||
</ul>
|
||||
|
||||
<p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -320,8 +308,6 @@ DELETE 1
|
||||
|
||||
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -350,8 +336,6 @@ DELETE 1
|
||||
|
||||
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b "dc=cgiarad,dc=org" -D "admigration1@cgiarad.org" -W "(sAMAccountName=admigration1)"
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -384,8 +368,6 @@ DELETE 1
|
||||
$ git reset --hard ilri/5_x-prod
|
||||
$ git rebase -i dspace-5.5
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -421,8 +403,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<ul>
|
||||
<li>In this case the select query was showing 95 results before the update</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -108,8 +108,6 @@
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -138,8 +136,6 @@
|
||||
<pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
|
||||
3168
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -166,8 +162,6 @@
|
||||
<li>This will save us a few gigs of backup space we’re paying for on S3</li>
|
||||
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -192,8 +186,6 @@
|
||||
<li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I’m pretty sure we don’t need it as of the latest few versions of Atmire’s Listings and Reports module</li>
|
||||
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -225,8 +217,6 @@
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)…</li>
|
||||
<li>Also, lots of things like “COTE D`LVOIRE” and “COTE D IVOIRE”</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -251,8 +241,6 @@
|
||||
<li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li>
|
||||
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -282,8 +270,6 @@
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -312,8 +298,6 @@
|
||||
<pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
|
||||
78
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -41,7 +41,7 @@ Disallow: /cgspace-notes/2015-12/
|
||||
Disallow: /cgspace-notes/2015-11/
|
||||
Disallow: /cgspace-notes/
|
||||
Disallow: /cgspace-notes/categories/
|
||||
Disallow: /cgspace-notes/tags/notes/
|
||||
Disallow: /cgspace-notes/categories/notes/
|
||||
Disallow: /cgspace-notes/tags/notes/
|
||||
Disallow: /cgspace-notes/posts/
|
||||
Disallow: /cgspace-notes/tags/
|
||||
|
||||
@ -4,7 +4,7 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2018-11/</loc>
|
||||
<lastmod>2018-11-06T18:03:44+02:00</lastmod>
|
||||
<lastmod>2018-11-07T19:20:25+02:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
@ -194,7 +194,7 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/</loc>
|
||||
<lastmod>2018-11-06T18:03:44+02:00</lastmod>
|
||||
<lastmod>2018-11-07T19:20:25+02:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
@ -203,27 +203,27 @@
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
|
||||
<lastmod>2018-11-06T18:03:44+02:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
|
||||
<lastmod>2018-03-09T22:10:33+02:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
|
||||
<lastmod>2018-11-07T19:20:25+02:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
|
||||
<lastmod>2018-11-06T18:03:44+02:00</lastmod>
|
||||
<lastmod>2018-11-07T19:20:25+02:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
|
||||
<lastmod>2018-11-06T18:03:44+02:00</lastmod>
|
||||
<lastmod>2018-11-07T19:20:25+02:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Tags"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -111,8 +111,6 @@
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -136,8 +134,6 @@
|
||||
<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
|
||||
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I’m super busy in Nairobi right now</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -163,8 +159,6 @@
|
||||
<li>Also, I’ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system’s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
|
||||
<li>I’m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I’m getting those autowire errors in Tomcat 8.5.30 again:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -201,8 +195,6 @@
|
||||
<li>The server only has 8GB of RAM so we’ll eventually need to upgrade to a larger one because we’ll start starving the OS, PostgreSQL, and command line batch processes</li>
|
||||
<li>I ran all system updates on DSpace Test and rebooted it</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -235,8 +227,6 @@
|
||||
|
||||
<pre><code>There is insufficient memory for the Java Runtime Environment to continue.
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -280,8 +270,6 @@ real 74m42.646s
|
||||
user 8m5.056s
|
||||
sys 2m7.289s
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -311,8 +299,6 @@ sys 2m7.289s
|
||||
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -336,8 +322,6 @@ sys 2m7.289s
|
||||
<li>I tried to test something on DSpace Test but noticed that it’s down since god knows when</li>
|
||||
<li>Catalina logs at least show some memory errors yesterday:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -360,8 +344,6 @@ sys 2m7.289s
|
||||
<ul>
|
||||
<li>Export a CSV of the IITA community metadata for Martin Mueller</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -387,8 +369,6 @@ sys 2m7.289s
|
||||
<li>Yesterday I figured out how to monitor DSpace sessions using JMX</li>
|
||||
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu’s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -96,8 +96,6 @@
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -121,8 +119,6 @@
|
||||
<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
|
||||
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I’m super busy in Nairobi right now</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -148,8 +144,6 @@
|
||||
<li>Also, I’ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system’s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
|
||||
<li>I’m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I’m getting those autowire errors in Tomcat 8.5.30 again:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -186,8 +180,6 @@
|
||||
<li>The server only has 8GB of RAM so we’ll eventually need to upgrade to a larger one because we’ll start starving the OS, PostgreSQL, and command line batch processes</li>
|
||||
<li>I ran all system updates on DSpace Test and rebooted it</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -220,8 +212,6 @@
|
||||
|
||||
<pre><code>There is insufficient memory for the Java Runtime Environment to continue.
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -265,8 +255,6 @@ real 74m42.646s
|
||||
user 8m5.056s
|
||||
sys 2m7.289s
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -296,8 +284,6 @@ sys 2m7.289s
|
||||
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -321,8 +307,6 @@ sys 2m7.289s
|
||||
<li>I tried to test something on DSpace Test but noticed that it’s down since god knows when</li>
|
||||
<li>Catalina logs at least show some memory errors yesterday:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -345,8 +329,6 @@ sys 2m7.289s
|
||||
<ul>
|
||||
<li>Export a CSV of the IITA community metadata for Martin Mueller</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -372,8 +354,6 @@ sys 2m7.289s
|
||||
<li>Yesterday I figured out how to monitor DSpace sessions using JMX</li>
|
||||
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu’s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -29,9 +29,7 @@
|
||||
<ul>
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -45,9 +43,7 @@
|
||||
<ul>
|
||||
<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
|
||||
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -63,9 +59,7 @@
|
||||
<li>I&rsquo;ll update the DSpace role in our <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure playbooks</a> and run the updated playbooks on CGSpace and DSpace Test</li>
|
||||
<li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
|
||||
<li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -92,9 +86,7 @@
|
||||
<li>Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core</li>
|
||||
<li>The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes</li>
|
||||
<li>I ran all system updates on DSpace Test and rebooted it</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -117,9 +109,7 @@
|
||||
</ul>
|
||||
|
||||
<pre><code>There is insufficient memory for the Java Runtime Environment to continue.
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -153,9 +143,7 @@
|
||||
real 74m42.646s
|
||||
user 8m5.056s
|
||||
sys 2m7.289s
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -175,9 +163,7 @@ sys 2m7.289s
|
||||
</ul></li>
|
||||
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -191,9 +177,7 @@ sys 2m7.289s
|
||||
<ul>
|
||||
<li>I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when</li>
|
||||
<li>Catalina logs at least show some memory errors yesterday:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -206,9 +190,7 @@ sys 2m7.289s
|
||||
|
||||
<ul>
|
||||
<li>Export a CSV of the IITA community metadata for Martin Mueller</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -224,9 +206,7 @@ sys 2m7.289s
|
||||
<li>We don&rsquo;t need to distinguish between internal and external works, so that makes it just a simple list</li>
|
||||
<li>Yesterday I figured out how to monitor DSpace sessions using JMX</li>
|
||||
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="https://alanorth.github.io/cgspace-notes/cgspace-notes/2018-01/">in 2018-01</a></li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -311,9 +291,7 @@ dspace.log.2018-01-02:34
|
||||
|
||||
<ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -329,9 +307,7 @@ dspace.log.2018-01-02:34
|
||||
<li>The logs say &ldquo;Timeout waiting for idle object&rdquo;</li>
|
||||
<li>PostgreSQL activity says there are 115 connections currently</li>
|
||||
<li>The list of connections to XMLUI and REST API for today:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -362,9 +338,7 @@ dspace.log.2018-01-02:34
|
||||
|
||||
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
|
||||
COPY 54701
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -385,9 +359,7 @@ COPY 54701
|
||||
<ul>
|
||||
<li>There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li>
|
||||
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -406,9 +378,7 @@ COPY 54701
|
||||
|
||||
<ul>
|
||||
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -439,9 +409,7 @@ COPY 54701
|
||||
<li>This was due to newline characters in the <code>dc.description.abstract</code> column, which caused OpenRefine to choke when exporting the CSV</li>
|
||||
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
|
||||
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -462,9 +430,7 @@ COPY 54701
|
||||
<li>Merge changes for WLE Phase II theme rename (<a href="https://github.com/ilri/DSpace/pull/329">#329</a>)</li>
|
||||
<li>Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace</li>
|
||||
<li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -506,9 +472,7 @@ COPY 54701
|
||||
</ul>
|
||||
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -539,9 +503,7 @@ COPY 54701
|
||||
|
||||
<pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg
|
||||
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -570,9 +532,7 @@ DELETE 1
|
||||
<ul>
|
||||
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
|
||||
<li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -587,9 +547,7 @@ DELETE 1
|
||||
<li>I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error</li>
|
||||
<li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li>
|
||||
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -616,9 +574,7 @@ DELETE 1
|
||||
<li>I see thousands of them in the logs for the last few months, so it&rsquo;s not related to the DSpace 5.5 upgrade</li>
|
||||
<li>I&rsquo;ve raised a ticket with Atmire to ask</li>
|
||||
<li>Another worrying error from dspace.log is:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -633,9 +589,7 @@ DELETE 1
|
||||
<li>Add <code>dc.type</code> to the output options for Atmire&rsquo;s Listings and Reports module (<a href="https://github.com/ilri/DSpace/pull/286">#286</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
|
||||
<p></p></description>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -658,9 +612,7 @@ DELETE 1
|
||||
</ul>
|
||||
|
||||
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -679,9 +631,7 @@ DELETE 1
|
||||
</ul>
|
||||
|
||||
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot;
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -704,9 +654,7 @@ DELETE 1
|
||||
<pre><code>$ git checkout -b 55new 5_x-prod
|
||||
$ git reset --hard ilri/5_x-prod
|
||||
$ git rebase -i dspace-5.5
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -732,9 +680,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<ul>
|
||||
<li>In this case the select query was showing 95 results before the update</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -752,9 +698,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<li>This is their publications set: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;from=2016-01-01&amp;set=p15738coll2&amp;metadataPrefix=oai_dc">http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;from=2016-01-01&amp;set=p15738coll2&amp;metadataPrefix=oai_dc</a></li>
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -773,9 +717,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
|
||||
3168
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -792,9 +734,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<li>After running DSpace for over five years I&rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year!</li>
|
||||
<li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li>
|
||||
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -809,9 +749,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<li>Looking at issues with author authorities on CGSpace</li>
|
||||
<li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module</li>
|
||||
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -833,9 +771,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<ul>
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li>
|
||||
<li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -850,9 +786,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<li>Move ILRI collection <code>10568/12503</code> from <code>10568/27869</code> to <code>10568/27629</code> using the <a href="https://gist.github.com/alanorth/392c4660e8b022d99dfa">move_collections.sh</a> script I wrote last year.</li>
|
||||
<li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li>
|
||||
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
|
||||
</ul>
|
||||
|
||||
<p></p></description>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -872,9 +806,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -893,9 +825,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
|
||||
78
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
</channel>
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -160,8 +160,6 @@ dspace.log.2018-01-02:34
|
||||
<ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -187,8 +185,6 @@ dspace.log.2018-01-02:34
|
||||
<li>PostgreSQL activity says there are 115 connections currently</li>
|
||||
<li>The list of connections to XMLUI and REST API for today:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -229,8 +225,6 @@ dspace.log.2018-01-02:34
|
||||
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
|
||||
COPY 54701
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -261,8 +255,6 @@ COPY 54701
|
||||
<li>There appears to be a pattern but I’ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li>
|
||||
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -291,8 +283,6 @@ COPY 54701
|
||||
<ul>
|
||||
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne’s user account is both in the approvers step as well as the group</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -333,8 +323,6 @@ COPY 54701
|
||||
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
|
||||
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -365,8 +353,6 @@ COPY 54701
|
||||
<li>Looking at extracting the metadata registries from ICARDA’s MEL DSpace database so we can compare fields with CGSpace</li>
|
||||
<li>We can use PostgreSQL’s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -436,8 +422,6 @@ COPY 54701
|
||||
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -106,8 +106,6 @@
|
||||
<pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg
|
||||
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -146,8 +144,6 @@ DELETE 1
|
||||
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
|
||||
<li>Looks like we’ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -172,8 +168,6 @@ DELETE 1
|
||||
<li>I tested on DSpace Test as well and it doesn’t work there either</li>
|
||||
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -210,8 +204,6 @@ DELETE 1
|
||||
<li>I’ve raised a ticket with Atmire to ask</li>
|
||||
<li>Another worrying error from dspace.log is:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -236,8 +228,6 @@ DELETE 1
|
||||
</ul>
|
||||
|
||||
<p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -270,8 +260,6 @@ DELETE 1
|
||||
|
||||
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -300,8 +288,6 @@ DELETE 1
|
||||
|
||||
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b "dc=cgiarad,dc=org" -D "admigration1@cgiarad.org" -W "(sAMAccountName=admigration1)"
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -334,8 +320,6 @@ DELETE 1
|
||||
$ git reset --hard ilri/5_x-prod
|
||||
$ git rebase -i dspace-5.5
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -371,8 +355,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<ul>
|
||||
<li>In this case the select query was showing 95 results before the update</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -400,8 +382,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -94,8 +94,6 @@
|
||||
<pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
|
||||
3168
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -122,8 +120,6 @@
|
||||
<li>This will save us a few gigs of backup space we’re paying for on S3</li>
|
||||
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -148,8 +144,6 @@
|
||||
<li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I’m pretty sure we don’t need it as of the latest few versions of Atmire’s Listings and Reports module</li>
|
||||
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -181,8 +175,6 @@
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)…</li>
|
||||
<li>Also, lots of things like “COTE D`LVOIRE” and “COTE D IVOIRE”</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -207,8 +199,6 @@
|
||||
<li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li>
|
||||
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -238,8 +228,6 @@
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -268,8 +256,6 @@
|
||||
<pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
|
||||
78
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Tags"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -175,8 +175,6 @@ dspace.log.2018-01-02:34
|
||||
<ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -202,8 +200,6 @@ dspace.log.2018-01-02:34
|
||||
<li>PostgreSQL activity says there are 115 connections currently</li>
|
||||
<li>The list of connections to XMLUI and REST API for today:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -244,8 +240,6 @@ dspace.log.2018-01-02:34
|
||||
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
|
||||
COPY 54701
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -276,8 +270,6 @@ COPY 54701
|
||||
<li>There appears to be a pattern but I’ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li>
|
||||
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -296,8 +288,6 @@ COPY 54701
|
||||
</p>
|
||||
</header>
|
||||
<p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -326,8 +316,6 @@ COPY 54701
|
||||
<ul>
|
||||
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne’s user account is both in the approvers step as well as the group</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -368,8 +356,6 @@ COPY 54701
|
||||
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
|
||||
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -400,8 +386,6 @@ COPY 54701
|
||||
<li>Looking at extracting the metadata registries from ICARDA’s MEL DSpace database so we can compare fields with CGSpace</li>
|
||||
<li>We can use PostgreSQL’s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Tags"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -114,8 +114,6 @@
|
||||
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -156,8 +154,6 @@
|
||||
<pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg
|
||||
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -196,8 +192,6 @@ DELETE 1
|
||||
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
|
||||
<li>Looks like we’ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -222,8 +216,6 @@ DELETE 1
|
||||
<li>I tested on DSpace Test as well and it doesn’t work there either</li>
|
||||
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -260,8 +252,6 @@ DELETE 1
|
||||
<li>I’ve raised a ticket with Atmire to ask</li>
|
||||
<li>Another worrying error from dspace.log is:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -286,8 +276,6 @@ DELETE 1
|
||||
</ul>
|
||||
|
||||
<p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -320,8 +308,6 @@ DELETE 1
|
||||
|
||||
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -350,8 +336,6 @@ DELETE 1
|
||||
|
||||
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b "dc=cgiarad,dc=org" -D "admigration1@cgiarad.org" -W "(sAMAccountName=admigration1)"
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -384,8 +368,6 @@ DELETE 1
|
||||
$ git reset --hard ilri/5_x-prod
|
||||
$ git rebase -i dspace-5.5
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -421,8 +403,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<ul>
|
||||
<li>In this case the select query was showing 95 results before the update</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Tags"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.50" />
|
||||
<meta name="generator" content="Hugo 0.51" />
|
||||
|
||||
|
||||
|
||||
@ -108,8 +108,6 @@
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -138,8 +136,6 @@
|
||||
<pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
|
||||
3168
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -166,8 +162,6 @@
|
||||
<li>This will save us a few gigs of backup space we’re paying for on S3</li>
|
||||
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -192,8 +186,6 @@
|
||||
<li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I’m pretty sure we don’t need it as of the latest few versions of Atmire’s Listings and Reports module</li>
|
||||
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -225,8 +217,6 @@
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)…</li>
|
||||
<li>Also, lots of things like “COTE D`LVOIRE” and “COTE D IVOIRE”</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -251,8 +241,6 @@
|
||||
<li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li>
|
||||
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -282,8 +270,6 @@
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
@ -312,8 +298,6 @@
|
||||
<pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
|
||||
78
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
Loading…
Reference in New Issue
Block a user