Update notes for 2018-11-08

This commit is contained in:
Alan Orth 2018-11-08 09:02:20 +02:00
parent fecac58ec8
commit 51aa83e6c3
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
67 changed files with 196 additions and 970 deletions

View File

@ -274,4 +274,10 @@ $ time ./rest-find-collections.py 10568/27629 --rest-url https://dspacetest.cgia
- Update my [dspace-statistics-api](https://github.com/ilri/dspace-statistics-api) to use a database management class with Python contexts so that connections and cursors are automatically opened and closed - Update my [dspace-statistics-api](https://github.com/ilri/dspace-statistics-api) to use a database management class with Python contexts so that connections and cursors are automatically opened and closed
- Tag version 0.7.0 of the dspace-statistics-api - Tag version 0.7.0 of the dspace-statistics-api
## 2018-11-08
- I deployed verison 0.7.0 of the dspace-statistics-api on DSpace Test (linode19) so I can test it for a few days (and check the Munin stats to see the change in database connections) before deploying on CGSpace
- I also enabled systemd's persistent journal by setting [`Storage=persistent` in *journald.conf*](https://www.freedesktop.org/software/systemd/man/journald.conf.html)
- Apparently [Ubuntu 16.04 defaulted to using rsyslog for boot records until early 2018](https://www.freedesktop.org/software/systemd/man/journald.conf.html), so I removed `rsyslog` too
<!-- vim: set sw=2 ts=2: --> <!-- vim: set sw=2 ts=2: -->

View File

@ -16,8 +16,6 @@ Last week I had increased the limit from 30 to 60, which seemed to help, but now
$ psql -c &#39;SELECT * from pg_stat_activity;&#39; | grep idle | grep -c cgspace $ psql -c &#39;SELECT * from pg_stat_activity;&#39; | grep idle | grep -c cgspace
78 78
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2015-11/" /><meta property="article:published_time" content="2015-11-23T17:00:57&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2015-11/" /><meta property="article:published_time" content="2015-11-23T17:00:57&#43;03:00"/>
@ -35,10 +33,8 @@ Last week I had increased the limit from 30 to 60, which seemed to help, but now
$ psql -c &#39;SELECT * from pg_stat_activity;&#39; | grep idle | grep -c cgspace $ psql -c &#39;SELECT * from pg_stat_activity;&#39; | grep idle | grep -c cgspace
78 78
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -128,8 +124,6 @@ $ psql -c &#39;SELECT * from pg_stat_activity;&#39; | grep idle | grep -c cgspac
78 78
</code></pre> </code></pre>
<p></p>
<ul> <ul>
<li>For now I have increased the limit from 60 to 90, run updates, and rebooted the server</li> <li>For now I have increased the limit from 60 to 90, run updates, and rebooted the server</li>
</ul> </ul>

View File

@ -17,8 +17,6 @@ Replace lzop with xz in log compression cron jobs on DSpace Test—it uses less
-rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18 -rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo -rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz -rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2015-12/" /><meta property="article:published_time" content="2015-12-02T13:18:00&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2015-12/" /><meta property="article:published_time" content="2015-12-02T13:18:00&#43;03:00"/>
@ -37,10 +35,8 @@ Replace lzop with xz in log compression cron jobs on DSpace Test—it uses less
-rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18 -rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo -rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz -rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -131,8 +127,6 @@ Replace lzop with xz in log compression cron jobs on DSpace Test—it uses less
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz -rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
</code></pre> </code></pre>
<p></p>
<ul> <ul>
<li>I had used lrzip once, but it needs more memory and is harder to use as it requires the lrztar wrapper</li> <li>I had used lrzip once, but it needs more memory and is harder to use as it requires the lrztar wrapper</li>
<li>Need to remember to go check if everything is ok in a few days and then change CGSpace</li> <li>Need to remember to go check if everything is ok in a few days and then change CGSpace</li>

View File

@ -12,8 +12,6 @@
Move ILRI collection 10568/12503 from 10568/27869 to 10568/27629 using the move_collections.sh script I wrote last year. Move ILRI collection 10568/12503 from 10568/27869 to 10568/27629 using the move_collections.sh script I wrote last year.
I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated. I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.
Update GitHub wiki for documentation of maintenance tasks. Update GitHub wiki for documentation of maintenance tasks.
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-01/" /><meta property="article:published_time" content="2016-01-13T13:18:00&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-01/" /><meta property="article:published_time" content="2016-01-13T13:18:00&#43;03:00"/>
@ -27,10 +25,8 @@ Update GitHub wiki for documentation of maintenance tasks.
Move ILRI collection 10568/12503 from 10568/27869 to 10568/27629 using the move_collections.sh script I wrote last year. Move ILRI collection 10568/12503 from 10568/27869 to 10568/27629 using the move_collections.sh script I wrote last year.
I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated. I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.
Update GitHub wiki for documentation of maintenance tasks. Update GitHub wiki for documentation of maintenance tasks.
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -116,8 +112,6 @@ Update GitHub wiki for documentation of maintenance tasks.
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li> <li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
</ul> </ul>
<p></p>
<h2 id="2016-01-14">2016-01-14</h2> <h2 id="2016-01-14">2016-01-14</h2>
<ul> <ul>

View File

@ -19,8 +19,6 @@ I noticed we have a very interesting list of countries on CGSpace:
Not only are there 49,000 countries, we have some blanks (25)&hellip; Not only are there 49,000 countries, we have some blanks (25)&hellip;
Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo; Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-02/" /><meta property="article:published_time" content="2016-02-05T13:18:00&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-02/" /><meta property="article:published_time" content="2016-02-05T13:18:00&#43;03:00"/>
@ -41,10 +39,8 @@ I noticed we have a very interesting list of countries on CGSpace:
Not only are there 49,000 countries, we have some blanks (25)&hellip; Not only are there 49,000 countries, we have some blanks (25)&hellip;
Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo; Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -137,8 +133,6 @@ Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&r
<li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li> <li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li>
</ul> </ul>
<p></p>
<h2 id="2016-02-06">2016-02-06</h2> <h2 id="2016-02-06">2016-02-06</h2>
<ul> <ul>

View File

@ -12,8 +12,6 @@
Looking at issues with author authorities on CGSpace Looking at issues with author authorities on CGSpace
For some reason we still have the index-lucene-update cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module For some reason we still have the index-lucene-update cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module
Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-03/" /><meta property="article:published_time" content="2016-03-02T16:50:00&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-03/" /><meta property="article:published_time" content="2016-03-02T16:50:00&#43;03:00"/>
@ -27,10 +25,8 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
Looking at issues with author authorities on CGSpace Looking at issues with author authorities on CGSpace
For some reason we still have the index-lucene-update cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module For some reason we still have the index-lucene-update cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module
Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -116,8 +112,6 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li> <li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
</ul> </ul>
<p></p>
<h2 id="2016-03-07">2016-03-07</h2> <h2 id="2016-03-07">2016-03-07</h2>
<ul> <ul>

View File

@ -14,8 +14,6 @@ We are backing up all logs in the log folder, including useless stuff like solr,
After running DSpace for over five years I&rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year! After running DSpace for over five years I&rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year!
This will save us a few gigs of backup space we&rsquo;re paying for on S3 This will save us a few gigs of backup space we&rsquo;re paying for on S3
Also, I noticed the checker log has some errors we should pay attention to: Also, I noticed the checker log has some errors we should pay attention to:
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-04/" /><meta property="article:published_time" content="2016-04-04T11:06:00&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-04/" /><meta property="article:published_time" content="2016-04-04T11:06:00&#43;03:00"/>
@ -31,10 +29,8 @@ We are backing up all logs in the log folder, including useless stuff like solr,
After running DSpace for over five years I&rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year! After running DSpace for over five years I&rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year!
This will save us a few gigs of backup space we&rsquo;re paying for on S3 This will save us a few gigs of backup space we&rsquo;re paying for on S3
Also, I noticed the checker log has some errors we should pay attention to: Also, I noticed the checker log has some errors we should pay attention to:
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -122,8 +118,6 @@ Also, I noticed the checker log has some errors we should pay attention to:
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li> <li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
</ul> </ul>
<p></p>
<pre><code>Run start time: 03/06/2016 04:00:22 <pre><code>Run start time: 03/06/2016 04:00:22
Error retrieving bitstream ID 71274 from asset store. Error retrieving bitstream ID 71274 from asset store.
java.io.FileNotFoundException: /home/cgspace.cgiar.org/assetstore/64/29/06/64290601546459645925328536011917633626 (Too many open files) java.io.FileNotFoundException: /home/cgspace.cgiar.org/assetstore/64/29/06/64290601546459645925328536011917633626 (Too many open files)

View File

@ -16,8 +16,6 @@ There are 3,000 IPs accessing the REST API in a 24-hour period!
# awk &#39;{print $1}&#39; /var/log/nginx/rest.log | uniq | wc -l # awk &#39;{print $1}&#39; /var/log/nginx/rest.log | uniq | wc -l
3168 3168
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-05/" /><meta property="article:published_time" content="2016-05-01T23:06:00&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-05/" /><meta property="article:published_time" content="2016-05-01T23:06:00&#43;03:00"/>
@ -35,10 +33,8 @@ There are 3,000 IPs accessing the REST API in a 24-hour period!
# awk &#39;{print $1}&#39; /var/log/nginx/rest.log | uniq | wc -l # awk &#39;{print $1}&#39; /var/log/nginx/rest.log | uniq | wc -l
3168 3168
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -128,8 +124,6 @@ There are 3,000 IPs accessing the REST API in a 24-hour period!
3168 3168
</code></pre> </code></pre>
<p></p>
<ul> <ul>
<li>The two most often requesters are in Ethiopia and Colombia: 213.55.99.121 and 181.118.144.29</li> <li>The two most often requesters are in Ethiopia and Colombia: 213.55.99.121 and 181.118.144.29</li>
<li>100% of the requests coming from Ethiopia are like this and result in an HTTP 500:</li> <li>100% of the requests coming from Ethiopia are like this and result in an HTTP 500:</li>

View File

@ -15,8 +15,6 @@ After reading the OAI documentation and testing with an OAI validator I found ou
This is their publications set: http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;from=2016-01-01&amp;set=p15738coll2&amp;metadataPrefix=oai_dc This is their publications set: http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;from=2016-01-01&amp;set=p15738coll2&amp;metadataPrefix=oai_dc
You can see the others by using the OAI ListSets verb: http://ebrary.ifpri.org/oai/oai.php?verb=ListSets You can see the others by using the OAI ListSets verb: http://ebrary.ifpri.org/oai/oai.php?verb=ListSets
Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in dc.identifier.fund to cg.identifier.cpwfproject and then the rest to dc.description.sponsorship Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in dc.identifier.fund to cg.identifier.cpwfproject and then the rest to dc.description.sponsorship
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-06/" /><meta property="article:published_time" content="2016-06-01T10:53:00&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-06/" /><meta property="article:published_time" content="2016-06-01T10:53:00&#43;03:00"/>
@ -33,10 +31,8 @@ After reading the OAI documentation and testing with an OAI validator I found ou
This is their publications set: http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;from=2016-01-01&amp;set=p15738coll2&amp;metadataPrefix=oai_dc This is their publications set: http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;from=2016-01-01&amp;set=p15738coll2&amp;metadataPrefix=oai_dc
You can see the others by using the OAI ListSets verb: http://ebrary.ifpri.org/oai/oai.php?verb=ListSets You can see the others by using the OAI ListSets verb: http://ebrary.ifpri.org/oai/oai.php?verb=ListSets
Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in dc.identifier.fund to cg.identifier.cpwfproject and then the rest to dc.description.sponsorship Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in dc.identifier.fund to cg.identifier.cpwfproject and then the rest to dc.description.sponsorship
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -125,8 +121,6 @@ Working on second phase of metadata migration, looks like this will work for mov
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li> <li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
</ul> </ul>
<p></p>
<pre><code>dspacetest=# update metadatavalue set metadata_field_id=130 where metadata_field_id=75 and (text_value like 'PN%' or text_value like 'PHASE%' or text_value = 'CBA' or text_value = 'IA'); <pre><code>dspacetest=# update metadatavalue set metadata_field_id=130 where metadata_field_id=75 and (text_value like 'PN%' or text_value like 'PHASE%' or text_value = 'CBA' or text_value = 'IA');
UPDATE 497 UPDATE 497
dspacetest=# update metadatavalue set metadata_field_id=29 where metadata_field_id=75; dspacetest=# update metadatavalue set metadata_field_id=29 where metadata_field_id=75;

View File

@ -23,8 +23,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
In this case the select query was showing 95 results before the update In this case the select query was showing 95 results before the update
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-07/" /><meta property="article:published_time" content="2016-07-01T10:53:00&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-07/" /><meta property="article:published_time" content="2016-07-01T10:53:00&#43;03:00"/>
@ -49,10 +47,8 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
In this case the select query was showing 95 results before the update In this case the select query was showing 95 results before the update
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -149,8 +145,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
<li>In this case the select query was showing 95 results before the update</li> <li>In this case the select query was showing 95 results before the update</li>
</ul> </ul>
<p></p>
<h2 id="2016-07-02">2016-07-02</h2> <h2 id="2016-07-02">2016-07-02</h2>
<ul> <ul>

View File

@ -20,8 +20,6 @@ Start working on DSpace 5.15.5 port:
$ git checkout -b 55new 5_x-prod $ git checkout -b 55new 5_x-prod
$ git reset --hard ilri/5_x-prod $ git reset --hard ilri/5_x-prod
$ git rebase -i dspace-5.5 $ git rebase -i dspace-5.5
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-08/" /><meta property="article:published_time" content="2016-08-01T15:53:00&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-08/" /><meta property="article:published_time" content="2016-08-01T15:53:00&#43;03:00"/>
@ -43,10 +41,8 @@ Start working on DSpace 5.15.5 port:
$ git checkout -b 55new 5_x-prod $ git checkout -b 55new 5_x-prod
$ git reset --hard ilri/5_x-prod $ git reset --hard ilri/5_x-prod
$ git rebase -i dspace-5.5 $ git rebase -i dspace-5.5
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -140,8 +136,6 @@ $ git reset --hard ilri/5_x-prod
$ git rebase -i dspace-5.5 $ git rebase -i dspace-5.5
</code></pre> </code></pre>
<p></p>
<ul> <ul>
<li>Lots of conflicts that don&rsquo;t make sense (ie, shouldn&rsquo;t conflict!)</li> <li>Lots of conflicts that don&rsquo;t make sense (ie, shouldn&rsquo;t conflict!)</li>
<li>This file in particular conflicts almost 10 times: <code>dspace/modules/xmlui-mirage2/src/main/webapp/themes/CGIAR/styles/_style.scss</code></li> <li>This file in particular conflicts almost 10 times: <code>dspace/modules/xmlui-mirage2/src/main/webapp/themes/CGIAR/styles/_style.scss</code></li>

View File

@ -16,8 +16,6 @@ It looks like we might be able to use OUs now, instead of DCs:
$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot; $ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot;
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-09/" /><meta property="article:published_time" content="2016-09-01T15:53:00&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-09/" /><meta property="article:published_time" content="2016-09-01T15:53:00&#43;03:00"/>
@ -35,10 +33,8 @@ It looks like we might be able to use OUs now, instead of DCs:
$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot; $ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot;
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -128,8 +124,6 @@ $ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=or
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot; <pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot;
</code></pre> </code></pre>
<p></p>
<ul> <ul>
<li>User who has been migrated to the root vs user still in the hierarchical structure:</li> <li>User who has been migrated to the root vs user still in the hierarchical structure:</li>
</ul> </ul>

View File

@ -20,8 +20,6 @@ I exported a random item&rsquo;s metadata as CSV, deleted all columns except id
0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X 0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-10/" /><meta property="article:published_time" content="2016-10-03T15:53:00&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-10/" /><meta property="article:published_time" content="2016-10-03T15:53:00&#43;03:00"/>
@ -43,10 +41,8 @@ I exported a random item&rsquo;s metadata as CSV, deleted all columns except id
0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X 0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -140,8 +136,6 @@ I exported a random item&rsquo;s metadata as CSV, deleted all columns except id
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X <pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
</code></pre> </code></pre>
<p></p>
<ul> <ul>
<li>Hmm, with the <code>dc.contributor.author</code> column removed, DSpace doesn&rsquo;t detect any changes</li> <li>Hmm, with the <code>dc.contributor.author</code> column removed, DSpace doesn&rsquo;t detect any changes</li>
<li>With a blank <code>dc.contributor.author</code> column, DSpace wants to remove all non-ORCID authors and add the new ORCID authors</li> <li>With a blank <code>dc.contributor.author</code> column, DSpace wants to remove all non-ORCID authors and add the new ORCID authors</li>

View File

@ -12,8 +12,6 @@
Add dc.type to the output options for Atmire&rsquo;s Listings and Reports module (#286) Add dc.type to the output options for Atmire&rsquo;s Listings and Reports module (#286)
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-11/" /><meta property="article:published_time" content="2016-11-01T09:21:00&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-11/" /><meta property="article:published_time" content="2016-11-01T09:21:00&#43;03:00"/>
@ -27,10 +25,8 @@ Add dc.type to the output options for Atmire&rsquo;s Listings and Reports module
Add dc.type to the output options for Atmire&rsquo;s Listings and Reports module (#286) Add dc.type to the output options for Atmire&rsquo;s Listings and Reports module (#286)
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -116,8 +112,6 @@ Add dc.type to the output options for Atmire&rsquo;s Listings and Reports module
<p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p> <p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
<p></p>
<h2 id="2016-11-02">2016-11-02</h2> <h2 id="2016-11-02">2016-11-02</h2>
<ul> <ul>

View File

@ -24,8 +24,6 @@ While looking in the logs for errors, I see tons of warnings about Atmire MQM:
I see thousands of them in the logs for the last few months, so it&rsquo;s not related to the DSpace 5.5 upgrade I see thousands of them in the logs for the last few months, so it&rsquo;s not related to the DSpace 5.5 upgrade
I&rsquo;ve raised a ticket with Atmire to ask I&rsquo;ve raised a ticket with Atmire to ask
Another worrying error from dspace.log is: Another worrying error from dspace.log is:
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-12/" /><meta property="article:published_time" content="2016-12-02T10:43:00&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-12/" /><meta property="article:published_time" content="2016-12-02T10:43:00&#43;03:00"/>
@ -51,10 +49,8 @@ While looking in the logs for errors, I see tons of warnings about Atmire MQM:
I see thousands of them in the logs for the last few months, so it&rsquo;s not related to the DSpace 5.5 upgrade I see thousands of them in the logs for the last few months, so it&rsquo;s not related to the DSpace 5.5 upgrade
I&rsquo;ve raised a ticket with Atmire to ask I&rsquo;ve raised a ticket with Atmire to ask
Another worrying error from dspace.log is: Another worrying error from dspace.log is:
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -152,8 +148,6 @@ Another worrying error from dspace.log is:
<li>Another worrying error from dspace.log is:</li> <li>Another worrying error from dspace.log is:</li>
</ul> </ul>
<p></p>
<pre><code>org.springframework.web.util.NestedServletException: Handler processing failed; nested exception is java.lang.NoSuchMethodError: com.atmire.statistics.generator.DSpaceObjectDatasetGenerator.toDatasetQuery(Lorg/dspace/core/Context;)Lcom/atmire/statistics/content/DatasetQuery; <pre><code>org.springframework.web.util.NestedServletException: Handler processing failed; nested exception is java.lang.NoSuchMethodError: com.atmire.statistics.generator.DSpaceObjectDatasetGenerator.toDatasetQuery(Lorg/dspace/core/Context;)Lcom/atmire/statistics/content/DatasetQuery;
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:972) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:972)
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)

View File

@ -12,8 +12,6 @@
I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error
I tested on DSpace Test as well and it doesn&rsquo;t work there either I tested on DSpace Test as well and it doesn&rsquo;t work there either
I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-01/" /><meta property="article:published_time" content="2017-01-02T10:43:00&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-01/" /><meta property="article:published_time" content="2017-01-02T10:43:00&#43;03:00"/>
@ -27,10 +25,8 @@ I asked on the dspace-tech mailing list because it seems to be broken, and actua
I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error
I tested on DSpace Test as well and it doesn&rsquo;t work there either I tested on DSpace Test as well and it doesn&rsquo;t work there either
I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -116,8 +112,6 @@ I asked on the dspace-tech mailing list because it seems to be broken, and actua
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li> <li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
</ul> </ul>
<p></p>
<h2 id="2017-01-04">2017-01-04</h2> <h2 id="2017-01-04">2017-01-04</h2>
<ul> <ul>

View File

@ -26,8 +26,6 @@ DELETE 1
Create issue on GitHub to track the addition of CCAFS Phase II project tags (#301) Create issue on GitHub to track the addition of CCAFS Phase II project tags (#301)
Looks like we&rsquo;ll be using cg.identifier.ccafsprojectpii as the field name Looks like we&rsquo;ll be using cg.identifier.ccafsprojectpii as the field name
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-02/" /><meta property="article:published_time" content="2017-02-07T07:04:52-08:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-02/" /><meta property="article:published_time" content="2017-02-07T07:04:52-08:00"/>
@ -55,10 +53,8 @@ DELETE 1
Create issue on GitHub to track the addition of CCAFS Phase II project tags (#301) Create issue on GitHub to track the addition of CCAFS Phase II project tags (#301)
Looks like we&rsquo;ll be using cg.identifier.ccafsprojectpii as the field name Looks like we&rsquo;ll be using cg.identifier.ccafsprojectpii as the field name
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -158,8 +154,6 @@ DELETE 1
<li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li> <li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
</ul> </ul>
<p></p>
<h2 id="2017-02-08">2017-02-08</h2> <h2 id="2017-02-08">2017-02-08</h2>
<ul> <ul>

View File

@ -28,8 +28,6 @@ Interestingly, it seems DSpace 4.x&rsquo;s thumbnails were sRGB, but forcing reg
$ identify ~/Desktop/alc_contrastes_desafios.jpg $ identify ~/Desktop/alc_contrastes_desafios.jpg
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600&#43;0&#43;0 8-bit CMYK 168KB 0.000u 0:00.000 /Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600&#43;0&#43;0 8-bit CMYK 168KB 0.000u 0:00.000
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-03/" /><meta property="article:published_time" content="2017-03-01T17:08:52&#43;02:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-03/" /><meta property="article:published_time" content="2017-03-01T17:08:52&#43;02:00"/>
@ -59,10 +57,8 @@ Interestingly, it seems DSpace 4.x&rsquo;s thumbnails were sRGB, but forcing reg
$ identify ~/Desktop/alc_contrastes_desafios.jpg $ identify ~/Desktop/alc_contrastes_desafios.jpg
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600&#43;0&#43;0 8-bit CMYK 168KB 0.000u 0:00.000 /Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600&#43;0&#43;0 8-bit CMYK 168KB 0.000u 0:00.000
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -164,8 +160,6 @@ $ identify ~/Desktop/alc_contrastes_desafios.jpg
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000 /Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
</code></pre> </code></pre>
<p></p>
<ul> <ul>
<li>This results in discolored thumbnails when compared to the original PDF, for example sRGB and CMYK:</li> <li>This results in discolored thumbnails when compared to the original PDF, for example sRGB and CMYK:</li>
</ul> </ul>

View File

@ -21,8 +21,6 @@ Testing the CMYK patch on a collection with 650 items:
$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt $ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-04/" /><meta property="article:published_time" content="2017-04-02T17:08:52&#43;02:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-04/" /><meta property="article:published_time" content="2017-04-02T17:08:52&#43;02:00"/>
@ -45,10 +43,8 @@ Testing the CMYK patch on a collection with 650 items:
$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt $ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -143,8 +139,6 @@ $ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Th
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt <pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt
</code></pre> </code></pre>
<p></p>
<h2 id="2017-04-03">2017-04-03</h2> <h2 id="2017-04-03">2017-04-03</h2>
<ul> <ul>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="May, 2017"/> <meta name="twitter:title" content="May, 2017"/>
<meta name="twitter:description" content="2017-05-01 ICARDA apparently started working on CG Core on their MEL repository They have done a few cg.* fields, but not very consistent and even copy some of CGSpace items: https://mel.cgiar.org/xmlui/handle/20.500.11766/6911?show=full https://cgspace.cgiar.org/handle/10568/73683 2017-05-02 Atmire got back about the Workflow Statistics issue, and apparently it&rsquo;s a bug in the CUA module so they will send us a pull request 2017-05-04 Sync DSpace Test with database and assetstore from CGSpace Re-deploy DSpace Test with Atmire&rsquo;s CUA patch for workflow statistics, run system updates, and restart the server Now I can see the workflow statistics and am able to select users, but everything returns 0 items Megan says there are still some mapped items are not appearing since last week, so I forced a full index-discovery -b Need to remember to check if the collection has more items (currently 39 on CGSpace, but 118 on the freshly reindexed DSPace Test) tomorrow: https://cgspace."/> <meta name="twitter:description" content="2017-05-01 ICARDA apparently started working on CG Core on their MEL repository They have done a few cg.* fields, but not very consistent and even copy some of CGSpace items: https://mel.cgiar.org/xmlui/handle/20.500.11766/6911?show=full https://cgspace.cgiar.org/handle/10568/73683 2017-05-02 Atmire got back about the Workflow Statistics issue, and apparently it&rsquo;s a bug in the CUA module so they will send us a pull request 2017-05-04 Sync DSpace Test with database and assetstore from CGSpace Re-deploy DSpace Test with Atmire&rsquo;s CUA patch for workflow statistics, run system updates, and restart the server Now I can see the workflow statistics and am able to select users, but everything returns 0 items Megan says there are still some mapped items are not appearing since last week, so I forced a full index-discovery -b Need to remember to check if the collection has more items (currently 39 on CGSpace, but 118 on the freshly reindexed DSPace Test) tomorrow: https://cgspace."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="June, 2017"/> <meta name="twitter:title" content="June, 2017"/>
<meta name="twitter:description" content="2017-06-01 After discussion with WLE and CGSpace content people, we decided to just add one metadata field for the WLE Research Themes The cg.identifier.wletheme field will be used for both Phase I and Phase II Research Themes Then we&rsquo;ll create a new sub-community for Phase II and create collections for the research themes there The current &ldquo;Research Themes&rdquo; community will be renamed to &ldquo;WLE Phase I Research Themes&rdquo; Tagged all items in the current Phase I collections with their appropriate themes Create pull request to add Phase II research themes to the submission form: #328 Add cg."/> <meta name="twitter:description" content="2017-06-01 After discussion with WLE and CGSpace content people, we decided to just add one metadata field for the WLE Research Themes The cg.identifier.wletheme field will be used for both Phase I and Phase II Research Themes Then we&rsquo;ll create a new sub-community for Phase II and create collections for the research themes there The current &ldquo;Research Themes&rdquo; community will be renamed to &ldquo;WLE Phase I Research Themes&rdquo; Tagged all items in the current Phase I collections with their appropriate themes Create pull request to add Phase II research themes to the submission form: #328 Add cg."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />

View File

@ -18,8 +18,6 @@ Run system updates and reboot DSpace Test
Merge changes for WLE Phase II theme rename (#329) Merge changes for WLE Phase II theme rename (#329)
Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace
We can use PostgreSQL&rsquo;s extended output format (-x) plus sed to format the output into quasi XML: We can use PostgreSQL&rsquo;s extended output format (-x) plus sed to format the output into quasi XML:
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-07/" /><meta property="article:published_time" content="2017-07-01T18:03:52&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-07/" /><meta property="article:published_time" content="2017-07-01T18:03:52&#43;03:00"/>
@ -39,10 +37,8 @@ Run system updates and reboot DSpace Test
Merge changes for WLE Phase II theme rename (#329) Merge changes for WLE Phase II theme rename (#329)
Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace
We can use PostgreSQL&rsquo;s extended output format (-x) plus sed to format the output into quasi XML: We can use PostgreSQL&rsquo;s extended output format (-x) plus sed to format the output into quasi XML:
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -134,8 +130,6 @@ We can use PostgreSQL&rsquo;s extended output format (-x) plus sed to format the
<li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li> <li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
</ul> </ul>
<p></p>
<pre><code>$ psql dspacenew -x -c 'select element, qualifier, scope_note from metadatafieldregistry where metadata_schema_id=5 order by element, qualifier;' | sed -r 's:^-\[ RECORD (.*) \]-+$:&lt;/dc-type&gt;\n&lt;dc-type&gt;\n&lt;schema&gt;cg&lt;/schema&gt;:;s:([^ ]*) +\| (.*): &lt;\1&gt;\2&lt;/\1&gt;:;s:^$:&lt;/dc-type&gt;:;1s:&lt;/dc-type&gt;\n::' <pre><code>$ psql dspacenew -x -c 'select element, qualifier, scope_note from metadatafieldregistry where metadata_schema_id=5 order by element, qualifier;' | sed -r 's:^-\[ RECORD (.*) \]-+$:&lt;/dc-type&gt;\n&lt;dc-type&gt;\n&lt;schema&gt;cg&lt;/schema&gt;:;s:([^ ]*) +\| (.*): &lt;\1&gt;\2&lt;/\1&gt;:;s:^$:&lt;/dc-type&gt;:;1s:&lt;/dc-type&gt;\n::'
</code></pre> </code></pre>

View File

@ -28,8 +28,6 @@ Abenet pointed out that the CGIAR Library Historical Archive collection I sent J
This was due to newline characters in the dc.description.abstract column, which caused OpenRefine to choke when exporting the CSV This was due to newline characters in the dc.description.abstract column, which caused OpenRefine to choke when exporting the CSV
I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using g/^$/d I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using g/^$/d
Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-08/" /><meta property="article:published_time" content="2017-08-01T11:51:52&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-08/" /><meta property="article:published_time" content="2017-08-01T11:51:52&#43;03:00"/>
@ -59,10 +57,8 @@ Abenet pointed out that the CGIAR Library Historical Archive collection I sent J
This was due to newline characters in the dc.description.abstract column, which caused OpenRefine to choke when exporting the CSV This was due to newline characters in the dc.description.abstract column, which caused OpenRefine to choke when exporting the CSV
I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using g/^$/d I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using g/^$/d
Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -164,8 +160,6 @@ Then I cleaned up the author authorities and HTML characters in OpenRefine and s
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li> <li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
</ul> </ul>
<p></p>
<h2 id="2017-08-02">2017-08-02</h2> <h2 id="2017-08-02">2017-08-02</h2>
<ul> <ul>

View File

@ -16,8 +16,6 @@ Linode sent an alert that CGSpace (linode18) was using 261% CPU for the past two
Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-09/" /><meta property="article:published_time" content="2017-09-07T16:54:52&#43;07:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-09/" /><meta property="article:published_time" content="2017-09-07T16:54:52&#43;07:00"/>
@ -35,10 +33,8 @@ Linode sent an alert that CGSpace (linode18) was using 261% CPU for the past two
Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -128,8 +124,6 @@ Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li> <li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li>
</ul> </ul>
<p></p>
<h2 id="2017-09-10">2017-09-10</h2> <h2 id="2017-09-10">2017-09-10</h2>
<ul> <ul>

View File

@ -18,8 +18,6 @@ http://hdl.handle.net/10568/78495||http://hdl.handle.net/10568/79336
There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine
Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-10/" /><meta property="article:published_time" content="2017-10-01T08:07:54&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-10/" /><meta property="article:published_time" content="2017-10-01T08:07:54&#43;03:00"/>
@ -39,10 +37,8 @@ http://hdl.handle.net/10568/78495||http://hdl.handle.net/10568/79336
There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine
Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -134,8 +130,6 @@ Add Katherine Lutz to the groups for content submission and edit steps of the CG
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li> <li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
</ul> </ul>
<p></p>
<h2 id="2017-10-02">2017-10-02</h2> <h2 id="2017-10-02">2017-10-02</h2>
<ul> <ul>

View File

@ -28,8 +28,6 @@ Generate list of authors on CGSpace for Peter to go through and correct:
dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = &#39;contributor&#39; and qualifier = &#39;author&#39;) AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv; dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = &#39;contributor&#39; and qualifier = &#39;author&#39;) AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
COPY 54701 COPY 54701
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-11/" /><meta property="article:published_time" content="2017-11-02T09:37:54&#43;02:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-11/" /><meta property="article:published_time" content="2017-11-02T09:37:54&#43;02:00"/>
@ -59,10 +57,8 @@ Generate list of authors on CGSpace for Peter to go through and correct:
dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = &#39;contributor&#39; and qualifier = &#39;author&#39;) AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv; dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = &#39;contributor&#39; and qualifier = &#39;author&#39;) AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
COPY 54701 COPY 54701
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -164,8 +160,6 @@ COPY 54701
COPY 54701 COPY 54701
</code></pre> </code></pre>
<p></p>
<ul> <ul>
<li>Abenet asked if it would be possible to generate a report of items in Listing and Reports that had &ldquo;International Fund for Agricultural Development&rdquo; as the <em>only</em> investor</li> <li>Abenet asked if it would be possible to generate a report of items in Listing and Reports that had &ldquo;International Fund for Agricultural Development&rdquo; as the <em>only</em> investor</li>
<li>I opened a ticket with Atmire to ask if this was possible: <a href="https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=540">https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=540</a></li> <li>I opened a ticket with Atmire to ask if this was possible: <a href="https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=540">https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=540</a></li>

View File

@ -13,8 +13,6 @@ Uptime Robot noticed that CGSpace went down
The logs say &ldquo;Timeout waiting for idle object&rdquo; The logs say &ldquo;Timeout waiting for idle object&rdquo;
PostgreSQL activity says there are 115 connections currently PostgreSQL activity says there are 115 connections currently
The list of connections to XMLUI and REST API for today: The list of connections to XMLUI and REST API for today:
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-12/" /><meta property="article:published_time" content="2017-12-01T13:53:54&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-12/" /><meta property="article:published_time" content="2017-12-01T13:53:54&#43;03:00"/>
@ -29,10 +27,8 @@ Uptime Robot noticed that CGSpace went down
The logs say &ldquo;Timeout waiting for idle object&rdquo; The logs say &ldquo;Timeout waiting for idle object&rdquo;
PostgreSQL activity says there are 115 connections currently PostgreSQL activity says there are 115 connections currently
The list of connections to XMLUI and REST API for today: The list of connections to XMLUI and REST API for today:
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -119,8 +115,6 @@ The list of connections to XMLUI and REST API for today:
<li>The list of connections to XMLUI and REST API for today:</li> <li>The list of connections to XMLUI and REST API for today:</li>
</ul> </ul>
<p></p>
<pre><code># cat /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/access.log /var/log/nginx/access.log.1 /var/log/nginx/library-access.log /var/log/nginx/library-access.log.1 | grep -E &quot;1/Dec/2017&quot; | awk '{print $1}' | sort -n | uniq -c | sort -h | tail <pre><code># cat /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/access.log /var/log/nginx/access.log.1 /var/log/nginx/library-access.log /var/log/nginx/library-access.log.1 | grep -E &quot;1/Dec/2017&quot; | awk '{print $1}' | sort -n | uniq -c | sort -h | tail
763 2.86.122.76 763 2.86.122.76
907 207.46.13.94 907 207.46.13.94

View File

@ -82,8 +82,6 @@ dspace.log.2018-01-02:34
Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-01/" /><meta property="article:published_time" content="2018-01-02T08:35:54-08:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-01/" /><meta property="article:published_time" content="2018-01-02T08:35:54-08:00"/>
@ -167,10 +165,8 @@ dspace.log.2018-01-02:34
Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -326,8 +322,6 @@ dspace.log.2018-01-02:34
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li> <li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li>
</ul> </ul>
<p></p>
<h2 id="2018-01-03">2018-01-03</h2> <h2 id="2018-01-03">2018-01-03</h2>
<ul> <ul>

View File

@ -13,8 +13,6 @@ Peter gave feedback on the dc.rights proof of concept that I had sent him last w
We don&rsquo;t need to distinguish between internal and external works, so that makes it just a simple list We don&rsquo;t need to distinguish between internal and external works, so that makes it just a simple list
Yesterday I figured out how to monitor DSpace sessions using JMX Yesterday I figured out how to monitor DSpace sessions using JMX
I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu&rsquo;s munin-plugins-java package and used the stuff I discovered about JMX in 2018-01 I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu&rsquo;s munin-plugins-java package and used the stuff I discovered about JMX in 2018-01
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-02/" /><meta property="article:published_time" content="2018-02-01T16:28:54&#43;02:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-02/" /><meta property="article:published_time" content="2018-02-01T16:28:54&#43;02:00"/>
@ -29,10 +27,8 @@ Peter gave feedback on the dc.rights proof of concept that I had sent him last w
We don&rsquo;t need to distinguish between internal and external works, so that makes it just a simple list We don&rsquo;t need to distinguish between internal and external works, so that makes it just a simple list
Yesterday I figured out how to monitor DSpace sessions using JMX Yesterday I figured out how to monitor DSpace sessions using JMX
I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu&rsquo;s munin-plugins-java package and used the stuff I discovered about JMX in 2018-01 I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu&rsquo;s munin-plugins-java package and used the stuff I discovered about JMX in 2018-01
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -119,8 +115,6 @@ I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu&rsquo;s munin-pl
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li> <li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li>
</ul> </ul>
<p></p>
<p><img src="/cgspace-notes/2018/02/jmx_dspace_sessions-day.png" alt="DSpace Sessions" /></p> <p><img src="/cgspace-notes/2018/02/jmx_dspace_sessions-day.png" alt="DSpace Sessions" /></p>
<ul> <ul>

View File

@ -10,8 +10,6 @@
Export a CSV of the IITA community metadata for Martin Mueller Export a CSV of the IITA community metadata for Martin Mueller
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-03/" /><meta property="article:published_time" content="2018-03-02T16:07:54&#43;02:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-03/" /><meta property="article:published_time" content="2018-03-02T16:07:54&#43;02:00"/>
@ -23,10 +21,8 @@ Export a CSV of the IITA community metadata for Martin Mueller
Export a CSV of the IITA community metadata for Martin Mueller Export a CSV of the IITA community metadata for Martin Mueller
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -110,8 +106,6 @@ Export a CSV of the IITA community metadata for Martin Mueller
<li>Export a CSV of the IITA community metadata for Martin Mueller</li> <li>Export a CSV of the IITA community metadata for Martin Mueller</li>
</ul> </ul>
<p></p>
<h2 id="2018-03-06">2018-03-06</h2> <h2 id="2018-03-06">2018-03-06</h2>
<ul> <ul>

View File

@ -11,8 +11,6 @@
I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when
Catalina logs at least show some memory errors yesterday: Catalina logs at least show some memory errors yesterday:
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-04/" /><meta property="article:published_time" content="2018-04-01T16:13:54&#43;02:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-04/" /><meta property="article:published_time" content="2018-04-01T16:13:54&#43;02:00"/>
@ -25,10 +23,8 @@ Catalina logs at least show some memory errors yesterday:
I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when
Catalina logs at least show some memory errors yesterday: Catalina logs at least show some memory errors yesterday:
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -113,8 +109,6 @@ Catalina logs at least show some memory errors yesterday:
<li>Catalina logs at least show some memory errors yesterday:</li> <li>Catalina logs at least show some memory errors yesterday:</li>
</ul> </ul>
<p></p>
<pre><code>Mar 31, 2018 10:26:42 PM org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor run <pre><code>Mar 31, 2018 10:26:42 PM org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor run
SEVERE: Unexpected death of background thread ContainerBackgroundProcessor[StandardEngine[Catalina]] SEVERE: Unexpected death of background thread ContainerBackgroundProcessor[StandardEngine[Catalina]]
java.lang.OutOfMemoryError: Java heap space java.lang.OutOfMemoryError: Java heap space

View File

@ -17,8 +17,6 @@ http://localhost:3000/solr/statistics/update?stream.body=%3Ccommit/%3E
Then I reduced the JVM heap size from 6144 back to 5120m Then I reduced the JVM heap size from 6144 back to 5120m
Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the Ansible infrastructure scripts to support hosts choosing which distribution they want to use Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the Ansible infrastructure scripts to support hosts choosing which distribution they want to use
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-05/" /><meta property="article:published_time" content="2018-05-01T16:43:54&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-05/" /><meta property="article:published_time" content="2018-05-01T16:43:54&#43;03:00"/>
@ -37,10 +35,8 @@ http://localhost:3000/solr/statistics/update?stream.body=%3Ccommit/%3E
Then I reduced the JVM heap size from 6144 back to 5120m Then I reduced the JVM heap size from 6144 back to 5120m
Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the Ansible infrastructure scripts to support hosts choosing which distribution they want to use Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the Ansible infrastructure scripts to support hosts choosing which distribution they want to use
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -131,8 +127,6 @@ Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li> <li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
</ul> </ul>
<p></p>
<h2 id="2018-05-02">2018-05-02</h2> <h2 id="2018-05-02">2018-05-02</h2>
<ul> <ul>

View File

@ -31,8 +31,6 @@ $ time schedtool -D -e ionice -c2 -n7 nice -n19 [dspace]/bin/dspace index-discov
real 74m42.646s real 74m42.646s
user 8m5.056s user 8m5.056s
sys 2m7.289s sys 2m7.289s
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-06/" /><meta property="article:published_time" content="2018-06-04T19:49:54-07:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-06/" /><meta property="article:published_time" content="2018-06-04T19:49:54-07:00"/>
@ -65,10 +63,8 @@ $ time schedtool -D -e ionice -c2 -n7 nice -n19 [dspace]/bin/dspace index-discov
real 74m42.646s real 74m42.646s
user 8m5.056s user 8m5.056s
sys 2m7.289s sys 2m7.289s
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -173,8 +169,6 @@ user 8m5.056s
sys 2m7.289s sys 2m7.289s
</code></pre> </code></pre>
<p></p>
<h2 id="2018-06-06">2018-06-06</h2> <h2 id="2018-06-06">2018-06-06</h2>
<ul> <ul>

View File

@ -20,8 +20,6 @@ During the mvn package stage on the 5.8 branch I kept getting issues with java r
There is insufficient memory for the Java Runtime Environment to continue. There is insufficient memory for the Java Runtime Environment to continue.
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-07/" /><meta property="article:published_time" content="2018-07-01T12:56:54&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-07/" /><meta property="article:published_time" content="2018-07-01T12:56:54&#43;03:00"/>
@ -43,10 +41,8 @@ During the mvn package stage on the 5.8 branch I kept getting issues with java r
There is insufficient memory for the Java Runtime Environment to continue. There is insufficient memory for the Java Runtime Environment to continue.
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -140,8 +136,6 @@ There is insufficient memory for the Java Runtime Environment to continue.
<pre><code>There is insufficient memory for the Java Runtime Environment to continue. <pre><code>There is insufficient memory for the Java Runtime Environment to continue.
</code></pre> </code></pre>
<p></p>
<ul> <ul>
<li>As the machine only has 8GB of RAM, I reduced the Tomcat memory heap from 5120m to 4096m so I could try to allocate more to the build process:</li> <li>As the machine only has 8GB of RAM, I reduced the Tomcat memory heap from 5120m to 4096m so I could try to allocate more to the build process:</li>
</ul> </ul>

View File

@ -24,8 +24,6 @@ I&rsquo;m not sure why Tomcat didn&rsquo;t crash with an OutOfMemoryError&hellip
Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core
The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes
I ran all system updates on DSpace Test and rebooted it I ran all system updates on DSpace Test and rebooted it
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-08/" /><meta property="article:published_time" content="2018-08-01T11:52:54&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-08/" /><meta property="article:published_time" content="2018-08-01T11:52:54&#43;03:00"/>
@ -51,10 +49,8 @@ I&rsquo;m not sure why Tomcat didn&rsquo;t crash with an OutOfMemoryError&hellip
Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core
The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes
I ran all system updates on DSpace Test and rebooted it I ran all system updates on DSpace Test and rebooted it
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -152,8 +148,6 @@ I ran all system updates on DSpace Test and rebooted it
<li>I ran all system updates on DSpace Test and rebooted it</li> <li>I ran all system updates on DSpace Test and rebooted it</li>
</ul> </ul>
<p></p>
<ul> <ul>
<li>I started looking over the latest round of IITA batch records from Sisay on DSpace Test: <a href="https://dspacetest.cgiar.org/handle/10568/103250">IITA July_30</a> <li>I started looking over the latest round of IITA batch records from Sisay on DSpace Test: <a href="https://dspacetest.cgiar.org/handle/10568/103250">IITA July_30</a>

View File

@ -13,8 +13,6 @@ New PostgreSQL JDBC driver version 42.2.5
I&rsquo;ll update the DSpace role in our Ansible infrastructure playbooks and run the updated playbooks on CGSpace and DSpace Test I&rsquo;ll update the DSpace role in our Ansible infrastructure playbooks and run the updated playbooks on CGSpace and DSpace Test
Also, I&rsquo;ll re-run the postgresql tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month Also, I&rsquo;ll re-run the postgresql tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month
I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again: I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-09/" /><meta property="article:published_time" content="2018-09-02T09:55:54&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-09/" /><meta property="article:published_time" content="2018-09-02T09:55:54&#43;03:00"/>
@ -29,10 +27,8 @@ New PostgreSQL JDBC driver version 42.2.5
I&rsquo;ll update the DSpace role in our Ansible infrastructure playbooks and run the updated playbooks on CGSpace and DSpace Test I&rsquo;ll update the DSpace role in our Ansible infrastructure playbooks and run the updated playbooks on CGSpace and DSpace Test
Also, I&rsquo;ll re-run the postgresql tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month Also, I&rsquo;ll re-run the postgresql tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month
I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again: I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -119,8 +115,6 @@ I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I
<li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li> <li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li>
</ul> </ul>
<p></p>
<pre><code>02-Sep-2018 11:18:52.678 SEVERE [localhost-startStop-1] org.apache.catalina.core.StandardContext.listenerStart Exception sending context initialized event to listener instance of class [org.dspace.servicemanager.servlet.DSpaceKernelServletContextListener] <pre><code>02-Sep-2018 11:18:52.678 SEVERE [localhost-startStop-1] org.apache.catalina.core.StandardContext.listenerStart Exception sending context initialized event to listener instance of class [org.dspace.servicemanager.servlet.DSpaceKernelServletContextListener]
java.lang.RuntimeException: Failure during filter init: Failed to startup the DSpace Service Manager: failure starting up spring service manager: Error creating bean with name 'conversionService' defined in file [/home/dspacetest.cgiar.org/config/spring/xmlui/spring-dspace-addon-cua-services.xml]: Cannot create inner bean 'com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$ColumnsConverter#4c5d5a2' of type [com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$ColumnsConverter] while setting bean property 'converters' with key [1]; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$ColumnsConverter#4c5d5a2': Injection of autowired dependencies failed; nested exception is org.springframework.beans.factory.BeanCreationException: Could not autowire field: private com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$FilterConverter com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$ColumnsConverter.filterConverter; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No matching bean of type [com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$FilterConverter] found for dependency: expected at least 1 bean which qualifies as autowire candidate for this dependency. Dependency annotations: {@org.springframework.beans.factory.annotation.Autowired(required=true)} java.lang.RuntimeException: Failure during filter init: Failed to startup the DSpace Service Manager: failure starting up spring service manager: Error creating bean with name 'conversionService' defined in file [/home/dspacetest.cgiar.org/config/spring/xmlui/spring-dspace-addon-cua-services.xml]: Cannot create inner bean 'com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$ColumnsConverter#4c5d5a2' of type [com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$ColumnsConverter] while setting bean property 'converters' with key [1]; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$ColumnsConverter#4c5d5a2': Injection of autowired dependencies failed; nested exception is org.springframework.beans.factory.BeanCreationException: Could not autowire field: private com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$FilterConverter com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$ColumnsConverter.filterConverter; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No matching bean of type [com.atmire.app.xmlui.aspect.statistics.mostpopular.MostPopularConfig$FilterConverter] found for dependency: expected at least 1 bean which qualifies as autowire candidate for this dependency. Dependency annotations: {@org.springframework.beans.factory.annotation.Autowired(required=true)}
at org.dspace.servicemanager.servlet.DSpaceKernelServletContextListener.contextInitialized(DSpaceKernelServletContextListener.java:92) at org.dspace.servicemanager.servlet.DSpaceKernelServletContextListener.contextInitialized(DSpaceKernelServletContextListener.java:92)

View File

@ -11,8 +11,6 @@
Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items
I created a GitHub issue to track this #389, because I&rsquo;m super busy in Nairobi right now I created a GitHub issue to track this #389, because I&rsquo;m super busy in Nairobi right now
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-10/" /><meta property="article:published_time" content="2018-10-01T22:31:54&#43;03:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-10/" /><meta property="article:published_time" content="2018-10-01T22:31:54&#43;03:00"/>
@ -25,10 +23,8 @@ I created a GitHub issue to track this #389, because I&rsquo;m super busy in Nai
Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items
I created a GitHub issue to track this #389, because I&rsquo;m super busy in Nairobi right now I created a GitHub issue to track this #389, because I&rsquo;m super busy in Nairobi right now
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -113,8 +109,6 @@ I created a GitHub issue to track this #389, because I&rsquo;m super busy in Nai
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li> <li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li>
</ul> </ul>
<p></p>
<h2 id="2018-10-03">2018-10-03</h2> <h2 id="2018-10-03">2018-10-03</h2>
<ul> <ul>

View File

@ -18,12 +18,10 @@ Send a note about my dspace-statistics-api to the dspace-tech mailing list
Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage
Today these are the top 10 IPs: Today these are the top 10 IPs:
" /> " />
<meta property="og:type" content="article" /> <meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-11/" /><meta property="article:published_time" content="2018-11-01T16:41:30&#43;02:00"/> <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2018-11/" /><meta property="article:published_time" content="2018-11-01T16:41:30&#43;02:00"/>
<meta property="article:modified_time" content="2018-11-06T18:03:44&#43;02:00"/> <meta property="article:modified_time" content="2018-11-07T19:20:25&#43;02:00"/>
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="November, 2018"/> <meta name="twitter:title" content="November, 2018"/>
@ -39,10 +37,8 @@ Send a note about my dspace-statistics-api to the dspace-tech mailing list
Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage
Today these are the top 10 IPs: Today these are the top 10 IPs:
"/> "/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -52,9 +48,9 @@ Today these are the top 10 IPs:
"@type": "BlogPosting", "@type": "BlogPosting",
"headline": "November, 2018", "headline": "November, 2018",
"url": "https://alanorth.github.io/cgspace-notes/2018-11/", "url": "https://alanorth.github.io/cgspace-notes/2018-11/",
"wordCount": "1244", "wordCount": "1310",
"datePublished": "2018-11-01T16:41:30&#43;02:00", "datePublished": "2018-11-01T16:41:30&#43;02:00",
"dateModified": "2018-11-06T18:03:44&#43;02:00", "dateModified": "2018-11-07T19:20:25&#43;02:00",
"author": { "author": {
"@type": "Person", "@type": "Person",
"name": "Alan Orth" "name": "Alan Orth"
@ -134,8 +130,6 @@ Today these are the top 10 IPs:
<li>Today these are the top 10 IPs:</li> <li>Today these are the top 10 IPs:</li>
</ul> </ul>
<p></p>
<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;03/Nov/2018&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 <pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;03/Nov/2018&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
1300 66.249.64.63 1300 66.249.64.63
1384 35.237.175.180 1384 35.237.175.180
@ -420,6 +414,14 @@ Today these are the top 10 IPs:
<li>Tag version 0.7.0 of the dspace-statistics-api</li> <li>Tag version 0.7.0 of the dspace-statistics-api</li>
</ul> </ul>
<h2 id="2018-11-08">2018-11-08</h2>
<ul>
<li>I deployed verison 0.7.0 of the dspace-statistics-api on DSpace Test (linode19) so I can test it for a few days (and check the Munin stats to see the change in database connections) before deploying on CGSpace</li>
<li>I also enabled systemd&rsquo;s persistent journal by setting <a href="https://www.freedesktop.org/software/systemd/man/journald.conf.html"><code>Storage=persistent</code> in <em>journald.conf</em></a></li>
<li>Apparently <a href="https://www.freedesktop.org/software/systemd/man/journald.conf.html">Ubuntu 16.04 defaulted to using rsyslog for boot records until early 2018</a>, so I removed <code>rsyslog</code> too</li>
</ul>
<!-- vim: set sw=2 ts=2: --> <!-- vim: set sw=2 ts=2: -->

View File

@ -13,7 +13,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="404 Page not found"/> <meta name="twitter:title" content="404 Page not found"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />

View File

@ -13,7 +13,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Categories"/> <meta name="twitter:title" content="Categories"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -109,8 +109,6 @@
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li> <li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
<li>Today these are the top 10 IPs:</li> <li>Today these are the top 10 IPs:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
</article> </article>
@ -134,8 +132,6 @@
<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li> <li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li> <li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a>
</article> </article>
@ -161,8 +157,6 @@
<li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li> <li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
<li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li> <li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
</article> </article>
@ -199,8 +193,6 @@
<li>The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes</li> <li>The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes</li>
<li>I ran all system updates on DSpace Test and rebooted it</li> <li>I ran all system updates on DSpace Test and rebooted it</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a>
</article> </article>
@ -233,8 +225,6 @@
<pre><code>There is insufficient memory for the Java Runtime Environment to continue. <pre><code>There is insufficient memory for the Java Runtime Environment to continue.
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a>
</article> </article>
@ -278,8 +268,6 @@ real 74m42.646s
user 8m5.056s user 8m5.056s
sys 2m7.289s sys 2m7.289s
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a>
</article> </article>
@ -309,8 +297,6 @@ sys 2m7.289s
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li> <li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li> <li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
</article> </article>
@ -334,8 +320,6 @@ sys 2m7.289s
<li>I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when</li> <li>I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when</li>
<li>Catalina logs at least show some memory errors yesterday:</li> <li>Catalina logs at least show some memory errors yesterday:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a>
</article> </article>
@ -358,8 +342,6 @@ sys 2m7.289s
<ul> <ul>
<li>Export a CSV of the IITA community metadata for Martin Mueller</li> <li>Export a CSV of the IITA community metadata for Martin Mueller</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
</article> </article>
@ -385,8 +367,6 @@ sys 2m7.289s
<li>Yesterday I figured out how to monitor DSpace sessions using JMX</li> <li>Yesterday I figured out how to monitor DSpace sessions using JMX</li>
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li> <li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Notes"/> <meta name="twitter:title" content="Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -84,8 +84,6 @@
</p> </p>
</header> </header>
<p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p> <p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a>
</article> </article>

View File

@ -17,9 +17,7 @@
<pubDate>Mon, 18 Sep 2017 16:38:35 +0300</pubDate> <pubDate>Mon, 18 Sep 2017 16:38:35 +0300</pubDate>
<guid>https://alanorth.github.io/cgspace-notes/cgiar-library-migration/</guid> <guid>https://alanorth.github.io/cgspace-notes/cgiar-library-migration/</guid>
<description>&lt;p&gt;Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called &lt;em&gt;CGIAR System Organization&lt;/em&gt;.&lt;/p&gt; <description>&lt;p&gt;Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called &lt;em&gt;CGIAR System Organization&lt;/em&gt;.&lt;/p&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
</channel> </channel>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Categories"/> <meta name="twitter:title" content="Categories"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -175,8 +175,6 @@ dspace.log.2018-01-02:34
<ul> <ul>
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li> <li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
</article> </article>
@ -202,8 +200,6 @@ dspace.log.2018-01-02:34
<li>PostgreSQL activity says there are 115 connections currently</li> <li>PostgreSQL activity says there are 115 connections currently</li>
<li>The list of connections to XMLUI and REST API for today:</li> <li>The list of connections to XMLUI and REST API for today:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a>
</article> </article>
@ -244,8 +240,6 @@ dspace.log.2018-01-02:34
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv; <pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
COPY 54701 COPY 54701
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
</article> </article>
@ -276,8 +270,6 @@ COPY 54701
<li>There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li> <li>There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li>
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li> <li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a>
</article> </article>
@ -296,8 +288,6 @@ COPY 54701
</p> </p>
</header> </header>
<p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p> <p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a>
</article> </article>
@ -326,8 +316,6 @@ COPY 54701
<ul> <ul>
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li> <li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a>
</article> </article>
@ -368,8 +356,6 @@ COPY 54701
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li> <li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li> <li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a>
</article> </article>
@ -400,8 +386,6 @@ COPY 54701
<li>Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace</li> <li>Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace</li>
<li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li> <li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Categories"/> <meta name="twitter:title" content="Categories"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -114,8 +114,6 @@
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt <pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
</article> </article>
@ -156,8 +154,6 @@
<pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg <pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000 /Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a>
</article> </article>
@ -196,8 +192,6 @@ DELETE 1
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li> <li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
<li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li> <li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a>
</article> </article>
@ -222,8 +216,6 @@ DELETE 1
<li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li> <li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li>
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li> <li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
</article> </article>
@ -260,8 +252,6 @@ DELETE 1
<li>I&rsquo;ve raised a ticket with Atmire to ask</li> <li>I&rsquo;ve raised a ticket with Atmire to ask</li>
<li>Another worrying error from dspace.log is:</li> <li>Another worrying error from dspace.log is:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a>
</article> </article>
@ -286,8 +276,6 @@ DELETE 1
</ul> </ul>
<p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p> <p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a>
</article> </article>
@ -320,8 +308,6 @@ DELETE 1
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X <pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a>
</article> </article>
@ -350,8 +336,6 @@ DELETE 1
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot; <pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot;
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a>
</article> </article>
@ -384,8 +368,6 @@ DELETE 1
$ git reset --hard ilri/5_x-prod $ git reset --hard ilri/5_x-prod
$ git rebase -i dspace-5.5 $ git rebase -i dspace-5.5
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a>
</article> </article>
@ -421,8 +403,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
<ul> <ul>
<li>In this case the select query was showing 95 results before the update</li> <li>In this case the select query was showing 95 results before the update</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Categories"/> <meta name="twitter:title" content="Categories"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -108,8 +108,6 @@
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li> <li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li> <li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
</article> </article>
@ -138,8 +136,6 @@
<pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l <pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
3168 3168
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a>
</article> </article>
@ -166,8 +162,6 @@
<li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li> <li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li>
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li> <li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a>
</article> </article>
@ -192,8 +186,6 @@
<li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module</li> <li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module</li>
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li> <li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a>
</article> </article>
@ -225,8 +217,6 @@
<li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li> <li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li>
<li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li> <li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a>
</article> </article>
@ -251,8 +241,6 @@
<li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li> <li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li>
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li> <li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a>
</article> </article>
@ -282,8 +270,6 @@
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo -rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz -rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a>
</article> </article>
@ -312,8 +298,6 @@
<pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace <pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
78 78
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="CGIAR Library Migration"/> <meta name="twitter:title" content="CGIAR Library Migration"/>
<meta name="twitter:description" content="Notes on the migration of the CGIAR Library to CGSpace"/> <meta name="twitter:description" content="Notes on the migration of the CGIAR Library to CGSpace"/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -95,8 +95,6 @@
</header> </header>
<p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p> <p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
<p></p>
<h2 id="pre-migration-technical-todos">Pre-migration Technical TODOs</h2> <h2 id="pre-migration-technical-todos">Pre-migration Technical TODOs</h2>
<p>Things that need to happen before the migration:</p> <p>Things that need to happen before the migration:</p>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="CGSpace Notes"/> <meta name="twitter:title" content="CGSpace Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -111,8 +111,6 @@
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li> <li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
<li>Today these are the top 10 IPs:</li> <li>Today these are the top 10 IPs:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
</article> </article>
@ -136,8 +134,6 @@
<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li> <li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li> <li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a>
</article> </article>
@ -163,8 +159,6 @@
<li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li> <li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
<li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li> <li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
</article> </article>
@ -201,8 +195,6 @@
<li>The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes</li> <li>The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes</li>
<li>I ran all system updates on DSpace Test and rebooted it</li> <li>I ran all system updates on DSpace Test and rebooted it</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a>
</article> </article>
@ -235,8 +227,6 @@
<pre><code>There is insufficient memory for the Java Runtime Environment to continue. <pre><code>There is insufficient memory for the Java Runtime Environment to continue.
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a>
</article> </article>
@ -280,8 +270,6 @@ real 74m42.646s
user 8m5.056s user 8m5.056s
sys 2m7.289s sys 2m7.289s
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a>
</article> </article>
@ -311,8 +299,6 @@ sys 2m7.289s
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li> <li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li> <li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
</article> </article>
@ -336,8 +322,6 @@ sys 2m7.289s
<li>I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when</li> <li>I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when</li>
<li>Catalina logs at least show some memory errors yesterday:</li> <li>Catalina logs at least show some memory errors yesterday:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a>
</article> </article>
@ -360,8 +344,6 @@ sys 2m7.289s
<ul> <ul>
<li>Export a CSV of the IITA community metadata for Martin Mueller</li> <li>Export a CSV of the IITA community metadata for Martin Mueller</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
</article> </article>
@ -387,8 +369,6 @@ sys 2m7.289s
<li>Yesterday I figured out how to monitor DSpace sessions using JMX</li> <li>Yesterday I figured out how to monitor DSpace sessions using JMX</li>
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li> <li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a>
</article> </article>

View File

@ -29,9 +29,7 @@
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage&lt;/li&gt; &lt;li&gt;Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage&lt;/li&gt;
&lt;li&gt;Today these are the top 10 IPs:&lt;/li&gt; &lt;li&gt;Today these are the top 10 IPs:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -45,9 +43,7 @@
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items&lt;/li&gt; &lt;li&gt;Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items&lt;/li&gt;
&lt;li&gt;I created a GitHub issue to track this &lt;a href=&#34;https://github.com/ilri/DSpace/issues/389&#34;&gt;#389&lt;/a&gt;, because I&amp;rsquo;m super busy in Nairobi right now&lt;/li&gt; &lt;li&gt;I created a GitHub issue to track this &lt;a href=&#34;https://github.com/ilri/DSpace/issues/389&#34;&gt;#389&lt;/a&gt;, because I&amp;rsquo;m super busy in Nairobi right now&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -63,9 +59,7 @@
&lt;li&gt;I&amp;rsquo;ll update the DSpace role in our &lt;a href=&#34;https://github.com/ilri/rmg-ansible-public&#34;&gt;Ansible infrastructure playbooks&lt;/a&gt; and run the updated playbooks on CGSpace and DSpace Test&lt;/li&gt; &lt;li&gt;I&amp;rsquo;ll update the DSpace role in our &lt;a href=&#34;https://github.com/ilri/rmg-ansible-public&#34;&gt;Ansible infrastructure playbooks&lt;/a&gt; and run the updated playbooks on CGSpace and DSpace Test&lt;/li&gt;
&lt;li&gt;Also, I&amp;rsquo;ll re-run the &lt;code&gt;postgresql&lt;/code&gt; tasks because the custom PostgreSQL variables are dynamic according to the system&amp;rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month&lt;/li&gt; &lt;li&gt;Also, I&amp;rsquo;ll re-run the &lt;code&gt;postgresql&lt;/code&gt; tasks because the custom PostgreSQL variables are dynamic according to the system&amp;rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month&lt;/li&gt;
&lt;li&gt;I&amp;rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&amp;rsquo;m getting those autowire errors in Tomcat 8.5.30 again:&lt;/li&gt; &lt;li&gt;I&amp;rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&amp;rsquo;m getting those autowire errors in Tomcat 8.5.30 again:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -92,9 +86,7 @@
&lt;li&gt;Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core&lt;/li&gt; &lt;li&gt;Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core&lt;/li&gt;
&lt;li&gt;The server only has 8GB of RAM so we&amp;rsquo;ll eventually need to upgrade to a larger one because we&amp;rsquo;ll start starving the OS, PostgreSQL, and command line batch processes&lt;/li&gt; &lt;li&gt;The server only has 8GB of RAM so we&amp;rsquo;ll eventually need to upgrade to a larger one because we&amp;rsquo;ll start starving the OS, PostgreSQL, and command line batch processes&lt;/li&gt;
&lt;li&gt;I ran all system updates on DSpace Test and rebooted it&lt;/li&gt; &lt;li&gt;I ran all system updates on DSpace Test and rebooted it&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -117,9 +109,7 @@
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;There is insufficient memory for the Java Runtime Environment to continue. &lt;pre&gt;&lt;code&gt;There is insufficient memory for the Java Runtime Environment to continue.
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -153,9 +143,7 @@
real 74m42.646s real 74m42.646s
user 8m5.056s user 8m5.056s
sys 2m7.289s sys 2m7.289s
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -175,9 +163,7 @@ sys 2m7.289s
&lt;/ul&gt;&lt;/li&gt; &lt;/ul&gt;&lt;/li&gt;
&lt;li&gt;Then I reduced the JVM heap size from 6144 back to 5120m&lt;/li&gt; &lt;li&gt;Then I reduced the JVM heap size from 6144 back to 5120m&lt;/li&gt;
&lt;li&gt;Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the &lt;a href=&#34;https://github.com/ilri/rmg-ansible-public&#34;&gt;Ansible infrastructure scripts&lt;/a&gt; to support hosts choosing which distribution they want to use&lt;/li&gt; &lt;li&gt;Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the &lt;a href=&#34;https://github.com/ilri/rmg-ansible-public&#34;&gt;Ansible infrastructure scripts&lt;/a&gt; to support hosts choosing which distribution they want to use&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -191,9 +177,7 @@ sys 2m7.289s
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;I tried to test something on DSpace Test but noticed that it&amp;rsquo;s down since god knows when&lt;/li&gt; &lt;li&gt;I tried to test something on DSpace Test but noticed that it&amp;rsquo;s down since god knows when&lt;/li&gt;
&lt;li&gt;Catalina logs at least show some memory errors yesterday:&lt;/li&gt; &lt;li&gt;Catalina logs at least show some memory errors yesterday:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -206,9 +190,7 @@ sys 2m7.289s
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Export a CSV of the IITA community metadata for Martin Mueller&lt;/li&gt; &lt;li&gt;Export a CSV of the IITA community metadata for Martin Mueller&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -224,9 +206,7 @@ sys 2m7.289s
&lt;li&gt;We don&amp;rsquo;t need to distinguish between internal and external works, so that makes it just a simple list&lt;/li&gt; &lt;li&gt;We don&amp;rsquo;t need to distinguish between internal and external works, so that makes it just a simple list&lt;/li&gt;
&lt;li&gt;Yesterday I figured out how to monitor DSpace sessions using JMX&lt;/li&gt; &lt;li&gt;Yesterday I figured out how to monitor DSpace sessions using JMX&lt;/li&gt;
&lt;li&gt;I copied the logic in the &lt;code&gt;jmx_tomcat_dbpools&lt;/code&gt; provided by Ubuntu&amp;rsquo;s &lt;code&gt;munin-plugins-java&lt;/code&gt; package and used the stuff I discovered about JMX &lt;a href=&#34;https://alanorth.github.io/cgspace-notes/cgspace-notes/2018-01/&#34;&gt;in 2018-01&lt;/a&gt;&lt;/li&gt; &lt;li&gt;I copied the logic in the &lt;code&gt;jmx_tomcat_dbpools&lt;/code&gt; provided by Ubuntu&amp;rsquo;s &lt;code&gt;munin-plugins-java&lt;/code&gt; package and used the stuff I discovered about JMX &lt;a href=&#34;https://alanorth.github.io/cgspace-notes/cgspace-notes/2018-01/&#34;&gt;in 2018-01&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -311,9 +291,7 @@ dspace.log.2018-01-02:34
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&amp;rsquo;s Encrypt if it&amp;rsquo;s just a handful of domains&lt;/li&gt; &lt;li&gt;Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&amp;rsquo;s Encrypt if it&amp;rsquo;s just a handful of domains&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -329,9 +307,7 @@ dspace.log.2018-01-02:34
&lt;li&gt;The logs say &amp;ldquo;Timeout waiting for idle object&amp;rdquo;&lt;/li&gt; &lt;li&gt;The logs say &amp;ldquo;Timeout waiting for idle object&amp;rdquo;&lt;/li&gt;
&lt;li&gt;PostgreSQL activity says there are 115 connections currently&lt;/li&gt; &lt;li&gt;PostgreSQL activity says there are 115 connections currently&lt;/li&gt;
&lt;li&gt;The list of connections to XMLUI and REST API for today:&lt;/li&gt; &lt;li&gt;The list of connections to XMLUI and REST API for today:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -362,9 +338,7 @@ dspace.log.2018-01-02:34
&lt;pre&gt;&lt;code&gt;dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = &#39;contributor&#39; and qualifier = &#39;author&#39;) AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv; &lt;pre&gt;&lt;code&gt;dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = &#39;contributor&#39; and qualifier = &#39;author&#39;) AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
COPY 54701 COPY 54701
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -385,9 +359,7 @@ COPY 54701
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;There appears to be a pattern but I&amp;rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine&lt;/li&gt; &lt;li&gt;There appears to be a pattern but I&amp;rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine&lt;/li&gt;
&lt;li&gt;Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections&lt;/li&gt; &lt;li&gt;Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -396,9 +368,7 @@ COPY 54701
<pubDate>Mon, 18 Sep 2017 16:38:35 +0300</pubDate> <pubDate>Mon, 18 Sep 2017 16:38:35 +0300</pubDate>
<guid>https://alanorth.github.io/cgspace-notes/cgiar-library-migration/</guid> <guid>https://alanorth.github.io/cgspace-notes/cgiar-library-migration/</guid>
<description>&lt;p&gt;Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called &lt;em&gt;CGIAR System Organization&lt;/em&gt;.&lt;/p&gt; <description>&lt;p&gt;Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called &lt;em&gt;CGIAR System Organization&lt;/em&gt;.&lt;/p&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -417,9 +387,7 @@ COPY 54701
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Ask Sisay to clean up the WLE approvers a bit, as Marianne&amp;rsquo;s user account is both in the approvers step as well as the group&lt;/li&gt; &lt;li&gt;Ask Sisay to clean up the WLE approvers a bit, as Marianne&amp;rsquo;s user account is both in the approvers step as well as the group&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -450,9 +418,7 @@ COPY 54701
&lt;li&gt;This was due to newline characters in the &lt;code&gt;dc.description.abstract&lt;/code&gt; column, which caused OpenRefine to choke when exporting the CSV&lt;/li&gt; &lt;li&gt;This was due to newline characters in the &lt;code&gt;dc.description.abstract&lt;/code&gt; column, which caused OpenRefine to choke when exporting the CSV&lt;/li&gt;
&lt;li&gt;I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using &lt;code&gt;g/^$/d&lt;/code&gt;&lt;/li&gt; &lt;li&gt;I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using &lt;code&gt;g/^$/d&lt;/code&gt;&lt;/li&gt;
&lt;li&gt;Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet&lt;/li&gt; &lt;li&gt;Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -473,9 +439,7 @@ COPY 54701
&lt;li&gt;Merge changes for WLE Phase II theme rename (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/329&#34;&gt;#329&lt;/a&gt;)&lt;/li&gt; &lt;li&gt;Merge changes for WLE Phase II theme rename (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/329&#34;&gt;#329&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Looking at extracting the metadata registries from ICARDA&amp;rsquo;s MEL DSpace database so we can compare fields with CGSpace&lt;/li&gt; &lt;li&gt;Looking at extracting the metadata registries from ICARDA&amp;rsquo;s MEL DSpace database so we can compare fields with CGSpace&lt;/li&gt;
&lt;li&gt;We can use PostgreSQL&amp;rsquo;s extended output format (&lt;code&gt;-x&lt;/code&gt;) plus &lt;code&gt;sed&lt;/code&gt; to format the output into quasi XML:&lt;/li&gt; &lt;li&gt;We can use PostgreSQL&amp;rsquo;s extended output format (&lt;code&gt;-x&lt;/code&gt;) plus &lt;code&gt;sed&lt;/code&gt; to format the output into quasi XML:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -517,9 +481,7 @@ COPY 54701
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &amp;quot;ImageMagick PDF Thumbnail&amp;quot; -v &amp;gt;&amp;amp; /tmp/filter-media-cmyk.txt &lt;pre&gt;&lt;code&gt;$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &amp;quot;ImageMagick PDF Thumbnail&amp;quot; -v &amp;gt;&amp;amp; /tmp/filter-media-cmyk.txt
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -550,9 +512,7 @@ COPY 54701
&lt;pre&gt;&lt;code&gt;$ identify ~/Desktop/alc_contrastes_desafios.jpg &lt;pre&gt;&lt;code&gt;$ identify ~/Desktop/alc_contrastes_desafios.jpg
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000 /Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -581,9 +541,7 @@ DELETE 1
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Create issue on GitHub to track the addition of CCAFS Phase II project tags (&lt;a href=&#34;https://github.com/ilri/DSpace/issues/301&#34;&gt;#301&lt;/a&gt;)&lt;/li&gt; &lt;li&gt;Create issue on GitHub to track the addition of CCAFS Phase II project tags (&lt;a href=&#34;https://github.com/ilri/DSpace/issues/301&#34;&gt;#301&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Looks like we&amp;rsquo;ll be using &lt;code&gt;cg.identifier.ccafsprojectpii&lt;/code&gt; as the field name&lt;/li&gt; &lt;li&gt;Looks like we&amp;rsquo;ll be using &lt;code&gt;cg.identifier.ccafsprojectpii&lt;/code&gt; as the field name&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -598,9 +556,7 @@ DELETE 1
&lt;li&gt;I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error&lt;/li&gt; &lt;li&gt;I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error&lt;/li&gt;
&lt;li&gt;I tested on DSpace Test as well and it doesn&amp;rsquo;t work there either&lt;/li&gt; &lt;li&gt;I tested on DSpace Test as well and it doesn&amp;rsquo;t work there either&lt;/li&gt;
&lt;li&gt;I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&amp;rsquo;m not sure if we&amp;rsquo;ve ever had the sharding task run successfully over all these years&lt;/li&gt; &lt;li&gt;I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&amp;rsquo;m not sure if we&amp;rsquo;ve ever had the sharding task run successfully over all these years&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -627,9 +583,7 @@ DELETE 1
&lt;li&gt;I see thousands of them in the logs for the last few months, so it&amp;rsquo;s not related to the DSpace 5.5 upgrade&lt;/li&gt; &lt;li&gt;I see thousands of them in the logs for the last few months, so it&amp;rsquo;s not related to the DSpace 5.5 upgrade&lt;/li&gt;
&lt;li&gt;I&amp;rsquo;ve raised a ticket with Atmire to ask&lt;/li&gt; &lt;li&gt;I&amp;rsquo;ve raised a ticket with Atmire to ask&lt;/li&gt;
&lt;li&gt;Another worrying error from dspace.log is:&lt;/li&gt; &lt;li&gt;Another worrying error from dspace.log is:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -644,9 +598,7 @@ DELETE 1
&lt;li&gt;Add &lt;code&gt;dc.type&lt;/code&gt; to the output options for Atmire&amp;rsquo;s Listings and Reports module (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/286&#34;&gt;#286&lt;/a&gt;)&lt;/li&gt; &lt;li&gt;Add &lt;code&gt;dc.type&lt;/code&gt; to the output options for Atmire&amp;rsquo;s Listings and Reports module (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/286&#34;&gt;#286&lt;/a&gt;)&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;
&lt;p&gt;&lt;img src=&#34;https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png&#34; alt=&#34;Listings and Reports with output type&#34; /&gt;&lt;/p&gt; &lt;p&gt;&lt;img src=&#34;https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png&#34; alt=&#34;Listings and Reports with output type&#34; /&gt;&lt;/p&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -669,9 +621,7 @@ DELETE 1
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X &lt;pre&gt;&lt;code&gt;0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -690,9 +640,7 @@ DELETE 1
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &amp;quot;dc=cgiarad,dc=org&amp;quot; -D &amp;quot;admigration1@cgiarad.org&amp;quot; -W &amp;quot;(sAMAccountName=admigration1)&amp;quot; &lt;pre&gt;&lt;code&gt;$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &amp;quot;dc=cgiarad,dc=org&amp;quot; -D &amp;quot;admigration1@cgiarad.org&amp;quot; -W &amp;quot;(sAMAccountName=admigration1)&amp;quot;
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -715,9 +663,7 @@ DELETE 1
&lt;pre&gt;&lt;code&gt;$ git checkout -b 55new 5_x-prod &lt;pre&gt;&lt;code&gt;$ git checkout -b 55new 5_x-prod
$ git reset --hard ilri/5_x-prod $ git reset --hard ilri/5_x-prod
$ git rebase -i dspace-5.5 $ git rebase -i dspace-5.5
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -743,9 +689,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;In this case the select query was showing 95 results before the update&lt;/li&gt; &lt;li&gt;In this case the select query was showing 95 results before the update&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -763,9 +707,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;li&gt;This is their publications set: &lt;a href=&#34;http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;amp;from=2016-01-01&amp;amp;set=p15738coll2&amp;amp;metadataPrefix=oai_dc&#34;&gt;http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;amp;from=2016-01-01&amp;amp;set=p15738coll2&amp;amp;metadataPrefix=oai_dc&lt;/a&gt;&lt;/li&gt; &lt;li&gt;This is their publications set: &lt;a href=&#34;http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;amp;from=2016-01-01&amp;amp;set=p15738coll2&amp;amp;metadataPrefix=oai_dc&#34;&gt;http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;amp;from=2016-01-01&amp;amp;set=p15738coll2&amp;amp;metadataPrefix=oai_dc&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;You can see the others by using the OAI &lt;code&gt;ListSets&lt;/code&gt; verb: &lt;a href=&#34;http://ebrary.ifpri.org/oai/oai.php?verb=ListSets&#34;&gt;http://ebrary.ifpri.org/oai/oai.php?verb=ListSets&lt;/a&gt;&lt;/li&gt; &lt;li&gt;You can see the others by using the OAI &lt;code&gt;ListSets&lt;/code&gt; verb: &lt;a href=&#34;http://ebrary.ifpri.org/oai/oai.php?verb=ListSets&#34;&gt;http://ebrary.ifpri.org/oai/oai.php?verb=ListSets&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in &lt;code&gt;dc.identifier.fund&lt;/code&gt; to &lt;code&gt;cg.identifier.cpwfproject&lt;/code&gt; and then the rest to &lt;code&gt;dc.description.sponsorship&lt;/code&gt;&lt;/li&gt; &lt;li&gt;Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in &lt;code&gt;dc.identifier.fund&lt;/code&gt; to &lt;code&gt;cg.identifier.cpwfproject&lt;/code&gt; and then the rest to &lt;code&gt;dc.description.sponsorship&lt;/code&gt;&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -784,9 +726,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;pre&gt;&lt;code&gt;# awk &#39;{print $1}&#39; /var/log/nginx/rest.log | uniq | wc -l &lt;pre&gt;&lt;code&gt;# awk &#39;{print $1}&#39; /var/log/nginx/rest.log | uniq | wc -l
3168 3168
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -803,9 +743,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;li&gt;After running DSpace for over five years I&amp;rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year!&lt;/li&gt; &lt;li&gt;After running DSpace for over five years I&amp;rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year!&lt;/li&gt;
&lt;li&gt;This will save us a few gigs of backup space we&amp;rsquo;re paying for on S3&lt;/li&gt; &lt;li&gt;This will save us a few gigs of backup space we&amp;rsquo;re paying for on S3&lt;/li&gt;
&lt;li&gt;Also, I noticed the &lt;code&gt;checker&lt;/code&gt; log has some errors we should pay attention to:&lt;/li&gt; &lt;li&gt;Also, I noticed the &lt;code&gt;checker&lt;/code&gt; log has some errors we should pay attention to:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -820,9 +758,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;li&gt;Looking at issues with author authorities on CGSpace&lt;/li&gt; &lt;li&gt;Looking at issues with author authorities on CGSpace&lt;/li&gt;
&lt;li&gt;For some reason we still have the &lt;code&gt;index-lucene-update&lt;/code&gt; cron job active on CGSpace, but I&amp;rsquo;m pretty sure we don&amp;rsquo;t need it as of the latest few versions of Atmire&amp;rsquo;s Listings and Reports module&lt;/li&gt; &lt;li&gt;For some reason we still have the &lt;code&gt;index-lucene-update&lt;/code&gt; cron job active on CGSpace, but I&amp;rsquo;m pretty sure we don&amp;rsquo;t need it as of the latest few versions of Atmire&amp;rsquo;s Listings and Reports module&lt;/li&gt;
&lt;li&gt;Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server&lt;/li&gt; &lt;li&gt;Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -844,9 +780,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Not only are there 49,000 countries, we have some blanks (25)&amp;hellip;&lt;/li&gt; &lt;li&gt;Not only are there 49,000 countries, we have some blanks (25)&amp;hellip;&lt;/li&gt;
&lt;li&gt;Also, lots of things like &amp;ldquo;COTE D`LVOIRE&amp;rdquo; and &amp;ldquo;COTE D IVOIRE&amp;rdquo;&lt;/li&gt; &lt;li&gt;Also, lots of things like &amp;ldquo;COTE D`LVOIRE&amp;rdquo; and &amp;ldquo;COTE D IVOIRE&amp;rdquo;&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -861,9 +795,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;li&gt;Move ILRI collection &lt;code&gt;10568/12503&lt;/code&gt; from &lt;code&gt;10568/27869&lt;/code&gt; to &lt;code&gt;10568/27629&lt;/code&gt; using the &lt;a href=&#34;https://gist.github.com/alanorth/392c4660e8b022d99dfa&#34;&gt;move_collections.sh&lt;/a&gt; script I wrote last year.&lt;/li&gt; &lt;li&gt;Move ILRI collection &lt;code&gt;10568/12503&lt;/code&gt; from &lt;code&gt;10568/27869&lt;/code&gt; to &lt;code&gt;10568/27629&lt;/code&gt; using the &lt;a href=&#34;https://gist.github.com/alanorth/392c4660e8b022d99dfa&#34;&gt;move_collections.sh&lt;/a&gt; script I wrote last year.&lt;/li&gt;
&lt;li&gt;I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.&lt;/li&gt; &lt;li&gt;I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.&lt;/li&gt;
&lt;li&gt;Update GitHub wiki for documentation of &lt;a href=&#34;https://github.com/ilri/DSpace/wiki/Maintenance-Tasks&#34;&gt;maintenance tasks&lt;/a&gt;.&lt;/li&gt; &lt;li&gt;Update GitHub wiki for documentation of &lt;a href=&#34;https://github.com/ilri/DSpace/wiki/Maintenance-Tasks&#34;&gt;maintenance tasks&lt;/a&gt;.&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -883,9 +815,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
-rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18 -rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo -rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz -rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -904,9 +834,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;pre&gt;&lt;code&gt;$ psql -c &#39;SELECT * from pg_stat_activity;&#39; | grep idle | grep -c cgspace &lt;pre&gt;&lt;code&gt;$ psql -c &#39;SELECT * from pg_stat_activity;&#39; | grep idle | grep -c cgspace
78 78
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
</channel> </channel>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="CGSpace Notes"/> <meta name="twitter:title" content="CGSpace Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -175,8 +175,6 @@ dspace.log.2018-01-02:34
<ul> <ul>
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li> <li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
</article> </article>
@ -202,8 +200,6 @@ dspace.log.2018-01-02:34
<li>PostgreSQL activity says there are 115 connections currently</li> <li>PostgreSQL activity says there are 115 connections currently</li>
<li>The list of connections to XMLUI and REST API for today:</li> <li>The list of connections to XMLUI and REST API for today:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a>
</article> </article>
@ -244,8 +240,6 @@ dspace.log.2018-01-02:34
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv; <pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
COPY 54701 COPY 54701
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
</article> </article>
@ -276,8 +270,6 @@ COPY 54701
<li>There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li> <li>There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li>
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li> <li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a>
</article> </article>
@ -296,8 +288,6 @@ COPY 54701
</p> </p>
</header> </header>
<p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p> <p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a>
</article> </article>
@ -326,8 +316,6 @@ COPY 54701
<ul> <ul>
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li> <li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a>
</article> </article>
@ -368,8 +356,6 @@ COPY 54701
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li> <li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li> <li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a>
</article> </article>
@ -400,8 +386,6 @@ COPY 54701
<li>Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace</li> <li>Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace</li>
<li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li> <li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="CGSpace Notes"/> <meta name="twitter:title" content="CGSpace Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -114,8 +114,6 @@
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt <pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
</article> </article>
@ -156,8 +154,6 @@
<pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg <pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000 /Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a>
</article> </article>
@ -196,8 +192,6 @@ DELETE 1
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li> <li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
<li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li> <li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a>
</article> </article>
@ -222,8 +216,6 @@ DELETE 1
<li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li> <li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li>
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li> <li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
</article> </article>
@ -260,8 +252,6 @@ DELETE 1
<li>I&rsquo;ve raised a ticket with Atmire to ask</li> <li>I&rsquo;ve raised a ticket with Atmire to ask</li>
<li>Another worrying error from dspace.log is:</li> <li>Another worrying error from dspace.log is:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a>
</article> </article>
@ -286,8 +276,6 @@ DELETE 1
</ul> </ul>
<p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p> <p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a>
</article> </article>
@ -320,8 +308,6 @@ DELETE 1
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X <pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a>
</article> </article>
@ -350,8 +336,6 @@ DELETE 1
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot; <pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot;
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a>
</article> </article>
@ -384,8 +368,6 @@ DELETE 1
$ git reset --hard ilri/5_x-prod $ git reset --hard ilri/5_x-prod
$ git rebase -i dspace-5.5 $ git rebase -i dspace-5.5
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a>
</article> </article>
@ -421,8 +403,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
<ul> <ul>
<li>In this case the select query was showing 95 results before the update</li> <li>In this case the select query was showing 95 results before the update</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="CGSpace Notes"/> <meta name="twitter:title" content="CGSpace Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -108,8 +108,6 @@
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li> <li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li> <li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
</article> </article>
@ -138,8 +136,6 @@
<pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l <pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
3168 3168
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a>
</article> </article>
@ -166,8 +162,6 @@
<li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li> <li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li>
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li> <li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a>
</article> </article>
@ -192,8 +186,6 @@
<li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module</li> <li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module</li>
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li> <li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a>
</article> </article>
@ -225,8 +217,6 @@
<li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li> <li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li>
<li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li> <li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a>
</article> </article>
@ -251,8 +241,6 @@
<li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li> <li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li>
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li> <li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a>
</article> </article>
@ -282,8 +270,6 @@
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo -rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz -rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a>
</article> </article>
@ -312,8 +298,6 @@
<pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace <pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
78 78
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Posts"/> <meta name="twitter:title" content="Posts"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -111,8 +111,6 @@
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li> <li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
<li>Today these are the top 10 IPs:</li> <li>Today these are the top 10 IPs:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
</article> </article>
@ -136,8 +134,6 @@
<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li> <li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li> <li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a>
</article> </article>
@ -163,8 +159,6 @@
<li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li> <li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
<li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li> <li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
</article> </article>
@ -201,8 +195,6 @@
<li>The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes</li> <li>The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes</li>
<li>I ran all system updates on DSpace Test and rebooted it</li> <li>I ran all system updates on DSpace Test and rebooted it</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a>
</article> </article>
@ -235,8 +227,6 @@
<pre><code>There is insufficient memory for the Java Runtime Environment to continue. <pre><code>There is insufficient memory for the Java Runtime Environment to continue.
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a>
</article> </article>
@ -280,8 +270,6 @@ real 74m42.646s
user 8m5.056s user 8m5.056s
sys 2m7.289s sys 2m7.289s
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a>
</article> </article>
@ -311,8 +299,6 @@ sys 2m7.289s
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li> <li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li> <li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
</article> </article>
@ -336,8 +322,6 @@ sys 2m7.289s
<li>I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when</li> <li>I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when</li>
<li>Catalina logs at least show some memory errors yesterday:</li> <li>Catalina logs at least show some memory errors yesterday:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a>
</article> </article>
@ -360,8 +344,6 @@ sys 2m7.289s
<ul> <ul>
<li>Export a CSV of the IITA community metadata for Martin Mueller</li> <li>Export a CSV of the IITA community metadata for Martin Mueller</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
</article> </article>
@ -387,8 +369,6 @@ sys 2m7.289s
<li>Yesterday I figured out how to monitor DSpace sessions using JMX</li> <li>Yesterday I figured out how to monitor DSpace sessions using JMX</li>
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li> <li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a>
</article> </article>

View File

@ -29,9 +29,7 @@
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage&lt;/li&gt; &lt;li&gt;Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage&lt;/li&gt;
&lt;li&gt;Today these are the top 10 IPs:&lt;/li&gt; &lt;li&gt;Today these are the top 10 IPs:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -45,9 +43,7 @@
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items&lt;/li&gt; &lt;li&gt;Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items&lt;/li&gt;
&lt;li&gt;I created a GitHub issue to track this &lt;a href=&#34;https://github.com/ilri/DSpace/issues/389&#34;&gt;#389&lt;/a&gt;, because I&amp;rsquo;m super busy in Nairobi right now&lt;/li&gt; &lt;li&gt;I created a GitHub issue to track this &lt;a href=&#34;https://github.com/ilri/DSpace/issues/389&#34;&gt;#389&lt;/a&gt;, because I&amp;rsquo;m super busy in Nairobi right now&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -63,9 +59,7 @@
&lt;li&gt;I&amp;rsquo;ll update the DSpace role in our &lt;a href=&#34;https://github.com/ilri/rmg-ansible-public&#34;&gt;Ansible infrastructure playbooks&lt;/a&gt; and run the updated playbooks on CGSpace and DSpace Test&lt;/li&gt; &lt;li&gt;I&amp;rsquo;ll update the DSpace role in our &lt;a href=&#34;https://github.com/ilri/rmg-ansible-public&#34;&gt;Ansible infrastructure playbooks&lt;/a&gt; and run the updated playbooks on CGSpace and DSpace Test&lt;/li&gt;
&lt;li&gt;Also, I&amp;rsquo;ll re-run the &lt;code&gt;postgresql&lt;/code&gt; tasks because the custom PostgreSQL variables are dynamic according to the system&amp;rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month&lt;/li&gt; &lt;li&gt;Also, I&amp;rsquo;ll re-run the &lt;code&gt;postgresql&lt;/code&gt; tasks because the custom PostgreSQL variables are dynamic according to the system&amp;rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month&lt;/li&gt;
&lt;li&gt;I&amp;rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&amp;rsquo;m getting those autowire errors in Tomcat 8.5.30 again:&lt;/li&gt; &lt;li&gt;I&amp;rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&amp;rsquo;m getting those autowire errors in Tomcat 8.5.30 again:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -92,9 +86,7 @@
&lt;li&gt;Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core&lt;/li&gt; &lt;li&gt;Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core&lt;/li&gt;
&lt;li&gt;The server only has 8GB of RAM so we&amp;rsquo;ll eventually need to upgrade to a larger one because we&amp;rsquo;ll start starving the OS, PostgreSQL, and command line batch processes&lt;/li&gt; &lt;li&gt;The server only has 8GB of RAM so we&amp;rsquo;ll eventually need to upgrade to a larger one because we&amp;rsquo;ll start starving the OS, PostgreSQL, and command line batch processes&lt;/li&gt;
&lt;li&gt;I ran all system updates on DSpace Test and rebooted it&lt;/li&gt; &lt;li&gt;I ran all system updates on DSpace Test and rebooted it&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -117,9 +109,7 @@
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;There is insufficient memory for the Java Runtime Environment to continue. &lt;pre&gt;&lt;code&gt;There is insufficient memory for the Java Runtime Environment to continue.
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -153,9 +143,7 @@
real 74m42.646s real 74m42.646s
user 8m5.056s user 8m5.056s
sys 2m7.289s sys 2m7.289s
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -175,9 +163,7 @@ sys 2m7.289s
&lt;/ul&gt;&lt;/li&gt; &lt;/ul&gt;&lt;/li&gt;
&lt;li&gt;Then I reduced the JVM heap size from 6144 back to 5120m&lt;/li&gt; &lt;li&gt;Then I reduced the JVM heap size from 6144 back to 5120m&lt;/li&gt;
&lt;li&gt;Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the &lt;a href=&#34;https://github.com/ilri/rmg-ansible-public&#34;&gt;Ansible infrastructure scripts&lt;/a&gt; to support hosts choosing which distribution they want to use&lt;/li&gt; &lt;li&gt;Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the &lt;a href=&#34;https://github.com/ilri/rmg-ansible-public&#34;&gt;Ansible infrastructure scripts&lt;/a&gt; to support hosts choosing which distribution they want to use&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -191,9 +177,7 @@ sys 2m7.289s
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;I tried to test something on DSpace Test but noticed that it&amp;rsquo;s down since god knows when&lt;/li&gt; &lt;li&gt;I tried to test something on DSpace Test but noticed that it&amp;rsquo;s down since god knows when&lt;/li&gt;
&lt;li&gt;Catalina logs at least show some memory errors yesterday:&lt;/li&gt; &lt;li&gt;Catalina logs at least show some memory errors yesterday:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -206,9 +190,7 @@ sys 2m7.289s
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Export a CSV of the IITA community metadata for Martin Mueller&lt;/li&gt; &lt;li&gt;Export a CSV of the IITA community metadata for Martin Mueller&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -224,9 +206,7 @@ sys 2m7.289s
&lt;li&gt;We don&amp;rsquo;t need to distinguish between internal and external works, so that makes it just a simple list&lt;/li&gt; &lt;li&gt;We don&amp;rsquo;t need to distinguish between internal and external works, so that makes it just a simple list&lt;/li&gt;
&lt;li&gt;Yesterday I figured out how to monitor DSpace sessions using JMX&lt;/li&gt; &lt;li&gt;Yesterday I figured out how to monitor DSpace sessions using JMX&lt;/li&gt;
&lt;li&gt;I copied the logic in the &lt;code&gt;jmx_tomcat_dbpools&lt;/code&gt; provided by Ubuntu&amp;rsquo;s &lt;code&gt;munin-plugins-java&lt;/code&gt; package and used the stuff I discovered about JMX &lt;a href=&#34;https://alanorth.github.io/cgspace-notes/cgspace-notes/2018-01/&#34;&gt;in 2018-01&lt;/a&gt;&lt;/li&gt; &lt;li&gt;I copied the logic in the &lt;code&gt;jmx_tomcat_dbpools&lt;/code&gt; provided by Ubuntu&amp;rsquo;s &lt;code&gt;munin-plugins-java&lt;/code&gt; package and used the stuff I discovered about JMX &lt;a href=&#34;https://alanorth.github.io/cgspace-notes/cgspace-notes/2018-01/&#34;&gt;in 2018-01&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -311,9 +291,7 @@ dspace.log.2018-01-02:34
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&amp;rsquo;s Encrypt if it&amp;rsquo;s just a handful of domains&lt;/li&gt; &lt;li&gt;Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&amp;rsquo;s Encrypt if it&amp;rsquo;s just a handful of domains&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -329,9 +307,7 @@ dspace.log.2018-01-02:34
&lt;li&gt;The logs say &amp;ldquo;Timeout waiting for idle object&amp;rdquo;&lt;/li&gt; &lt;li&gt;The logs say &amp;ldquo;Timeout waiting for idle object&amp;rdquo;&lt;/li&gt;
&lt;li&gt;PostgreSQL activity says there are 115 connections currently&lt;/li&gt; &lt;li&gt;PostgreSQL activity says there are 115 connections currently&lt;/li&gt;
&lt;li&gt;The list of connections to XMLUI and REST API for today:&lt;/li&gt; &lt;li&gt;The list of connections to XMLUI and REST API for today:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -362,9 +338,7 @@ dspace.log.2018-01-02:34
&lt;pre&gt;&lt;code&gt;dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = &#39;contributor&#39; and qualifier = &#39;author&#39;) AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv; &lt;pre&gt;&lt;code&gt;dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = &#39;contributor&#39; and qualifier = &#39;author&#39;) AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
COPY 54701 COPY 54701
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -385,9 +359,7 @@ COPY 54701
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;There appears to be a pattern but I&amp;rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine&lt;/li&gt; &lt;li&gt;There appears to be a pattern but I&amp;rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine&lt;/li&gt;
&lt;li&gt;Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections&lt;/li&gt; &lt;li&gt;Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -396,9 +368,7 @@ COPY 54701
<pubDate>Mon, 18 Sep 2017 16:38:35 +0300</pubDate> <pubDate>Mon, 18 Sep 2017 16:38:35 +0300</pubDate>
<guid>https://alanorth.github.io/cgspace-notes/cgiar-library-migration/</guid> <guid>https://alanorth.github.io/cgspace-notes/cgiar-library-migration/</guid>
<description>&lt;p&gt;Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called &lt;em&gt;CGIAR System Organization&lt;/em&gt;.&lt;/p&gt; <description>&lt;p&gt;Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called &lt;em&gt;CGIAR System Organization&lt;/em&gt;.&lt;/p&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -417,9 +387,7 @@ COPY 54701
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Ask Sisay to clean up the WLE approvers a bit, as Marianne&amp;rsquo;s user account is both in the approvers step as well as the group&lt;/li&gt; &lt;li&gt;Ask Sisay to clean up the WLE approvers a bit, as Marianne&amp;rsquo;s user account is both in the approvers step as well as the group&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -450,9 +418,7 @@ COPY 54701
&lt;li&gt;This was due to newline characters in the &lt;code&gt;dc.description.abstract&lt;/code&gt; column, which caused OpenRefine to choke when exporting the CSV&lt;/li&gt; &lt;li&gt;This was due to newline characters in the &lt;code&gt;dc.description.abstract&lt;/code&gt; column, which caused OpenRefine to choke when exporting the CSV&lt;/li&gt;
&lt;li&gt;I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using &lt;code&gt;g/^$/d&lt;/code&gt;&lt;/li&gt; &lt;li&gt;I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using &lt;code&gt;g/^$/d&lt;/code&gt;&lt;/li&gt;
&lt;li&gt;Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet&lt;/li&gt; &lt;li&gt;Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -473,9 +439,7 @@ COPY 54701
&lt;li&gt;Merge changes for WLE Phase II theme rename (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/329&#34;&gt;#329&lt;/a&gt;)&lt;/li&gt; &lt;li&gt;Merge changes for WLE Phase II theme rename (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/329&#34;&gt;#329&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Looking at extracting the metadata registries from ICARDA&amp;rsquo;s MEL DSpace database so we can compare fields with CGSpace&lt;/li&gt; &lt;li&gt;Looking at extracting the metadata registries from ICARDA&amp;rsquo;s MEL DSpace database so we can compare fields with CGSpace&lt;/li&gt;
&lt;li&gt;We can use PostgreSQL&amp;rsquo;s extended output format (&lt;code&gt;-x&lt;/code&gt;) plus &lt;code&gt;sed&lt;/code&gt; to format the output into quasi XML:&lt;/li&gt; &lt;li&gt;We can use PostgreSQL&amp;rsquo;s extended output format (&lt;code&gt;-x&lt;/code&gt;) plus &lt;code&gt;sed&lt;/code&gt; to format the output into quasi XML:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -517,9 +481,7 @@ COPY 54701
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &amp;quot;ImageMagick PDF Thumbnail&amp;quot; -v &amp;gt;&amp;amp; /tmp/filter-media-cmyk.txt &lt;pre&gt;&lt;code&gt;$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &amp;quot;ImageMagick PDF Thumbnail&amp;quot; -v &amp;gt;&amp;amp; /tmp/filter-media-cmyk.txt
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -550,9 +512,7 @@ COPY 54701
&lt;pre&gt;&lt;code&gt;$ identify ~/Desktop/alc_contrastes_desafios.jpg &lt;pre&gt;&lt;code&gt;$ identify ~/Desktop/alc_contrastes_desafios.jpg
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000 /Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -581,9 +541,7 @@ DELETE 1
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Create issue on GitHub to track the addition of CCAFS Phase II project tags (&lt;a href=&#34;https://github.com/ilri/DSpace/issues/301&#34;&gt;#301&lt;/a&gt;)&lt;/li&gt; &lt;li&gt;Create issue on GitHub to track the addition of CCAFS Phase II project tags (&lt;a href=&#34;https://github.com/ilri/DSpace/issues/301&#34;&gt;#301&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Looks like we&amp;rsquo;ll be using &lt;code&gt;cg.identifier.ccafsprojectpii&lt;/code&gt; as the field name&lt;/li&gt; &lt;li&gt;Looks like we&amp;rsquo;ll be using &lt;code&gt;cg.identifier.ccafsprojectpii&lt;/code&gt; as the field name&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -598,9 +556,7 @@ DELETE 1
&lt;li&gt;I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error&lt;/li&gt; &lt;li&gt;I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error&lt;/li&gt;
&lt;li&gt;I tested on DSpace Test as well and it doesn&amp;rsquo;t work there either&lt;/li&gt; &lt;li&gt;I tested on DSpace Test as well and it doesn&amp;rsquo;t work there either&lt;/li&gt;
&lt;li&gt;I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&amp;rsquo;m not sure if we&amp;rsquo;ve ever had the sharding task run successfully over all these years&lt;/li&gt; &lt;li&gt;I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&amp;rsquo;m not sure if we&amp;rsquo;ve ever had the sharding task run successfully over all these years&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -627,9 +583,7 @@ DELETE 1
&lt;li&gt;I see thousands of them in the logs for the last few months, so it&amp;rsquo;s not related to the DSpace 5.5 upgrade&lt;/li&gt; &lt;li&gt;I see thousands of them in the logs for the last few months, so it&amp;rsquo;s not related to the DSpace 5.5 upgrade&lt;/li&gt;
&lt;li&gt;I&amp;rsquo;ve raised a ticket with Atmire to ask&lt;/li&gt; &lt;li&gt;I&amp;rsquo;ve raised a ticket with Atmire to ask&lt;/li&gt;
&lt;li&gt;Another worrying error from dspace.log is:&lt;/li&gt; &lt;li&gt;Another worrying error from dspace.log is:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -644,9 +598,7 @@ DELETE 1
&lt;li&gt;Add &lt;code&gt;dc.type&lt;/code&gt; to the output options for Atmire&amp;rsquo;s Listings and Reports module (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/286&#34;&gt;#286&lt;/a&gt;)&lt;/li&gt; &lt;li&gt;Add &lt;code&gt;dc.type&lt;/code&gt; to the output options for Atmire&amp;rsquo;s Listings and Reports module (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/286&#34;&gt;#286&lt;/a&gt;)&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;
&lt;p&gt;&lt;img src=&#34;https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png&#34; alt=&#34;Listings and Reports with output type&#34; /&gt;&lt;/p&gt; &lt;p&gt;&lt;img src=&#34;https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png&#34; alt=&#34;Listings and Reports with output type&#34; /&gt;&lt;/p&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -669,9 +621,7 @@ DELETE 1
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X &lt;pre&gt;&lt;code&gt;0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -690,9 +640,7 @@ DELETE 1
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &amp;quot;dc=cgiarad,dc=org&amp;quot; -D &amp;quot;admigration1@cgiarad.org&amp;quot; -W &amp;quot;(sAMAccountName=admigration1)&amp;quot; &lt;pre&gt;&lt;code&gt;$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &amp;quot;dc=cgiarad,dc=org&amp;quot; -D &amp;quot;admigration1@cgiarad.org&amp;quot; -W &amp;quot;(sAMAccountName=admigration1)&amp;quot;
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -715,9 +663,7 @@ DELETE 1
&lt;pre&gt;&lt;code&gt;$ git checkout -b 55new 5_x-prod &lt;pre&gt;&lt;code&gt;$ git checkout -b 55new 5_x-prod
$ git reset --hard ilri/5_x-prod $ git reset --hard ilri/5_x-prod
$ git rebase -i dspace-5.5 $ git rebase -i dspace-5.5
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -743,9 +689,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;In this case the select query was showing 95 results before the update&lt;/li&gt; &lt;li&gt;In this case the select query was showing 95 results before the update&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -763,9 +707,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;li&gt;This is their publications set: &lt;a href=&#34;http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;amp;from=2016-01-01&amp;amp;set=p15738coll2&amp;amp;metadataPrefix=oai_dc&#34;&gt;http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;amp;from=2016-01-01&amp;amp;set=p15738coll2&amp;amp;metadataPrefix=oai_dc&lt;/a&gt;&lt;/li&gt; &lt;li&gt;This is their publications set: &lt;a href=&#34;http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;amp;from=2016-01-01&amp;amp;set=p15738coll2&amp;amp;metadataPrefix=oai_dc&#34;&gt;http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;amp;from=2016-01-01&amp;amp;set=p15738coll2&amp;amp;metadataPrefix=oai_dc&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;You can see the others by using the OAI &lt;code&gt;ListSets&lt;/code&gt; verb: &lt;a href=&#34;http://ebrary.ifpri.org/oai/oai.php?verb=ListSets&#34;&gt;http://ebrary.ifpri.org/oai/oai.php?verb=ListSets&lt;/a&gt;&lt;/li&gt; &lt;li&gt;You can see the others by using the OAI &lt;code&gt;ListSets&lt;/code&gt; verb: &lt;a href=&#34;http://ebrary.ifpri.org/oai/oai.php?verb=ListSets&#34;&gt;http://ebrary.ifpri.org/oai/oai.php?verb=ListSets&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in &lt;code&gt;dc.identifier.fund&lt;/code&gt; to &lt;code&gt;cg.identifier.cpwfproject&lt;/code&gt; and then the rest to &lt;code&gt;dc.description.sponsorship&lt;/code&gt;&lt;/li&gt; &lt;li&gt;Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in &lt;code&gt;dc.identifier.fund&lt;/code&gt; to &lt;code&gt;cg.identifier.cpwfproject&lt;/code&gt; and then the rest to &lt;code&gt;dc.description.sponsorship&lt;/code&gt;&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -784,9 +726,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;pre&gt;&lt;code&gt;# awk &#39;{print $1}&#39; /var/log/nginx/rest.log | uniq | wc -l &lt;pre&gt;&lt;code&gt;# awk &#39;{print $1}&#39; /var/log/nginx/rest.log | uniq | wc -l
3168 3168
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -803,9 +743,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;li&gt;After running DSpace for over five years I&amp;rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year!&lt;/li&gt; &lt;li&gt;After running DSpace for over five years I&amp;rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year!&lt;/li&gt;
&lt;li&gt;This will save us a few gigs of backup space we&amp;rsquo;re paying for on S3&lt;/li&gt; &lt;li&gt;This will save us a few gigs of backup space we&amp;rsquo;re paying for on S3&lt;/li&gt;
&lt;li&gt;Also, I noticed the &lt;code&gt;checker&lt;/code&gt; log has some errors we should pay attention to:&lt;/li&gt; &lt;li&gt;Also, I noticed the &lt;code&gt;checker&lt;/code&gt; log has some errors we should pay attention to:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -820,9 +758,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;li&gt;Looking at issues with author authorities on CGSpace&lt;/li&gt; &lt;li&gt;Looking at issues with author authorities on CGSpace&lt;/li&gt;
&lt;li&gt;For some reason we still have the &lt;code&gt;index-lucene-update&lt;/code&gt; cron job active on CGSpace, but I&amp;rsquo;m pretty sure we don&amp;rsquo;t need it as of the latest few versions of Atmire&amp;rsquo;s Listings and Reports module&lt;/li&gt; &lt;li&gt;For some reason we still have the &lt;code&gt;index-lucene-update&lt;/code&gt; cron job active on CGSpace, but I&amp;rsquo;m pretty sure we don&amp;rsquo;t need it as of the latest few versions of Atmire&amp;rsquo;s Listings and Reports module&lt;/li&gt;
&lt;li&gt;Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server&lt;/li&gt; &lt;li&gt;Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -844,9 +780,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Not only are there 49,000 countries, we have some blanks (25)&amp;hellip;&lt;/li&gt; &lt;li&gt;Not only are there 49,000 countries, we have some blanks (25)&amp;hellip;&lt;/li&gt;
&lt;li&gt;Also, lots of things like &amp;ldquo;COTE D`LVOIRE&amp;rdquo; and &amp;ldquo;COTE D IVOIRE&amp;rdquo;&lt;/li&gt; &lt;li&gt;Also, lots of things like &amp;ldquo;COTE D`LVOIRE&amp;rdquo; and &amp;ldquo;COTE D IVOIRE&amp;rdquo;&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -861,9 +795,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;li&gt;Move ILRI collection &lt;code&gt;10568/12503&lt;/code&gt; from &lt;code&gt;10568/27869&lt;/code&gt; to &lt;code&gt;10568/27629&lt;/code&gt; using the &lt;a href=&#34;https://gist.github.com/alanorth/392c4660e8b022d99dfa&#34;&gt;move_collections.sh&lt;/a&gt; script I wrote last year.&lt;/li&gt; &lt;li&gt;Move ILRI collection &lt;code&gt;10568/12503&lt;/code&gt; from &lt;code&gt;10568/27869&lt;/code&gt; to &lt;code&gt;10568/27629&lt;/code&gt; using the &lt;a href=&#34;https://gist.github.com/alanorth/392c4660e8b022d99dfa&#34;&gt;move_collections.sh&lt;/a&gt; script I wrote last year.&lt;/li&gt;
&lt;li&gt;I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.&lt;/li&gt; &lt;li&gt;I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.&lt;/li&gt;
&lt;li&gt;Update GitHub wiki for documentation of &lt;a href=&#34;https://github.com/ilri/DSpace/wiki/Maintenance-Tasks&#34;&gt;maintenance tasks&lt;/a&gt;.&lt;/li&gt; &lt;li&gt;Update GitHub wiki for documentation of &lt;a href=&#34;https://github.com/ilri/DSpace/wiki/Maintenance-Tasks&#34;&gt;maintenance tasks&lt;/a&gt;.&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -883,9 +815,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
-rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18 -rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo -rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz -rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -904,9 +834,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;pre&gt;&lt;code&gt;$ psql -c &#39;SELECT * from pg_stat_activity;&#39; | grep idle | grep -c cgspace &lt;pre&gt;&lt;code&gt;$ psql -c &#39;SELECT * from pg_stat_activity;&#39; | grep idle | grep -c cgspace
78 78
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
</channel> </channel>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Posts"/> <meta name="twitter:title" content="Posts"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -175,8 +175,6 @@ dspace.log.2018-01-02:34
<ul> <ul>
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li> <li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
</article> </article>
@ -202,8 +200,6 @@ dspace.log.2018-01-02:34
<li>PostgreSQL activity says there are 115 connections currently</li> <li>PostgreSQL activity says there are 115 connections currently</li>
<li>The list of connections to XMLUI and REST API for today:</li> <li>The list of connections to XMLUI and REST API for today:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a>
</article> </article>
@ -244,8 +240,6 @@ dspace.log.2018-01-02:34
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv; <pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
COPY 54701 COPY 54701
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
</article> </article>
@ -276,8 +270,6 @@ COPY 54701
<li>There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li> <li>There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li>
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li> <li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a>
</article> </article>
@ -296,8 +288,6 @@ COPY 54701
</p> </p>
</header> </header>
<p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p> <p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a>
</article> </article>
@ -326,8 +316,6 @@ COPY 54701
<ul> <ul>
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li> <li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a>
</article> </article>
@ -368,8 +356,6 @@ COPY 54701
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li> <li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li> <li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a>
</article> </article>
@ -400,8 +386,6 @@ COPY 54701
<li>Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace</li> <li>Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace</li>
<li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li> <li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Posts"/> <meta name="twitter:title" content="Posts"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -114,8 +114,6 @@
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt <pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
</article> </article>
@ -156,8 +154,6 @@
<pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg <pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000 /Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a>
</article> </article>
@ -196,8 +192,6 @@ DELETE 1
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li> <li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
<li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li> <li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a>
</article> </article>
@ -222,8 +216,6 @@ DELETE 1
<li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li> <li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li>
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li> <li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
</article> </article>
@ -260,8 +252,6 @@ DELETE 1
<li>I&rsquo;ve raised a ticket with Atmire to ask</li> <li>I&rsquo;ve raised a ticket with Atmire to ask</li>
<li>Another worrying error from dspace.log is:</li> <li>Another worrying error from dspace.log is:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a>
</article> </article>
@ -286,8 +276,6 @@ DELETE 1
</ul> </ul>
<p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p> <p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a>
</article> </article>
@ -320,8 +308,6 @@ DELETE 1
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X <pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a>
</article> </article>
@ -350,8 +336,6 @@ DELETE 1
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot; <pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot;
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a>
</article> </article>
@ -384,8 +368,6 @@ DELETE 1
$ git reset --hard ilri/5_x-prod $ git reset --hard ilri/5_x-prod
$ git rebase -i dspace-5.5 $ git rebase -i dspace-5.5
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a>
</article> </article>
@ -421,8 +403,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
<ul> <ul>
<li>In this case the select query was showing 95 results before the update</li> <li>In this case the select query was showing 95 results before the update</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Posts"/> <meta name="twitter:title" content="Posts"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -108,8 +108,6 @@
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li> <li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li> <li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
</article> </article>
@ -138,8 +136,6 @@
<pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l <pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
3168 3168
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a>
</article> </article>
@ -166,8 +162,6 @@
<li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li> <li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li>
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li> <li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a>
</article> </article>
@ -192,8 +186,6 @@
<li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module</li> <li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module</li>
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li> <li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a>
</article> </article>
@ -225,8 +217,6 @@
<li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li> <li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li>
<li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li> <li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a>
</article> </article>
@ -251,8 +241,6 @@
<li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li> <li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li>
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li> <li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a>
</article> </article>
@ -282,8 +270,6 @@
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo -rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz -rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a>
</article> </article>
@ -312,8 +298,6 @@
<pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace <pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
78 78
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a>
</article> </article>

View File

@ -41,7 +41,7 @@ Disallow: /cgspace-notes/2015-12/
Disallow: /cgspace-notes/2015-11/ Disallow: /cgspace-notes/2015-11/
Disallow: /cgspace-notes/ Disallow: /cgspace-notes/
Disallow: /cgspace-notes/categories/ Disallow: /cgspace-notes/categories/
Disallow: /cgspace-notes/tags/notes/
Disallow: /cgspace-notes/categories/notes/ Disallow: /cgspace-notes/categories/notes/
Disallow: /cgspace-notes/tags/notes/
Disallow: /cgspace-notes/posts/ Disallow: /cgspace-notes/posts/
Disallow: /cgspace-notes/tags/ Disallow: /cgspace-notes/tags/

View File

@ -4,7 +4,7 @@
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/2018-11/</loc> <loc>https://alanorth.github.io/cgspace-notes/2018-11/</loc>
<lastmod>2018-11-06T18:03:44+02:00</lastmod> <lastmod>2018-11-07T19:20:25+02:00</lastmod>
</url> </url>
<url> <url>
@ -194,7 +194,7 @@
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/</loc> <loc>https://alanorth.github.io/cgspace-notes/</loc>
<lastmod>2018-11-06T18:03:44+02:00</lastmod> <lastmod>2018-11-07T19:20:25+02:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>
@ -203,27 +203,27 @@
<priority>0</priority> <priority>0</priority>
</url> </url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
<lastmod>2018-11-06T18:03:44+02:00</lastmod>
<priority>0</priority>
</url>
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc> <loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
<lastmod>2018-03-09T22:10:33+02:00</lastmod> <lastmod>2018-03-09T22:10:33+02:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
<lastmod>2018-11-07T19:20:25+02:00</lastmod>
<priority>0</priority>
</url>
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc> <loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
<lastmod>2018-11-06T18:03:44+02:00</lastmod> <lastmod>2018-11-07T19:20:25+02:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc> <loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
<lastmod>2018-11-06T18:03:44+02:00</lastmod> <lastmod>2018-11-07T19:20:25+02:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Tags"/> <meta name="twitter:title" content="Tags"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -111,8 +111,6 @@
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li> <li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
<li>Today these are the top 10 IPs:</li> <li>Today these are the top 10 IPs:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
</article> </article>
@ -136,8 +134,6 @@
<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li> <li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li> <li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a>
</article> </article>
@ -163,8 +159,6 @@
<li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li> <li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
<li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li> <li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
</article> </article>
@ -201,8 +195,6 @@
<li>The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes</li> <li>The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes</li>
<li>I ran all system updates on DSpace Test and rebooted it</li> <li>I ran all system updates on DSpace Test and rebooted it</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a>
</article> </article>
@ -235,8 +227,6 @@
<pre><code>There is insufficient memory for the Java Runtime Environment to continue. <pre><code>There is insufficient memory for the Java Runtime Environment to continue.
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a>
</article> </article>
@ -280,8 +270,6 @@ real 74m42.646s
user 8m5.056s user 8m5.056s
sys 2m7.289s sys 2m7.289s
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a>
</article> </article>
@ -311,8 +299,6 @@ sys 2m7.289s
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li> <li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li> <li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
</article> </article>
@ -336,8 +322,6 @@ sys 2m7.289s
<li>I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when</li> <li>I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when</li>
<li>Catalina logs at least show some memory errors yesterday:</li> <li>Catalina logs at least show some memory errors yesterday:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a>
</article> </article>
@ -360,8 +344,6 @@ sys 2m7.289s
<ul> <ul>
<li>Export a CSV of the IITA community metadata for Martin Mueller</li> <li>Export a CSV of the IITA community metadata for Martin Mueller</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
</article> </article>
@ -387,8 +369,6 @@ sys 2m7.289s
<li>Yesterday I figured out how to monitor DSpace sessions using JMX</li> <li>Yesterday I figured out how to monitor DSpace sessions using JMX</li>
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li> <li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Notes"/> <meta name="twitter:title" content="Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -96,8 +96,6 @@
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li> <li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
<li>Today these are the top 10 IPs:</li> <li>Today these are the top 10 IPs:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
</article> </article>
@ -121,8 +119,6 @@
<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li> <li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li> <li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a>
</article> </article>
@ -148,8 +144,6 @@
<li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li> <li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
<li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li> <li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
</article> </article>
@ -186,8 +180,6 @@
<li>The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes</li> <li>The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes</li>
<li>I ran all system updates on DSpace Test and rebooted it</li> <li>I ran all system updates on DSpace Test and rebooted it</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a>
</article> </article>
@ -220,8 +212,6 @@
<pre><code>There is insufficient memory for the Java Runtime Environment to continue. <pre><code>There is insufficient memory for the Java Runtime Environment to continue.
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a>
</article> </article>
@ -265,8 +255,6 @@ real 74m42.646s
user 8m5.056s user 8m5.056s
sys 2m7.289s sys 2m7.289s
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a>
</article> </article>
@ -296,8 +284,6 @@ sys 2m7.289s
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li> <li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li> <li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
</article> </article>
@ -321,8 +307,6 @@ sys 2m7.289s
<li>I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when</li> <li>I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when</li>
<li>Catalina logs at least show some memory errors yesterday:</li> <li>Catalina logs at least show some memory errors yesterday:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a>
</article> </article>
@ -345,8 +329,6 @@ sys 2m7.289s
<ul> <ul>
<li>Export a CSV of the IITA community metadata for Martin Mueller</li> <li>Export a CSV of the IITA community metadata for Martin Mueller</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
</article> </article>
@ -372,8 +354,6 @@ sys 2m7.289s
<li>Yesterday I figured out how to monitor DSpace sessions using JMX</li> <li>Yesterday I figured out how to monitor DSpace sessions using JMX</li>
<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li> <li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a>
</article> </article>

View File

@ -29,9 +29,7 @@
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage&lt;/li&gt; &lt;li&gt;Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage&lt;/li&gt;
&lt;li&gt;Today these are the top 10 IPs:&lt;/li&gt; &lt;li&gt;Today these are the top 10 IPs:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -45,9 +43,7 @@
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items&lt;/li&gt; &lt;li&gt;Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items&lt;/li&gt;
&lt;li&gt;I created a GitHub issue to track this &lt;a href=&#34;https://github.com/ilri/DSpace/issues/389&#34;&gt;#389&lt;/a&gt;, because I&amp;rsquo;m super busy in Nairobi right now&lt;/li&gt; &lt;li&gt;I created a GitHub issue to track this &lt;a href=&#34;https://github.com/ilri/DSpace/issues/389&#34;&gt;#389&lt;/a&gt;, because I&amp;rsquo;m super busy in Nairobi right now&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -63,9 +59,7 @@
&lt;li&gt;I&amp;rsquo;ll update the DSpace role in our &lt;a href=&#34;https://github.com/ilri/rmg-ansible-public&#34;&gt;Ansible infrastructure playbooks&lt;/a&gt; and run the updated playbooks on CGSpace and DSpace Test&lt;/li&gt; &lt;li&gt;I&amp;rsquo;ll update the DSpace role in our &lt;a href=&#34;https://github.com/ilri/rmg-ansible-public&#34;&gt;Ansible infrastructure playbooks&lt;/a&gt; and run the updated playbooks on CGSpace and DSpace Test&lt;/li&gt;
&lt;li&gt;Also, I&amp;rsquo;ll re-run the &lt;code&gt;postgresql&lt;/code&gt; tasks because the custom PostgreSQL variables are dynamic according to the system&amp;rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month&lt;/li&gt; &lt;li&gt;Also, I&amp;rsquo;ll re-run the &lt;code&gt;postgresql&lt;/code&gt; tasks because the custom PostgreSQL variables are dynamic according to the system&amp;rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month&lt;/li&gt;
&lt;li&gt;I&amp;rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&amp;rsquo;m getting those autowire errors in Tomcat 8.5.30 again:&lt;/li&gt; &lt;li&gt;I&amp;rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&amp;rsquo;m getting those autowire errors in Tomcat 8.5.30 again:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -92,9 +86,7 @@
&lt;li&gt;Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core&lt;/li&gt; &lt;li&gt;Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core&lt;/li&gt;
&lt;li&gt;The server only has 8GB of RAM so we&amp;rsquo;ll eventually need to upgrade to a larger one because we&amp;rsquo;ll start starving the OS, PostgreSQL, and command line batch processes&lt;/li&gt; &lt;li&gt;The server only has 8GB of RAM so we&amp;rsquo;ll eventually need to upgrade to a larger one because we&amp;rsquo;ll start starving the OS, PostgreSQL, and command line batch processes&lt;/li&gt;
&lt;li&gt;I ran all system updates on DSpace Test and rebooted it&lt;/li&gt; &lt;li&gt;I ran all system updates on DSpace Test and rebooted it&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -117,9 +109,7 @@
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;There is insufficient memory for the Java Runtime Environment to continue. &lt;pre&gt;&lt;code&gt;There is insufficient memory for the Java Runtime Environment to continue.
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -153,9 +143,7 @@
real 74m42.646s real 74m42.646s
user 8m5.056s user 8m5.056s
sys 2m7.289s sys 2m7.289s
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -175,9 +163,7 @@ sys 2m7.289s
&lt;/ul&gt;&lt;/li&gt; &lt;/ul&gt;&lt;/li&gt;
&lt;li&gt;Then I reduced the JVM heap size from 6144 back to 5120m&lt;/li&gt; &lt;li&gt;Then I reduced the JVM heap size from 6144 back to 5120m&lt;/li&gt;
&lt;li&gt;Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the &lt;a href=&#34;https://github.com/ilri/rmg-ansible-public&#34;&gt;Ansible infrastructure scripts&lt;/a&gt; to support hosts choosing which distribution they want to use&lt;/li&gt; &lt;li&gt;Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the &lt;a href=&#34;https://github.com/ilri/rmg-ansible-public&#34;&gt;Ansible infrastructure scripts&lt;/a&gt; to support hosts choosing which distribution they want to use&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -191,9 +177,7 @@ sys 2m7.289s
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;I tried to test something on DSpace Test but noticed that it&amp;rsquo;s down since god knows when&lt;/li&gt; &lt;li&gt;I tried to test something on DSpace Test but noticed that it&amp;rsquo;s down since god knows when&lt;/li&gt;
&lt;li&gt;Catalina logs at least show some memory errors yesterday:&lt;/li&gt; &lt;li&gt;Catalina logs at least show some memory errors yesterday:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -206,9 +190,7 @@ sys 2m7.289s
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Export a CSV of the IITA community metadata for Martin Mueller&lt;/li&gt; &lt;li&gt;Export a CSV of the IITA community metadata for Martin Mueller&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -224,9 +206,7 @@ sys 2m7.289s
&lt;li&gt;We don&amp;rsquo;t need to distinguish between internal and external works, so that makes it just a simple list&lt;/li&gt; &lt;li&gt;We don&amp;rsquo;t need to distinguish between internal and external works, so that makes it just a simple list&lt;/li&gt;
&lt;li&gt;Yesterday I figured out how to monitor DSpace sessions using JMX&lt;/li&gt; &lt;li&gt;Yesterday I figured out how to monitor DSpace sessions using JMX&lt;/li&gt;
&lt;li&gt;I copied the logic in the &lt;code&gt;jmx_tomcat_dbpools&lt;/code&gt; provided by Ubuntu&amp;rsquo;s &lt;code&gt;munin-plugins-java&lt;/code&gt; package and used the stuff I discovered about JMX &lt;a href=&#34;https://alanorth.github.io/cgspace-notes/cgspace-notes/2018-01/&#34;&gt;in 2018-01&lt;/a&gt;&lt;/li&gt; &lt;li&gt;I copied the logic in the &lt;code&gt;jmx_tomcat_dbpools&lt;/code&gt; provided by Ubuntu&amp;rsquo;s &lt;code&gt;munin-plugins-java&lt;/code&gt; package and used the stuff I discovered about JMX &lt;a href=&#34;https://alanorth.github.io/cgspace-notes/cgspace-notes/2018-01/&#34;&gt;in 2018-01&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -311,9 +291,7 @@ dspace.log.2018-01-02:34
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&amp;rsquo;s Encrypt if it&amp;rsquo;s just a handful of domains&lt;/li&gt; &lt;li&gt;Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&amp;rsquo;s Encrypt if it&amp;rsquo;s just a handful of domains&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -329,9 +307,7 @@ dspace.log.2018-01-02:34
&lt;li&gt;The logs say &amp;ldquo;Timeout waiting for idle object&amp;rdquo;&lt;/li&gt; &lt;li&gt;The logs say &amp;ldquo;Timeout waiting for idle object&amp;rdquo;&lt;/li&gt;
&lt;li&gt;PostgreSQL activity says there are 115 connections currently&lt;/li&gt; &lt;li&gt;PostgreSQL activity says there are 115 connections currently&lt;/li&gt;
&lt;li&gt;The list of connections to XMLUI and REST API for today:&lt;/li&gt; &lt;li&gt;The list of connections to XMLUI and REST API for today:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -362,9 +338,7 @@ dspace.log.2018-01-02:34
&lt;pre&gt;&lt;code&gt;dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = &#39;contributor&#39; and qualifier = &#39;author&#39;) AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv; &lt;pre&gt;&lt;code&gt;dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = &#39;contributor&#39; and qualifier = &#39;author&#39;) AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
COPY 54701 COPY 54701
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -385,9 +359,7 @@ COPY 54701
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;There appears to be a pattern but I&amp;rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine&lt;/li&gt; &lt;li&gt;There appears to be a pattern but I&amp;rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine&lt;/li&gt;
&lt;li&gt;Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections&lt;/li&gt; &lt;li&gt;Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -406,9 +378,7 @@ COPY 54701
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Ask Sisay to clean up the WLE approvers a bit, as Marianne&amp;rsquo;s user account is both in the approvers step as well as the group&lt;/li&gt; &lt;li&gt;Ask Sisay to clean up the WLE approvers a bit, as Marianne&amp;rsquo;s user account is both in the approvers step as well as the group&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -439,9 +409,7 @@ COPY 54701
&lt;li&gt;This was due to newline characters in the &lt;code&gt;dc.description.abstract&lt;/code&gt; column, which caused OpenRefine to choke when exporting the CSV&lt;/li&gt; &lt;li&gt;This was due to newline characters in the &lt;code&gt;dc.description.abstract&lt;/code&gt; column, which caused OpenRefine to choke when exporting the CSV&lt;/li&gt;
&lt;li&gt;I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using &lt;code&gt;g/^$/d&lt;/code&gt;&lt;/li&gt; &lt;li&gt;I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using &lt;code&gt;g/^$/d&lt;/code&gt;&lt;/li&gt;
&lt;li&gt;Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet&lt;/li&gt; &lt;li&gt;Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -462,9 +430,7 @@ COPY 54701
&lt;li&gt;Merge changes for WLE Phase II theme rename (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/329&#34;&gt;#329&lt;/a&gt;)&lt;/li&gt; &lt;li&gt;Merge changes for WLE Phase II theme rename (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/329&#34;&gt;#329&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Looking at extracting the metadata registries from ICARDA&amp;rsquo;s MEL DSpace database so we can compare fields with CGSpace&lt;/li&gt; &lt;li&gt;Looking at extracting the metadata registries from ICARDA&amp;rsquo;s MEL DSpace database so we can compare fields with CGSpace&lt;/li&gt;
&lt;li&gt;We can use PostgreSQL&amp;rsquo;s extended output format (&lt;code&gt;-x&lt;/code&gt;) plus &lt;code&gt;sed&lt;/code&gt; to format the output into quasi XML:&lt;/li&gt; &lt;li&gt;We can use PostgreSQL&amp;rsquo;s extended output format (&lt;code&gt;-x&lt;/code&gt;) plus &lt;code&gt;sed&lt;/code&gt; to format the output into quasi XML:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -506,9 +472,7 @@ COPY 54701
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &amp;quot;ImageMagick PDF Thumbnail&amp;quot; -v &amp;gt;&amp;amp; /tmp/filter-media-cmyk.txt &lt;pre&gt;&lt;code&gt;$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &amp;quot;ImageMagick PDF Thumbnail&amp;quot; -v &amp;gt;&amp;amp; /tmp/filter-media-cmyk.txt
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -539,9 +503,7 @@ COPY 54701
&lt;pre&gt;&lt;code&gt;$ identify ~/Desktop/alc_contrastes_desafios.jpg &lt;pre&gt;&lt;code&gt;$ identify ~/Desktop/alc_contrastes_desafios.jpg
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000 /Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -570,9 +532,7 @@ DELETE 1
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Create issue on GitHub to track the addition of CCAFS Phase II project tags (&lt;a href=&#34;https://github.com/ilri/DSpace/issues/301&#34;&gt;#301&lt;/a&gt;)&lt;/li&gt; &lt;li&gt;Create issue on GitHub to track the addition of CCAFS Phase II project tags (&lt;a href=&#34;https://github.com/ilri/DSpace/issues/301&#34;&gt;#301&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Looks like we&amp;rsquo;ll be using &lt;code&gt;cg.identifier.ccafsprojectpii&lt;/code&gt; as the field name&lt;/li&gt; &lt;li&gt;Looks like we&amp;rsquo;ll be using &lt;code&gt;cg.identifier.ccafsprojectpii&lt;/code&gt; as the field name&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -587,9 +547,7 @@ DELETE 1
&lt;li&gt;I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error&lt;/li&gt; &lt;li&gt;I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error&lt;/li&gt;
&lt;li&gt;I tested on DSpace Test as well and it doesn&amp;rsquo;t work there either&lt;/li&gt; &lt;li&gt;I tested on DSpace Test as well and it doesn&amp;rsquo;t work there either&lt;/li&gt;
&lt;li&gt;I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&amp;rsquo;m not sure if we&amp;rsquo;ve ever had the sharding task run successfully over all these years&lt;/li&gt; &lt;li&gt;I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&amp;rsquo;m not sure if we&amp;rsquo;ve ever had the sharding task run successfully over all these years&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -616,9 +574,7 @@ DELETE 1
&lt;li&gt;I see thousands of them in the logs for the last few months, so it&amp;rsquo;s not related to the DSpace 5.5 upgrade&lt;/li&gt; &lt;li&gt;I see thousands of them in the logs for the last few months, so it&amp;rsquo;s not related to the DSpace 5.5 upgrade&lt;/li&gt;
&lt;li&gt;I&amp;rsquo;ve raised a ticket with Atmire to ask&lt;/li&gt; &lt;li&gt;I&amp;rsquo;ve raised a ticket with Atmire to ask&lt;/li&gt;
&lt;li&gt;Another worrying error from dspace.log is:&lt;/li&gt; &lt;li&gt;Another worrying error from dspace.log is:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -633,9 +589,7 @@ DELETE 1
&lt;li&gt;Add &lt;code&gt;dc.type&lt;/code&gt; to the output options for Atmire&amp;rsquo;s Listings and Reports module (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/286&#34;&gt;#286&lt;/a&gt;)&lt;/li&gt; &lt;li&gt;Add &lt;code&gt;dc.type&lt;/code&gt; to the output options for Atmire&amp;rsquo;s Listings and Reports module (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/286&#34;&gt;#286&lt;/a&gt;)&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;
&lt;p&gt;&lt;img src=&#34;https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png&#34; alt=&#34;Listings and Reports with output type&#34; /&gt;&lt;/p&gt; &lt;p&gt;&lt;img src=&#34;https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png&#34; alt=&#34;Listings and Reports with output type&#34; /&gt;&lt;/p&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -658,9 +612,7 @@ DELETE 1
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X &lt;pre&gt;&lt;code&gt;0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -679,9 +631,7 @@ DELETE 1
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &amp;quot;dc=cgiarad,dc=org&amp;quot; -D &amp;quot;admigration1@cgiarad.org&amp;quot; -W &amp;quot;(sAMAccountName=admigration1)&amp;quot; &lt;pre&gt;&lt;code&gt;$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &amp;quot;dc=cgiarad,dc=org&amp;quot; -D &amp;quot;admigration1@cgiarad.org&amp;quot; -W &amp;quot;(sAMAccountName=admigration1)&amp;quot;
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -704,9 +654,7 @@ DELETE 1
&lt;pre&gt;&lt;code&gt;$ git checkout -b 55new 5_x-prod &lt;pre&gt;&lt;code&gt;$ git checkout -b 55new 5_x-prod
$ git reset --hard ilri/5_x-prod $ git reset --hard ilri/5_x-prod
$ git rebase -i dspace-5.5 $ git rebase -i dspace-5.5
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -732,9 +680,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;In this case the select query was showing 95 results before the update&lt;/li&gt; &lt;li&gt;In this case the select query was showing 95 results before the update&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -752,9 +698,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;li&gt;This is their publications set: &lt;a href=&#34;http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;amp;from=2016-01-01&amp;amp;set=p15738coll2&amp;amp;metadataPrefix=oai_dc&#34;&gt;http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;amp;from=2016-01-01&amp;amp;set=p15738coll2&amp;amp;metadataPrefix=oai_dc&lt;/a&gt;&lt;/li&gt; &lt;li&gt;This is their publications set: &lt;a href=&#34;http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;amp;from=2016-01-01&amp;amp;set=p15738coll2&amp;amp;metadataPrefix=oai_dc&#34;&gt;http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&amp;amp;from=2016-01-01&amp;amp;set=p15738coll2&amp;amp;metadataPrefix=oai_dc&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;You can see the others by using the OAI &lt;code&gt;ListSets&lt;/code&gt; verb: &lt;a href=&#34;http://ebrary.ifpri.org/oai/oai.php?verb=ListSets&#34;&gt;http://ebrary.ifpri.org/oai/oai.php?verb=ListSets&lt;/a&gt;&lt;/li&gt; &lt;li&gt;You can see the others by using the OAI &lt;code&gt;ListSets&lt;/code&gt; verb: &lt;a href=&#34;http://ebrary.ifpri.org/oai/oai.php?verb=ListSets&#34;&gt;http://ebrary.ifpri.org/oai/oai.php?verb=ListSets&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in &lt;code&gt;dc.identifier.fund&lt;/code&gt; to &lt;code&gt;cg.identifier.cpwfproject&lt;/code&gt; and then the rest to &lt;code&gt;dc.description.sponsorship&lt;/code&gt;&lt;/li&gt; &lt;li&gt;Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in &lt;code&gt;dc.identifier.fund&lt;/code&gt; to &lt;code&gt;cg.identifier.cpwfproject&lt;/code&gt; and then the rest to &lt;code&gt;dc.description.sponsorship&lt;/code&gt;&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -773,9 +717,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;pre&gt;&lt;code&gt;# awk &#39;{print $1}&#39; /var/log/nginx/rest.log | uniq | wc -l &lt;pre&gt;&lt;code&gt;# awk &#39;{print $1}&#39; /var/log/nginx/rest.log | uniq | wc -l
3168 3168
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -792,9 +734,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;li&gt;After running DSpace for over five years I&amp;rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year!&lt;/li&gt; &lt;li&gt;After running DSpace for over five years I&amp;rsquo;ve never needed to look in any other log file than dspace.log, leave alone one from last year!&lt;/li&gt;
&lt;li&gt;This will save us a few gigs of backup space we&amp;rsquo;re paying for on S3&lt;/li&gt; &lt;li&gt;This will save us a few gigs of backup space we&amp;rsquo;re paying for on S3&lt;/li&gt;
&lt;li&gt;Also, I noticed the &lt;code&gt;checker&lt;/code&gt; log has some errors we should pay attention to:&lt;/li&gt; &lt;li&gt;Also, I noticed the &lt;code&gt;checker&lt;/code&gt; log has some errors we should pay attention to:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -809,9 +749,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;li&gt;Looking at issues with author authorities on CGSpace&lt;/li&gt; &lt;li&gt;Looking at issues with author authorities on CGSpace&lt;/li&gt;
&lt;li&gt;For some reason we still have the &lt;code&gt;index-lucene-update&lt;/code&gt; cron job active on CGSpace, but I&amp;rsquo;m pretty sure we don&amp;rsquo;t need it as of the latest few versions of Atmire&amp;rsquo;s Listings and Reports module&lt;/li&gt; &lt;li&gt;For some reason we still have the &lt;code&gt;index-lucene-update&lt;/code&gt; cron job active on CGSpace, but I&amp;rsquo;m pretty sure we don&amp;rsquo;t need it as of the latest few versions of Atmire&amp;rsquo;s Listings and Reports module&lt;/li&gt;
&lt;li&gt;Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server&lt;/li&gt; &lt;li&gt;Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -833,9 +771,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Not only are there 49,000 countries, we have some blanks (25)&amp;hellip;&lt;/li&gt; &lt;li&gt;Not only are there 49,000 countries, we have some blanks (25)&amp;hellip;&lt;/li&gt;
&lt;li&gt;Also, lots of things like &amp;ldquo;COTE D`LVOIRE&amp;rdquo; and &amp;ldquo;COTE D IVOIRE&amp;rdquo;&lt;/li&gt; &lt;li&gt;Also, lots of things like &amp;ldquo;COTE D`LVOIRE&amp;rdquo; and &amp;ldquo;COTE D IVOIRE&amp;rdquo;&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -850,9 +786,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;li&gt;Move ILRI collection &lt;code&gt;10568/12503&lt;/code&gt; from &lt;code&gt;10568/27869&lt;/code&gt; to &lt;code&gt;10568/27629&lt;/code&gt; using the &lt;a href=&#34;https://gist.github.com/alanorth/392c4660e8b022d99dfa&#34;&gt;move_collections.sh&lt;/a&gt; script I wrote last year.&lt;/li&gt; &lt;li&gt;Move ILRI collection &lt;code&gt;10568/12503&lt;/code&gt; from &lt;code&gt;10568/27869&lt;/code&gt; to &lt;code&gt;10568/27629&lt;/code&gt; using the &lt;a href=&#34;https://gist.github.com/alanorth/392c4660e8b022d99dfa&#34;&gt;move_collections.sh&lt;/a&gt; script I wrote last year.&lt;/li&gt;
&lt;li&gt;I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.&lt;/li&gt; &lt;li&gt;I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.&lt;/li&gt;
&lt;li&gt;Update GitHub wiki for documentation of &lt;a href=&#34;https://github.com/ilri/DSpace/wiki/Maintenance-Tasks&#34;&gt;maintenance tasks&lt;/a&gt;.&lt;/li&gt; &lt;li&gt;Update GitHub wiki for documentation of &lt;a href=&#34;https://github.com/ilri/DSpace/wiki/Maintenance-Tasks&#34;&gt;maintenance tasks&lt;/a&gt;.&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -872,9 +806,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
-rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18 -rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo -rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz -rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
<item> <item>
@ -893,9 +825,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
&lt;pre&gt;&lt;code&gt;$ psql -c &#39;SELECT * from pg_stat_activity;&#39; | grep idle | grep -c cgspace &lt;pre&gt;&lt;code&gt;$ psql -c &#39;SELECT * from pg_stat_activity;&#39; | grep idle | grep -c cgspace
78 78
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;</description>
&lt;p&gt;&lt;/p&gt;</description>
</item> </item>
</channel> </channel>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Notes"/> <meta name="twitter:title" content="Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -160,8 +160,6 @@ dspace.log.2018-01-02:34
<ul> <ul>
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li> <li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
</article> </article>
@ -187,8 +185,6 @@ dspace.log.2018-01-02:34
<li>PostgreSQL activity says there are 115 connections currently</li> <li>PostgreSQL activity says there are 115 connections currently</li>
<li>The list of connections to XMLUI and REST API for today:</li> <li>The list of connections to XMLUI and REST API for today:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a>
</article> </article>
@ -229,8 +225,6 @@ dspace.log.2018-01-02:34
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv; <pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
COPY 54701 COPY 54701
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
</article> </article>
@ -261,8 +255,6 @@ COPY 54701
<li>There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li> <li>There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li>
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li> <li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a>
</article> </article>
@ -291,8 +283,6 @@ COPY 54701
<ul> <ul>
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li> <li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a>
</article> </article>
@ -333,8 +323,6 @@ COPY 54701
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li> <li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li> <li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a>
</article> </article>
@ -365,8 +353,6 @@ COPY 54701
<li>Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace</li> <li>Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace</li>
<li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li> <li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a>
</article> </article>
@ -436,8 +422,6 @@ COPY 54701
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt <pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Notes"/> <meta name="twitter:title" content="Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -106,8 +106,6 @@
<pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg <pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000 /Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a>
</article> </article>
@ -146,8 +144,6 @@ DELETE 1
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li> <li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
<li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li> <li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a>
</article> </article>
@ -172,8 +168,6 @@ DELETE 1
<li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li> <li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li>
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li> <li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
</article> </article>
@ -210,8 +204,6 @@ DELETE 1
<li>I&rsquo;ve raised a ticket with Atmire to ask</li> <li>I&rsquo;ve raised a ticket with Atmire to ask</li>
<li>Another worrying error from dspace.log is:</li> <li>Another worrying error from dspace.log is:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a>
</article> </article>
@ -236,8 +228,6 @@ DELETE 1
</ul> </ul>
<p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p> <p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a>
</article> </article>
@ -270,8 +260,6 @@ DELETE 1
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X <pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a>
</article> </article>
@ -300,8 +288,6 @@ DELETE 1
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot; <pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot;
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a>
</article> </article>
@ -334,8 +320,6 @@ DELETE 1
$ git reset --hard ilri/5_x-prod $ git reset --hard ilri/5_x-prod
$ git rebase -i dspace-5.5 $ git rebase -i dspace-5.5
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a>
</article> </article>
@ -371,8 +355,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
<ul> <ul>
<li>In this case the select query was showing 95 results before the update</li> <li>In this case the select query was showing 95 results before the update</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a>
</article> </article>
@ -400,8 +382,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li> <li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li> <li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Notes"/> <meta name="twitter:title" content="Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -94,8 +94,6 @@
<pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l <pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
3168 3168
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a>
</article> </article>
@ -122,8 +120,6 @@
<li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li> <li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li>
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li> <li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a>
</article> </article>
@ -148,8 +144,6 @@
<li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module</li> <li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module</li>
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li> <li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a>
</article> </article>
@ -181,8 +175,6 @@
<li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li> <li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li>
<li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li> <li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a>
</article> </article>
@ -207,8 +199,6 @@
<li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li> <li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li>
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li> <li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a>
</article> </article>
@ -238,8 +228,6 @@
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo -rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz -rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a>
</article> </article>
@ -268,8 +256,6 @@
<pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace <pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
78 78
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Tags"/> <meta name="twitter:title" content="Tags"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -175,8 +175,6 @@ dspace.log.2018-01-02:34
<ul> <ul>
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li> <li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
</article> </article>
@ -202,8 +200,6 @@ dspace.log.2018-01-02:34
<li>PostgreSQL activity says there are 115 connections currently</li> <li>PostgreSQL activity says there are 115 connections currently</li>
<li>The list of connections to XMLUI and REST API for today:</li> <li>The list of connections to XMLUI and REST API for today:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a>
</article> </article>
@ -244,8 +240,6 @@ dspace.log.2018-01-02:34
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv; <pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
COPY 54701 COPY 54701
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
</article> </article>
@ -276,8 +270,6 @@ COPY 54701
<li>There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li> <li>There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</li>
<li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li> <li>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a>
</article> </article>
@ -296,8 +288,6 @@ COPY 54701
</p> </p>
</header> </header>
<p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p> <p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a>
</article> </article>
@ -326,8 +316,6 @@ COPY 54701
<ul> <ul>
<li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li> <li>Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account is both in the approvers step as well as the group</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-09/'>Read more →</a>
</article> </article>
@ -368,8 +356,6 @@ COPY 54701
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li> <li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li> <li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a>
</article> </article>
@ -400,8 +386,6 @@ COPY 54701
<li>Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace</li> <li>Looking at extracting the metadata registries from ICARDA&rsquo;s MEL DSpace database so we can compare fields with CGSpace</li>
<li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li> <li>We can use PostgreSQL&rsquo;s extended output format (<code>-x</code>) plus <code>sed</code> to format the output into quasi XML:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-07/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Tags"/> <meta name="twitter:title" content="Tags"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -114,8 +114,6 @@
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt <pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Thumbnail&quot; -v &gt;&amp; /tmp/filter-media-cmyk.txt
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
</article> </article>
@ -156,8 +154,6 @@
<pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg <pre><code>$ identify ~/Desktop/alc_contrastes_desafios.jpg
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000 /Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-03/'>Read more →</a>
</article> </article>
@ -196,8 +192,6 @@ DELETE 1
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li> <li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
<li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li> <li>Looks like we&rsquo;ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a>
</article> </article>
@ -222,8 +216,6 @@ DELETE 1
<li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li> <li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li>
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li> <li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
</article> </article>
@ -260,8 +252,6 @@ DELETE 1
<li>I&rsquo;ve raised a ticket with Atmire to ask</li> <li>I&rsquo;ve raised a ticket with Atmire to ask</li>
<li>Another worrying error from dspace.log is:</li> <li>Another worrying error from dspace.log is:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-12/'>Read more →</a>
</article> </article>
@ -286,8 +276,6 @@ DELETE 1
</ul> </ul>
<p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p> <p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-11/'>Read more →</a>
</article> </article>
@ -320,8 +308,6 @@ DELETE 1
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X <pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a>
</article> </article>
@ -350,8 +336,6 @@ DELETE 1
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot; <pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot;
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-09/'>Read more →</a>
</article> </article>
@ -384,8 +368,6 @@ DELETE 1
$ git reset --hard ilri/5_x-prod $ git reset --hard ilri/5_x-prod
$ git rebase -i dspace-5.5 $ git rebase -i dspace-5.5
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-08/'>Read more →</a>
</article> </article>
@ -421,8 +403,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
<ul> <ul>
<li>In this case the select query was showing 95 results before the update</li> <li>In this case the select query was showing 95 results before the update</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-07/'>Read more →</a>
</article> </article>

View File

@ -14,7 +14,7 @@
<meta name="twitter:card" content="summary"/> <meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Tags"/> <meta name="twitter:title" content="Tags"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.50" /> <meta name="generator" content="Hugo 0.51" />
@ -108,8 +108,6 @@
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li> <li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li> <li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
</article> </article>
@ -138,8 +136,6 @@
<pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l <pre><code># awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
3168 3168
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-05/'>Read more →</a>
</article> </article>
@ -166,8 +162,6 @@
<li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li> <li>This will save us a few gigs of backup space we&rsquo;re paying for on S3</li>
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li> <li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a>
</article> </article>
@ -192,8 +186,6 @@
<li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module</li> <li>For some reason we still have the <code>index-lucene-update</code> cron job active on CGSpace, but I&rsquo;m pretty sure we don&rsquo;t need it as of the latest few versions of Atmire&rsquo;s Listings and Reports module</li>
<li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li> <li>Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-03/'>Read more →</a>
</article> </article>
@ -225,8 +217,6 @@
<li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li> <li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li>
<li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li> <li>Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&rdquo;</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-02/'>Read more →</a>
</article> </article>
@ -251,8 +241,6 @@
<li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li> <li>I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.</li>
<li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li> <li>Update GitHub wiki for documentation of <a href="https://github.com/ilri/DSpace/wiki/Maintenance-Tasks">maintenance tasks</a>.</li>
</ul> </ul>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2016-01/'>Read more →</a>
</article> </article>
@ -282,8 +270,6 @@
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo -rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz -rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a>
</article> </article>
@ -312,8 +298,6 @@
<pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace <pre><code>$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
78 78
</code></pre> </code></pre>
<p></p>
<a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a> <a href='https://alanorth.github.io/cgspace-notes/2015-11/'>Read more →</a>
</article> </article>