mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2025-01-27 05:49:12 +01:00
Add notes for 2021-09-13
This commit is contained in:
@ -24,7 +24,7 @@ Export a CSV of the IITA community metadata for Martin Mueller
|
||||
|
||||
Export a CSV of the IITA community metadata for Martin Mueller
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.87.0" />
|
||||
<meta name="generator" content="Hugo 0.88.1" />
|
||||
|
||||
|
||||
|
||||
@ -122,7 +122,7 @@ Export a CSV of the IITA community metadata for Martin Mueller
|
||||
<li>There were some records using a non-breaking space in their AGROVOC subject field</li>
|
||||
<li>I checked and tested some author corrections from Peter from last week, and then applied them on CGSpace</li>
|
||||
</ul>
|
||||
<pre><code>$ ./fix-metadata-values.py -i Correct-309-authors-2018-03-06.csv -db dspace -u dspace -p 'fuuu' -f dc.contributor.author -t correct -m 3
|
||||
<pre tabindex="0"><code>$ ./fix-metadata-values.py -i Correct-309-authors-2018-03-06.csv -db dspace -u dspace -p 'fuuu' -f dc.contributor.author -t correct -m 3
|
||||
$ ./delete-metadata-values.py -i Delete-3-Authors-2018-03-06.csv -db dspace -u dspace-p 'fuuu' -f dc.contributor.author -m 3
|
||||
</code></pre><ul>
|
||||
<li>This time there were no errors in whitespace but I did have to correct one incorrectly encoded accent character</li>
|
||||
@ -132,16 +132,16 @@ $ ./delete-metadata-values.py -i Delete-3-Authors-2018-03-06.csv -db dspace -u d
|
||||
<li>Run all system updates on DSpace Test and reboot server</li>
|
||||
<li>I ran the <a href="https://gist.github.com/alanorth/24d8081a5dc25e2a4e27e548e7e2389c">orcid-authority-to-item.py</a> script on CGSpace and mapped 2,864 ORCID identifiers from Solr to item metadata</li>
|
||||
</ul>
|
||||
<pre><code>$ ./orcid-authority-to-item.py -db dspace -u dspace -p 'fuuu' -s http://localhost:8081/solr -d
|
||||
<pre tabindex="0"><code>$ ./orcid-authority-to-item.py -db dspace -u dspace -p 'fuuu' -s http://localhost:8081/solr -d
|
||||
</code></pre><ul>
|
||||
<li>I ran the DSpace cleanup script on CGSpace and it threw an error (as always):</li>
|
||||
</ul>
|
||||
<pre><code>Error: ERROR: update or delete on table "bitstream" violates foreign key constraint "bundle_primary_bitstream_id_fkey" on table "bundle"
|
||||
<pre tabindex="0"><code>Error: ERROR: update or delete on table "bitstream" violates foreign key constraint "bundle_primary_bitstream_id_fkey" on table "bundle"
|
||||
Detail: Key (bitstream_id)=(150659) is still referenced from table "bundle".
|
||||
</code></pre><ul>
|
||||
<li>The solution is, as always:</li>
|
||||
</ul>
|
||||
<pre><code>$ psql dspace -c 'update bundle set primary_bitstream_id=NULL where primary_bitstream_id in (150659);'
|
||||
<pre tabindex="0"><code>$ psql dspace -c 'update bundle set primary_bitstream_id=NULL where primary_bitstream_id in (150659);'
|
||||
UPDATE 1
|
||||
</code></pre><ul>
|
||||
<li>Apply the proposed PostgreSQL indexes from DS-3636 (pull request <a href="https://github.com/DSpace/DSpace/pull/1791/">#1791</a> on CGSpace (linode18)</li>
|
||||
@ -159,7 +159,7 @@ UPDATE 1
|
||||
<li>This makes the CSV have tons of columns, for example <code>dc.title</code>, <code>dc.title[]</code>, <code>dc.title[en]</code>, <code>dc.title[eng]</code>, <code>dc.title[en_US]</code> and so on!</li>
|
||||
<li>I think I can fix — or at least normalize — them in the database:</li>
|
||||
</ul>
|
||||
<pre><code>dspace=# select distinct text_lang from metadatavalue where resource_type_id=2;
|
||||
<pre tabindex="0"><code>dspace=# select distinct text_lang from metadatavalue where resource_type_id=2;
|
||||
text_lang
|
||||
-----------
|
||||
|
||||
@ -199,7 +199,7 @@ dspacetest=# select distinct text_lang from metadatavalue where resource_type_id
|
||||
<li>On second inspection it looks like <code>dc.description.provenance</code> fields use the text_lang “en” so that’s probably why there are over 100,000 fields changed…</li>
|
||||
<li>If I skip that, there are about 2,000, which seems more reasonably like the amount of fields users have edited manually, or fucked up during CSV import, etc:</li>
|
||||
</ul>
|
||||
<pre><code>dspace=# update metadatavalue set text_lang='en_US' where resource_type_id=2 and text_lang in ('EN','En','en_','EN_US','en_U','eng');
|
||||
<pre tabindex="0"><code>dspace=# update metadatavalue set text_lang='en_US' where resource_type_id=2 and text_lang in ('EN','En','en_','EN_US','en_U','eng');
|
||||
UPDATE 2309
|
||||
</code></pre><ul>
|
||||
<li>I will apply this on CGSpace right now</li>
|
||||
@ -207,18 +207,18 @@ UPDATE 2309
|
||||
<li>Using a series of filters, flags, and GREL expressions to isolate items for a certain author, I figured out how to add ORCID identifiers to the <code>cg.creator.id</code> field</li>
|
||||
<li>For example, a GREL expression in a custom text facet to get all items with <code>dc.contributor.author[en_US]</code> of a certain author with several name variations (this is how you use a logical OR in OpenRefine):</li>
|
||||
</ul>
|
||||
<pre><code>or(value.contains('Ceballos, Hern'), value.contains('Hernández Ceballos'))
|
||||
<pre tabindex="0"><code>or(value.contains('Ceballos, Hern'), value.contains('Hernández Ceballos'))
|
||||
</code></pre><ul>
|
||||
<li>Then you can flag or star matching items and then use a conditional to either set the value directly or add it to an existing value:</li>
|
||||
</ul>
|
||||
<pre><code>if(isBlank(value), "Hernan Ceballos: 0000-0002-8744-7918", value + "||Hernan Ceballos: 0000-0002-8744-7918")
|
||||
<pre tabindex="0"><code>if(isBlank(value), "Hernan Ceballos: 0000-0002-8744-7918", value + "||Hernan Ceballos: 0000-0002-8744-7918")
|
||||
</code></pre><ul>
|
||||
<li>One thing that bothers me is that this won’t honor author order</li>
|
||||
<li>It might be better to do batches of these in PostgreSQL with a script that takes the <code>place</code> column of an author into account when setting the <code>cg.creator.id</code></li>
|
||||
<li>I wrote a Python script to read the author names and ORCID identifiers from CSV and create matching <code>cg.creator.id</code> fields: <a href="https://gist.github.com/alanorth/a49d85cd9c5dea89cddbe809813a7050">add-orcid-identifiers-csv.py </a></li>
|
||||
<li>The CSV should have two columns: author name and ORCID identifier:</li>
|
||||
</ul>
|
||||
<pre><code>dc.contributor.author,cg.creator.id
|
||||
<pre tabindex="0"><code>dc.contributor.author,cg.creator.id
|
||||
"Orth, Alan",Alan S. Orth: 0000-0002-1735-7458
|
||||
"Orth, A.",Alan S. Orth: 0000-0002-1735-7458
|
||||
</code></pre><ul>
|
||||
@ -236,7 +236,7 @@ UPDATE 2309
|
||||
<li>Peter also wrote to say he is having issues with the Atmire Listings and Reports module</li>
|
||||
<li>When I logged in to try it I get a blank white page after continuing and I see this in dspace.log.2018-03-11:</li>
|
||||
</ul>
|
||||
<pre><code>2018-03-11 11:38:15,592 WARN org.dspace.app.webui.servlet.InternalErrorServlet @ :session_id=91C2C0C59669B33A7683570F6010603A:internal_error:-- URL Was: https://cgspace.cgiar.or
|
||||
<pre tabindex="0"><code>2018-03-11 11:38:15,592 WARN org.dspace.app.webui.servlet.InternalErrorServlet @ :session_id=91C2C0C59669B33A7683570F6010603A:internal_error:-- URL Was: https://cgspace.cgiar.or
|
||||
g/jspui/listings-and-reports
|
||||
-- Method: POST
|
||||
-- Parameters were:
|
||||
@ -282,7 +282,7 @@ org.apache.jasper.JasperException: java.lang.NullPointerException
|
||||
<ul>
|
||||
<li>The error in the DSpace log is:</li>
|
||||
</ul>
|
||||
<pre><code>org.apache.jasper.JasperException: java.lang.ArrayIndexOutOfBoundsException: -1
|
||||
<pre tabindex="0"><code>org.apache.jasper.JasperException: java.lang.ArrayIndexOutOfBoundsException: -1
|
||||
</code></pre><ul>
|
||||
<li>The full error is here: <a href="https://gist.github.com/alanorth/ea47c092725960e39610db9b0c13f6ca">https://gist.github.com/alanorth/ea47c092725960e39610db9b0c13f6ca</a></li>
|
||||
<li>If I do a report for “Orth, Alan” with the same custom layout it works!</li>
|
||||
@ -295,16 +295,16 @@ org.apache.jasper.JasperException: java.lang.NullPointerException
|
||||
<li>I have removed the old server (linode02 aka linode578611) in favor of linode19 aka linode6624164</li>
|
||||
<li>Looking at the CRP subjects on CGSpace I see there is one blank one so I’ll just fix it:</li>
|
||||
</ul>
|
||||
<pre><code>dspace=# delete from metadatavalue where resource_type_id=2 and metadata_field_id=230 and text_value='';
|
||||
<pre tabindex="0"><code>dspace=# delete from metadatavalue where resource_type_id=2 and metadata_field_id=230 and text_value='';
|
||||
</code></pre><ul>
|
||||
<li>Copy all CRP subjects to a CSV to do the mass updates:</li>
|
||||
</ul>
|
||||
<pre><code>dspace=# \copy (select distinct text_value, count(*) from metadatavalue where resource_type_id=2 and metadata_field_id=230 group by text_value order by count desc) to /tmp/crps.csv with csv header;
|
||||
<pre tabindex="0"><code>dspace=# \copy (select distinct text_value, count(*) from metadatavalue where resource_type_id=2 and metadata_field_id=230 group by text_value order by count desc) to /tmp/crps.csv with csv header;
|
||||
COPY 21
|
||||
</code></pre><ul>
|
||||
<li>Once I prepare the new input forms (<a href="https://github.com/ilri/DSpace/issues/362">#362</a>) I will need to do the batch corrections:</li>
|
||||
</ul>
|
||||
<pre><code>$ ./fix-metadata-values.py -i Correct-21-CRPs-2018-03-16.csv -db dspace -u dspace -p 'fuuu' -f cg.contributor.crp -t correct -m 230 -n -d
|
||||
<pre tabindex="0"><code>$ ./fix-metadata-values.py -i Correct-21-CRPs-2018-03-16.csv -db dspace -u dspace -p 'fuuu' -f cg.contributor.crp -t correct -m 230 -n -d
|
||||
</code></pre><ul>
|
||||
<li>Create a pull request to update the input forms for the new CRP subject style (<a href="https://github.com/ilri/DSpace/pull/366">#366</a>)</li>
|
||||
</ul>
|
||||
@ -316,13 +316,13 @@ COPY 21
|
||||
<li>CGSpace crashed this morning for about seven minutes and Dani restarted Tomcat</li>
|
||||
<li>Around that time there were an increase of SQL errors:</li>
|
||||
</ul>
|
||||
<pre><code>2018-03-19 09:10:54,856 ERROR org.dspace.storage.rdbms.DatabaseManager @ SQL QueryTable Error -
|
||||
<pre tabindex="0"><code>2018-03-19 09:10:54,856 ERROR org.dspace.storage.rdbms.DatabaseManager @ SQL QueryTable Error -
|
||||
...
|
||||
2018-03-19 09:10:54,862 ERROR org.dspace.storage.rdbms.DatabaseManager @ SQL query singleTable Error -
|
||||
</code></pre><ul>
|
||||
<li>But these errors, I don’t even know what they mean, because a handful of them happen every day:</li>
|
||||
</ul>
|
||||
<pre><code>$ grep -c 'ERROR org.dspace.storage.rdbms.DatabaseManager' dspace.log.2018-03-1*
|
||||
<pre tabindex="0"><code>$ grep -c 'ERROR org.dspace.storage.rdbms.DatabaseManager' dspace.log.2018-03-1*
|
||||
dspace.log.2018-03-10:13
|
||||
dspace.log.2018-03-11:15
|
||||
dspace.log.2018-03-12:13
|
||||
@ -336,7 +336,7 @@ dspace.log.2018-03-19:90
|
||||
</code></pre><ul>
|
||||
<li>There wasn’t even a lot of traffic at the time (8–9 AM):</li>
|
||||
</ul>
|
||||
<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "19/Mar/2018:0[89]:" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
<pre tabindex="0"><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "19/Mar/2018:0[89]:" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
92 40.77.167.197
|
||||
92 83.103.94.48
|
||||
96 40.77.167.175
|
||||
@ -350,7 +350,7 @@ dspace.log.2018-03-19:90
|
||||
</code></pre><ul>
|
||||
<li>Well there is a hint in Tomcat’s <code>catalina.out</code>:</li>
|
||||
</ul>
|
||||
<pre><code>Mon Mar 19 09:05:28 UTC 2018 | Query:id: 92032 AND type:2
|
||||
<pre tabindex="0"><code>Mon Mar 19 09:05:28 UTC 2018 | Query:id: 92032 AND type:2
|
||||
Exception in thread "http-bio-127.0.0.1-8081-exec-280" java.lang.OutOfMemoryError: Java heap space
|
||||
</code></pre><ul>
|
||||
<li>So someone was doing something heavy somehow… my guess is content and usage stats!</li>
|
||||
@ -367,7 +367,7 @@ Exception in thread "http-bio-127.0.0.1-8081-exec-280" java.lang.OutOf
|
||||
<ul>
|
||||
<li>DSpace Test has been down for a few hours with SQL and memory errors starting this morning:</li>
|
||||
</ul>
|
||||
<pre><code>2018-03-20 08:47:10,177 ERROR org.dspace.storage.rdbms.DatabaseManager @ SQL QueryTable Error -
|
||||
<pre tabindex="0"><code>2018-03-20 08:47:10,177 ERROR org.dspace.storage.rdbms.DatabaseManager @ SQL QueryTable Error -
|
||||
...
|
||||
2018-03-20 08:53:11,624 ERROR org.dspace.app.xmlui.cocoon.DSpaceCocoonServletFilter @ Serious Error Occurred Processing Request!
|
||||
org.springframework.web.util.NestedServletException: Handler processing failed; nested exception is java.lang.OutOfMemoryError: Java heap space
|
||||
@ -377,20 +377,20 @@ org.springframework.web.util.NestedServletException: Handler processing failed;
|
||||
<li>Abenet told me that one of Lance Robinson’s ORCID iDs on CGSpace is incorrect</li>
|
||||
<li>I will remove it from the controlled vocabulary (<a href="https://github.com/ilri/DSpace/pull/367">#367</a>) and update any items using the old one:</li>
|
||||
</ul>
|
||||
<pre><code>dspace=# update metadatavalue set text_value='Lance W. Robinson: 0000-0002-5224-8644' where resource_type_id=2 and metadata_field_id=240 and text_value like '%0000-0002-6344-195X%';
|
||||
<pre tabindex="0"><code>dspace=# update metadatavalue set text_value='Lance W. Robinson: 0000-0002-5224-8644' where resource_type_id=2 and metadata_field_id=240 and text_value like '%0000-0002-6344-195X%';
|
||||
UPDATE 1
|
||||
</code></pre><ul>
|
||||
<li>Communicate with DSpace editors on Yammer about being more careful about spaces and character editing when doing manual metadata edits</li>
|
||||
<li>Merge the changes to CRP names to the <code>5_x-prod</code> branch and deploy on CGSpace (<a href="https://github.com/ilri/DSpace/pull/363">#363</a>)</li>
|
||||
<li>Run corrections for CRP names in the database:</li>
|
||||
</ul>
|
||||
<pre><code>$ ./fix-metadata-values.py -i /tmp/Correct-21-CRPs-2018-03-16.csv -f cg.contributor.crp -t correct -m 230 -db dspace -u dspace -p 'fuuu'
|
||||
<pre tabindex="0"><code>$ ./fix-metadata-values.py -i /tmp/Correct-21-CRPs-2018-03-16.csv -f cg.contributor.crp -t correct -m 230 -db dspace -u dspace -p 'fuuu'
|
||||
</code></pre><ul>
|
||||
<li>Run all system updates on CGSpace (linode18) and reboot the server</li>
|
||||
<li>I started a full Discovery re-index on CGSpace because of the updated CRPs</li>
|
||||
<li>I see this error in the DSpace log:</li>
|
||||
</ul>
|
||||
<pre><code>2018-03-20 19:03:14,844 ERROR com.atmire.dspace.discovery.AtmireSolrService @ No choices plugin was configured for field "dc_contributor_author".
|
||||
<pre tabindex="0"><code>2018-03-20 19:03:14,844 ERROR com.atmire.dspace.discovery.AtmireSolrService @ No choices plugin was configured for field "dc_contributor_author".
|
||||
java.lang.IllegalArgumentException: No choices plugin was configured for field "dc_contributor_author".
|
||||
at org.dspace.content.authority.ChoiceAuthorityManager.getLabel(ChoiceAuthorityManager.java:261)
|
||||
at org.dspace.content.authority.ChoiceAuthorityManager.getLabel(ChoiceAuthorityManager.java:249)
|
||||
@ -427,28 +427,28 @@ java.lang.IllegalArgumentException: No choices plugin was configured for field
|
||||
<li>Afterwards we’ll want to do some batch tagging of ORCID identifiers to these names</li>
|
||||
<li>CGSpace crashed again this afternoon, I’m not sure of the cause but there are a lot of SQL errors in the DSpace log:</li>
|
||||
</ul>
|
||||
<pre><code>2018-03-21 15:11:08,166 ERROR org.dspace.storage.rdbms.DatabaseManager @ SQL QueryTable Error -
|
||||
<pre tabindex="0"><code>2018-03-21 15:11:08,166 ERROR org.dspace.storage.rdbms.DatabaseManager @ SQL QueryTable Error -
|
||||
java.sql.SQLException: Connection has already been closed.
|
||||
</code></pre><ul>
|
||||
<li>I have no idea why so many connections were abandoned this afternoon:</li>
|
||||
</ul>
|
||||
<pre><code># grep 'Mar 21, 2018' /var/log/tomcat7/catalina.out | grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon'
|
||||
<pre tabindex="0"><code># grep 'Mar 21, 2018' /var/log/tomcat7/catalina.out | grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon'
|
||||
268
|
||||
</code></pre><ul>
|
||||
<li>DSpace Test crashed again due to Java heap space, this is from the DSpace log:</li>
|
||||
</ul>
|
||||
<pre><code>2018-03-21 15:18:48,149 ERROR org.dspace.app.xmlui.cocoon.DSpaceCocoonServletFilter @ Serious Error Occurred Processing Request!
|
||||
<pre tabindex="0"><code>2018-03-21 15:18:48,149 ERROR org.dspace.app.xmlui.cocoon.DSpaceCocoonServletFilter @ Serious Error Occurred Processing Request!
|
||||
org.springframework.web.util.NestedServletException: Handler processing failed; nested exception is java.lang.OutOfMemoryError: Java heap space
|
||||
</code></pre><ul>
|
||||
<li>And this is from the Tomcat Catalina log:</li>
|
||||
</ul>
|
||||
<pre><code>Mar 21, 2018 11:20:00 AM org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor run
|
||||
<pre tabindex="0"><code>Mar 21, 2018 11:20:00 AM org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor run
|
||||
SEVERE: Unexpected death of background thread ContainerBackgroundProcessor[StandardEngine[Catalina]]
|
||||
java.lang.OutOfMemoryError: Java heap space
|
||||
</code></pre><ul>
|
||||
<li>But there are tons of heap space errors on DSpace Test actually:</li>
|
||||
</ul>
|
||||
<pre><code># grep -c 'java.lang.OutOfMemoryError: Java heap space' /var/log/tomcat7/catalina.out
|
||||
<pre tabindex="0"><code># grep -c 'java.lang.OutOfMemoryError: Java heap space' /var/log/tomcat7/catalina.out
|
||||
319
|
||||
</code></pre><ul>
|
||||
<li>I guess we need to give it more RAM because it now has CGSpace’s large Solr core</li>
|
||||
@ -457,7 +457,7 @@ java.lang.OutOfMemoryError: Java heap space
|
||||
<li>Deploy the new JDBC driver on DSpace Test</li>
|
||||
<li>I’m also curious to see how long the <code>dspace index-discovery -b</code> takes on DSpace Test where the DSpace installation directory is on one of Linode’s new block storage volumes</li>
|
||||
</ul>
|
||||
<pre><code>$ time schedtool -D -e ionice -c2 -n7 nice -n19 dspace index-discovery -b
|
||||
<pre tabindex="0"><code>$ time schedtool -D -e ionice -c2 -n7 nice -n19 dspace index-discovery -b
|
||||
|
||||
real 208m19.155s
|
||||
user 8m39.138s
|
||||
@ -470,7 +470,7 @@ sys 2m45.135s
|
||||
<li>For example, Peter has inadvertantly introduced Unicode character 0xfffd into several fields</li>
|
||||
<li>I can search for Unicode values by their hex code in OpenRefine using the following GREL expression:</li>
|
||||
</ul>
|
||||
<pre><code>isNotNull(value.match(/.*\ufffd.*/))
|
||||
<pre tabindex="0"><code>isNotNull(value.match(/.*\ufffd.*/))
|
||||
</code></pre><ul>
|
||||
<li>I need to be able to add many common characters though so that it is useful to copy and paste into a new project to find issues</li>
|
||||
</ul>
|
||||
@ -489,11 +489,11 @@ sys 2m45.135s
|
||||
<li>Looking at Peter’s author corrections and trying to work out a way to find errors in OpenRefine easily</li>
|
||||
<li>I can find all names that have acceptable characters using a GREL expression like:</li>
|
||||
</ul>
|
||||
<pre><code>isNotNull(value.match(/.*[a-zA-ZáÁéèïíñØøöóúü].*/))
|
||||
<pre tabindex="0"><code>isNotNull(value.match(/.*[a-zA-ZáÁéèïíñØøöóúü].*/))
|
||||
</code></pre><ul>
|
||||
<li>But it’s probably better to just say which characters I know for sure are not valid (like parentheses, pipe, or weird Unicode characters):</li>
|
||||
</ul>
|
||||
<pre><code>or(
|
||||
<pre tabindex="0"><code>or(
|
||||
isNotNull(value.match(/.*[(|)].*/)),
|
||||
isNotNull(value.match(/.*\uFFFD.*/)),
|
||||
isNotNull(value.match(/.*\u00A0.*/)),
|
||||
@ -502,7 +502,7 @@ sys 2m45.135s
|
||||
</code></pre><ul>
|
||||
<li>And here’s one combined GREL expression to check for items marked as to delete or check so I can flag them and export them to a separate CSV (though perhaps it’s time to add delete support to my <code>fix-metadata-values.py</code> script:</li>
|
||||
</ul>
|
||||
<pre><code>or(
|
||||
<pre tabindex="0"><code>or(
|
||||
isNotNull(value.match(/.*delete.*/i)),
|
||||
isNotNull(value.match(/.*remove.*/i)),
|
||||
isNotNull(value.match(/.*check.*/i))
|
||||
@ -521,7 +521,7 @@ sys 2m45.135s
|
||||
<p>Test the corrections and deletions locally, then run them on CGSpace:</p>
|
||||
</li>
|
||||
</ul>
|
||||
<pre><code>$ ./fix-metadata-values.py -i /tmp/Correct-2928-Authors-2018-03-21.csv -db dspace -u dspace -p 'fuuu' -f dc.contributor.author -t correct -m 3
|
||||
<pre tabindex="0"><code>$ ./fix-metadata-values.py -i /tmp/Correct-2928-Authors-2018-03-21.csv -db dspace -u dspace -p 'fuuu' -f dc.contributor.author -t correct -m 3
|
||||
$ ./delete-metadata-values.py -i /tmp/Delete-8-Authors-2018-03-21.csv -f dc.contributor.author -m 3 -db dspacetest -u dspace -p 'fuuu'
|
||||
</code></pre><ul>
|
||||
<li>Afterwards I started a full Discovery reindexing on both CGSpace and DSpace Test</li>
|
||||
@ -542,12 +542,12 @@ $ ./delete-metadata-values.py -i /tmp/Delete-8-Authors-2018-03-21.csv -f dc.cont
|
||||
<li>DSpace Test crashed due to heap space so I’ve increased it from 4096m to 5120m</li>
|
||||
<li>The error in Tomcat’s <code>catalina.out</code> was:</li>
|
||||
</ul>
|
||||
<pre><code>Exception in thread "RMI TCP Connection(idle)" java.lang.OutOfMemoryError: Java heap space
|
||||
<pre tabindex="0"><code>Exception in thread "RMI TCP Connection(idle)" java.lang.OutOfMemoryError: Java heap space
|
||||
</code></pre><ul>
|
||||
<li>Add ISI Journal (cg.isijournal) as an option in Atmire’s Listing and Reports layout (<a href="https://github.com/ilri/DSpace/pull/370">#370</a>) for Abenet</li>
|
||||
<li>I noticed a few hundred CRPs using the old capitalized formatting so I corrected them:</li>
|
||||
</ul>
|
||||
<pre><code>$ ./fix-metadata-values.py -i /tmp/Correct-21-CRPs-2018-03-16.csv -f cg.contributor.crp -t correct -m 230 -db cgspace -u cgspace -p 'fuuu'
|
||||
<pre tabindex="0"><code>$ ./fix-metadata-values.py -i /tmp/Correct-21-CRPs-2018-03-16.csv -f cg.contributor.crp -t correct -m 230 -db cgspace -u cgspace -p 'fuuu'
|
||||
Fixed 29 occurences of: CLIMATE CHANGE, AGRICULTURE AND FOOD SECURITY
|
||||
Fixed 7 occurences of: WATER, LAND AND ECOSYSTEMS
|
||||
Fixed 19 occurences of: AGRICULTURE FOR NUTRITION AND HEALTH
|
||||
|
||||
Reference in New Issue
Block a user