mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2025-01-27 05:49:12 +01:00
Add notes for 2019-05-05
This commit is contained in:
@ -15,7 +15,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="May, 2017"/>
|
||||
<meta name="twitter:description" content="2017-05-01 ICARDA apparently started working on CG Core on their MEL repository They have done a few cg.* fields, but not very consistent and even copy some of CGSpace items: https://mel.cgiar.org/xmlui/handle/20.500.11766/6911?show=full https://cgspace.cgiar.org/handle/10568/73683 2017-05-02 Atmire got back about the Workflow Statistics issue, and apparently it’s a bug in the CUA module so they will send us a pull request 2017-05-04 Sync DSpace Test with database and assetstore from CGSpace Re-deploy DSpace Test with Atmire’s CUA patch for workflow statistics, run system updates, and restart the server Now I can see the workflow statistics and am able to select users, but everything returns 0 items Megan says there are still some mapped items are not appearing since last week, so I forced a full index-discovery -b Need to remember to check if the collection has more items (currently 39 on CGSpace, but 118 on the freshly reindexed DSPace Test) tomorrow: https://cgspace."/>
|
||||
<meta name="generator" content="Hugo 0.55.3" />
|
||||
<meta name="generator" content="Hugo 0.55.5" />
|
||||
|
||||
|
||||
|
||||
@ -128,14 +128,13 @@
|
||||
|
||||
<ul>
|
||||
<li>Discovered that CGSpace has ~700 items that are missing the <code>cg.identifier.status</code> field</li>
|
||||
<li>Need to perhaps try using the “required metadata” curation task to find fields missing these items:</li>
|
||||
</ul>
|
||||
|
||||
<li><p>Need to perhaps try using the “required metadata” curation task to find fields missing these items:</p>
|
||||
|
||||
<pre><code>$ [dspace]/bin/dspace curate -t requiredmetadata -i 10568/1 -r - > /tmp/curation.out
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>It seems the curation task dies when it finds an item which has missing metadata</li>
|
||||
<li><p>It seems the curation task dies when it finds an item which has missing metadata</p></li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-05-06">2017-05-06</h2>
|
||||
@ -149,15 +148,14 @@
|
||||
<h2 id="2017-05-07">2017-05-07</h2>
|
||||
|
||||
<ul>
|
||||
<li>Testing one replacement for CCAFS Flagships (<code>cg.subject.ccafs</code>), first changed in the submission forms, and then in the database:</li>
|
||||
</ul>
|
||||
<li><p>Testing one replacement for CCAFS Flagships (<code>cg.subject.ccafs</code>), first changed in the submission forms, and then in the database:</p>
|
||||
|
||||
<pre><code>$ ./fix-metadata-values.py -i ccafs-flagships-may7.csv -f cg.subject.ccafs -t correct -m 210 -d dspace -u dspace -p fuuu
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>Also, CCAFS wants to re-order their flagships to prioritize the Phase II ones</li>
|
||||
<li>Waiting for feedback from CCAFS, then I can merge <a href="https://github.com/ilri/DSpace/pull/320">#320</a></li>
|
||||
<li><p>Also, CCAFS wants to re-order their flagships to prioritize the Phase II ones</p></li>
|
||||
|
||||
<li><p>Waiting for feedback from CCAFS, then I can merge <a href="https://github.com/ilri/DSpace/pull/320">#320</a></p></li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-05-08">2017-05-08</h2>
|
||||
@ -168,19 +166,20 @@
|
||||
<li>When ingesting some collections I was getting <code>java.lang.OutOfMemoryError: GC overhead limit exceeded</code>, which can be solved by disabling the GC timeout with <code>-XX:-UseGCOverheadLimit</code></li>
|
||||
<li>Other times I was getting an error about heap space, so I kept bumping the RAM allocation by 512MB each time (up to 4096m!) it crashed</li>
|
||||
<li>This leads to tens of thousands of abandoned files in the assetstore, which need to be cleaned up using <code>dspace cleanup -v</code>, or else you’ll run out of disk space</li>
|
||||
<li>In the end I realized it’s better to use submission mode (<code>-s</code>) to ingest the community object as a single AIP without its children, followed by each of the collections:</li>
|
||||
</ul>
|
||||
|
||||
<li><p>In the end I realized it’s better to use submission mode (<code>-s</code>) to ingest the community object as a single AIP without its children, followed by each of the collections:</p>
|
||||
|
||||
<pre><code>$ export JAVA_OPTS="-Dfile.encoding=UTF-8 -Xmx2048m -XX:-UseGCOverheadLimit"
|
||||
$ [dspace]/bin/dspace packager -s -o ignoreHandle=false -t AIP -e some@user.com -p 10568/87775 /home/aorth/10947-1/10947-1.zip
|
||||
$ for collection in /home/aorth/10947-1/COLLECTION@10947-*; do [dspace]/bin/dspace packager -s -o ignoreHandle=false -t AIP -e some@user.com -p 10947/1 $collection; done
|
||||
$ for item in /home/aorth/10947-1/ITEM@10947-*; do [dspace]/bin/dspace packager -r -f -u -t AIP -e some@user.com $item; done
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>Note that in submission mode DSpace ignores the handle specified in <code>mets.xml</code> in the zip file, so you need to turn that off with <code>-o ignoreHandle=false</code></li>
|
||||
<li>The <code>-u</code> option supresses prompts, to allow the process to run without user input</li>
|
||||
<li>Give feedback to CIFOR about their data quality:
|
||||
<li><p>Note that in submission mode DSpace ignores the handle specified in <code>mets.xml</code> in the zip file, so you need to turn that off with <code>-o ignoreHandle=false</code></p></li>
|
||||
|
||||
<li><p>The <code>-u</code> option supresses prompts, to allow the process to run without user input</p></li>
|
||||
|
||||
<li><p>Give feedback to CIFOR about their data quality:</p>
|
||||
|
||||
<ul>
|
||||
<li>Suggestion: uppercase dc.subject, cg.coverage.region, and cg.coverage.subregion in your crosswalk so they match CGSpace and therefore can be faceted / reported on easier</li>
|
||||
@ -189,34 +188,37 @@ $ for item in /home/aorth/10947-1/ITEM@10947-*; do [dspace]/bin/dspace packager
|
||||
<li>Suggestion: use dc.type “Blog Post” instead of “Blog” for your blog post items (we are also adding a “Blog Post” type to CGSpace soon)</li>
|
||||
<li>Question: many of your items use dc.document.uri AND cg.identifier.url with the same text value?</li>
|
||||
</ul></li>
|
||||
<li>Help Marianne from WLE with an Open Search query to show the latest WLE CRP outputs: <a href="https://cgspace.cgiar.org/open-search/discover?query=crpsubject:WATER%2C+LAND+AND+ECOSYSTEMS&sort_by=2&order=DESC">https://cgspace.cgiar.org/open-search/discover?query=crpsubject:WATER%2C+LAND+AND+ECOSYSTEMS&sort_by=2&order=DESC</a></li>
|
||||
<li>This uses the webui’s item list sort options, see <code>webui.itemlist.sort-option</code> in <code>dspace.cfg</code></li>
|
||||
<li>The equivalent Discovery search would be: <a href="https://cgspace.cgiar.org/discover?filtertype_1=crpsubject&filter_relational_operator_1=equals&filter_1=WATER%2C+LAND+AND+ECOSYSTEMS&submit_apply_filter=&query=&rpp=10&sort_by=dc.date.issued_dt&order=desc">https://cgspace.cgiar.org/discover?filtertype_1=crpsubject&filter_relational_operator_1=equals&filter_1=WATER%2C+LAND+AND+ECOSYSTEMS&submit_apply_filter=&query=&rpp=10&sort_by=dc.date.issued_dt&order=desc</a></li>
|
||||
|
||||
<li><p>Help Marianne from WLE with an Open Search query to show the latest WLE CRP outputs: <a href="https://cgspace.cgiar.org/open-search/discover?query=crpsubject:WATER%2C+LAND+AND+ECOSYSTEMS&sort_by=2&order=DESC">https://cgspace.cgiar.org/open-search/discover?query=crpsubject:WATER%2C+LAND+AND+ECOSYSTEMS&sort_by=2&order=DESC</a></p></li>
|
||||
|
||||
<li><p>This uses the webui’s item list sort options, see <code>webui.itemlist.sort-option</code> in <code>dspace.cfg</code></p></li>
|
||||
|
||||
<li><p>The equivalent Discovery search would be: <a href="https://cgspace.cgiar.org/discover?filtertype_1=crpsubject&filter_relational_operator_1=equals&filter_1=WATER%2C+LAND+AND+ECOSYSTEMS&submit_apply_filter=&query=&rpp=10&sort_by=dc.date.issued_dt&order=desc">https://cgspace.cgiar.org/discover?filtertype_1=crpsubject&filter_relational_operator_1=equals&filter_1=WATER%2C+LAND+AND+ECOSYSTEMS&submit_apply_filter=&query=&rpp=10&sort_by=dc.date.issued_dt&order=desc</a></p></li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-05-09">2017-05-09</h2>
|
||||
|
||||
<ul>
|
||||
<li>The CGIAR Library metadata has some blank metadata values, which leads to <code>|||</code> in the Discovery facets</li>
|
||||
<li>Clean these up in the database using:</li>
|
||||
</ul>
|
||||
|
||||
<li><p>Clean these up in the database using:</p>
|
||||
|
||||
<pre><code>dspace=# delete from metadatavalue where resource_type_id=2 and text_value='';
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>I ended up running into issues during data cleaning and decided to wipe out the entire community and re-sync DSpace Test assetstore and database from CGSpace rather than waiting for the cleanup task to clean up</li>
|
||||
<li>Hours into the re-ingestion I ran into more errors, and had to erase everything and start over <em>again</em>!</li>
|
||||
<li>Now, no matter what I do I keep getting foreign key errors…</li>
|
||||
</ul>
|
||||
<li><p>I ended up running into issues during data cleaning and decided to wipe out the entire community and re-sync DSpace Test assetstore and database from CGSpace rather than waiting for the cleanup task to clean up</p></li>
|
||||
|
||||
<li><p>Hours into the re-ingestion I ran into more errors, and had to erase everything and start over <em>again</em>!</p></li>
|
||||
|
||||
<li><p>Now, no matter what I do I keep getting foreign key errors…</p>
|
||||
|
||||
<pre><code>Caused by: org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint "handle_pkey"
|
||||
Detail: Key (handle_id)=(80928) already exists.
|
||||
</code></pre>
|
||||
Detail: Key (handle_id)=(80928) already exists.
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>I think those errors actually come from me running the <code>update-sequences.sql</code> script while Tomcat/DSpace are running</li>
|
||||
<li>Apparently you need to stop Tomcat!</li>
|
||||
<li><p>I think those errors actually come from me running the <code>update-sequences.sql</code> script while Tomcat/DSpace are running</p></li>
|
||||
|
||||
<li><p>Apparently you need to stop Tomcat!</p></li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-05-10">2017-05-10</h2>
|
||||
@ -224,8 +226,8 @@ $ for item in /home/aorth/10947-1/ITEM@10947-*; do [dspace]/bin/dspace packager
|
||||
<ul>
|
||||
<li>Atmire says they are willing to extend the ORCID implementation, and I’ve asked them to provide a quote</li>
|
||||
<li>I clarified that the scope of the implementation should be that ORCIDs are stored in the database and exposed via REST / API like other fields</li>
|
||||
<li>Finally finished importing all the CGIAR Library content, final method was:</li>
|
||||
</ul>
|
||||
|
||||
<li><p>Finally finished importing all the CGIAR Library content, final method was:</p>
|
||||
|
||||
<pre><code>$ export JAVA_OPTS="-Dfile.encoding=UTF-8 -Xmx3072m -XX:-UseGCOverheadLimit"
|
||||
$ [dspace]/bin/dspace packager -r -a -t AIP -o skipIfParentMissing=true -e some@user.com -p 10568/80923 /home/aorth/10947-2517/10947-2517.zip
|
||||
@ -234,17 +236,19 @@ $ [dspace]/bin/dspace packager -r -a -t AIP -o skipIfParentMissing=true -e some@
|
||||
$ [dspace]/bin/dspace packager -s -t AIP -o ignoreHandle=false -e some@user.com -p 10568/80923 /home/aorth/10947-1/10947-1.zip
|
||||
$ for collection in /home/aorth/10947-1/COLLECTION@10947-*; do [dspace]/bin/dspace packager -s -o ignoreHandle=false -t AIP -e some@user.com -p 10947/1 $collection; done
|
||||
$ for item in /home/aorth/10947-1/ITEM@10947-*; do [dspace]/bin/dspace packager -r -f -u -t AIP -e some@user.com $item; done
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>Basically, import the smaller communities using recursive AIP import (with <code>skipIfParentMissing</code>)</li>
|
||||
<li>Then, for the larger collection, create the community, collections, and items separately, ingesting the items one by one</li>
|
||||
<li>The <code>-XX:-UseGCOverheadLimit</code> JVM option helps with some issues in large imports</li>
|
||||
<li>After this I ran the <code>update-sequences.sql</code> script (with Tomcat shut down), and cleaned up the 200+ blank metadata records:</li>
|
||||
</ul>
|
||||
<li><p>Basically, import the smaller communities using recursive AIP import (with <code>skipIfParentMissing</code>)</p></li>
|
||||
|
||||
<li><p>Then, for the larger collection, create the community, collections, and items separately, ingesting the items one by one</p></li>
|
||||
|
||||
<li><p>The <code>-XX:-UseGCOverheadLimit</code> JVM option helps with some issues in large imports</p></li>
|
||||
|
||||
<li><p>After this I ran the <code>update-sequences.sql</code> script (with Tomcat shut down), and cleaned up the 200+ blank metadata records:</p>
|
||||
|
||||
<pre><code>dspace=# delete from metadatavalue where resource_type_id=2 and text_value='';
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-05-13">2017-05-13</h2>
|
||||
|
||||
@ -261,13 +265,12 @@ $ for item in /home/aorth/10947-1/ITEM@10947-*; do [dspace]/bin/dspace packager
|
||||
<li>After that I started looking in the <code>dc.subject</code> field to try to pull countries and regions out, but there are too many values in there</li>
|
||||
<li>Bump the Academicons dependency of the Mirage 2 themes from 1.6.0 to 1.8.0 because the upstream deleted the old tag and now the build is failing: <a href="https://github.com/ilri/DSpace/pull/321">#321</a></li>
|
||||
<li>Merge changes to CCAFS project identifiers and flagships: <a href="https://github.com/ilri/DSpace/pull/320">#320</a></li>
|
||||
<li>Run updates for CCAFS flagships on CGSpace:</li>
|
||||
</ul>
|
||||
|
||||
<li><p>Run updates for CCAFS flagships on CGSpace:</p>
|
||||
|
||||
<pre><code>$ ./fix-metadata-values.py -i /tmp/ccafs-flagships-may7.csv -f cg.subject.ccafs -t correct -m 210 -d dspace -u dspace -p 'fuuu'
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li><p>These include:</p>
|
||||
|
||||
<ul>
|
||||
@ -292,44 +295,38 @@ $ for item in /home/aorth/10947-1/ITEM@10947-*; do [dspace]/bin/dspace packager
|
||||
<h2 id="2017-05-17">2017-05-17</h2>
|
||||
|
||||
<ul>
|
||||
<li>Looking into the error I get when trying to create a new collection on DSpace Test:</li>
|
||||
</ul>
|
||||
<li><p>Looking into the error I get when trying to create a new collection on DSpace Test:</p>
|
||||
|
||||
<pre><code>ERROR: duplicate key value violates unique constraint "handle_pkey" Detail: Key (handle_id)=(84834) already exists.
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>I tried updating the sequences a few times, with Tomcat running and stopped, but it hasn’t helped</li>
|
||||
<li>It appears item with <code>handle_id</code> 84834 is one of the imported CGIAR Library items:</li>
|
||||
</ul>
|
||||
<li><p>I tried updating the sequences a few times, with Tomcat running and stopped, but it hasn’t helped</p></li>
|
||||
|
||||
<li><p>It appears item with <code>handle_id</code> 84834 is one of the imported CGIAR Library items:</p>
|
||||
|
||||
<pre><code>dspace=# select * from handle where handle_id=84834;
|
||||
handle_id | handle | resource_type_id | resource_id
|
||||
handle_id | handle | resource_type_id | resource_id
|
||||
-----------+------------+------------------+-------------
|
||||
84834 | 10947/1332 | 2 | 87113
|
||||
</code></pre>
|
||||
84834 | 10947/1332 | 2 | 87113
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>Looks like the max <code>handle_id</code> is actually much higher:</li>
|
||||
</ul>
|
||||
<li><p>Looks like the max <code>handle_id</code> is actually much higher:</p>
|
||||
|
||||
<pre><code>dspace=# select * from handle where handle_id=(select max(handle_id) from handle);
|
||||
handle_id | handle | resource_type_id | resource_id
|
||||
handle_id | handle | resource_type_id | resource_id
|
||||
-----------+----------+------------------+-------------
|
||||
86873 | 10947/99 | 2 | 89153
|
||||
86873 | 10947/99 | 2 | 89153
|
||||
(1 row)
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>I’ve posted on the dspace-test mailing list to see if I can just manually set the <code>handle_seq</code> to that value</li>
|
||||
<li>Actually, it seems I can manually set the handle sequence using:</li>
|
||||
</ul>
|
||||
<li><p>I’ve posted on the dspace-test mailing list to see if I can just manually set the <code>handle_seq</code> to that value</p></li>
|
||||
|
||||
<li><p>Actually, it seems I can manually set the handle sequence using:</p>
|
||||
|
||||
<pre><code>dspace=# select setval('handle_seq',86873);
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>After that I can create collections just fine, though I’m not sure if it has other side effects</li>
|
||||
<li><p>After that I can create collections just fine, though I’m not sure if it has other side effects</p></li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-05-21">2017-05-21</h2>
|
||||
@ -344,15 +341,13 @@ $ for item in /home/aorth/10947-1/ITEM@10947-*; do [dspace]/bin/dspace packager
|
||||
|
||||
<ul>
|
||||
<li>Do some cleanups of community and collection names in CGIAR System Management Office community on DSpace Test, as well as move some items as Peter requested</li>
|
||||
<li>Peter wanted a list of authors in here, so I generated a list of collections using the “View Source” on each community and this hacky awk:</li>
|
||||
</ul>
|
||||
|
||||
<li><p>Peter wanted a list of authors in here, so I generated a list of collections using the “View Source” on each community and this hacky awk:</p>
|
||||
|
||||
<pre><code>$ grep 10947/ /tmp/collections | grep -v cocoon | awk -F/ '{print $3"/"$4}' | awk -F\" '{print $1}' | vim -
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>Then I joined them together and ran this old SQL query from the dspace-tech mailing list which gives you authors for items in those collections:</li>
|
||||
</ul>
|
||||
<li><p>Then I joined them together and ran this old SQL query from the dspace-tech mailing list which gives you authors for items in those collections:</p>
|
||||
|
||||
<pre><code>dspace=# select distinct text_value
|
||||
from metadatavalue
|
||||
@ -367,18 +362,17 @@ AND resource_id IN (select item_id from collection2item where collection_id IN (
|
||||
47/2519', '10947/2708', '10947/2526', '10947/2871', '10947/2527', '10947/4467', '10947/3457', '10947/2528', '10947/2529', '10947/2533', '10947/2530', '10947/2
|
||||
531', '10947/2532', '10947/2538', '10947/2534', '10947/2540', '10947/2900', '10947/2539', '10947/2784', '10947/2536', '10947/2805', '10947/2541', '10947/2535'
|
||||
, '10947/2537', '10568/93761')));
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>To get a CSV (with counts) from that:</li>
|
||||
</ul>
|
||||
<li><p>To get a CSV (with counts) from that:</p>
|
||||
|
||||
<pre><code>dspace=# \copy (select distinct text_value, count(*)
|
||||
from metadatavalue
|
||||
where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author')
|
||||
AND resource_type_id = 2
|
||||
AND resource_id IN (select item_id from collection2item where collection_id IN (select resource_id from handle where handle in ('10947/2', '10947/3', '10947/10', '10947/4', '10947/5', '10947/6', '10947/7', '10947/8', '10947/9', '10947/11', '10947/25', '10947/12', '10947/26', '10947/27', '10947/28', '10947/29', '10947/30', '10947/13', '10947/14', '10947/15', '10947/16', '10947/31', '10947/32', '10947/33', '10947/34', '10947/35', '10947/36', '10947/37', '10947/17', '10947/18', '10947/38', '10947/19', '10947/39', '10947/40', '10947/41', '10947/42', '10947/43', '10947/2512', '10947/44', '10947/20', '10947/21', '10947/45', '10947/46', '10947/47', '10947/48', '10947/49', '10947/22', '10947/23', '10947/24', '10947/50', '10947/51', '10947/2518', '10947/2776', '10947/2790', '10947/2521', '10947/2522', '10947/2782', '10947/2525', '10947/2836', '10947/2524', '10947/2878', '10947/2520', '10947/2523', '10947/2786', '10947/2631', '10947/2589', '10947/2519', '10947/2708', '10947/2526', '10947/2871', '10947/2527', '10947/4467', '10947/3457', '10947/2528', '10947/2529', '10947/2533', '10947/2530', '10947/2531', '10947/2532', '10947/2538', '10947/2534', '10947/2540', '10947/2900', '10947/2539', '10947/2784', '10947/2536', '10947/2805', '10947/2541', '10947/2535', '10947/2537', '10568/93761'))) group by text_value order by count desc) to /tmp/cgiar-librar-authors.csv with csv;
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-05-23">2017-05-23</h2>
|
||||
|
||||
@ -386,15 +380,14 @@ AND resource_id IN (select item_id from collection2item where collection_id IN (
|
||||
<li>Add Affiliation to filters on Listing and Reports module (<a href="https://github.com/ilri/DSpace/pull/325">#325</a>)</li>
|
||||
<li>Start looking at WLE’s Phase II metadata updates but it seems they are not tagging their items properly, as their website importer infers which theme to use based on the name of the CGSpace collection!</li>
|
||||
<li>For now I’ve suggested that they just change the collection names and that we fix their metadata manually afterwards</li>
|
||||
<li>Also, they have a lot of messed up values in their <code>cg.subject.wle</code> field so I will clean up some of those first:</li>
|
||||
</ul>
|
||||
|
||||
<li><p>Also, they have a lot of messed up values in their <code>cg.subject.wle</code> field so I will clean up some of those first:</p>
|
||||
|
||||
<pre><code>dspace=# \copy (select distinct text_value from metadatavalue where resource_type_id=2 and metadata_field_id=119) to /tmp/wle.csv with csv;
|
||||
COPY 111
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>Respond to Atmire message about ORCIDs, saying that right now we’d prefer to just have them available via REST API like any other metadata field, and that I’m available for a Skype</li>
|
||||
<li><p>Respond to Atmire message about ORCIDs, saying that right now we’d prefer to just have them available via REST API like any other metadata field, and that I’m available for a Skype</p></li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-05-26">2017-05-26</h2>
|
||||
@ -410,38 +403,33 @@ COPY 111
|
||||
<li>File an issue on GitHub to explore/track migration to proper country/region codes (ISO <sup>2</sup>⁄<sub>3</sub> and UN M.49): <a href="https://github.com/ilri/DSpace/issues/326">#326</a></li>
|
||||
<li>Ask Peter how the Landportal.info people should acknowledge us as the source of data on their website</li>
|
||||
<li>Communicate with MARLO people about progress on exposing ORCIDs via the REST API, as it is set to be discussed in the <a href="https://wiki.duraspace.org/display/cmtygp/DCAT+Meeting+June+2017">June, 2017 DCAT meeting</a></li>
|
||||
<li>Find all of Amos Omore’s author name variations so I can link them to his authority entry that has an ORCID:</li>
|
||||
</ul>
|
||||
|
||||
<li><p>Find all of Amos Omore’s author name variations so I can link them to his authority entry that has an ORCID:</p>
|
||||
|
||||
<pre><code>dspace=# select distinct text_value, authority, confidence from metadatavalue where metadata_field_id=3 and text_value like 'Omore, A%';
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>Set the authority for all variations to one containing an ORCID:</li>
|
||||
</ul>
|
||||
<li><p>Set the authority for all variations to one containing an ORCID:</p>
|
||||
|
||||
<pre><code>dspace=# update metadatavalue set authority='4428ee88-90ef-4107-b837-3c0ec988520b', confidence=600 where metadata_field_id=3 and resource_type_id=2 and text_value like 'Omore, A%';
|
||||
UPDATE 187
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>Next I need to do Edgar Twine:</li>
|
||||
</ul>
|
||||
<li><p>Next I need to do Edgar Twine:</p>
|
||||
|
||||
<pre><code>dspace=# select distinct text_value, authority, confidence from metadatavalue where metadata_field_id=3 and text_value like 'Twine, E%';
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>But it doesn’t look like any of his existing entries are linked to an authority which has an ORCID, so I edited the metadata via “Edit this Item” and looked up his ORCID and linked it there</li>
|
||||
<li>Now I should be able to set his name variations to the new authority:</li>
|
||||
</ul>
|
||||
<li><p>But it doesn’t look like any of his existing entries are linked to an authority which has an ORCID, so I edited the metadata via “Edit this Item” and looked up his ORCID and linked it there</p></li>
|
||||
|
||||
<li><p>Now I should be able to set his name variations to the new authority:</p>
|
||||
|
||||
<pre><code>dspace=# update metadatavalue set authority='f70d0a01-d562-45b8-bca3-9cf7f249bc8b', confidence=600 where metadata_field_id=3 and resource_type_id=2 and text_value like 'Twine, E%';
|
||||
</code></pre>
|
||||
</code></pre></li>
|
||||
|
||||
<ul>
|
||||
<li>Run the corrections on CGSpace and then update discovery / authority</li>
|
||||
<li>I notice that there are a handful of <code>java.lang.OutOfMemoryError: Java heap space</code> errors in the Catalina logs on CGSpace, I should go look into that…</li>
|
||||
<li><p>Run the corrections on CGSpace and then update discovery / authority</p></li>
|
||||
|
||||
<li><p>I notice that there are a handful of <code>java.lang.OutOfMemoryError: Java heap space</code> errors in the Catalina logs on CGSpace, I should go look into that…</p></li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-05-29">2017-05-29</h2>
|
||||
|
||||
Reference in New Issue
Block a user