mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-12-22 21:22:19 +01:00
Add notes for 2020-09-10
This commit is contained in:
parent
3f3e94d80a
commit
9d0f0cbfde
GPG Key ID:
0FB860CC9C45B1B9
@ -146,5 +146,49 @@ https://cgspace.cgiar.org/bitstream/handle/10568/82745/Characteristics-Silage.JP
|
||||
- So they end up getting rate limited due to the XMLUI rate limits
|
||||
- I told them to use the REST API bitstream retrieve links, because we don't have any rate limits there
|
||||
|
||||
## 2020-09-09
|
||||
|
||||
- Wire up the systemd service/timer for the CGSpace Country Code Tagger curation task in the [Ansible infrastructure scripts](https://github.com/ilri/rmg-ansible-public)
|
||||
- ~~For now it won't work on DSpace 6 because the curation task invocation needs to be slightly different (minus the `-l` parameter) and for some reason the task isn't working on DSpace Test (version 6) right now~~
|
||||
- I added DSpace 6 support to the playbook templates...
|
||||
- Run system updates on DSpace Test (linode26), re-deploy the DSpace 6 test branch, and reboot the server
|
||||
- After rebooting I deleted old copies of the cgspace-java-helpers JAR in the DSpace lib directory and then the curation worked
|
||||
- To my great surprise the curation worked (and completed, albeit a few times slower) on my local DSpace 6 environment as well:
|
||||
|
||||
```
|
||||
$ ~/dspace63/bin/dspace curate -t countrycodetagger -i all -s object
|
||||
```
|
||||
|
||||
## 2020-09-10
|
||||
|
||||
- I checked the country code tagger on CGSpace and DSpace Test and it ran fine from the systemd timer last night... w00t
|
||||
- I started looking at Peter's changes to the CGSpace regions that were proposed in 2020-07
|
||||
- The changes will be:
|
||||
|
||||
```
|
||||
$ cat 2020-09-10-fix-cgspace-regions.csv
|
||||
cg.coverage.region,correct
|
||||
EAST AFRICA,EASTERN AFRICA
|
||||
WEST AFRICA,WESTERN AFRICA
|
||||
SOUTHEAST ASIA,SOUTHEASTERN ASIA
|
||||
SOUTH ASIA,SOUTHERN ASIA
|
||||
AFRICA SOUTH OF SAHARA,SUB-SAHARAN AFRICA
|
||||
NORTH AFRICA,NORTHERN AFRICA
|
||||
WEST ASIA,WESTERN ASIA
|
||||
SOUTHWEST ASIA,SOUTHWESTERN ASIA
|
||||
$ ./fix-metadata-values.py -i 2020-09-10-fix-cgspace-regions.csv -db dspace -u dspace -p 'fuuu' -f cg.coverage.region -t 'correct' -m 227 -d -n
|
||||
Connected to database.
|
||||
Would fix 12227 occurences of: EAST AFRICA
|
||||
Would fix 7996 occurences of: WEST AFRICA
|
||||
Would fix 3515 occurences of: SOUTHEAST ASIA
|
||||
Would fix 3443 occurences of: SOUTH ASIA
|
||||
Would fix 1134 occurences of: AFRICA SOUTH OF SAHARA
|
||||
Would fix 357 occurences of: NORTH AFRICA
|
||||
Would fix 81 occurences of: WEST ASIA
|
||||
Would fix 3 occurences of: SOUTHWEST ASIA
|
||||
```
|
||||
|
||||
- I think we need to wait for the web team, though, as they need to update their mappings
|
||||
- Not to mention that we'll need to give WLE and CCAFS time to update their harvesters as well... hmmm
|
||||
|
||||
<!-- vim: set sw=2 ts=2: -->
|
||||
|
||||
@ -25,7 +25,7 @@ I filed an issue on OpenRXV to make some minor edits to the admin UI: https://gi
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2020-09/" />
|
||||
<meta property="article:published_time" content="2020-09-02T15:35:54+03:00" />
|
||||
<meta property="article:modified_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="article:modified_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="September, 2020"/>
|
||||
@ -55,9 +55,9 @@ I filed an issue on OpenRXV to make some minor edits to the admin UI: https://gi
|
||||
"@type": "BlogPosting",
|
||||
"headline": "September, 2020",
|
||||
"url": "https://alanorth.github.io/cgspace-notes/2020-09/",
|
||||
"wordCount": "838",
|
||||
"wordCount": "1159",
|
||||
"datePublished": "2020-09-02T15:35:54+03:00",
|
||||
"dateModified": "2020-09-04T13:32:16+03:00",
|
||||
"dateModified": "2020-09-08T12:10:08+03:00",
|
||||
"author": {
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
@ -290,6 +290,58 @@ dspace=# UPDATE metadatavalue SET text_value = regexp_replace(text_value, '^http
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<h2 id="2020-09-09">2020-09-09</h2>
|
||||
<ul>
|
||||
<li>Wire up the systemd service/timer for the CGSpace Country Code Tagger curation task in the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a>
|
||||
<ul>
|
||||
<li><del>For now it won’t work on DSpace 6 because the curation task invocation needs to be slightly different (minus the <code>-l</code> parameter) and for some reason the task isn’t working on DSpace Test (version 6) right now</del></li>
|
||||
<li>I added DSpace 6 support to the playbook templates…</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>Run system updates on DSpace Test (linode26), re-deploy the DSpace 6 test branch, and reboot the server
|
||||
<ul>
|
||||
<li>After rebooting I deleted old copies of the cgspace-java-helpers JAR in the DSpace lib directory and then the curation worked</li>
|
||||
<li>To my great surprise the curation worked (and completed, albeit a few times slower) on my local DSpace 6 environment as well:</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<pre><code>$ ~/dspace63/bin/dspace curate -t countrycodetagger -i all -s object
|
||||
</code></pre><h2 id="2020-09-10">2020-09-10</h2>
|
||||
<ul>
|
||||
<li>I checked the country code tagger on CGSpace and DSpace Test and it ran fine from the systemd timer last night… w00t</li>
|
||||
<li>I started looking at Peter’s changes to the CGSpace regions that were proposed in 2020-07
|
||||
<ul>
|
||||
<li>The changes will be:</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<pre><code>$ cat 2020-09-10-fix-cgspace-regions.csv
|
||||
cg.coverage.region,correct
|
||||
EAST AFRICA,EASTERN AFRICA
|
||||
WEST AFRICA,WESTERN AFRICA
|
||||
SOUTHEAST ASIA,SOUTHEASTERN ASIA
|
||||
SOUTH ASIA,SOUTHERN ASIA
|
||||
AFRICA SOUTH OF SAHARA,SUB-SAHARAN AFRICA
|
||||
NORTH AFRICA,NORTHERN AFRICA
|
||||
WEST ASIA,WESTERN ASIA
|
||||
SOUTHWEST ASIA,SOUTHWESTERN ASIA
|
||||
$ ./fix-metadata-values.py -i 2020-09-10-fix-cgspace-regions.csv -db dspace -u dspace -p 'fuuu' -f cg.coverage.region -t 'correct' -m 227 -d -n
|
||||
Connected to database.
|
||||
Would fix 12227 occurences of: EAST AFRICA
|
||||
Would fix 7996 occurences of: WEST AFRICA
|
||||
Would fix 3515 occurences of: SOUTHEAST ASIA
|
||||
Would fix 3443 occurences of: SOUTH ASIA
|
||||
Would fix 1134 occurences of: AFRICA SOUTH OF SAHARA
|
||||
Would fix 357 occurences of: NORTH AFRICA
|
||||
Would fix 81 occurences of: WEST ASIA
|
||||
Would fix 3 occurences of: SOUTHWEST ASIA
|
||||
</code></pre><ul>
|
||||
<li>I think we need to wait for the web team, though, as they need to update their mappings
|
||||
<ul>
|
||||
<li>Not to mention that we’ll need to give WLE and CCAFS time to update their harvesters as well… hmmm</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<!-- raw HTML omitted -->
|
||||
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Categories"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-09-04T13:32:16+03:00" />
|
||||
<meta property="og:updated_time" content="2020-09-08T12:10:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
|
||||
@ -4,27 +4,27 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/</loc>
|
||||
<lastmod>2020-09-04T13:32:16+03:00</lastmod>
|
||||
<lastmod>2020-09-08T12:10:08+03:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/</loc>
|
||||
<lastmod>2020-09-04T13:32:16+03:00</lastmod>
|
||||
<lastmod>2020-09-08T12:10:08+03:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
|
||||
<lastmod>2020-09-04T13:32:16+03:00</lastmod>
|
||||
<lastmod>2020-09-08T12:10:08+03:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
|
||||
<lastmod>2020-09-04T13:32:16+03:00</lastmod>
|
||||
<lastmod>2020-09-08T12:10:08+03:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2020-09/</loc>
|
||||
<lastmod>2020-09-04T13:32:16+03:00</lastmod>
|
||||
<lastmod>2020-09-08T12:10:08+03:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
|
||||
Loading…
Reference in New Issue
Block a user