mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-12-28 07:54:29 +01:00
Add notes for 2021-02-14
This commit is contained in:
parent
195b3b2954
commit
0089125198
GPG Key ID:
0FB860CC9C45B1B9
@ -326,4 +326,44 @@ or(
|
||||
- Call with Abdullah and Yousef to discuss some issues
|
||||
- We got the Angular expressions parser working...
|
||||
|
||||
## 2021-02-13
|
||||
|
||||
- Run system updates, deploy latest `6_x-prod` branch, and reboot CGSpace (linode18)
|
||||
- Normalize `text_lang` of DSpace item metadata on CGSpace:
|
||||
|
||||
```
|
||||
dspace=# SELECT DISTINCT text_lang, count(text_lang) FROM metadatavalue WHERE dspace_object_id IN (SELECT uuid FROM item) GROUP BY text_lang ORDER BY count DESC;
|
||||
text_lang | count
|
||||
-----------+---------
|
||||
en_US | 2567413
|
||||
| 8050
|
||||
en | 7601
|
||||
| 0
|
||||
(4 rows)
|
||||
dspace=# UPDATE metadatavalue SET text_lang='en_US' WHERE dspace_object_id IN (SELECT uuid FROM item);
|
||||
```
|
||||
|
||||
- Start a full Discovery re-indexing on CGSpace
|
||||
|
||||
## 2021-02-14
|
||||
|
||||
- Clear the OpenRXV temp items index:
|
||||
|
||||
```console
|
||||
$ curl -XDELETE 'http://localhost:9200/openrxv-items-temp'
|
||||
```
|
||||
|
||||
- Then start a full harvesting of CGSpace in the AReS Explorer admin dashboard
|
||||
- Peter asked me about a few other recently submitted FEAST items that are restricted
|
||||
- I checked the collection and there was an empty group there for the "default read" authorization
|
||||
- I deleted the group and fixed the authorization policies for two new items manually
|
||||
- Upload fifteen items to CGSpace for Peter Ballantyne
|
||||
- Move 313 journals from series, which Peter had indicated when we were cleaning up the series last week
|
||||
- I re-purposed one of my Python metadata scripts to create `move-metadata-values.py`
|
||||
- The script reads a text file with one metadata value per line and moves them from one metadata field id to another
|
||||
|
||||
```console
|
||||
$ ./ilri/move-metadata-values.py -i /tmp/move.txt -db dspace -u dspace -p 'fuuu' -f 43 -t 55
|
||||
```
|
||||
|
||||
<!-- vim: set sw=2 ts=2: -->
|
||||
|
||||
@ -32,7 +32,7 @@ $ curl -s 'http://localhost:9200/openrxv-items-temp/_count?q=*&pretty
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2021-02/" />
|
||||
<meta property="article:published_time" content="2021-02-01T10:13:54+02:00" />
|
||||
<meta property="article:modified_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="article:modified_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
@ -70,9 +70,9 @@ $ curl -s 'http://localhost:9200/openrxv-items-temp/_count?q=*&pretty
|
||||
"@type": "BlogPosting",
|
||||
"headline": "February, 2021",
|
||||
"url": "https://alanorth.github.io/cgspace-notes/2021-02/",
|
||||
"wordCount": "2064",
|
||||
"wordCount": "2281",
|
||||
"datePublished": "2021-02-01T10:13:54+02:00",
|
||||
"dateModified": "2021-02-11T09:36:09+02:00",
|
||||
"dateModified": "2021-02-11T22:24:21+02:00",
|
||||
"author": {
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
@ -485,7 +485,46 @@ $ csvcut -c id /tmp/2021-02-10-ILRI.csv | sed '1d' | sort | uniq -c | sort -h |
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<!-- raw HTML omitted -->
|
||||
<h2 id="2021-02-13">2021-02-13</h2>
|
||||
<ul>
|
||||
<li>Run system updates, deploy latest <code>6_x-prod</code> branch, and reboot CGSpace (linode18)</li>
|
||||
<li>Normalize <code>text_lang</code> of DSpace item metadata on CGSpace:</li>
|
||||
</ul>
|
||||
<pre><code>dspace=# SELECT DISTINCT text_lang, count(text_lang) FROM metadatavalue WHERE dspace_object_id IN (SELECT uuid FROM item) GROUP BY text_lang ORDER BY count DESC;
|
||||
text_lang | count
|
||||
-----------+---------
|
||||
en_US | 2567413
|
||||
| 8050
|
||||
en | 7601
|
||||
| 0
|
||||
(4 rows)
|
||||
dspace=# UPDATE metadatavalue SET text_lang='en_US' WHERE dspace_object_id IN (SELECT uuid FROM item);
|
||||
</code></pre><ul>
|
||||
<li>Start a full Discovery re-indexing on CGSpace</li>
|
||||
</ul>
|
||||
<h2 id="2021-02-14">2021-02-14</h2>
|
||||
<ul>
|
||||
<li>Clear the OpenRXV temp items index:</li>
|
||||
</ul>
|
||||
<pre><code class="language-console" data-lang="console">$ curl -XDELETE 'http://localhost:9200/openrxv-items-temp'
|
||||
</code></pre><ul>
|
||||
<li>Then start a full harvesting of CGSpace in the AReS Explorer admin dashboard</li>
|
||||
<li>Peter asked me about a few other recently submitted FEAST items that are restricted
|
||||
<ul>
|
||||
<li>I checked the collection and there was an empty group there for the “default read” authorization</li>
|
||||
<li>I deleted the group and fixed the authorization policies for two new items manually</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>Upload fifteen items to CGSpace for Peter Ballantyne</li>
|
||||
<li>Move 313 journals from series, which Peter had indicated when we were cleaning up the series last week
|
||||
<ul>
|
||||
<li>I re-purposed one of my Python metadata scripts to create <code>move-metadata-values.py</code></li>
|
||||
<li>The script reads a text file with one metadata value per line and moves them from one metadata field id to another</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<pre><code class="language-console" data-lang="console">$ ./ilri/move-metadata-values.py -i /tmp/move.txt -db dspace -u dspace -p 'fuuu' -f 43 -t 55
|
||||
</code></pre><!-- raw HTML omitted -->
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-02-11T09:36:09+02:00" />
|
||||
<meta property="og:updated_time" content="2021-02-11T22:24:21+02:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -4,27 +4,27 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/</loc>
|
||||
<lastmod>2021-02-11T09:36:09+02:00</lastmod>
|
||||
<lastmod>2021-02-11T22:24:21+02:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/</loc>
|
||||
<lastmod>2021-02-11T09:36:09+02:00</lastmod>
|
||||
<lastmod>2021-02-11T22:24:21+02:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2021-02/</loc>
|
||||
<lastmod>2021-02-11T09:36:09+02:00</lastmod>
|
||||
<lastmod>2021-02-11T22:24:21+02:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
|
||||
<lastmod>2021-02-11T09:36:09+02:00</lastmod>
|
||||
<lastmod>2021-02-11T22:24:21+02:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
|
||||
<lastmod>2021-02-11T09:36:09+02:00</lastmod>
|
||||
<lastmod>2021-02-11T22:24:21+02:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
|
||||
Loading…
Reference in New Issue
Block a user