mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-11-22 06:35:03 +01:00
Add notes for 2022-03-31
This commit is contained in:
parent
79b5f023e1
commit
054d666fe0
GPG Key ID:
0FB860CC9C45B1B9
@ -271,4 +271,31 @@ $ chrt -b 0 dspace filter-media -p "ImageMagick PDF Thumbnail" -i 10947/50
|
||||
- After that I did some normalization on the `cg.subject.system` metadata and extracted a few dozen countries to the country field
|
||||
- Start a harvest on AReS
|
||||
|
||||
## 2022-03-30
|
||||
|
||||
- Yesterday Rafael from CIAT asked me to re-create his approver account on DSpace Test as well
|
||||
|
||||
```console
|
||||
$ dspace user -a -m tip-approve@cgiar.org -g Rafael -s Rodriguez -p 'fuuuu'
|
||||
```
|
||||
|
||||
- I started looking into the request regarding the CIAT Library PDFs
|
||||
- There are over 4,000 links to PDFs hosted on that server in CGSpace metadata
|
||||
- The links seem to be down though! I emailed Paola to ask
|
||||
|
||||
## 2022-03-31
|
||||
|
||||
- Switch DSpace Test (linode26) back to CMS GC so I can do some monitoring and evaluation of GC before switching to G1GC
|
||||
- Leroy from CIAT said that the CIAT Library server has security issues so was limited to internal traffic
|
||||
- I extracted a list of URLs from CGSpace to send him:
|
||||
|
||||
```console
|
||||
localhost/dspacetest= ☘ \COPY (SELECT DISTINCT(text_value) FROM metadatavalue WHERE metadata_field_id=219 AND text_value ~ 'https?://ciat-library') to /tmp/2022-03-31-ciat-library-urls.csv WITH CSV HEADER;
|
||||
COPY 4552
|
||||
```
|
||||
|
||||
- I did some checks and cleanups in OpenRefine because there are some values with "#page" etc
|
||||
- Once I sorted them there were only ~2,700, which means there are going to be almost two thousand items with duplicate PDFs
|
||||
- I suggested that we might want to handle those cases specially and extract the chapters or whatever page range since they are probably books
|
||||
|
||||
<!-- vim: set sw=2 ts=2: -->
|
||||
|
||||
@ -19,7 +19,7 @@ $ csvjoin -c id /tmp/2022-03-01-tac-batch4-701-980.csv /tmp/tac4-filenames.csv &
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2022-03/" />
|
||||
<meta property="article:published_time" content="2022-03-01T16:46:54+03:00" />
|
||||
<meta property="article:modified_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="article:modified_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
@ -44,9 +44,9 @@ $ csvjoin -c id /tmp/2022-03-01-tac-batch4-701-980.csv /tmp/tac4-filenames.csv &
|
||||
"@type": "BlogPosting",
|
||||
"headline": "March, 2022",
|
||||
"url": "https://alanorth.github.io/cgspace-notes/2022-03/",
|
||||
"wordCount": "1589",
|
||||
"wordCount": "1789",
|
||||
"datePublished": "2022-03-01T16:46:54+03:00",
|
||||
"dateModified": "2022-03-29T16:01:48+03:00",
|
||||
"dateModified": "2022-03-29T21:26:07+03:00",
|
||||
"author": {
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
@ -406,6 +406,38 @@ isNotNull(value.match('889'))
|
||||
<li>After that I did some normalization on the <code>cg.subject.system</code> metadata and extracted a few dozen countries to the country field</li>
|
||||
<li>Start a harvest on AReS</li>
|
||||
</ul>
|
||||
<h2 id="2022-03-30">2022-03-30</h2>
|
||||
<ul>
|
||||
<li>Yesterday Rafael from CIAT asked me to re-create his approver account on DSpace Test as well</li>
|
||||
</ul>
|
||||
<div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-console" data-lang="console"><span style="display:flex;"><span>$ dspace user -a -m tip-approve@cgiar.org -g Rafael -s Rodriguez -p <span style="color:#e6db74">'fuuuu'</span>
|
||||
</span></span></code></pre></div><ul>
|
||||
<li>I started looking into the request regarding the CIAT Library PDFs
|
||||
<ul>
|
||||
<li>There are over 4,000 links to PDFs hosted on that server in CGSpace metadata</li>
|
||||
<li>The links seem to be down though! I emailed Paola to ask</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<h2 id="2022-03-31">2022-03-31</h2>
|
||||
<ul>
|
||||
<li>Switch DSpace Test (linode26) back to CMS GC so I can do some monitoring and evaluation of GC before switching to G1GC</li>
|
||||
<li>Leroy from CIAT said that the CIAT Library server has security issues so was limited to internal traffic
|
||||
<ul>
|
||||
<li>I extracted a list of URLs from CGSpace to send him:</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-console" data-lang="console"><span style="display:flex;"><span>localhost/dspacetest= ☘ \COPY (SELECT DISTINCT(text_value) FROM metadatavalue WHERE metadata_field_id=219 AND text_value ~ 'https?://ciat-library') to /tmp/2022-03-31-ciat-library-urls.csv WITH CSV HEADER;
|
||||
</span></span><span style="display:flex;"><span>COPY 4552
|
||||
</span></span></code></pre></div><ul>
|
||||
<li>I did some checks and cleanups in OpenRefine because there are some values with “#page” etc
|
||||
<ul>
|
||||
<li>Once I sorted them there were only ~2,700, which means there are going to be almost two thousand items with duplicate PDFs</li>
|
||||
<li>I suggested that we might want to handle those cases specially and extract the chapters or whatever page range since they are probably books</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<!-- raw HTML omitted -->
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2022-03-29T16:01:48+03:00" />
|
||||
<meta property="og:updated_time" content="2022-03-29T21:26:07+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -3,19 +3,19 @@
|
||||
xmlns:xhtml="http://www.w3.org/1999/xhtml">
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/</loc>
|
||||
<lastmod>2022-03-29T16:01:48+03:00</lastmod>
|
||||
<lastmod>2022-03-29T21:26:07+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/</loc>
|
||||
<lastmod>2022-03-29T16:01:48+03:00</lastmod>
|
||||
<lastmod>2022-03-29T21:26:07+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2022-03/</loc>
|
||||
<lastmod>2022-03-29T16:01:48+03:00</lastmod>
|
||||
<lastmod>2022-03-29T21:26:07+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
|
||||
<lastmod>2022-03-29T16:01:48+03:00</lastmod>
|
||||
<lastmod>2022-03-29T21:26:07+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
|
||||
<lastmod>2022-03-29T16:01:48+03:00</lastmod>
|
||||
<lastmod>2022-03-29T21:26:07+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2022-02/</loc>
|
||||
<lastmod>2022-03-01T17:17:27+03:00</lastmod>
|
||||
|
||||
Loading…
Reference in New Issue
Block a user