alanorth/cgspace-notes
1
0
Fork 0
mirror of https://github.com/alanorth/cgspace-notes.git synced 2024-12-23 21:44:30 +01:00
Code Issues Projects Releases Wiki Activity

Update notes for 2017-12-17

Browse Source
This commit is contained in:
Alan Orth 2017-12-17 11:22:21 +02:00
parent 226a940ff3
commit 7016d8b3f1
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
3 changed files with 25 additions and 8 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
content/post/2017-12.md
View File

@ -202,4 +202,13 @@ UPDATE 1
- The dates are in super long ISO8601 format (from Excel?) like `2016-02-07T00:00:00Z` so I converted them to simpler forms in GREL: `value.toString("yyyy-MM-dd")`
- I trimmed the whitespaces in a few fields but it wasn't many
- Rename her thumbnail column to filename, and format it so SAFBuilder adds the files to the thumbnail bundle with this GREL in OpenRefine: `value + "__bundle:THUMBNAIL"`
- Rename dc.identifier.status and dc.identifier.url columns to cg.identifier.status and cg.identifier.url
- Item 4 has weird characters in citation, ie: Nagoya et de Trait
- Some author names need normalization, ie: `Aggarwal, Pramod` and `Aggarwal, Pramod K.`
- Something weird going on with duplicate authors that have the same text value, like `Berto, Jayson C.` and `Balmeo, Katherine P.`
- I will send her feedback on some author names like UNEP and ICRISAT and ask her for the missing thumbnail11.jpg
- I did a test import of the data locally after building with SAFBuilder but for some reason I had to specify the collection (even though the collections were specified in the `collection` field)
```
$ JAVA_OPTS="-Xmx512m -Dfile.encoding=UTF-8" ~/dspace/bin/dspace import --add --eperson=aorth@mjanja.ch --collection=10568/89338 --source /Users/aorth/Downloads/2016\ bulk\ upload\ thumbnails/SimpleArchiveFormat --mapfile=/tmp/ccafs.map &> /tmp/ccafs.log
```

14
public/2017-12/index.html
View File

@ -23,7 +23,7 @@ The list of connections to XMLUI and REST API for today:
<meta property="article:published_time" content="2017-12-01T13:53:54&#43;03:00"/>
<meta property="article:modified_time" content="2017-12-17T09:55:04&#43;02:00"/>
<meta property="article:modified_time" content="2017-12-17T10:56:56&#43;02:00"/>
@ -56,9 +56,9 @@ The list of connections to XMLUI and REST API for today:
"@type": "BlogPosting",
"headline": "December, 2017",
"url": "https://alanorth.github.io/cgspace-notes/2017-12/",
"wordCount": "1128",
"wordCount": "1231",
"datePublished": "2017-12-01T13:53:54&#43;03:00",
"dateModified": "2017-12-17T09:55:04&#43;02:00",
"dateModified": "2017-12-17T10:56:56&#43;02:00",
"author": {
"@type": "Person",
"name": "Alan Orth"
@ -347,10 +347,18 @@ UPDATE 1
<li>The dates are in super long ISO8601 format (from Excel?) like <code>2016-02-07T00:00:00Z</code> so I converted them to simpler forms in GREL: <code>value.toString(&quot;yyyy-MM-dd&quot;)</code></li>
<li>I trimmed the whitespaces in a few fields but it wasn&rsquo;t many</li>
<li>Rename her thumbnail column to filename, and format it so SAFBuilder adds the files to the thumbnail bundle with this GREL in OpenRefine: <code>value + &quot;__bundle:THUMBNAIL&quot;</code></li>
<li>Rename dc.identifier.status and dc.identifier.url columns to cg.identifier.status and cg.identifier.url</li>
<li>Item 4 has weird characters in citation, ie: Nagoya et de Trait</li>
<li>Some author names need normalization, ie: <code>Aggarwal, Pramod</code> and <code>Aggarwal, Pramod K.</code></li>
<li>Something weird going on with duplicate authors that have the same text value, like <code>Berto, Jayson C.</code> and <code>Balmeo, Katherine P.</code></li>
<li>I will send her feedback on some author names like UNEP and ICRISAT and ask her for the missing thumbnail11.jpg</li>
</ul></li>
<li>I did a test import of the data locally after building with SAFBuilder but for some reason I had to specify the collection (even though the collections were specified in the <code>collection</code> field)</li>
</ul>
<pre><code>$ JAVA_OPTS=&quot;-Xmx512m -Dfile.encoding=UTF-8&quot; ~/dspace/bin/dspace import --add --eperson=aorth@mjanja.ch --collection=10568/89338 --source /Users/aorth/Downloads/2016\ bulk\ upload\ thumbnails/SimpleArchiveFormat --mapfile=/tmp/ccafs.map &amp;&gt; /tmp/ccafs.log
</code></pre>

10
public/sitemap.xml
View File

@ -4,7 +4,7 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/2017-12/</loc>
<lastmod>2017-12-17T09:55:04+02:00</lastmod>
<lastmod>2017-12-17T10:56:56+02:00</lastmod>
</url>
<url>
@ -139,7 +139,7 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/</loc>
<lastmod>2017-12-17T09:55:04+02:00</lastmod>
<lastmod>2017-12-17T10:56:56+02:00</lastmod>
<priority>0</priority>
</url>
@ -150,7 +150,7 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
<lastmod>2017-12-17T09:55:04+02:00</lastmod>
<lastmod>2017-12-17T10:56:56+02:00</lastmod>
<priority>0</priority>
</url>
@ -162,13 +162,13 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/post/</loc>
<lastmod>2017-12-17T09:55:04+02:00</lastmod>
<lastmod>2017-12-17T10:56:56+02:00</lastmod>
<priority>0</priority>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
<lastmod>2017-12-17T09:55:04+02:00</lastmod>
<lastmod>2017-12-17T10:56:56+02:00</lastmod>
<priority>0</priority>
</url>