Regenerate public

2019-10-28 13:51:00 +02:00 · 2019-10-28 13:51:00 +02:00 · ba0fe49fd6
parent efe26b9798
commit ba0fe49fd6
8 changed files with 1695 additions and 11 deletions
--- a/docs/2019-10/index.html
+++ b/docs/2019-10/index.html
@ -11,7 +11,7 @@
 <meta property="og:type" content="article" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2019-10/" />
 <meta property="article:published_time" content="2019-10-01T13:20:51+03:00" />
-<meta property="article:modified_time" content="2019-10-28T13:41:08+02:00" />
+<meta property="article:modified_time" content="2019-10-28T13:50:17+02:00" />

 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="October, 2019"/>
@ -27,9 +27,9 @@
  "@type": "BlogPosting",
  "headline": "October, 2019",
  "url": "https:\/\/alanorth.github.io\/cgspace-notes\/2019-10\/",
-  "wordCount": "1535",
+  "wordCount": "1593",
  "datePublished": "2019-10-01T13:20:51+03:00",
-  "dateModified": "2019-10-28T13:41:08+02:00",
+  "dateModified": "2019-10-28T13:50:17+02:00",
  "author": {
    "@type": "Person",
    "name": "Alan Orth"
@ -384,6 +384,23 @@ $ dspace import -a -c 10568/104057 -e fuu@cgiar.org -m 2019-10-15-Bioversity.map
 <li>Create a test user for Mohammad Salem to test depositing from MEL to DSpace Test, as the last one I had created in 2019-08 was cleared when we re-syncronized DSpace Test with CGSpace recently.</li>
 </ul>

+<h2 id="2019-10-25">2019-10-25</h2>
+
+<ul>
+<li>Give a presentationa (via WebEx) about open source software to the ILRI Open Access Week
+
+<ul>
+<li>The title was <em>Making ILRI code open: Software as an International Public Good</em></li>
+<li>It is available on CGSpace: <a href="https://hdl.handle.net/10568/105514">https://hdl.handle.net/10568/105514</a></li>
+</ul></li>
+</ul>
+
+<h2 id="2019-10-28">2019-10-28</h2>
+
+<ul>
+<li>Move the CGSpace CG Core v2 notes from a <a href="https://gist.github.com/alanorth/2db39e91f48d116e00a4edffd6ba6409">GitHub Gist</a> to a <a href="/cgspace-notes/cgspace-cgcorev2-migration/">page</a> on this site for archive and searchability sake</li>
+</ul>
+
 <!-- vim: set sw=2 ts=2: -->


--- a/docs/categories/notes/page/2/index.html
+++ b/docs/categories/notes/page/2/index.html
@ -0,0 +1,462 @@
+<!DOCTYPE html>
+<html lang="en" >
+
+  <head>
+    <meta charset="utf-8">
+<meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">
+
+<meta property="og:title" content="Notes" />
+<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
+<meta property="og:type" content="website" />
+<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
+
+<meta property="og:updated_time" content="2019-10-28T13:27:35+02:00" />
+
+<meta name="twitter:card" content="summary"/>
+<meta name="twitter:title" content="Notes"/>
+<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
+<meta name="generator" content="Hugo 0.59.0" />
+
+
+    
+      
+    
+
+    <link rel="canonical" href="https://alanorth.github.io/cgspace-notes/categories/notes/">
+
+    <title>CGSpace Notes</title>
+
+    
+    <!-- combined, minified CSS -->
+    <link href="https://alanorth.github.io/cgspace-notes/css/style.css" rel="stylesheet" integrity="sha384-G5B34w7DFTumWTswxYzTX7NWfbvQEg1HbFFEg6ItN03uTAAoS2qkPS/fu3LhuuSA" crossorigin="anonymous">
+    
+
+    <!-- RSS 2.0 feed -->
+    <link rel="alternate" type="application/rss+xml" href="https://alanorth.github.io/cgspace-notes/categories/notes/index.xml" title="CGSpace Notes" />
+    
+
+    
+
+    
+
+  </head>
+
+  <body>
+
+    
+    <div class="blog-masthead">
+      <div class="container">
+        <nav class="nav blog-nav">
+          <a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
+        </nav>
+      </div>
+    </div>
+    
+
+    
+    
+    <header class="blog-header">
+      <div class="container">
+        <h1 class="blog-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/" rel="home">CGSpace Notes</a></h1>
+        <p class="lead blog-description" dir="auto">Documenting day-to-day work on the <a href="https://cgspace.cgiar.org">CGSpace</a> repository.</p>
+      </div>
+    </header>
+    
+    
+
+    
+    <div class="container">
+      <div class="row">
+        <div class="col-sm-8 blog-main">
+
+          
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-01/">January, 2019</a></h2>
+    <p class="blog-post-meta"><time datetime="2019-01-02T09:48:30&#43;02:00">Wed Jan 02, 2019</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2019-01-02">2019-01-02</h2>
+
+<ul>
+<li>Linode alerted that CGSpace (linode18) had a higher outbound traffic rate than normal early this morning</li>
+
+<li><p>I don&rsquo;t see anything interesting in the web server logs around that time though:</p>
+
+<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;02/Jan/2019:0(1|2|3)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+ 92 40.77.167.4
+ 99 210.7.29.100
+120 38.126.157.45
+177 35.237.175.180
+177 40.77.167.32
+216 66.249.75.219
+225 18.203.76.93
+261 46.101.86.248
+357 207.46.13.1
+903 54.70.40.11
+</code></pre></li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2019-01/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-12/">December, 2018</a></h2>
+    <p class="blog-post-meta"><time datetime="2018-12-02T02:09:30&#43;02:00">Sun Dec 02, 2018</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2018-12-01">2018-12-01</h2>
+
+<ul>
+<li>Switch CGSpace (linode18) to use OpenJDK instead of Oracle JDK</li>
+<li>I manually installed OpenJDK, then removed Oracle JDK, then re-ran the <a href="http://github.com/ilri/rmg-ansible-public">Ansible playbook</a> to update all configuration files, etc</li>
+<li>Then I ran all system updates and restarted the server</li>
+</ul>
+
+<h2 id="2018-12-02">2018-12-02</h2>
+
+<ul>
+<li>I noticed that there is another issue with PDF thumbnails on CGSpace, and I see there was another <a href="https://usn.ubuntu.com/3831-1/">Ghostscript vulnerability last week</a></li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2018-12/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-11/">November, 2018</a></h2>
+    <p class="blog-post-meta"><time datetime="2018-11-01T16:41:30&#43;02:00">Thu Nov 01, 2018</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2018-11-01">2018-11-01</h2>
+
+<ul>
+<li>Finalize AReS Phase I and Phase II ToRs</li>
+<li>Send a note about my <a href="https://github.com/ilri/dspace-statistics-api">dspace-statistics-api</a> to the dspace-tech mailing list</li>
+</ul>
+
+<h2 id="2018-11-03">2018-11-03</h2>
+
+<ul>
+<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
+<li>Today these are the top 10 IPs:</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-10/">October, 2018</a></h2>
+    <p class="blog-post-meta"><time datetime="2018-10-01T22:31:54&#43;03:00">Mon Oct 01, 2018</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2018-10-01">2018-10-01</h2>
+
+<ul>
+<li>Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items</li>
+<li>I created a GitHub issue to track this <a href="https://github.com/ilri/DSpace/issues/389">#389</a>, because I&rsquo;m super busy in Nairobi right now</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2018-10/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-09/">September, 2018</a></h2>
+    <p class="blog-post-meta"><time datetime="2018-09-02T09:55:54&#43;03:00">Sun Sep 02, 2018</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2018-09-02">2018-09-02</h2>
+
+<ul>
+<li>New <a href="https://jdbc.postgresql.org/documentation/changelog.html#version_42.2.5">PostgreSQL JDBC driver version 42.2.5</a></li>
+<li>I&rsquo;ll update the DSpace role in our <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure playbooks</a> and run the updated playbooks on CGSpace and DSpace Test</li>
+<li>Also, I&rsquo;ll re-run the <code>postgresql</code> tasks because the custom PostgreSQL variables are dynamic according to the system&rsquo;s RAM, and we never re-ran them after migrating to larger Linodes last month</li>
+<li>I&rsquo;m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I&rsquo;m getting those autowire errors in Tomcat 8.5.30 again:</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2018-09/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-08/">August, 2018</a></h2>
+    <p class="blog-post-meta"><time datetime="2018-08-01T11:52:54&#43;03:00">Wed Aug 01, 2018</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2018-08-01">2018-08-01</h2>
+
+<ul>
+<li><p>DSpace Test had crashed at some point yesterday morning and I see the following in <code>dmesg</code>:</p>
+
+<pre><code>[Tue Jul 31 00:00:41 2018] Out of memory: Kill process 1394 (java) score 668 or sacrifice child
+[Tue Jul 31 00:00:41 2018] Killed process 1394 (java) total-vm:15601860kB, anon-rss:5355528kB, file-rss:0kB, shmem-rss:0kB
+[Tue Jul 31 00:00:41 2018] oom_reaper: reaped process 1394 (java), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
+</code></pre></li>
+
+<li><p>Judging from the time of the crash it was probably related to the Discovery indexing that starts at midnight</p></li>
+
+<li><p>From the DSpace log I see that eventually Solr stopped responding, so I guess the <code>java</code> process that was OOM killed above was Tomcat&rsquo;s</p></li>
+
+<li><p>I&rsquo;m not sure why Tomcat didn&rsquo;t crash with an OutOfMemoryError&hellip;</p></li>
+
+<li><p>Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did a few months ago when we tried to run the whole CGSpace Solr core</p></li>
+
+<li><p>The server only has 8GB of RAM so we&rsquo;ll eventually need to upgrade to a larger one because we&rsquo;ll start starving the OS, PostgreSQL, and command line batch processes</p></li>
+
+<li><p>I ran all system updates on DSpace Test and rebooted it</p></li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2018-08/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-07/">July, 2018</a></h2>
+    <p class="blog-post-meta"><time datetime="2018-07-01T12:56:54&#43;03:00">Sun Jul 01, 2018</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2018-07-01">2018-07-01</h2>
+
+<ul>
+<li><p>I want to upgrade DSpace Test to DSpace 5.8 so I took a backup of its current database just in case:</p>
+
+<pre><code>$ pg_dump -b -v -o --format=custom -U dspace -f dspace-2018-07-01.backup dspace
+</code></pre></li>
+
+<li><p>During the <code>mvn package</code> stage on the 5.8 branch I kept getting issues with java running out of memory:</p>
+
+<pre><code>There is insufficient memory for the Java Runtime Environment to continue.
+</code></pre></li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2018-07/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-06/">June, 2018</a></h2>
+    <p class="blog-post-meta"><time datetime="2018-06-04T19:49:54-07:00">Mon Jun 04, 2018</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2018-06-04">2018-06-04</h2>
+
+<ul>
+<li>Test the <a href="https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=560">DSpace 5.8 module upgrades from Atmire</a> (<a href="https://github.com/ilri/DSpace/pull/378">#378</a>)
+
+<ul>
+<li>There seems to be a problem with the CUA and L&amp;R versions in <code>pom.xml</code> because they are using SNAPSHOT and it doesn&rsquo;t build</li>
+</ul></li>
+<li>I added the new CCAFS Phase II Project Tag <code>PII-FP1_PACCA2</code> and merged it into the <code>5_x-prod</code> branch (<a href="https://github.com/ilri/DSpace/pull/379">#379</a>)</li>
+
+<li><p>I proofed and tested the ILRI author corrections that Peter sent back to me this week:</p>
+
+<pre><code>$ ./fix-metadata-values.py -i /tmp/2018-05-30-Correct-660-authors.csv -db dspace -u dspace -p 'fuuu' -f dc.contributor.author -t correct -m 3 -n
+</code></pre></li>
+
+<li><p>I think a sane proofing workflow in OpenRefine is to apply the custom text facets for check/delete/remove and illegal characters that I developed in <a href="/cgspace-notes/2018-03/">March, 2018</a></p></li>
+
+<li><p>Time to index ~70,000 items on CGSpace:</p>
+
+<pre><code>$ time schedtool -D -e ionice -c2 -n7 nice -n19 [dspace]/bin/dspace index-discovery -b                                  
+
+real    74m42.646s
+user    8m5.056s
+sys     2m7.289s
+</code></pre></li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2018-06/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-05/">May, 2018</a></h2>
+    <p class="blog-post-meta"><time datetime="2018-05-01T16:43:54&#43;03:00">Tue May 01, 2018</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2018-05-01">2018-05-01</h2>
+
+<ul>
+<li>I cleared the Solr statistics core on DSpace Test by issuing two commands directly to the Solr admin interface:
+
+<ul>
+<li><a href="http://localhost:3000/solr/statistics/update?stream.body=%3Cdelete%3E%3Cquery%3E*:*%3C/query%3E%3C/delete%3E">http://localhost:3000/solr/statistics/update?stream.body=%3Cdelete%3E%3Cquery%3E*:*%3C/query%3E%3C/delete%3E</a></li>
+<li><a href="http://localhost:3000/solr/statistics/update?stream.body=%3Ccommit/%3E">http://localhost:3000/solr/statistics/update?stream.body=%3Ccommit/%3E</a></li>
+</ul></li>
+<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
+<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-04/">April, 2018</a></h2>
+    <p class="blog-post-meta"><time datetime="2018-04-01T16:13:54&#43;02:00">Sun Apr 01, 2018</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2018-04-01">2018-04-01</h2>
+
+<ul>
+<li>I tried to test something on DSpace Test but noticed that it&rsquo;s down since god knows when</li>
+<li>Catalina logs at least show some memory errors yesterday:</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2018-04/'>Read more →</a>
+</article> 
+
+
+
+
+
+<nav class="blog-pagination">
+  
+  <a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/" rel="prev" role="button">Previous page</a>
+  <a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/page/3/" rel="next" role="button">Next page</a>
+  
+  
+  
+</nav>
+
+
+
+
+
+        </div> <!-- /.blog-main -->
+
+        <aside class="col-sm-3 ml-auto blog-sidebar">
+  
+
+  
+        <section class="sidebar-module">
+    <h4>Recent Posts</h4>
+    <ol class="list-unstyled">
+
+
+<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
+
+<li><a href="/cgspace-notes/2019-10/">October, 2019</a></li>
+
+<li><a href="/cgspace-notes/2019-09/">September, 2019</a></li>
+
+<li><a href="/cgspace-notes/2019-08/">August, 2019</a></li>
+
+<li><a href="/cgspace-notes/2019-07/">July, 2019</a></li>
+
+    </ol>
+  </section>
+
+  
+
+  
+  <section class="sidebar-module">
+    <h4>Links</h4>
+    <ol class="list-unstyled">
+      
+      <li><a href="https://cgspace.cgiar.org">CGSpace</a></li>
+      
+      <li><a href="https://dspacetest.cgiar.org">DSpace Test</a></li>
+      
+      <li><a href="https://github.com/ilri/DSpace">CGSpace @ GitHub</a></li>
+      
+    </ol>
+  </section>
+  
+</aside>
+
+
+      </div> <!-- /.row -->
+    </div> <!-- /.container -->
+    
+
+    
+    <footer class="blog-footer">
+      <p dir="auto">
+      
+      Blog template created by <a href="https://twitter.com/mdo">@mdo</a>, ported to Hugo by <a href='https://twitter.com/mralanorth'>@mralanorth</a>.
+      
+      </p>
+      <p>
+      <a href="#">Back to top</a>
+      </p>
+    </footer>
+    
+
+  </body>
+
+</html>
--- a/docs/categories/notes/page/3/index.html
+++ b/docs/categories/notes/page/3/index.html
@ -0,0 +1,404 @@
+<!DOCTYPE html>
+<html lang="en" >
+
+  <head>
+    <meta charset="utf-8">
+<meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">
+
+<meta property="og:title" content="Notes" />
+<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
+<meta property="og:type" content="website" />
+<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
+
+<meta property="og:updated_time" content="2019-10-28T13:27:35+02:00" />
+
+<meta name="twitter:card" content="summary"/>
+<meta name="twitter:title" content="Notes"/>
+<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
+<meta name="generator" content="Hugo 0.59.0" />
+
+
+    
+      
+    
+
+    <link rel="canonical" href="https://alanorth.github.io/cgspace-notes/categories/notes/">
+
+    <title>CGSpace Notes</title>
+
+    
+    <!-- combined, minified CSS -->
+    <link href="https://alanorth.github.io/cgspace-notes/css/style.css" rel="stylesheet" integrity="sha384-G5B34w7DFTumWTswxYzTX7NWfbvQEg1HbFFEg6ItN03uTAAoS2qkPS/fu3LhuuSA" crossorigin="anonymous">
+    
+
+    <!-- RSS 2.0 feed -->
+    <link rel="alternate" type="application/rss+xml" href="https://alanorth.github.io/cgspace-notes/categories/notes/index.xml" title="CGSpace Notes" />
+    
+
+    
+
+    
+
+  </head>
+
+  <body>
+
+    
+    <div class="blog-masthead">
+      <div class="container">
+        <nav class="nav blog-nav">
+          <a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
+        </nav>
+      </div>
+    </div>
+    
+
+    
+    
+    <header class="blog-header">
+      <div class="container">
+        <h1 class="blog-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/" rel="home">CGSpace Notes</a></h1>
+        <p class="lead blog-description" dir="auto">Documenting day-to-day work on the <a href="https://cgspace.cgiar.org">CGSpace</a> repository.</p>
+      </div>
+    </header>
+    
+    
+
+    
+    <div class="container">
+      <div class="row">
+        <div class="col-sm-8 blog-main">
+
+          
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-03/">March, 2018</a></h2>
+    <p class="blog-post-meta"><time datetime="2018-03-02T16:07:54&#43;02:00">Fri Mar 02, 2018</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2018-03-02">2018-03-02</h2>
+
+<ul>
+<li>Export a CSV of the IITA community metadata for Martin Mueller</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2018-03/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-02/">February, 2018</a></h2>
+    <p class="blog-post-meta"><time datetime="2018-02-01T16:28:54&#43;02:00">Thu Feb 01, 2018</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2018-02-01">2018-02-01</h2>
+
+<ul>
+<li>Peter gave feedback on the <code>dc.rights</code> proof of concept that I had sent him last week</li>
+<li>We don&rsquo;t need to distinguish between internal and external works, so that makes it just a simple list</li>
+<li>Yesterday I figured out how to monitor DSpace sessions using JMX</li>
+<li>I copied the logic in the <code>jmx_tomcat_dbpools</code> provided by Ubuntu&rsquo;s <code>munin-plugins-java</code> package and used the stuff I discovered about JMX <a href="/cgspace-notes/2018-01/">in 2018-01</a></li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2018-02/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-01/">January, 2018</a></h2>
+    <p class="blog-post-meta"><time datetime="2018-01-02T08:35:54-08:00">Tue Jan 02, 2018</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2018-01-02">2018-01-02</h2>
+
+<ul>
+<li>Uptime Robot noticed that CGSpace went down and up a few times last night, for a few minutes each time</li>
+<li>I didn&rsquo;t get any load alerts from Linode and the REST and XMLUI logs don&rsquo;t show anything out of the ordinary</li>
+<li>The nginx logs show HTTP 200s until <code>02/Jan/2018:11:27:17 +0000</code> when Uptime Robot got an HTTP 500</li>
+<li>In dspace.log around that time I see many errors like &ldquo;Client closed the connection before file download was complete&rdquo;</li>
+
+<li><p>And just before that I see this:</p>
+
+<pre><code>Caused by: org.apache.tomcat.jdbc.pool.PoolExhaustedException: [http-bio-127.0.0.1-8443-exec-980] Timeout: Pool empty. Unable to fetch a connection in 5 seconds, none available[size:50; busy:50; idle:0; lastwait:5000].
+</code></pre></li>
+
+<li><p>Ah hah! So the pool was actually empty!</p></li>
+
+<li><p>I need to increase that, let&rsquo;s try to bump it up from 50 to 75</p></li>
+
+<li><p>After that one client got an HTTP 499 but then the rest were HTTP 200, so I don&rsquo;t know what the hell Uptime Robot saw</p></li>
+
+<li><p>I notice this error quite a few times in dspace.log:</p>
+
+<pre><code>2018-01-02 01:21:19,137 ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ Error while searching for sidebar facets
+org.dspace.discovery.SearchServiceException: org.apache.solr.search.SyntaxError: Cannot parse 'dateIssued_keyword:[1976+TO+1979]': Encountered &quot; &quot;]&quot; &quot;] &quot;&quot; at line 1, column 32.
+</code></pre></li>
+
+<li><p>And there are many of these errors every day for the past month:</p>
+
+<pre><code>$ grep -c &quot;Error while searching for sidebar facets&quot; dspace.log.*
+dspace.log.2017-11-21:4
+dspace.log.2017-11-22:1
+dspace.log.2017-11-23:4
+dspace.log.2017-11-24:11
+dspace.log.2017-11-25:0
+dspace.log.2017-11-26:1
+dspace.log.2017-11-27:7
+dspace.log.2017-11-28:21
+dspace.log.2017-11-29:31
+dspace.log.2017-11-30:15
+dspace.log.2017-12-01:15
+dspace.log.2017-12-02:20
+dspace.log.2017-12-03:38
+dspace.log.2017-12-04:65
+dspace.log.2017-12-05:43
+dspace.log.2017-12-06:72
+dspace.log.2017-12-07:27
+dspace.log.2017-12-08:15
+dspace.log.2017-12-09:29
+dspace.log.2017-12-10:35
+dspace.log.2017-12-11:20
+dspace.log.2017-12-12:44
+dspace.log.2017-12-13:36
+dspace.log.2017-12-14:59
+dspace.log.2017-12-15:104
+dspace.log.2017-12-16:53
+dspace.log.2017-12-17:66
+dspace.log.2017-12-18:83
+dspace.log.2017-12-19:101
+dspace.log.2017-12-20:74
+dspace.log.2017-12-21:55
+dspace.log.2017-12-22:66
+dspace.log.2017-12-23:50
+dspace.log.2017-12-24:85
+dspace.log.2017-12-25:62
+dspace.log.2017-12-26:49
+dspace.log.2017-12-27:30
+dspace.log.2017-12-28:54
+dspace.log.2017-12-29:68
+dspace.log.2017-12-30:89
+dspace.log.2017-12-31:53
+dspace.log.2018-01-01:45
+dspace.log.2018-01-02:34
+</code></pre></li>
+
+<li><p>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let&rsquo;s Encrypt if it&rsquo;s just a handful of domains</p></li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-12/">December, 2017</a></h2>
+    <p class="blog-post-meta"><time datetime="2017-12-01T13:53:54&#43;03:00">Fri Dec 01, 2017</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2017-12-01">2017-12-01</h2>
+
+<ul>
+<li>Uptime Robot noticed that CGSpace went down</li>
+<li>The logs say &ldquo;Timeout waiting for idle object&rdquo;</li>
+<li>PostgreSQL activity says there are 115 connections currently</li>
+<li>The list of connections to XMLUI and REST API for today:</li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2017-12/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-11/">November, 2017</a></h2>
+    <p class="blog-post-meta"><time datetime="2017-11-02T09:37:54&#43;02:00">Thu Nov 02, 2017</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2017-11-01">2017-11-01</h2>
+
+<ul>
+<li>The CORE developers responded to say they are looking into their bot not respecting our robots.txt</li>
+</ul>
+
+<h2 id="2017-11-02">2017-11-02</h2>
+
+<ul>
+<li><p>Today there have been no hits by CORE and no alerts from Linode (coincidence?)</p>
+
+<pre><code># grep -c &quot;CORE&quot; /var/log/nginx/access.log
+0
+</code></pre></li>
+
+<li><p>Generate list of authors on CGSpace for Peter to go through and correct:</p>
+
+<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
+COPY 54701
+</code></pre></li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-10/">October, 2017</a></h2>
+    <p class="blog-post-meta"><time datetime="2017-10-01T08:07:54&#43;03:00">Sun Oct 01, 2017</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+</p>
+  </header>
+  <h2 id="2017-10-01">2017-10-01</h2>
+
+<ul>
+<li><p>Peter emailed to point out that many items in the <a href="https://cgspace.cgiar.org/handle/10568/2703">ILRI archive collection</a> have multiple handles:</p>
+
+<pre><code>http://hdl.handle.net/10568/78495||http://hdl.handle.net/10568/79336
+</code></pre></li>
+
+<li><p>There appears to be a pattern but I&rsquo;ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine</p></li>
+
+<li><p>Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections</p></li>
+</ul>
+  <a href='https://alanorth.github.io/cgspace-notes/2017-10/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/cgiar-library-migration/">CGIAR Library Migration</a></h2>
+    <p class="blog-post-meta"><time datetime="2017-09-18T16:38:35&#43;03:00">Mon Sep 18, 2017</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+<i class="fa fa-tag" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/tags/migration" rel="tag">Migration</a>
+
+</p>
+  </header>
+  <p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
+  <a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a>
+</article> 
+
+
+
+
+
+<nav class="blog-pagination">
+  
+  
+  <a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/page/2/" rel="prev" role="button">Previous page</a>
+  <a class="btn btn-outline-primary disabled" href="#" role="button" aria-disabled="true">Next page</a>
+  
+  
+</nav>
+
+
+
+
+
+        </div> <!-- /.blog-main -->
+
+        <aside class="col-sm-3 ml-auto blog-sidebar">
+  
+
+  
+        <section class="sidebar-module">
+    <h4>Recent Posts</h4>
+    <ol class="list-unstyled">
+
+
+<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
+
+<li><a href="/cgspace-notes/2019-10/">October, 2019</a></li>
+
+<li><a href="/cgspace-notes/2019-09/">September, 2019</a></li>
+
+<li><a href="/cgspace-notes/2019-08/">August, 2019</a></li>
+
+<li><a href="/cgspace-notes/2019-07/">July, 2019</a></li>
+
+    </ol>
+  </section>
+
+  
+
+  
+  <section class="sidebar-module">
+    <h4>Links</h4>
+    <ol class="list-unstyled">
+      
+      <li><a href="https://cgspace.cgiar.org">CGSpace</a></li>
+      
+      <li><a href="https://dspacetest.cgiar.org">DSpace Test</a></li>
+      
+      <li><a href="https://github.com/ilri/DSpace">CGSpace @ GitHub</a></li>
+      
+    </ol>
+  </section>
+  
+</aside>
+
+
+      </div> <!-- /.row -->
+    </div> <!-- /.container -->
+    
+
+    
+    <footer class="blog-footer">
+      <p dir="auto">
+      
+      Blog template created by <a href="https://twitter.com/mdo">@mdo</a>, ported to Hugo by <a href='https://twitter.com/mralanorth'>@mralanorth</a>.
+      
+      </p>
+      <p>
+      <a href="#">Back to top</a>
+      </p>
+    </footer>
+    
+
+  </body>
+
+</html>
--- a/docs/cgspace-cgcorev2-migration/index.html
+++ b/docs/cgspace-cgcorev2-migration/index.html
@ -0,0 +1,580 @@
+<!DOCTYPE html>
+<html lang="en" >
+
+  <head>
+    <meta charset="utf-8">
+<meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">
+
+<meta property="og:title" content="CGSpace CG Core v2 Migration" />
+<meta property="og:description" content="Possible changes to CGSpace metadata fields to align more with DC, QDC, and DCTERMS as well as CG Core v2." />
+<meta property="og:type" content="article" />
+<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/cgspace-cgcorev2-migration/" />
+<meta property="article:published_time" content="2019-10-28T13:27:35+02:00" />
+<meta property="article:modified_time" content="2019-10-28T13:47:52+02:00" />
+
+<meta name="twitter:card" content="summary"/>
+<meta name="twitter:title" content="CGSpace CG Core v2 Migration"/>
+<meta name="twitter:description" content="Possible changes to CGSpace metadata fields to align more with DC, QDC, and DCTERMS as well as CG Core v2."/>
+<meta name="generator" content="Hugo 0.59.0" />
+
+
+    
+<script type="application/ld+json">
+{
+  "@context": "http://schema.org",
+  "@type": "BlogPosting",
+  "headline": "CGSpace CG Core v2 Migration",
+  "url": "https:\/\/alanorth.github.io\/cgspace-notes\/cgspace-cgcorev2-migration\/",
+  "wordCount": "536",
+  "datePublished": "2019-10-28T13:27:35+02:00",
+  "dateModified": "2019-10-28T13:47:52+02:00",
+  "author": {
+    "@type": "Person",
+    "name": "Alan Orth"
+  },
+  "keywords": "Notes, Migration",
+  "description": "Possible changes to CGSpace metadata fields to align more with DC, QDC, and DCTERMS as well as CG Core v2."
+}
+</script>
+
+
+
+    <link rel="canonical" href="https://alanorth.github.io/cgspace-notes/cgspace-cgcorev2-migration/">
+
+    <title>CGSpace CG Core v2 Migration | CGSpace Notes</title>
+
+    
+    <!-- combined, minified CSS -->
+    <link href="https://alanorth.github.io/cgspace-notes/css/style.css" rel="stylesheet" integrity="sha384-G5B34w7DFTumWTswxYzTX7NWfbvQEg1HbFFEg6ItN03uTAAoS2qkPS/fu3LhuuSA" crossorigin="anonymous">
+    
+
+    <!-- RSS 2.0 feed -->
+    
+
+    
+
+    
+
+  </head>
+
+  <body>
+
+    
+    <div class="blog-masthead">
+      <div class="container">
+        <nav class="nav blog-nav">
+          <a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
+        </nav>
+      </div>
+    </div>
+    
+
+    
+    
+    <header class="blog-header">
+      <div class="container">
+        <h1 class="blog-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/" rel="home">CGSpace Notes</a></h1>
+        <p class="lead blog-description" dir="auto">Documenting day-to-day work on the <a href="https://cgspace.cgiar.org">CGSpace</a> repository.</p>
+      </div>
+    </header>
+    
+    
+
+    
+    <div class="container">
+      <div class="row">
+        <div class="col-sm-8 blog-main">
+
+          
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></h2>
+    <p class="blog-post-meta"><time datetime="2019-10-28T13:27:35&#43;02:00">Mon Oct 28, 2019</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+<i class="fa fa-tag" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/tags/migration" rel="tag">Migration</a>
+
+</p>
+  </header>
+  <p>Possible changes to CGSpace metadata fields to align more with DC, QDC, and DCTERMS as well as CG Core v2.</p>
+
+<p>With reference to <a href="https://agriculturalsemantics.github.io/cg-core/cgcore.html">CG Core v2 draft standard</a> by Marie-Angélique as well as <a href="http://www.dublincore.org/specifications/dublin-core/dcmi-terms/">DCMI DCTERMS</a>.</p>
+
+<ul>
+<li><a href="#proposed-changes">Proposed Changes</a></li>
+<li><a href="#fields-to-create">Fields to Create</a></li>
+<li><a href="#fields-to-delete">Fields to Delete</a></li>
+<li><a href="#implementation-progress">Implementation Progress</a></li>
+</ul>
+
+<h2 id="proposed-changes">Proposed Changes</h2>
+
+<p>As of 2019-09-11 the scope of the changes includes the following fields:</p>
+
+<ul>
+<li>dc.contributor.author→dcterms.creator
+
+<ul>
+<li>for people and institutional authors</li>
+</ul></li>
+<li>cg.creator.id→cg.creator.identifier
+
+<ul>
+<li>ORCID identifiers</li>
+</ul></li>
+<li>dc.title→dcterms.title</li>
+<li>dc.format.extent→dcterms.extent</li>
+<li>dc.date.issued→dcterms.issued</li>
+<li>dc.description.abstract→dcterms.abstract</li>
+<li>dc.description→dcterms.description</li>
+<li>dc.description.sponsorship→cg.contributor.donor
+
+<ul>
+<li>values from CrossRef or Grid.ac if possible</li>
+</ul></li>
+<li>dc.description.version→cg.peer-reviewed</li>
+<li>cg.fulltextstatus→cg.howpublished
+
+<ul>
+<li>CGSpace uses values like &ldquo;Formally Published&rdquo; or &ldquo;Grey Literature&rdquo;</li>
+</ul></li>
+<li>dc.identifier.citation→dcterms.bibliographicCitation</li>
+<li>cg.identifier.status→dcterms.accessRights
+
+<ul>
+<li>current values are &ldquo;Open Access&rdquo; and &ldquo;Limited Access&rdquo;</li>
+<li>future values are possibly &ldquo;Open&rdquo; and &ldquo;Restricted&rdquo;?</li>
+</ul></li>
+<li>dc.language.iso→dcterms.language
+
+<ul>
+<li>current values are ISO 639-1 (aka Alpha 2)</li>
+<li>future values are possibly ISO 639-3 (aka Alpha 3)?</li>
+</ul></li>
+<li>cg.link.reference→dcterms.relation</li>
+<li>dc.publisher→dcterms.publisher</li>
+<li>dc.relation.ispartofseries→dcterms.isPartOf</li>
+<li>dc.rights→dcterms.license
+
+<ul>
+<li>Using <a href="https://spdx.org/licenses/">SPDX license identifiers</a> if possible</li>
+</ul></li>
+<li>dc.source→cg.journal</li>
+<li>dc.subject→dcterms.subject</li>
+<li>dc.type→dcterms.type</li>
+<li>dc.identifier.isbn→cg.isbn</li>
+<li>dc.identifier.issn→cg.issn</li>
+<li>cg.identifier.dataurl→cg.hasMetadata</li>
+<li>dc.title.alternative→dcterms.alternative</li>
+</ul>
+
+<p>The following fields are currently out of the scope of this migration because they are used internally by DSpace 5.x/6.x and would be difficult to change without significant modifications to the core of the code:</p>
+
+<ul>
+<li>dc.date.available</li>
+<li>dc.date.accessioned</li>
+<li>dc.identifier.uri</li>
+<li>dc.description.provenance</li>
+</ul>
+
+<h2 id="fields-to-create">Fields to Create</h2>
+
+<p>Make sure the following fields exist:</p>
+
+<ul class="task-list">
+<li><label><input type="checkbox" checked disabled class="task-list-item"> cg.creator.identifier (242)</label></li>
+<li><label><input type="checkbox" checked disabled class="task-list-item"> cg.contributor.donor (243)</label></li>
+<li><label><input type="checkbox" checked disabled class="task-list-item"> cg.peer-reviewed (244)</label></li>
+<li><label><input type="checkbox" checked disabled class="task-list-item"> cg.howpublished (245)</label></li>
+<li><label><input type="checkbox" checked disabled class="task-list-item"> cg.journal (246)</label></li>
+<li><label><input type="checkbox" checked disabled class="task-list-item"> cg.isbn (247)</label></li>
+<li><label><input type="checkbox" checked disabled class="task-list-item"> cg.issn (248)</label></li>
+<li><label><input type="checkbox" checked disabled class="task-list-item"> cg.hasMetadata (249)</label></li>
+</ul>
+
+<h2 id="fields-to-delete">Fields to delete</h2>
+
+<p>Fields to delete after migration:</p>
+
+<ul class="task-list">
+<li><label><input type="checkbox" disabled class="task-list-item"> cg.creator.id</label></li>
+<li><label><input type="checkbox" disabled class="task-list-item"> cg.fulltextstatus</label></li>
+<li><label><input type="checkbox" disabled class="task-list-item"> cg.identifier.status</label></li>
+<li><label><input type="checkbox" disabled class="task-list-item"> cg.link.reference</label></li>
+<li><label><input type="checkbox" disabled class="task-list-item"> cg.identifier.dataurl</label></li>
+</ul>
+
+<h2 id="implementation-progress">Implementation Progress</h2>
+
+<p>Tally of the status of the implementation of the new fields in the CGSpace <code>5_x-cgcorev2</code> branch.</p>
+
+<table>
+<thead>
+<tr>
+<th>Field Name</th>
+<th align="center">migrate-fields.sh</th>
+<th align="center">Input Forms</th>
+<th align="center">XMLUI Themes¹</th>
+<th align="center">dspace.cfg</th>
+<th align="center">Discovery</th>
+<th align="center">Atmire Modules</th>
+<th align="center">Crosswalks</th>
+</tr>
+</thead>
+
+<tbody>
+<tr>
+<td>dcterms.creator</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">?</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>cg.creator.identifier</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.title</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.extent</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.issued</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">?</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.abstract</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.description</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>cg.contributor.donor</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>cg.peer-reviewed</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>cg.howpublished</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.bibliographicCitation</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.accessRights</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.language</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.relation</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.publisher</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.isPartOf</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.license</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>cg.journal</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.subject</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.type</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>cg.isbn</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>cg.issn</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center">-</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>cg.hasMetadata</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+
+<tr>
+<td>dcterms.alternative</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">-</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center">✓</td>
+<td align="center"></td>
+</tr>
+</tbody>
+</table>
+
+<p>There are a few things that I need to check once I get a deployment of this code up and running:</p>
+
+<ul>
+<li>Assess the XSL changes to see if things like <code>not(@qualifier)]</code> still make sense after we move fields from DC to DCTERMS, as some fields will no longer have qualifiers</li>
+<li>Do I need to edit crosswalks that we are not using, like <a href="https://wiki.duraspace.org/display/DSDOC5x/DSpace+AIP+Format#DSpaceAIPFormat-MODSSchema">MODS</a>?</li>
+<li>There is potentially a lot of work in the OAI metadata formats like DIM, METS, and QDC (see <code>dspace/config/crosswalks/oai/*.xsl</code>)</li>
+</ul>
+
+<hr />
+
+<p>¹ Not committed yet because I don&rsquo;t want to have to make minor adjustments in multiple commits. Re-apply the gauntlet of fixes with the sed script:</p>
+
+<pre><code>$ find dspace/modules/xmlui-mirage2/src/main/webapp/themes -iname &quot;*.xsl&quot; -exec ./cgcore-xsl-replacements.sed {} \;
+</code></pre>
+
+  
+
+  
+
+</article> 
+
+
+
+        </div> <!-- /.blog-main -->
+
+        <aside class="col-sm-3 ml-auto blog-sidebar">
+  
+
+  
+        <section class="sidebar-module">
+    <h4>Recent Posts</h4>
+    <ol class="list-unstyled">
+
+
+<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
+
+<li><a href="/cgspace-notes/2019-10/">October, 2019</a></li>
+
+<li><a href="/cgspace-notes/2019-09/">September, 2019</a></li>
+
+<li><a href="/cgspace-notes/2019-08/">August, 2019</a></li>
+
+<li><a href="/cgspace-notes/2019-07/">July, 2019</a></li>
+
+    </ol>
+  </section>
+
+  
+
+  
+  <section class="sidebar-module">
+    <h4>Links</h4>
+    <ol class="list-unstyled">
+      
+      <li><a href="https://cgspace.cgiar.org">CGSpace</a></li>
+      
+      <li><a href="https://dspacetest.cgiar.org">DSpace Test</a></li>
+      
+      <li><a href="https://github.com/ilri/DSpace">CGSpace @ GitHub</a></li>
+      
+    </ol>
+  </section>
+  
+</aside>
+
+
+      </div> <!-- /.row -->
+    </div> <!-- /.container -->
+    
+
+    
+    <footer class="blog-footer">
+      <p dir="auto">
+      
+      Blog template created by <a href="https://twitter.com/mdo">@mdo</a>, ported to Hugo by <a href='https://twitter.com/mralanorth'>@mralanorth</a>.
+      
+      </p>
+      <p>
+      <a href="#">Back to top</a>
+      </p>
+    </footer>
+    
+
+  </body>
+
+</html>
--- a/docs/sitemap.xml
+++ b/docs/sitemap.xml
@ -4,42 +4,42 @@
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/categories/</loc>
-    <lastmod>2019-10-28T13:42:02+02:00</lastmod>
+    <lastmod>2019-10-28T13:50:17+02:00</lastmod>
  </url>
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/cgspace-cgcorev2-migration/</loc>
-    <lastmod>2019-10-28T13:42:02+02:00</lastmod>
+    <lastmod>2019-10-28T13:47:52+02:00</lastmod>
  </url>
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/</loc>
-    <lastmod>2019-10-28T13:42:02+02:00</lastmod>
+    <lastmod>2019-10-28T13:50:17+02:00</lastmod>
  </url>
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/tags/migration/</loc>
-    <lastmod>2019-10-28T13:42:02+02:00</lastmod>
+    <lastmod>2019-10-28T13:47:52+02:00</lastmod>
  </url>
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
-    <lastmod>2019-10-28T13:42:02+02:00</lastmod>
+    <lastmod>2019-10-28T13:50:17+02:00</lastmod>
  </url>
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
-    <lastmod>2019-10-28T13:42:02+02:00</lastmod>
+    <lastmod>2019-10-28T13:50:17+02:00</lastmod>
  </url>
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
-    <lastmod>2019-10-28T13:42:02+02:00</lastmod>
+    <lastmod>2019-10-28T13:47:52+02:00</lastmod>
  </url>
  
  <url>
    <loc>https://alanorth.github.io/cgspace-notes/2019-10/</loc>
-    <lastmod>2019-10-28T13:41:08+02:00</lastmod>
+    <lastmod>2019-10-28T13:50:17+02:00</lastmod>
  </url>
  
  <url>
--- a/docs/tags/migration/index.html
+++ b/docs/tags/migration/index.html
@ -0,0 +1,185 @@
+<!DOCTYPE html>
+<html lang="en" >
+
+  <head>
+    <meta charset="utf-8">
+<meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">
+
+<meta property="og:title" content="Migration" />
+<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
+<meta property="og:type" content="website" />
+<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/tags/migration/" />
+
+<meta property="og:updated_time" content="2019-10-28T13:27:35+02:00" />
+
+<meta name="twitter:card" content="summary"/>
+<meta name="twitter:title" content="Migration"/>
+<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
+<meta name="generator" content="Hugo 0.59.0" />
+
+
+    
+      
+    
+
+    <link rel="canonical" href="https://alanorth.github.io/cgspace-notes/tags/migration/">
+
+    <title>CGSpace Notes</title>
+
+    
+    <!-- combined, minified CSS -->
+    <link href="https://alanorth.github.io/cgspace-notes/css/style.css" rel="stylesheet" integrity="sha384-G5B34w7DFTumWTswxYzTX7NWfbvQEg1HbFFEg6ItN03uTAAoS2qkPS/fu3LhuuSA" crossorigin="anonymous">
+    
+
+    <!-- RSS 2.0 feed -->
+    <link rel="alternate" type="application/rss+xml" href="https://alanorth.github.io/cgspace-notes/tags/migration/index.xml" title="CGSpace Notes" />
+    
+
+    
+
+    
+
+  </head>
+
+  <body>
+
+    
+    <div class="blog-masthead">
+      <div class="container">
+        <nav class="nav blog-nav">
+          <a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
+        </nav>
+      </div>
+    </div>
+    
+
+    
+    
+    <header class="blog-header">
+      <div class="container">
+        <h1 class="blog-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/" rel="home">CGSpace Notes</a></h1>
+        <p class="lead blog-description" dir="auto">Documenting day-to-day work on the <a href="https://cgspace.cgiar.org">CGSpace</a> repository.</p>
+      </div>
+    </header>
+    
+    
+
+    
+    <div class="container">
+      <div class="row">
+        <div class="col-sm-8 blog-main">
+
+          
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></h2>
+    <p class="blog-post-meta"><time datetime="2019-10-28T13:27:35&#43;02:00">Mon Oct 28, 2019</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+<i class="fa fa-tag" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/tags/migration" rel="tag">Migration</a>
+
+</p>
+  </header>
+  <p>Possible changes to CGSpace metadata fields to align more with DC, QDC, and DCTERMS as well as CG Core v2.</p>
+
+<p>With reference to <a href="https://agriculturalsemantics.github.io/cg-core/cgcore.html">CG Core v2 draft standard</a> by Marie-Angélique as well as <a href="http://www.dublincore.org/specifications/dublin-core/dcmi-terms/">DCMI DCTERMS</a>.</p>
+  <a href='https://alanorth.github.io/cgspace-notes/cgspace-cgcorev2-migration/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+<article class="blog-post">
+  <header>
+    <h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/cgiar-library-migration/">CGIAR Library Migration</a></h2>
+    <p class="blog-post-meta"><time datetime="2017-09-18T16:38:35&#43;03:00">Mon Sep 18, 2017</time> by Alan Orth in 
+<i class="fa fa-folder" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/categories/notes" rel="category tag">Notes</a>
+
+
+<i class="fa fa-tag" aria-hidden="true"></i>&nbsp;<a href="/cgspace-notes/tags/migration" rel="tag">Migration</a>
+
+</p>
+  </header>
+  <p>Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called <em>CGIAR System Organization</em>.</p>
+  <a href='https://alanorth.github.io/cgspace-notes/cgiar-library-migration/'>Read more →</a>
+</article> 
+
+
+
+
+
+
+
+
+        </div> <!-- /.blog-main -->
+
+        <aside class="col-sm-3 ml-auto blog-sidebar">
+  
+
+  
+        <section class="sidebar-module">
+    <h4>Recent Posts</h4>
+    <ol class="list-unstyled">
+
+
+<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
+
+<li><a href="/cgspace-notes/2019-10/">October, 2019</a></li>
+
+<li><a href="/cgspace-notes/2019-09/">September, 2019</a></li>
+
+<li><a href="/cgspace-notes/2019-08/">August, 2019</a></li>
+
+<li><a href="/cgspace-notes/2019-07/">July, 2019</a></li>
+
+    </ol>
+  </section>
+
+  
+
+  
+  <section class="sidebar-module">
+    <h4>Links</h4>
+    <ol class="list-unstyled">
+      
+      <li><a href="https://cgspace.cgiar.org">CGSpace</a></li>
+      
+      <li><a href="https://dspacetest.cgiar.org">DSpace Test</a></li>
+      
+      <li><a href="https://github.com/ilri/DSpace">CGSpace @ GitHub</a></li>
+      
+    </ol>
+  </section>
+  
+</aside>
+
+
+      </div> <!-- /.row -->
+    </div> <!-- /.container -->
+    
+
+    
+    <footer class="blog-footer">
+      <p dir="auto">
+      
+      Blog template created by <a href="https://twitter.com/mdo">@mdo</a>, ported to Hugo by <a href='https://twitter.com/mralanorth'>@mralanorth</a>.
+      
+      </p>
+      <p>
+      <a href="#">Back to top</a>
+      </p>
+    </footer>
+    
+
+  </body>
+
+</html>
--- a/docs/tags/migration/index.xml
+++ b/docs/tags/migration/index.xml
@ -0,0 +1,35 @@
+<?xml version="1.0" encoding="utf-8" standalone="yes"?>
+<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
+  <channel>
+    <title>Migration on CGSpace Notes</title>
+    <link>https://alanorth.github.io/cgspace-notes/tags/migration/</link>
+    <description>Recent content in Migration on CGSpace Notes</description>
+    <generator>Hugo -- gohugo.io</generator>
+    <language>en-us</language>
+    <lastBuildDate>Mon, 28 Oct 2019 13:27:35 +0200</lastBuildDate>
+    
+	<atom:link href="https://alanorth.github.io/cgspace-notes/tags/migration/index.xml" rel="self" type="application/rss+xml" />
+    
+    
+    <item>
+      <title>CGSpace CG Core v2 Migration</title>
+      <link>https://alanorth.github.io/cgspace-notes/cgspace-cgcorev2-migration/</link>
+      <pubDate>Mon, 28 Oct 2019 13:27:35 +0200</pubDate>
+      
+      <guid>https://alanorth.github.io/cgspace-notes/cgspace-cgcorev2-migration/</guid>
+      <description>&lt;p&gt;Possible changes to CGSpace metadata fields to align more with DC, QDC, and DCTERMS as well as CG Core v2.&lt;/p&gt;
+
+&lt;p&gt;With reference to &lt;a href=&#34;https://agriculturalsemantics.github.io/cg-core/cgcore.html&#34;&gt;CG Core v2 draft standard&lt;/a&gt; by Marie-Angélique as well as &lt;a href=&#34;http://www.dublincore.org/specifications/dublin-core/dcmi-terms/&#34;&gt;DCMI DCTERMS&lt;/a&gt;.&lt;/p&gt;</description>
+    </item>
+    
+    <item>
+      <title>CGIAR Library Migration</title>
+      <link>https://alanorth.github.io/cgspace-notes/cgiar-library-migration/</link>
+      <pubDate>Mon, 18 Sep 2017 16:38:35 +0300</pubDate>
+      
+      <guid>https://alanorth.github.io/cgspace-notes/cgiar-library-migration/</guid>
+      <description>&lt;p&gt;Rough notes for importing the CGIAR Library content. It was decided that this content would go to a new top-level community called &lt;em&gt;CGIAR System Organization&lt;/em&gt;.&lt;/p&gt;</description>
+    </item>
+    
+  </channel>
+</rss>
--- a/docs/tags/migration/page/1/index.html
+++ b/docs/tags/migration/page/1/index.html
@ -0,0 +1 @@
+<!DOCTYPE html><html><head><title>https://alanorth.github.io/cgspace-notes/tags/migration/</title><link rel="canonical" href="https://alanorth.github.io/cgspace-notes/tags/migration/"/><meta name="robots" content="noindex"><meta charset="utf-8" /><meta http-equiv="refresh" content="0; url=https://alanorth.github.io/cgspace-notes/tags/migration/" /></head></html>
				`@ -0,0 +1 @@`
				`<!DOCTYPE html><html><head><title>https://alanorth.github.io/cgspace-notes/tags/migration/</title><link rel="canonical" href="https://alanorth.github.io/cgspace-notes/tags/migration/"/><meta name="robots" content="noindex"><meta charset="utf-8" /><meta http-equiv="refresh" content="0; url=https://alanorth.github.io/cgspace-notes/tags/migration/" /></head></html>`