Add notes for 2019-12-17

docs/2016-12/index.html

@@ -43,7 +43,7 @@ I see thousands of them in the logs for the last few months, so it's not rel
 I've raised a ticket with Atmire to ask
 Another worrying error from dspace.log is:
 "/>
-<meta name="generator" content="Hugo 0.60.1" />
+<meta name="generator" content="Hugo 0.61.0" />
 
 
     
@@ -124,7 +124,7 @@ Another worrying error from dspace.log is:
 
 </p>
   </header>
-  <h2 id="20161202">2016-12-02</h2>
+  <h2 id="2016-12-02">2016-12-02</h2>
 <ul>
 <li>CGSpace was down for five hours in the morning while I was sleeping</li>
 <li>While looking in the logs for errors, I see tons of warnings about Atmire MQM:</li>
@@ -242,7 +242,7 @@ org.apache.solr.client.solrj.SolrServerException: Server refused connection at:
 <li>Also, the disk is nearly full because of log file issues, so I'm running some compression on DSpace logs</li>
 <li>Normally these stay uncompressed for a month just in case we need to look at them, so now I've just compressed anything older than 2 weeks so we can get some disk space back</li>
 </ul>
-<h2 id="20161204">2016-12-04</h2>
+<h2 id="2016-12-04">2016-12-04</h2>
 <ul>
 <li>I got a weird report from the CGSpace checksum checker this morning</li>
 <li>It says 732 bitstreams have potential issues, for example:</li>
@@ -293,7 +293,7 @@ GC_TUNE=&quot;-XX:-UseSuperWord \
 <li>I need to try these because they are recommended by the Solr project itself</li>
 <li>Also, as always, I need to read <a href="https://wiki.apache.org/solr/ShawnHeisey">Shawn Heisey's wiki page on Solr</a></li>
 </ul>
-<h2 id="20161205">2016-12-05</h2>
+<h2 id="2016-12-05">2016-12-05</h2>
 <ul>
 <li>I did some basic benchmarking on a local DSpace before and after the JVM settings above, but there wasn't anything amazingly obvious</li>
 <li>I want to make the changes on DSpace Test and monitor the JVM heap graphs for a few days to see if they change the JVM GC patterns or anything (munin graphs)</li>
@@ -307,7 +307,7 @@ GC_TUNE=&quot;-XX:-UseSuperWord \
 </code></pre><ul>
 <li>I haven't tested it yet, but I created a pull request: <a href="https://github.com/ilri/DSpace/pull/289">#289</a></li>
 </ul>
-<h2 id="20161206">2016-12-06</h2>
+<h2 id="2016-12-06">2016-12-06</h2>
 <ul>
 <li>Some author authority corrections and name standardizations for Peter:</li>
 </ul>
@@ -360,7 +360,7 @@ java.lang.NullPointerException
 real    8m39.913s
 user    1m54.190s
 sys     0m22.647s
-</code></pre><h2 id="20161207">2016-12-07</h2>
+</code></pre><h2 id="2016-12-07">2016-12-07</h2>
 <ul>
 <li>For what it's worth, after running the same SQL updates on my local test server, <code>index-authority</code> runs and completes just fine</li>
 <li>I will have to test more</li>
@@ -459,7 +459,7 @@ update metadatavalue set text_value = 'Hoek, Rein van der', authority='4d6cbce2-
 update metadatavalue set authority='18349f29-61b1-44d7-ac60-89e55546e812', confidence=600 where resource_type_id=2 and metadata_field_id=3 and text_value like 'Thorne, P%';
 update metadatavalue set authority='0d8369bb-57f7-4b2f-92aa-af820b183aca', confidence=600 where resource_type_id=2 and metadata_field_id=3 and text_value like 'Thornton, P%';
 update metadatavalue set text_value='Grace, Delia', authority='bfa61d7c-7583-4175-991c-2e7315000f0c', confidence=600 where resource_type_id=2 and metadata_field_id=3 and text_value like 'Grace, D%';
-</code></pre><h2 id="20161208">2016-12-08</h2>
+</code></pre><h2 id="2016-12-08">2016-12-08</h2>
 <ul>
 <li>Something weird happened and Peter Thorne's names all ended up as &ldquo;Thorne&rdquo;, I guess because the original authority had that as its name value:</li>
 </ul>
@@ -506,7 +506,7 @@ UPDATE 362
 <li>In other news, I think we should really be using more RAM for PostgreSQL's <code>shared_buffers</code></li>
 <li>The <a href="https://www.postgresql.org/docs/9.5/static/runtime-config-resource.html">PostgreSQL documentation</a> recommends using 25% of the system's RAM on dedicated systems, but we should use a bit less since we also have a massive JVM heap and also benefit from some RAM being used by the OS cache</li>
 </ul>
-<h2 id="20161209">2016-12-09</h2>
+<h2 id="2016-12-09">2016-12-09</h2>
 <ul>
 <li>More work on finishing rough draft of KM4Dev article</li>
 <li>Set PostgreSQL's <code>shared_buffers</code> on CGSpace to 10% of system RAM (1200MB)</li>
@@ -517,7 +517,7 @@ dspace=# update metadatavalue set authority='2df8136e-d8f4-4142-b58c-562337cab76
 </code></pre><ul>
 <li>The authority IDs were different now than when I was looking a few days ago so I had to adjust them here</li>
 </ul>
-<h2 id="20161211">2016-12-11</h2>
+<h2 id="2016-12-11">2016-12-11</h2>
 <ul>
 <li>After enabling a sizable <code>shared_buffers</code> for CGSpace's PostgreSQL configuration the number of connections to the database dropped significantly</li>
 </ul>
@@ -553,7 +553,7 @@ UPDATE 35
 </code></pre><ul>
 <li>Work on article for KM4Dev journal</li>
 </ul>
-<h2 id="20161213">2016-12-13</h2>
+<h2 id="2016-12-13">2016-12-13</h2>
 <ul>
 <li>Checking in on CGSpace postgres stats again, looks like the <code>shared_buffers</code> change from a few days ago really made a big impact:</li>
 </ul>
@@ -640,7 +640,7 @@ Caused by: java.lang.NoSuchMethodError: com.atmire.statistics.generator.DSpaceOb
 <li>It happens on development and production, so I will have to ask Atmire</li>
 <li>Most likely an issue with installation/configuration</li>
 </ul>
-<h2 id="20161214">2016-12-14</h2>
+<h2 id="2016-12-14">2016-12-14</h2>
 <ul>
 <li>Atmire sent a quick fix for the <code>last-update.txt</code> file not found error</li>
 <li>After applying pull request <a href="https://github.com/ilri/DSpace/pull/291">#291</a> on DSpace Test I no longer see the error in the logs after the <code>UpdateSolrStorageReports</code> task runs</li>
@@ -648,7 +648,7 @@ Caused by: java.lang.NoSuchMethodError: com.atmire.statistics.generator.DSpaceOb
 <li>Made a pull request with a template for the cron jobs (<a href="https://github.com/ilri/rmg-ansible-public/pull/75">#75</a>)</li>
 <li>Testing SMTP from the new CGSpace server and it's not working, I'll have to tell James</li>
 </ul>
-<h2 id="20161215">2016-12-15</h2>
+<h2 id="2016-12-15">2016-12-15</h2>
 <ul>
 <li>Start planning for server migration this weekend, letting users know</li>
 <li>I am trying to figure out what the process is to <a href="http://handle.net/hnr_support.html">update the server's IP in the Handle system</a>, and emailing the hdladmin account bounces(!)</li>
@@ -662,7 +662,7 @@ Caused by: java.lang.NoSuchMethodError: com.atmire.statistics.generator.DSpaceOb
 </ul>
 <p><img src="/cgspace-notes/2016/12/batch-edit1.png" alt="Select all items with &ldquo;rangelands&rdquo; in metadata">
 <img src="/cgspace-notes/2016/12/batch-edit2.png" alt="Add RANGELANDS ILRI subject"></p>
-<h2 id="20161218">2016-12-18</h2>
+<h2 id="2016-12-18">2016-12-18</h2>
 <ul>
 <li>Add four new CRP subjects for 2017 and sort the input forms alphabetically (<a href="https://github.com/ilri/DSpace/pull/294">#294</a>)</li>
 <li>Test the SMTP on the new server and it's working</li>
@@ -737,13 +737,13 @@ $ exit
 </ul>
 </li>
 </ul>
-<h2 id="20161222">2016-12-22</h2>
+<h2 id="2016-12-22">2016-12-22</h2>
 <ul>
 <li>Abenet wanted a CSV of the IITA community, but the web export doesn't include the <code>dc.date.accessioned</code> field</li>
 <li>I had to export it from the command line using the <code>-a</code> flag:</li>
 </ul>
 <pre><code>$ [dspace]/bin/dspace metadata-export -a -f /tmp/iita.csv -i 10568/68616
-</code></pre><h2 id="20161228">2016-12-28</h2>
+</code></pre><h2 id="2016-12-28">2016-12-28</h2>
 <ul>
 <li>We've been getting two alerts per day about CPU usage on the new server from Linode</li>
 <li>These are caused by the batch jobs for Solr etc that run in the early morning hours</li>