Add notes for 2019-03-21

content/posts/2019-03.md

@@ -561,4 +561,39 @@ Max realtime timeout      unlimited            unlimited            us
 - Create a branch for Solr 4.10.4 changes so I can test on DSpace Test (linode19)
   - Deployed Solr 4.10.4 on DSpace Test and will leave it there for a few weeks, as well as on my local environment
 
+## 2019-03-21
+
+- It's been two days since we had the blank page issue on CGSpace, and looking in the Cocoon logs I see very low numbers of the errors that we were seeing the last time the issue occurred:
+
+```
+$ grep 'Can not load requested doc' cocoon.log.2019-03-20 | grep -oE '2019-03-20 [0-9]{2}:' | sort | uniq -c
+      3 2019-03-20 00:
+     12 2019-03-20 02:
+$ grep 'Can not load requested doc' cocoon.log.2019-03-21 | grep -oE '2019-03-21 [0-9]{2}:' | sort | uniq -c
+      4 2019-03-21 00:
+      1 2019-03-21 02:
+      4 2019-03-21 03:
+      1 2019-03-21 05:
+      4 2019-03-21 06:
+     11 2019-03-21 07:
+     14 2019-03-21 08:
+      3 2019-03-21 09:
+      4 2019-03-21 10:
+      5 2019-03-21 11:
+      4 2019-03-21 12:
+      3 2019-03-21 13:
+      6 2019-03-21 14:
+      2 2019-03-21 15:
+      3 2019-03-21 16:
+      3 2019-03-21 18:
+      1 2019-03-21 19:
+      6 2019-03-21 20:
+```
+
+- To investigate the Solr lock issue I added a `find` command to the Tomcat 7 service with `ExecStartPre` and `ExecStopPost` and noticed that the lock files are always there...
+  - Perhaps the lock files are less of an issue than I thought?
+  - I will share my thoughts with the dspace-tech community
+- In other news, I notice that that systemd always thinks that Tomcat has failed when it stops because the JVM exits with code 143, which is apparently normal
+  - We can add `SuccessExitStatus=143` to the systemd service so that it knows this is a successful exit
+
 <!-- vim: set sw=2 ts=2: -->

docs/2019-03/index.html

@@ -25,7 +25,7 @@ I think I will need to ask Udana to re-copy and paste the abstracts with more ca
 <meta property="og:type" content="article" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2019-03/" />
 <meta property="article:published_time" content="2019-03-01T12:16:30&#43;01:00"/>
-<meta property="article:modified_time" content="2019-03-19T23:54:07&#43;02:00"/>
+<meta property="article:modified_time" content="2019-03-21T00:36:18&#43;02:00"/>
 
 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="March, 2019"/>
@@ -55,9 +55,9 @@ I think I will need to ask Udana to re-copy and paste the abstracts with more ca
   "@type": "BlogPosting",
   "headline": "March, 2019",
   "url": "https://alanorth.github.io/cgspace-notes/2019-03/",
-  "wordCount": "3486",
+  "wordCount": "3715",
   "datePublished": "2019-03-01T12:16:30&#43;01:00",
-  "dateModified": "2019-03-19T23:54:07&#43;02:00",
+  "dateModified": "2019-03-21T00:36:18&#43;02:00",
   "author": {
     "@type": "Person",
     "name": "Alan Orth"
@@ -782,6 +782,50 @@ Max realtime timeout      unlimited            unlimited            us
 </ul></li>
 </ul>
 
+<h2 id="2019-03-21">2019-03-21</h2>
+
+<ul>
+<li>It&rsquo;s been two days since we had the blank page issue on CGSpace, and looking in the Cocoon logs I see very low numbers of the errors that we were seeing the last time the issue occurred:</li>
+</ul>
+
+<pre><code>$ grep 'Can not load requested doc' cocoon.log.2019-03-20 | grep -oE '2019-03-20 [0-9]{2}:' | sort | uniq -c
+      3 2019-03-20 00:
+     12 2019-03-20 02:
+$ grep 'Can not load requested doc' cocoon.log.2019-03-21 | grep -oE '2019-03-21 [0-9]{2}:' | sort | uniq -c
+      4 2019-03-21 00:
+      1 2019-03-21 02:
+      4 2019-03-21 03:
+      1 2019-03-21 05:
+      4 2019-03-21 06:
+     11 2019-03-21 07:
+     14 2019-03-21 08:
+      3 2019-03-21 09:
+      4 2019-03-21 10:
+      5 2019-03-21 11:
+      4 2019-03-21 12:
+      3 2019-03-21 13:
+      6 2019-03-21 14:
+      2 2019-03-21 15:
+      3 2019-03-21 16:
+      3 2019-03-21 18:
+      1 2019-03-21 19:
+      6 2019-03-21 20:
+</code></pre>
+
+<ul>
+<li>To investigate the Solr lock issue I added a <code>find</code> command to the Tomcat 7 service with <code>ExecStartPre</code> and <code>ExecStopPost</code> and noticed that the lock files are always there&hellip;
+
+<ul>
+<li>Perhaps the lock files are less of an issue than I thought?</li>
+<li>I will share my thoughts with the dspace-tech community</li>
+</ul></li>
+<li>In other news, I notice that that systemd always thinks that Tomcat has failed when it stops because the JVM exits with code 143, which is apparently normal
+
+<ul>
+<li>We can add <code>SuccessExitStatus=143</code> to the systemd service so that it knows this is a successful exit</li>
+</ul></li>
+</ul>
+
 <!-- vim: set sw=2 ts=2: -->
 
   

docs/robots.txt

@@ -45,7 +45,7 @@ Disallow: /cgspace-notes/2015-12/
 Disallow: /cgspace-notes/2015-11/
 Disallow: /cgspace-notes/
 Disallow: /cgspace-notes/categories/
-Disallow: /cgspace-notes/categories/notes/
 Disallow: /cgspace-notes/tags/notes/
+Disallow: /cgspace-notes/categories/notes/
 Disallow: /cgspace-notes/posts/
 Disallow: /cgspace-notes/tags/

docs/sitemap.xml

@@ -4,7 +4,7 @@
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/2019-03/</loc>
-    <lastmod>2019-03-19T23:54:07+02:00</lastmod>
+    <lastmod>2019-03-21T00:36:18+02:00</lastmod>
   </url>
   
   <url>
@@ -214,7 +214,7 @@
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/</loc>
-    <lastmod>2019-03-19T23:54:07+02:00</lastmod>
+    <lastmod>2019-03-21T00:36:18+02:00</lastmod>
     <priority>0</priority>
   </url>
   
@@ -223,27 +223,27 @@
     <priority>0</priority>
   </url>
   
+  <url>
+    <loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
+    <lastmod>2019-03-21T00:36:18+02:00</lastmod>
+    <priority>0</priority>
+  </url>
+  
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
     <lastmod>2018-03-09T22:10:33+02:00</lastmod>
     <priority>0</priority>
   </url>
   
-  <url>
-    <loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
-    <lastmod>2019-03-19T23:54:07+02:00</lastmod>
-    <priority>0</priority>
-  </url>
-  
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
-    <lastmod>2019-03-19T23:54:07+02:00</lastmod>
+    <lastmod>2019-03-21T00:36:18+02:00</lastmod>
     <priority>0</priority>
   </url>
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
-    <lastmod>2019-03-19T23:54:07+02:00</lastmod>
+    <lastmod>2019-03-21T00:36:18+02:00</lastmod>
     <priority>0</priority>
   </url>