Update notes for 2019-02-01

content/posts/2019-02.md

@@ -8,6 +8,23 @@ tags: ["Notes"]
 ## 2019-02-01
 
 - Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!
+- The top IPs before, during, and after this latest alert tonight were:
+
+```
+# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "01/Feb/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+```
+
+- `85.25.237.71` is the "Linguee Bot" that I first saw last month
 - The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase
 - There were just over 3 million accesses in the nginx logs last month:
 
@@ -24,5 +41,7 @@ sys     0m1.979s
 
 - Normally I'd say this was very high, but [about this time last year]({{< relref "2018-02.md" >}}) I remember thinking the same thing when we had 3.1 million...
 - I will have to keep an eye on this to see if there is some error in Solr...
+- Atmire sent their [pull request to re-enable the Metadata Quality Module (MQM) on our `5_x-dev` branch](https://github.com/ilri/DSpace/pull/407) today
+  - I will test it next week and send them feedback
 
 <!-- vim: set sw=2 ts=2: -->

docs/2019-01/index.html

@@ -27,7 +27,7 @@ I don’t see anything interesting in the web server logs around that time t
 " />
 <meta property="og:type" content="article" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2019-01/" /><meta property="article:published_time" content="2019-01-02T09:48:30&#43;02:00"/>
-<meta property="article:modified_time" content="2019-01-27T17:25:19&#43;02:00"/>
+<meta property="article:modified_time" content="2019-02-01T21:45:50&#43;02:00"/>
 
 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="January, 2019"/>
@@ -62,7 +62,7 @@ I don&rsquo;t see anything interesting in the web server logs around that time t
   "url": "https://alanorth.github.io/cgspace-notes/2019-01/",
   "wordCount": "5532",
   "datePublished": "2019-01-02T09:48:30&#43;02:00",
-  "dateModified": "2019-01-27T17:25:19&#43;02:00",
+  "dateModified": "2019-02-01T21:45:50&#43;02:00",
   "author": {
     "@type": "Person",
     "name": "Alan Orth"

docs/2019-02/index.html

@@ -10,6 +10,24 @@
 
 
 Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!
+The top IPs before, during, and after this latest alert tonight were:
+
+
+# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "01/Feb/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+
+
+
+85.25.237.71 is the “Linguee Bot” that I first saw last month
 The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase
 There were just over 3 million accesses in the nginx logs last month:
 
@@ -23,7 +41,7 @@ sys     0m1.979s
 " />
 <meta property="og:type" content="article" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2019-02/" /><meta property="article:published_time" content="2019-02-01T21:37:30&#43;02:00"/>
-<meta property="article:modified_time" content="2019-02-01T21:37:30&#43;02:00"/>
+<meta property="article:modified_time" content="2019-02-01T21:46:09&#43;02:00"/>
 
 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="February, 2019"/>
@@ -31,6 +49,24 @@ sys     0m1.979s
 
 
 Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!
+The top IPs before, during, and after this latest alert tonight were:
+
+
+# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;01/Feb/2019:(17|18|19|20|21)&quot; | awk &#39;{print $1}&#39; | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+
+
+
+85.25.237.71 is the &ldquo;Linguee Bot&rdquo; that I first saw last month
 The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase
 There were just over 3 million accesses in the nginx logs last month:
 
@@ -52,9 +88,9 @@ sys     0m1.979s
   "@type": "BlogPosting",
   "headline": "February, 2019",
   "url": "https://alanorth.github.io/cgspace-notes/2019-02/",
-  "wordCount": "132",
+  "wordCount": "227",
   "datePublished": "2019-02-01T21:37:30&#43;02:00",
-  "dateModified": "2019-02-01T21:37:30&#43;02:00",
+  "dateModified": "2019-02-01T21:46:09&#43;02:00",
   "author": {
     "@type": "Person",
     "name": "Alan Orth"
@@ -126,6 +162,24 @@ sys     0m1.979s
 
 <ul>
 <li>Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!</li>
+<li>The top IPs before, during, and after this latest alert tonight were:</li>
+</ul>
+
+<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;01/Feb/2019:(17|18|19|20|21)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+</code></pre>
+
+<ul>
+<li><code>85.25.237.71</code> is the &ldquo;Linguee Bot&rdquo; that I first saw last month</li>
 <li>The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase</li>
 <li>There were just over 3 million accesses in the nginx logs last month:</li>
 </ul>
@@ -141,6 +195,11 @@ sys     0m1.979s
 <ul>
 <li>Normally I&rsquo;d say this was very high, but <a href="/cgspace-notes/2018-02/">about this time last year</a> I remember thinking the same thing when we had 3.1 million&hellip;</li>
 <li>I will have to keep an eye on this to see if there is some error in Solr&hellip;</li>
+<li>Atmire sent their <a href="https://github.com/ilri/DSpace/pull/407">pull request to re-enable the Metadata Quality Module (MQM) on our <code>5_x-dev</code> branch</a> today
+
+<ul>
+<li>I will test it next week and send them feedback</li>
+</ul></li>
 </ul>
 
 <!-- vim: set sw=2 ts=2: -->

docs/categories/index.html

@@ -102,6 +102,24 @@
 
 <ul>
 <li>Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!</li>
+<li>The top IPs before, during, and after this latest alert tonight were:</li>
+</ul>
+
+<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;01/Feb/2019:(17|18|19|20|21)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+</code></pre>
+
+<ul>
+<li><code>85.25.237.71</code> is the &ldquo;Linguee Bot&rdquo; that I first saw last month</li>
 <li>The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase</li>
 <li>There were just over 3 million accesses in the nginx logs last month:</li>
 </ul>

docs/index.html

@@ -104,6 +104,24 @@
 
 <ul>
 <li>Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!</li>
+<li>The top IPs before, during, and after this latest alert tonight were:</li>
+</ul>
+
+<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;01/Feb/2019:(17|18|19|20|21)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+</code></pre>
+
+<ul>
+<li><code>85.25.237.71</code> is the &ldquo;Linguee Bot&rdquo; that I first saw last month</li>
 <li>The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase</li>
 <li>There were just over 3 million accesses in the nginx logs last month:</li>
 </ul>

docs/index.xml

@@ -21,6 +21,24 @@
 
 <ul>
 <li>Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!</li>
+<li>The top IPs before, during, and after this latest alert tonight were:</li>
+</ul>
+
+<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "01/Feb/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+</code></pre>
+
+<ul>
+<li><code>85.25.237.71</code> is the “Linguee Bot” that I first saw last month</li>
 <li>The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase</li>
 <li>There were just over 3 million accesses in the nginx logs last month:</li>
 </ul>

docs/posts/index.html

@@ -104,6 +104,24 @@
 
 <ul>
 <li>Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!</li>
+<li>The top IPs before, during, and after this latest alert tonight were:</li>
+</ul>
+
+<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;01/Feb/2019:(17|18|19|20|21)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+</code></pre>
+
+<ul>
+<li><code>85.25.237.71</code> is the &ldquo;Linguee Bot&rdquo; that I first saw last month</li>
 <li>The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase</li>
 <li>There were just over 3 million accesses in the nginx logs last month:</li>
 </ul>

docs/posts/index.xml

@@ -21,6 +21,24 @@
 
 <ul>
 <li>Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!</li>
+<li>The top IPs before, during, and after this latest alert tonight were:</li>
+</ul>
+
+<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "01/Feb/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+</code></pre>
+
+<ul>
+<li><code>85.25.237.71</code> is the “Linguee Bot” that I first saw last month</li>
 <li>The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase</li>
 <li>There were just over 3 million accesses in the nginx logs last month:</li>
 </ul>

docs/robots.txt

@@ -44,7 +44,7 @@ Disallow: /cgspace-notes/2015-12/
 Disallow: /cgspace-notes/2015-11/
 Disallow: /cgspace-notes/
 Disallow: /cgspace-notes/categories/
-Disallow: /cgspace-notes/tags/notes/
 Disallow: /cgspace-notes/categories/notes/
+Disallow: /cgspace-notes/tags/notes/
 Disallow: /cgspace-notes/posts/
 Disallow: /cgspace-notes/tags/

docs/sitemap.xml

@@ -4,12 +4,12 @@
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/2019-02/</loc>
-    <lastmod>2019-02-01T21:37:30+02:00</lastmod>
+    <lastmod>2019-02-01T21:46:09+02:00</lastmod>
   </url>
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/2019-01/</loc>
-    <lastmod>2019-01-27T17:25:19+02:00</lastmod>
+    <lastmod>2019-02-01T21:45:50+02:00</lastmod>
   </url>
   
   <url>
@@ -209,7 +209,7 @@
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/</loc>
-    <lastmod>2019-02-01T21:37:30+02:00</lastmod>
+    <lastmod>2019-02-01T21:46:09+02:00</lastmod>
     <priority>0</priority>
   </url>
   
@@ -218,27 +218,27 @@
     <priority>0</priority>
   </url>
   
-  <url>
-    <loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
-    <lastmod>2019-02-01T21:37:30+02:00</lastmod>
-    <priority>0</priority>
-  </url>
-  
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
     <lastmod>2018-03-09T22:10:33+02:00</lastmod>
     <priority>0</priority>
   </url>
   
+  <url>
+    <loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
+    <lastmod>2019-02-01T21:46:09+02:00</lastmod>
+    <priority>0</priority>
+  </url>
+  
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
-    <lastmod>2019-02-01T21:37:30+02:00</lastmod>
+    <lastmod>2019-02-01T21:46:09+02:00</lastmod>
     <priority>0</priority>
   </url>
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
-    <lastmod>2019-02-01T21:37:30+02:00</lastmod>
+    <lastmod>2019-02-01T21:46:09+02:00</lastmod>
     <priority>0</priority>
   </url>
   

docs/tags/index.html

@@ -104,6 +104,24 @@
 
 <ul>
 <li>Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!</li>
+<li>The top IPs before, during, and after this latest alert tonight were:</li>
+</ul>
+
+<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;01/Feb/2019:(17|18|19|20|21)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+</code></pre>
+
+<ul>
+<li><code>85.25.237.71</code> is the &ldquo;Linguee Bot&rdquo; that I first saw last month</li>
 <li>The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase</li>
 <li>There were just over 3 million accesses in the nginx logs last month:</li>
 </ul>

docs/tags/notes/index.html

@@ -89,6 +89,24 @@
 
 <ul>
 <li>Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!</li>
+<li>The top IPs before, during, and after this latest alert tonight were:</li>
+</ul>
+
+<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;01/Feb/2019:(17|18|19|20|21)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+</code></pre>
+
+<ul>
+<li><code>85.25.237.71</code> is the &ldquo;Linguee Bot&rdquo; that I first saw last month</li>
 <li>The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase</li>
 <li>There were just over 3 million accesses in the nginx logs last month:</li>
 </ul>

docs/tags/notes/index.xml

@@ -21,6 +21,24 @@
 
 <ul>
 <li>Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!</li>
+<li>The top IPs before, during, and after this latest alert tonight were:</li>
+</ul>
+
+<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "01/Feb/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+</code></pre>
+
+<ul>
+<li><code>85.25.237.71</code> is the “Linguee Bot” that I first saw last month</li>
 <li>The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase</li>
 <li>There were just over 3 million accesses in the nginx logs last month:</li>
 </ul>