Add notes for 2019-02-02

content/posts/2019-02.md

@@ -44,4 +44,26 @@ sys     0m1.979s
 - Atmire sent their [pull request to re-enable the Metadata Quality Module (MQM) on our `5_x-dev` branch](https://github.com/ilri/DSpace/pull/407) today
   - I will test it next week and send them feedback
 
+## 2019-02-02
+
+- Another alert from Linode about CGSpace (linode18) this morning, here are the top IPs in the web server logs before, during, and after that time:
+
+```
+# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "02/Feb/2019:0(1|2|3|4|5)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    284 18.195.78.144
+    329 207.46.13.32
+    417 35.237.175.180
+    448 34.218.226.147
+    694 2a01:4f8:13b:1296::2
+    718 2a01:4f8:140:3192::2
+    786 137.108.70.14
+   1002 5.9.6.51
+   6077 85.25.237.71
+   8726 45.5.184.2
+```
+
+- `45.5.184.2` is CIAT and `85.25.237.71` is the new Linguee bot that I first noticed a few days ago
+- I will increase the Linode alert threshold from 275 to 300% because this is becoming too much!
+- I tested the Atmire Metadata Quality Module (MQM)'s duplicate checked on the some [WLE items](https://dspacetest.cgiar.org/handle/10568/81268) that I helped Udana with a few months ago on DSpace Test (linode19) and indeed it found many duplicates!
+
 <!-- vim: set sw=2 ts=2: -->

docs/2019-02/index.html

@@ -41,7 +41,7 @@ sys     0m1.979s
 " />
 <meta property="og:type" content="article" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2019-02/" /><meta property="article:published_time" content="2019-02-01T21:37:30&#43;02:00"/>
-<meta property="article:modified_time" content="2019-02-01T21:46:09&#43;02:00"/>
+<meta property="article:modified_time" content="2019-02-02T00:01:39&#43;02:00"/>
 
 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="February, 2019"/>
@@ -88,9 +88,9 @@ sys     0m1.979s
   "@type": "BlogPosting",
   "headline": "February, 2019",
   "url": "https://alanorth.github.io/cgspace-notes/2019-02/",
-  "wordCount": "227",
+  "wordCount": "367",
   "datePublished": "2019-02-01T21:37:30&#43;02:00",
-  "dateModified": "2019-02-01T21:46:09&#43;02:00",
+  "dateModified": "2019-02-02T00:01:39&#43;02:00",
   "author": {
     "@type": "Person",
     "name": "Alan Orth"
@@ -202,6 +202,31 @@ sys     0m1.979s
 </ul></li>
 </ul>
 
+<h2 id="2019-02-02">2019-02-02</h2>
+
+<ul>
+<li>Another alert from Linode about CGSpace (linode18) this morning, here are the top IPs in the web server logs before, during, and after that time:</li>
+</ul>
+
+<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;02/Feb/2019:0(1|2|3|4|5)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    284 18.195.78.144
+    329 207.46.13.32
+    417 35.237.175.180
+    448 34.218.226.147
+    694 2a01:4f8:13b:1296::2
+    718 2a01:4f8:140:3192::2
+    786 137.108.70.14
+   1002 5.9.6.51
+   6077 85.25.237.71
+   8726 45.5.184.2
+</code></pre>
+
+<ul>
+<li><code>45.5.184.2</code> is CIAT and <code>85.25.237.71</code> is the new Linguee bot that I first noticed a few days ago</li>
+<li>I will increase the Linode alert threshold from 275 to 300% because this is becoming too much!</li>
+<li>I tested the Atmire Metadata Quality Module (MQM)&rsquo;s duplicate checked on the some <a href="https://dspacetest.cgiar.org/handle/10568/81268">WLE items</a> that I helped Udana with a few months ago on DSpace Test (linode19) and indeed it found many duplicates!</li>
+</ul>
+
 <!-- vim: set sw=2 ts=2: -->
 
   

docs/robots.txt

@@ -44,7 +44,7 @@ Disallow: /cgspace-notes/2015-12/
 Disallow: /cgspace-notes/2015-11/
 Disallow: /cgspace-notes/
 Disallow: /cgspace-notes/categories/
-Disallow: /cgspace-notes/categories/notes/
 Disallow: /cgspace-notes/tags/notes/
+Disallow: /cgspace-notes/categories/notes/
 Disallow: /cgspace-notes/posts/
 Disallow: /cgspace-notes/tags/

docs/sitemap.xml

@@ -4,7 +4,7 @@
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/2019-02/</loc>
-    <lastmod>2019-02-01T21:46:09+02:00</lastmod>
+    <lastmod>2019-02-02T00:01:39+02:00</lastmod>
   </url>
   
   <url>
@@ -209,7 +209,7 @@
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/</loc>
-    <lastmod>2019-02-01T21:46:09+02:00</lastmod>
+    <lastmod>2019-02-02T00:01:39+02:00</lastmod>
     <priority>0</priority>
   </url>
   
@@ -218,27 +218,27 @@
     <priority>0</priority>
   </url>
   
+  <url>
+    <loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
+    <lastmod>2019-02-02T00:01:39+02:00</lastmod>
+    <priority>0</priority>
+  </url>
+  
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
     <lastmod>2018-03-09T22:10:33+02:00</lastmod>
     <priority>0</priority>
   </url>
   
-  <url>
-    <loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
-    <lastmod>2019-02-01T21:46:09+02:00</lastmod>
-    <priority>0</priority>
-  </url>
-  
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
-    <lastmod>2019-02-01T21:46:09+02:00</lastmod>
+    <lastmod>2019-02-02T00:01:39+02:00</lastmod>
     <priority>0</priority>
   </url>
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
-    <lastmod>2019-02-01T21:46:09+02:00</lastmod>
+    <lastmod>2019-02-02T00:01:39+02:00</lastmod>
     <priority>0</priority>
   </url>