diff --git a/content/posts/2019-02.md b/content/posts/2019-02.md index 4274c9dd0..6d188bfe8 100644 --- a/content/posts/2019-02.md +++ b/content/posts/2019-02.md @@ -8,6 +8,23 @@ tags: ["Notes"] ## 2019-02-01 - Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again! +- The top IPs before, during, and after this latest alert tonight were: + +``` +# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "01/Feb/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 245 207.46.13.5 + 332 54.70.40.11 + 385 5.143.231.38 + 405 207.46.13.173 + 405 207.46.13.75 + 1117 66.249.66.219 + 1121 35.237.175.180 + 1546 5.9.6.51 + 2474 45.5.186.2 + 5490 85.25.237.71 +``` + +- `85.25.237.71` is the "Linguee Bot" that I first saw last month - The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase - There were just over 3 million accesses in the nginx logs last month: @@ -24,5 +41,7 @@ sys 0m1.979s - Normally I'd say this was very high, but [about this time last year]({{< relref "2018-02.md" >}}) I remember thinking the same thing when we had 3.1 million... - I will have to keep an eye on this to see if there is some error in Solr... +- Atmire sent their [pull request to re-enable the Metadata Quality Module (MQM) on our `5_x-dev` branch](https://github.com/ilri/DSpace/pull/407) today + - I will test it next week and send them feedback diff --git a/docs/2019-01/index.html b/docs/2019-01/index.html index 1cfa36d04..d651220d3 100644 --- a/docs/2019-01/index.html +++ b/docs/2019-01/index.html @@ -27,7 +27,7 @@ I don’t see anything interesting in the web server logs around that time t " /> - + @@ -62,7 +62,7 @@ I don’t see anything interesting in the web server logs around that time t "url": "https://alanorth.github.io/cgspace-notes/2019-01/", "wordCount": "5532", "datePublished": "2019-01-02T09:48:30+02:00", - "dateModified": "2019-01-27T17:25:19+02:00", + "dateModified": "2019-02-01T21:45:50+02:00", "author": { "@type": "Person", "name": "Alan Orth" diff --git a/docs/2019-02/index.html b/docs/2019-02/index.html index 9bcb79f19..0298bc275 100644 --- a/docs/2019-02/index.html +++ b/docs/2019-02/index.html @@ -10,6 +10,24 @@ Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again! +The top IPs before, during, and after this latest alert tonight were: + + +# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "01/Feb/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 245 207.46.13.5 + 332 54.70.40.11 + 385 5.143.231.38 + 405 207.46.13.173 + 405 207.46.13.75 + 1117 66.249.66.219 + 1121 35.237.175.180 + 1546 5.9.6.51 + 2474 45.5.186.2 + 5490 85.25.237.71 + + + +85.25.237.71 is the “Linguee Bot” that I first saw last month The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase There were just over 3 million accesses in the nginx logs last month: @@ -23,7 +41,7 @@ sys 0m1.979s " /> - + @@ -31,6 +49,24 @@ sys 0m1.979s Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again! +The top IPs before, during, and after this latest alert tonight were: + + +# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "01/Feb/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 245 207.46.13.5 + 332 54.70.40.11 + 385 5.143.231.38 + 405 207.46.13.173 + 405 207.46.13.75 + 1117 66.249.66.219 + 1121 35.237.175.180 + 1546 5.9.6.51 + 2474 45.5.186.2 + 5490 85.25.237.71 + + + +85.25.237.71 is the “Linguee Bot” that I first saw last month The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase There were just over 3 million accesses in the nginx logs last month: @@ -52,9 +88,9 @@ sys 0m1.979s "@type": "BlogPosting", "headline": "February, 2019", "url": "https://alanorth.github.io/cgspace-notes/2019-02/", - "wordCount": "132", + "wordCount": "227", "datePublished": "2019-02-01T21:37:30+02:00", - "dateModified": "2019-02-01T21:37:30+02:00", + "dateModified": "2019-02-01T21:46:09+02:00", "author": { "@type": "Person", "name": "Alan Orth" @@ -126,6 +162,24 @@ sys 0m1.979s + +
# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "01/Feb/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+
+ + @@ -141,6 +195,11 @@ sys 0m1.979s diff --git a/docs/categories/index.html b/docs/categories/index.html index b446f7ea9..5ecd57a7a 100644 --- a/docs/categories/index.html +++ b/docs/categories/index.html @@ -102,6 +102,24 @@ + +
# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "01/Feb/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+
+ + diff --git a/docs/index.html b/docs/index.html index ea2d4b07c..d11cfb98d 100644 --- a/docs/index.html +++ b/docs/index.html @@ -104,6 +104,24 @@ + +
# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "01/Feb/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+
+ + diff --git a/docs/index.xml b/docs/index.xml index d3c66abbd..b3de74ab6 100644 --- a/docs/index.xml +++ b/docs/index.xml @@ -21,6 +21,24 @@ <ul> <li>Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!</li> +<li>The top IPs before, during, and after this latest alert tonight were:</li> +</ul> + +<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;01/Feb/2019:(17|18|19|20|21)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 245 207.46.13.5 + 332 54.70.40.11 + 385 5.143.231.38 + 405 207.46.13.173 + 405 207.46.13.75 + 1117 66.249.66.219 + 1121 35.237.175.180 + 1546 5.9.6.51 + 2474 45.5.186.2 + 5490 85.25.237.71 +</code></pre> + +<ul> +<li><code>85.25.237.71</code> is the &ldquo;Linguee Bot&rdquo; that I first saw last month</li> <li>The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase</li> <li>There were just over 3 million accesses in the nginx logs last month:</li> </ul> diff --git a/docs/posts/index.html b/docs/posts/index.html index 036f9620a..70d3ea7c3 100644 --- a/docs/posts/index.html +++ b/docs/posts/index.html @@ -104,6 +104,24 @@ + +
# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "01/Feb/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+
+ + diff --git a/docs/posts/index.xml b/docs/posts/index.xml index ace5eb869..7b8c9f13f 100644 --- a/docs/posts/index.xml +++ b/docs/posts/index.xml @@ -21,6 +21,24 @@ <ul> <li>Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!</li> +<li>The top IPs before, during, and after this latest alert tonight were:</li> +</ul> + +<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;01/Feb/2019:(17|18|19|20|21)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 245 207.46.13.5 + 332 54.70.40.11 + 385 5.143.231.38 + 405 207.46.13.173 + 405 207.46.13.75 + 1117 66.249.66.219 + 1121 35.237.175.180 + 1546 5.9.6.51 + 2474 45.5.186.2 + 5490 85.25.237.71 +</code></pre> + +<ul> +<li><code>85.25.237.71</code> is the &ldquo;Linguee Bot&rdquo; that I first saw last month</li> <li>The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase</li> <li>There were just over 3 million accesses in the nginx logs last month:</li> </ul> diff --git a/docs/robots.txt b/docs/robots.txt index 66dc42771..d85aff9f8 100644 --- a/docs/robots.txt +++ b/docs/robots.txt @@ -44,7 +44,7 @@ Disallow: /cgspace-notes/2015-12/ Disallow: /cgspace-notes/2015-11/ Disallow: /cgspace-notes/ Disallow: /cgspace-notes/categories/ -Disallow: /cgspace-notes/tags/notes/ Disallow: /cgspace-notes/categories/notes/ +Disallow: /cgspace-notes/tags/notes/ Disallow: /cgspace-notes/posts/ Disallow: /cgspace-notes/tags/ diff --git a/docs/sitemap.xml b/docs/sitemap.xml index cdbb69be7..470ef7d6d 100644 --- a/docs/sitemap.xml +++ b/docs/sitemap.xml @@ -4,12 +4,12 @@ https://alanorth.github.io/cgspace-notes/2019-02/ - 2019-02-01T21:37:30+02:00 + 2019-02-01T21:46:09+02:00 https://alanorth.github.io/cgspace-notes/2019-01/ - 2019-01-27T17:25:19+02:00 + 2019-02-01T21:45:50+02:00 @@ -209,7 +209,7 @@ https://alanorth.github.io/cgspace-notes/ - 2019-02-01T21:37:30+02:00 + 2019-02-01T21:46:09+02:00 0 @@ -218,27 +218,27 @@ 0 - - https://alanorth.github.io/cgspace-notes/tags/notes/ - 2019-02-01T21:37:30+02:00 - 0 - - https://alanorth.github.io/cgspace-notes/categories/notes/ 2018-03-09T22:10:33+02:00 0 + + https://alanorth.github.io/cgspace-notes/tags/notes/ + 2019-02-01T21:46:09+02:00 + 0 + + https://alanorth.github.io/cgspace-notes/posts/ - 2019-02-01T21:37:30+02:00 + 2019-02-01T21:46:09+02:00 0 https://alanorth.github.io/cgspace-notes/tags/ - 2019-02-01T21:37:30+02:00 + 2019-02-01T21:46:09+02:00 0 diff --git a/docs/tags/index.html b/docs/tags/index.html index ff304d435..12178b481 100644 --- a/docs/tags/index.html +++ b/docs/tags/index.html @@ -104,6 +104,24 @@ + +
# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "01/Feb/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+
+ + diff --git a/docs/tags/notes/index.html b/docs/tags/notes/index.html index b648ffe66..c26512689 100644 --- a/docs/tags/notes/index.html +++ b/docs/tags/notes/index.html @@ -89,6 +89,24 @@ + +
# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "01/Feb/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    245 207.46.13.5
+    332 54.70.40.11
+    385 5.143.231.38
+    405 207.46.13.173
+    405 207.46.13.75
+   1117 66.249.66.219
+   1121 35.237.175.180
+   1546 5.9.6.51
+   2474 45.5.186.2
+   5490 85.25.237.71
+
+ + diff --git a/docs/tags/notes/index.xml b/docs/tags/notes/index.xml index 41d43641c..4e666713d 100644 --- a/docs/tags/notes/index.xml +++ b/docs/tags/notes/index.xml @@ -21,6 +21,24 @@ <ul> <li>Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!</li> +<li>The top IPs before, during, and after this latest alert tonight were:</li> +</ul> + +<pre><code># zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;01/Feb/2019:(17|18|19|20|21)&quot; | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 245 207.46.13.5 + 332 54.70.40.11 + 385 5.143.231.38 + 405 207.46.13.173 + 405 207.46.13.75 + 1117 66.249.66.219 + 1121 35.237.175.180 + 1546 5.9.6.51 + 2474 45.5.186.2 + 5490 85.25.237.71 +</code></pre> + +<ul> +<li><code>85.25.237.71</code> is the &ldquo;Linguee Bot&rdquo; that I first saw last month</li> <li>The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase</li> <li>There were just over 3 million accesses in the nginx logs last month:</li> </ul>