From 96ae01fa1422c822660181ab486134b74020ce9b Mon Sep 17 00:00:00 2001 From: Alan Orth Date: Sun, 31 Mar 2019 16:09:23 +0300 Subject: [PATCH] Update notes for 2019-03-31 --- content/posts/2019-03.md | 14 ++++++++++++++ docs/2019-03/index.html | 21 ++++++++++++++++++--- docs/sitemap.xml | 10 +++++----- 3 files changed, 37 insertions(+), 8 deletions(-) diff --git a/content/posts/2019-03.md b/content/posts/2019-03.md index ad567eba2..151c73251 100644 --- a/content/posts/2019-03.md +++ b/content/posts/2019-03.md @@ -1019,5 +1019,19 @@ $ time http --print h 'https://cgspace.cgiar.org/rest/items?expand=metadata,bits - Regarding RAM, our JVM heap is 8GB and we leave the rest of the system's 32GB of RAM to PostgreSQL and Solr buffers - Seeing as we have 56GB of Solr data it might be better to have more RAM in order to keep more of it in memory - Also, I know that the Linode block storage is a major bottleneck for Solr indexing +- Looking at the weird issue with shitloads of downloads on the [CTA item](https://cgspace.cgiar.org/handle/10568/100289) again +- The item was added on 2019-03-13 and these three IPs have attempted to download the item's bitstream 43,000 times since it was added eighteen days ago: + +``` +# zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 /var/log/nginx/access.log.{2..17}.gz | grep 'Spore-192-EN-web.pdf' | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 5 + 42 196.43.180.134 + 621 185.247.144.227 + 8102 18.194.46.84 + 14927 18.196.196.108 + 20265 18.195.78.144 +``` + +- I will send a mail to CTA to ask if they know these IPs +- I wonder if the Cocoon errors we had earlier this month were inadvertently related to the CPU steal issue... I see very low occurrences of the "Can not load requested doc" error in the Cocoon logs the past few days diff --git a/docs/2019-03/index.html b/docs/2019-03/index.html index 4f8ca83cd..1d3b72a89 100644 --- a/docs/2019-03/index.html +++ b/docs/2019-03/index.html @@ -25,7 +25,7 @@ I think I will need to ask Udana to re-copy and paste the abstracts with more ca - + @@ -55,9 +55,9 @@ I think I will need to ask Udana to re-copy and paste the abstracts with more ca "@type": "BlogPosting", "headline": "March, 2019", "url": "https://alanorth.github.io/cgspace-notes/2019-03/", - "wordCount": "6563", + "wordCount": "6692", "datePublished": "2019-03-01T12:16:30+01:00", - "dateModified": "2019-03-31T10:20:45+03:00", + "dateModified": "2019-03-31T13:34:41+03:00", "author": { "@type": "Person", "name": "Alan Orth" @@ -1332,6 +1332,21 @@ sys 0m2.551s
  • Seeing as we have 56GB of Solr data it might be better to have more RAM in order to keep more of it in memory
  • Also, I know that the Linode block storage is a major bottleneck for Solr indexing
    • +
  • Looking at the weird issue with shitloads of downloads on the CTA item again
    • +
  • The item was added on 2019-03-13 and these three IPs have attempted to download the item’s bitstream 43,000 times since it was added eighteen days ago:
    • + + +
    # zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 /var/log/nginx/access.log.{2..17}.gz | grep 'Spore-192-EN-web.pdf' | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 5
+     42 196.43.180.134
+    621 185.247.144.227
+   8102 18.194.46.84
+  14927 18.196.196.108
+  20265 18.195.78.144
+
    + + diff --git a/docs/sitemap.xml b/docs/sitemap.xml index b19cec9b3..bd1de0faf 100644 --- a/docs/sitemap.xml +++ b/docs/sitemap.xml @@ -4,7 +4,7 @@ https://alanorth.github.io/cgspace-notes/2019-03/ - 2019-03-31T10:20:45+03:00 + 2019-03-31T13:34:41+03:00 @@ -214,7 +214,7 @@ https://alanorth.github.io/cgspace-notes/ - 2019-03-31T10:20:45+03:00 + 2019-03-31T13:34:41+03:00 0 @@ -225,7 +225,7 @@ https://alanorth.github.io/cgspace-notes/tags/notes/ - 2019-03-31T10:20:45+03:00 + 2019-03-31T13:34:41+03:00 0 @@ -237,13 +237,13 @@ https://alanorth.github.io/cgspace-notes/posts/ - 2019-03-31T10:20:45+03:00 + 2019-03-31T13:34:41+03:00 0 https://alanorth.github.io/cgspace-notes/tags/ - 2019-03-31T10:20:45+03:00 + 2019-03-31T13:34:41+03:00 0