Update notes for 2019-03-31

content/posts/2019-03.md

@@ -1019,5 +1019,19 @@ $ time http --print h 'https://cgspace.cgiar.org/rest/items?expand=metadata,bits
     - Regarding RAM, our JVM heap is 8GB and we leave the rest of the system's 32GB of RAM to PostgreSQL and Solr buffers
     - Seeing as we have 56GB of Solr data it might be better to have more RAM in order to keep more of it in memory
     - Also, I know that the Linode block storage is a major bottleneck for Solr indexing
+- Looking at the weird issue with shitloads of downloads on the [CTA item](https://cgspace.cgiar.org/handle/10568/100289) again
+- The item was added on 2019-03-13 and these three IPs have attempted to download the item's bitstream 43,000 times since it was added eighteen days ago:
+
+```
+# zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 /var/log/nginx/access.log.{2..17}.gz | grep 'Spore-192-EN-web.pdf' | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 5
+     42 196.43.180.134
+    621 185.247.144.227
+   8102 18.194.46.84
+  14927 18.196.196.108
+  20265 18.195.78.144
+```
+
+- I will send a mail to CTA to ask if they know these IPs
+- I wonder if the Cocoon errors we had earlier this month were inadvertently related to the CPU steal issue... I see very low occurrences of the "Can not load requested doc" error in the Cocoon logs the past few days
 
 <!-- vim: set sw=2 ts=2: -->

docs/2019-03/index.html

@@ -25,7 +25,7 @@ I think I will need to ask Udana to re-copy and paste the abstracts with more ca
 <meta property="og:type" content="article" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2019-03/" />
 <meta property="article:published_time" content="2019-03-01T12:16:30&#43;01:00"/>
-<meta property="article:modified_time" content="2019-03-31T10:20:45&#43;03:00"/>
+<meta property="article:modified_time" content="2019-03-31T13:34:41&#43;03:00"/>
 
 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="March, 2019"/>
@@ -55,9 +55,9 @@ I think I will need to ask Udana to re-copy and paste the abstracts with more ca
   "@type": "BlogPosting",
   "headline": "March, 2019",
   "url": "https://alanorth.github.io/cgspace-notes/2019-03/",
-  "wordCount": "6563",
+  "wordCount": "6692",
   "datePublished": "2019-03-01T12:16:30&#43;01:00",
-  "dateModified": "2019-03-31T10:20:45&#43;03:00",
+  "dateModified": "2019-03-31T13:34:41&#43;03:00",
   "author": {
     "@type": "Person",
     "name": "Alan Orth"
@@ -1332,6 +1332,21 @@ sys     0m2.551s
 <li>Seeing as we have 56GB of Solr data it might be better to have more RAM in order to keep more of it in memory</li>
 <li>Also, I know that the Linode block storage is a major bottleneck for Solr indexing</li>
 </ul></li>
+<li>Looking at the weird issue with shitloads of downloads on the <a href="https://cgspace.cgiar.org/handle/10568/100289">CTA item</a> again</li>
+<li>The item was added on 2019-03-13 and these three IPs have attempted to download the item&rsquo;s bitstream 43,000 times since it was added eighteen days ago:</li>
+</ul>
+
+<pre><code># zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 /var/log/nginx/access.log.{2..17}.gz | grep 'Spore-192-EN-web.pdf' | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 5
+     42 196.43.180.134
+    621 185.247.144.227
+   8102 18.194.46.84
+  14927 18.196.196.108
+  20265 18.195.78.144
+</code></pre>
+
+<ul>
+<li>I will send a mail to CTA to ask if they know these IPs</li>
+<li>I wonder if the Cocoon errors we had earlier this month were inadvertently related to the CPU steal issue&hellip; I see very low occurrences of the &ldquo;Can not load requested doc&rdquo; error in the Cocoon logs the past few days</li>
 </ul>
 
 <!-- vim: set sw=2 ts=2: -->

docs/sitemap.xml

@@ -4,7 +4,7 @@
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/2019-03/</loc>
-    <lastmod>2019-03-31T10:20:45+03:00</lastmod>
+    <lastmod>2019-03-31T13:34:41+03:00</lastmod>
   </url>
   
   <url>
@@ -214,7 +214,7 @@
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/</loc>
-    <lastmod>2019-03-31T10:20:45+03:00</lastmod>
+    <lastmod>2019-03-31T13:34:41+03:00</lastmod>
     <priority>0</priority>
   </url>
   
@@ -225,7 +225,7 @@
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
-    <lastmod>2019-03-31T10:20:45+03:00</lastmod>
+    <lastmod>2019-03-31T13:34:41+03:00</lastmod>
     <priority>0</priority>
   </url>
   
@@ -237,13 +237,13 @@
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
-    <lastmod>2019-03-31T10:20:45+03:00</lastmod>
+    <lastmod>2019-03-31T13:34:41+03:00</lastmod>
     <priority>0</priority>
   </url>
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
-    <lastmod>2019-03-31T10:20:45+03:00</lastmod>
+    <lastmod>2019-03-31T13:34:41+03:00</lastmod>
     <priority>0</priority>
   </url>