alanorth/cgspace-notes
1
0
Fork 0
mirror of https://github.com/alanorth/cgspace-notes.git synced 2024-12-26 23:14:29 +01:00
Code Issues Projects Releases Wiki Activity

Update notes for 2019-03-31

Browse Source
This commit is contained in:
Alan Orth 2019-03-31 16:09:23 +03:00
parent 5c6c5e78f8
commit 96ae01fa14
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
3 changed files with 37 additions and 8 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

14
content/posts/2019-03.md
View File

@ -1019,5 +1019,19 @@ $ time http --print h 'https://cgspace.cgiar.org/rest/items?expand=metadata,bits
- Regarding RAM, our JVM heap is 8GB and we leave the rest of the system's 32GB of RAM to PostgreSQL and Solr buffers
- Seeing as we have 56GB of Solr data it might be better to have more RAM in order to keep more of it in memory
- Also, I know that the Linode block storage is a major bottleneck for Solr indexing
- Looking at the weird issue with shitloads of downloads on the [CTA item](https://cgspace.cgiar.org/handle/10568/100289) again
- The item was added on 2019-03-13 and these three IPs have attempted to download the item's bitstream 43,000 times since it was added eighteen days ago:
```
# zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 /var/log/nginx/access.log.{2..17}.gz | grep 'Spore-192-EN-web.pdf' | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 5
42 196.43.180.134
621 185.247.144.227
8102 18.194.46.84
14927 18.196.196.108
20265 18.195.78.144
```
- I will send a mail to CTA to ask if they know these IPs
- I wonder if the Cocoon errors we had earlier this month were inadvertently related to the CPU steal issue... I see very low occurrences of the "Can not load requested doc" error in the Cocoon logs the past few days
<!-- vim: set sw=2 ts=2: -->

21
docs/2019-03/index.html
View File

@ -25,7 +25,7 @@ I think I will need to ask Udana to re-copy and paste the abstracts with more ca
<meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2019-03/" />
<meta property="article:published_time" content="2019-03-01T12:16:30&#43;01:00"/>
<meta property="article:modified_time" content="2019-03-31T10:20:45&#43;03:00"/>
<meta property="article:modified_time" content="2019-03-31T13:34:41&#43;03:00"/>
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="March, 2019"/>
@ -55,9 +55,9 @@ I think I will need to ask Udana to re-copy and paste the abstracts with more ca
"@type": "BlogPosting",
"headline": "March, 2019",
"url": "https://alanorth.github.io/cgspace-notes/2019-03/",
"wordCount": "6563",
"wordCount": "6692",
"datePublished": "2019-03-01T12:16:30&#43;01:00",
"dateModified": "2019-03-31T10:20:45&#43;03:00",
"dateModified": "2019-03-31T13:34:41&#43;03:00",
"author": {
"@type": "Person",
"name": "Alan Orth"
@ -1332,6 +1332,21 @@ sys 0m2.551s
<li>Seeing as we have 56GB of Solr data it might be better to have more RAM in order to keep more of it in memory</li>
<li>Also, I know that the Linode block storage is a major bottleneck for Solr indexing</li>
</ul></li>
<li>Looking at the weird issue with shitloads of downloads on the <a href="https://cgspace.cgiar.org/handle/10568/100289">CTA item</a> again</li>
<li>The item was added on 2019-03-13 and these three IPs have attempted to download the item&rsquo;s bitstream 43,000 times since it was added eighteen days ago:</li>
</ul>
<pre><code># zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 /var/log/nginx/access.log.{2..17}.gz | grep 'Spore-192-EN-web.pdf' | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 5
42 196.43.180.134
621 185.247.144.227
8102 18.194.46.84
14927 18.196.196.108
20265 18.195.78.144
</code></pre>
<ul>
<li>I will send a mail to CTA to ask if they know these IPs</li>
<li>I wonder if the Cocoon errors we had earlier this month were inadvertently related to the CPU steal issue&hellip; I see very low occurrences of the &ldquo;Can not load requested doc&rdquo; error in the Cocoon logs the past few days</li>
</ul>
<!-- vim: set sw=2 ts=2: -->

10
docs/sitemap.xml
View File

@ -4,7 +4,7 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/2019-03/</loc>
<lastmod>2019-03-31T10:20:45+03:00</lastmod>
<lastmod>2019-03-31T13:34:41+03:00</lastmod>
</url>
<url>
@ -214,7 +214,7 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/</loc>
<lastmod>2019-03-31T10:20:45+03:00</lastmod>
<lastmod>2019-03-31T13:34:41+03:00</lastmod>
<priority>0</priority>
</url>
@ -225,7 +225,7 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
<lastmod>2019-03-31T10:20:45+03:00</lastmod>
<lastmod>2019-03-31T13:34:41+03:00</lastmod>
<priority>0</priority>
</url>
@ -237,13 +237,13 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
<lastmod>2019-03-31T10:20:45+03:00</lastmod>
<lastmod>2019-03-31T13:34:41+03:00</lastmod>
<priority>0</priority>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
<lastmod>2019-03-31T10:20:45+03:00</lastmod>
<lastmod>2019-03-31T13:34:41+03:00</lastmod>
<priority>0</priority>
</url>