mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-06-25 23:53:46 +02:00
Update notes for 2019-03-31
This commit is contained in:
parent
5c6c5e78f8
commit
96ae01fa14
GPG Key ID:
0FB860CC9C45B1B9
|
|
@ -1019,5 +1019,19 @@ $ time http --print h 'https://cgspace.cgiar.org/rest/items?expand=metadata,bits
|
|||
- Regarding RAM, our JVM heap is 8GB and we leave the rest of the system's 32GB of RAM to PostgreSQL and Solr buffers
|
||||
- Seeing as we have 56GB of Solr data it might be better to have more RAM in order to keep more of it in memory
|
||||
- Also, I know that the Linode block storage is a major bottleneck for Solr indexing
|
||||
- Looking at the weird issue with shitloads of downloads on the [CTA item](https://cgspace.cgiar.org/handle/10568/100289) again
|
||||
- The item was added on 2019-03-13 and these three IPs have attempted to download the item's bitstream 43,000 times since it was added eighteen days ago:
|
||||
|
||||
```
|
||||
# zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 /var/log/nginx/access.log.{2..17}.gz | grep 'Spore-192-EN-web.pdf' | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 5
|
||||
42 196.43.180.134
|
||||
621 185.247.144.227
|
||||
8102 18.194.46.84
|
||||
14927 18.196.196.108
|
||||
20265 18.195.78.144
|
||||
```
|
||||
|
||||
- I will send a mail to CTA to ask if they know these IPs
|
||||
- I wonder if the Cocoon errors we had earlier this month were inadvertently related to the CPU steal issue... I see very low occurrences of the "Can not load requested doc" error in the Cocoon logs the past few days
|
||||
|
||||
<!-- vim: set sw=2 ts=2: -->
|
||||
|
|
|
|||
|
|
@ -25,7 +25,7 @@ I think I will need to ask Udana to re-copy and paste the abstracts with more ca
|
|||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2019-03/" />
|
||||
<meta property="article:published_time" content="2019-03-01T12:16:30+01:00"/>
|
||||
<meta property="article:modified_time" content="2019-03-31T10:20:45+03:00"/>
|
||||
<meta property="article:modified_time" content="2019-03-31T13:34:41+03:00"/>
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="March, 2019"/>
|
||||
|
|
@ -55,9 +55,9 @@ I think I will need to ask Udana to re-copy and paste the abstracts with more ca
|
|||
"@type": "BlogPosting",
|
||||
"headline": "March, 2019",
|
||||
"url": "https://alanorth.github.io/cgspace-notes/2019-03/",
|
||||
"wordCount": "6563",
|
||||
"wordCount": "6692",
|
||||
"datePublished": "2019-03-01T12:16:30+01:00",
|
||||
"dateModified": "2019-03-31T10:20:45+03:00",
|
||||
"dateModified": "2019-03-31T13:34:41+03:00",
|
||||
"author": {
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
|
|
@ -1332,6 +1332,21 @@ sys 0m2.551s
|
|||
<li>Seeing as we have 56GB of Solr data it might be better to have more RAM in order to keep more of it in memory</li>
|
||||
<li>Also, I know that the Linode block storage is a major bottleneck for Solr indexing</li>
|
||||
</ul></li>
|
||||
<li>Looking at the weird issue with shitloads of downloads on the <a href="https://cgspace.cgiar.org/handle/10568/100289">CTA item</a> again</li>
|
||||
<li>The item was added on 2019-03-13 and these three IPs have attempted to download the item’s bitstream 43,000 times since it was added eighteen days ago:</li>
|
||||
</ul>
|
||||
|
||||
<pre><code># zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 /var/log/nginx/access.log.{2..17}.gz | grep 'Spore-192-EN-web.pdf' | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 5
|
||||
42 196.43.180.134
|
||||
621 185.247.144.227
|
||||
8102 18.194.46.84
|
||||
14927 18.196.196.108
|
||||
20265 18.195.78.144
|
||||
</code></pre>
|
||||
|
||||
<ul>
|
||||
<li>I will send a mail to CTA to ask if they know these IPs</li>
|
||||
<li>I wonder if the Cocoon errors we had earlier this month were inadvertently related to the CPU steal issue… I see very low occurrences of the “Can not load requested doc” error in the Cocoon logs the past few days</li>
|
||||
</ul>
|
||||
|
||||
<!-- vim: set sw=2 ts=2: -->
|
||||
|
|
|
|||
|
|
@ -4,7 +4,7 @@
|
|||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2019-03/</loc>
|
||||
<lastmod>2019-03-31T10:20:45+03:00</lastmod>
|
||||
<lastmod>2019-03-31T13:34:41+03:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
|
|
@ -214,7 +214,7 @@
|
|||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/</loc>
|
||||
<lastmod>2019-03-31T10:20:45+03:00</lastmod>
|
||||
<lastmod>2019-03-31T13:34:41+03:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
|
|
@ -225,7 +225,7 @@
|
|||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
|
||||
<lastmod>2019-03-31T10:20:45+03:00</lastmod>
|
||||
<lastmod>2019-03-31T13:34:41+03:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
|
|
@ -237,13 +237,13 @@
|
|||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
|
||||
<lastmod>2019-03-31T10:20:45+03:00</lastmod>
|
||||
<lastmod>2019-03-31T13:34:41+03:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
|
||||
<lastmod>2019-03-31T10:20:45+03:00</lastmod>
|
||||
<lastmod>2019-03-31T13:34:41+03:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
|
|
|
|||
Loading…
Reference in New Issue
Block a user