Update notes

This commit is contained in:
Alan Orth 2018-02-22 19:20:18 +02:00
parent def64b0799
commit 2fbd9bcae8
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
3 changed files with 33 additions and 29 deletions

View File

@ -793,19 +793,21 @@ $ cat orcid-test-values.txt
8686 45.5.184.196
```
- While looking at the logs I see some new bot:
- So I don't see any definite cause for this crash, I see a shit ton of abandoned PostgreSQL connections today around 1PM!
```
# grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon' /var/log/tomcat7/catalina.out
729
# grep 'Feb 22, 2018 1' /var/log/tomcat7/catalina.out | grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon'
519
```
- I think the `removeAbandonedTimeout` might still be too low (I increased it from 60 to 90 seconds last week)
- Abandoned connections is not a cause but a symptom, though perhaps something more like a few minutes is better?
- Also, while looking at the logs I see some new bot:
```
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.4.2661.102 Safari/537.36; 360Spider
```
- It seems to re-use its user agent but makes tons of useless requests and I wonder if I should add ".*spider.*" to the Tomcat Crawler Session Manager valve?
- This is definitely not good:
```
# grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon' /var/log/tomcat7/catalina.out
729
```
- I think the `removeAbandonedTimeout` might still be too low (I increased it from 60 to 90 seconds last week)
- Perhaps something more like a few minutes is better?

View File

@ -23,7 +23,7 @@ I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu’s munin-pl
<meta property="article:published_time" content="2018-02-01T16:28:54&#43;02:00"/>
<meta property="article:modified_time" content="2018-02-20T15:32:50&#43;02:00"/>
<meta property="article:modified_time" content="2018-02-22T18:10:11&#43;02:00"/>
@ -57,9 +57,9 @@ I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu&rsquo;s munin-pl
"@type": "BlogPosting",
"headline": "February, 2018",
"url": "https://alanorth.github.io/cgspace-notes/2018-02/",
"wordCount": "4946",
"wordCount": "4987",
"datePublished": "2018-02-01T16:28:54&#43;02:00",
"dateModified": "2018-02-20T15:32:50&#43;02:00",
"dateModified": "2018-02-22T18:10:11&#43;02:00",
"author": {
"@type": "Person",
"name": "Alan Orth"
@ -1011,7 +1011,19 @@ TypeError: 'NoneType' object is not subscriptable
</code></pre>
<ul>
<li>While looking at the logs I see some new bot:</li>
<li>So I don&rsquo;t see any definite cause for this crash, I see a shit ton of abandoned PostgreSQL connections today around 1PM!</li>
</ul>
<pre><code># grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon' /var/log/tomcat7/catalina.out
729
# grep 'Feb 22, 2018 1' /var/log/tomcat7/catalina.out | grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon'
519
</code></pre>
<ul>
<li>I think the <code>removeAbandonedTimeout</code> might still be too low (I increased it from 60 to 90 seconds last week)</li>
<li>Abandoned connections is not a cause but a symptom, though perhaps something more like a few minutes is better?</li>
<li>Also, while looking at the logs I see some new bot:</li>
</ul>
<pre><code>Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.4.2661.102 Safari/537.36; 360Spider
@ -1019,16 +1031,6 @@ TypeError: 'NoneType' object is not subscriptable
<ul>
<li>It seems to re-use its user agent but makes tons of useless requests and I wonder if I should add &ldquo;.<em>spider.</em>&rdquo; to the Tomcat Crawler Session Manager valve?</li>
<li>This is definitely not good:</li>
</ul>
<pre><code># grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon' /var/log/tomcat7/catalina.out
729
</code></pre>
<ul>
<li>I think the <code>removeAbandonedTimeout</code> might still be too low (I increased it from 60 to 90 seconds last week)</li>
<li>Perhaps something more like a few minutes is better?</li>
</ul>

View File

@ -4,7 +4,7 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/2018-02/</loc>
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
</url>
<url>
@ -149,7 +149,7 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/</loc>
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
<priority>0</priority>
</url>
@ -160,7 +160,7 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
<priority>0</priority>
</url>
@ -172,13 +172,13 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/post/</loc>
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
<priority>0</priority>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
<priority>0</priority>
</url>