mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-11-26 00:18:21 +01:00
Update notes
This commit is contained in:
parent
def64b0799
commit
2fbd9bcae8
@ -793,19 +793,21 @@ $ cat orcid-test-values.txt
|
||||
8686 45.5.184.196
|
||||
```
|
||||
|
||||
- While looking at the logs I see some new bot:
|
||||
- So I don't see any definite cause for this crash, I see a shit ton of abandoned PostgreSQL connections today around 1PM!
|
||||
|
||||
```
|
||||
# grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon' /var/log/tomcat7/catalina.out
|
||||
729
|
||||
# grep 'Feb 22, 2018 1' /var/log/tomcat7/catalina.out | grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon'
|
||||
519
|
||||
```
|
||||
|
||||
- I think the `removeAbandonedTimeout` might still be too low (I increased it from 60 to 90 seconds last week)
|
||||
- Abandoned connections is not a cause but a symptom, though perhaps something more like a few minutes is better?
|
||||
- Also, while looking at the logs I see some new bot:
|
||||
|
||||
```
|
||||
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.4.2661.102 Safari/537.36; 360Spider
|
||||
```
|
||||
|
||||
- It seems to re-use its user agent but makes tons of useless requests and I wonder if I should add ".*spider.*" to the Tomcat Crawler Session Manager valve?
|
||||
- This is definitely not good:
|
||||
|
||||
```
|
||||
# grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon' /var/log/tomcat7/catalina.out
|
||||
729
|
||||
```
|
||||
|
||||
- I think the `removeAbandonedTimeout` might still be too low (I increased it from 60 to 90 seconds last week)
|
||||
- Perhaps something more like a few minutes is better?
|
||||
|
@ -23,7 +23,7 @@ I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu’s munin-pl
|
||||
|
||||
<meta property="article:published_time" content="2018-02-01T16:28:54+02:00"/>
|
||||
|
||||
<meta property="article:modified_time" content="2018-02-20T15:32:50+02:00"/>
|
||||
<meta property="article:modified_time" content="2018-02-22T18:10:11+02:00"/>
|
||||
|
||||
|
||||
|
||||
@ -57,9 +57,9 @@ I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu’s munin-pl
|
||||
"@type": "BlogPosting",
|
||||
"headline": "February, 2018",
|
||||
"url": "https://alanorth.github.io/cgspace-notes/2018-02/",
|
||||
"wordCount": "4946",
|
||||
"wordCount": "4987",
|
||||
"datePublished": "2018-02-01T16:28:54+02:00",
|
||||
"dateModified": "2018-02-20T15:32:50+02:00",
|
||||
"dateModified": "2018-02-22T18:10:11+02:00",
|
||||
"author": {
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
@ -1011,7 +1011,19 @@ TypeError: 'NoneType' object is not subscriptable
|
||||
</code></pre>
|
||||
|
||||
<ul>
|
||||
<li>While looking at the logs I see some new bot:</li>
|
||||
<li>So I don’t see any definite cause for this crash, I see a shit ton of abandoned PostgreSQL connections today around 1PM!</li>
|
||||
</ul>
|
||||
|
||||
<pre><code># grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon' /var/log/tomcat7/catalina.out
|
||||
729
|
||||
# grep 'Feb 22, 2018 1' /var/log/tomcat7/catalina.out | grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon'
|
||||
519
|
||||
</code></pre>
|
||||
|
||||
<ul>
|
||||
<li>I think the <code>removeAbandonedTimeout</code> might still be too low (I increased it from 60 to 90 seconds last week)</li>
|
||||
<li>Abandoned connections is not a cause but a symptom, though perhaps something more like a few minutes is better?</li>
|
||||
<li>Also, while looking at the logs I see some new bot:</li>
|
||||
</ul>
|
||||
|
||||
<pre><code>Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.4.2661.102 Safari/537.36; 360Spider
|
||||
@ -1019,16 +1031,6 @@ TypeError: 'NoneType' object is not subscriptable
|
||||
|
||||
<ul>
|
||||
<li>It seems to re-use its user agent but makes tons of useless requests and I wonder if I should add “.<em>spider.</em>” to the Tomcat Crawler Session Manager valve?</li>
|
||||
<li>This is definitely not good:</li>
|
||||
</ul>
|
||||
|
||||
<pre><code># grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon' /var/log/tomcat7/catalina.out
|
||||
729
|
||||
</code></pre>
|
||||
|
||||
<ul>
|
||||
<li>I think the <code>removeAbandonedTimeout</code> might still be too low (I increased it from 60 to 90 seconds last week)</li>
|
||||
<li>Perhaps something more like a few minutes is better?</li>
|
||||
</ul>
|
||||
|
||||
|
||||
|
@ -4,7 +4,7 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2018-02/</loc>
|
||||
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
|
||||
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
@ -149,7 +149,7 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/</loc>
|
||||
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
|
||||
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
@ -160,7 +160,7 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
|
||||
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
|
||||
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
@ -172,13 +172,13 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/post/</loc>
|
||||
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
|
||||
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
|
||||
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
|
||||
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
|
Loading…
Reference in New Issue
Block a user