mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-11-22 14:45:03 +01:00
Update notes
This commit is contained in:
parent
def64b0799
commit
2fbd9bcae8
@ -793,19 +793,21 @@ $ cat orcid-test-values.txt
|
|||||||
8686 45.5.184.196
|
8686 45.5.184.196
|
||||||
```
|
```
|
||||||
|
|
||||||
- While looking at the logs I see some new bot:
|
- So I don't see any definite cause for this crash, I see a shit ton of abandoned PostgreSQL connections today around 1PM!
|
||||||
|
|
||||||
|
```
|
||||||
|
# grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon' /var/log/tomcat7/catalina.out
|
||||||
|
729
|
||||||
|
# grep 'Feb 22, 2018 1' /var/log/tomcat7/catalina.out | grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon'
|
||||||
|
519
|
||||||
|
```
|
||||||
|
|
||||||
|
- I think the `removeAbandonedTimeout` might still be too low (I increased it from 60 to 90 seconds last week)
|
||||||
|
- Abandoned connections is not a cause but a symptom, though perhaps something more like a few minutes is better?
|
||||||
|
- Also, while looking at the logs I see some new bot:
|
||||||
|
|
||||||
```
|
```
|
||||||
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.4.2661.102 Safari/537.36; 360Spider
|
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.4.2661.102 Safari/537.36; 360Spider
|
||||||
```
|
```
|
||||||
|
|
||||||
- It seems to re-use its user agent but makes tons of useless requests and I wonder if I should add ".*spider.*" to the Tomcat Crawler Session Manager valve?
|
- It seems to re-use its user agent but makes tons of useless requests and I wonder if I should add ".*spider.*" to the Tomcat Crawler Session Manager valve?
|
||||||
- This is definitely not good:
|
|
||||||
|
|
||||||
```
|
|
||||||
# grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon' /var/log/tomcat7/catalina.out
|
|
||||||
729
|
|
||||||
```
|
|
||||||
|
|
||||||
- I think the `removeAbandonedTimeout` might still be too low (I increased it from 60 to 90 seconds last week)
|
|
||||||
- Perhaps something more like a few minutes is better?
|
|
||||||
|
@ -23,7 +23,7 @@ I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu’s munin-pl
|
|||||||
|
|
||||||
<meta property="article:published_time" content="2018-02-01T16:28:54+02:00"/>
|
<meta property="article:published_time" content="2018-02-01T16:28:54+02:00"/>
|
||||||
|
|
||||||
<meta property="article:modified_time" content="2018-02-20T15:32:50+02:00"/>
|
<meta property="article:modified_time" content="2018-02-22T18:10:11+02:00"/>
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
@ -57,9 +57,9 @@ I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu’s munin-pl
|
|||||||
"@type": "BlogPosting",
|
"@type": "BlogPosting",
|
||||||
"headline": "February, 2018",
|
"headline": "February, 2018",
|
||||||
"url": "https://alanorth.github.io/cgspace-notes/2018-02/",
|
"url": "https://alanorth.github.io/cgspace-notes/2018-02/",
|
||||||
"wordCount": "4946",
|
"wordCount": "4987",
|
||||||
"datePublished": "2018-02-01T16:28:54+02:00",
|
"datePublished": "2018-02-01T16:28:54+02:00",
|
||||||
"dateModified": "2018-02-20T15:32:50+02:00",
|
"dateModified": "2018-02-22T18:10:11+02:00",
|
||||||
"author": {
|
"author": {
|
||||||
"@type": "Person",
|
"@type": "Person",
|
||||||
"name": "Alan Orth"
|
"name": "Alan Orth"
|
||||||
@ -1011,7 +1011,19 @@ TypeError: 'NoneType' object is not subscriptable
|
|||||||
</code></pre>
|
</code></pre>
|
||||||
|
|
||||||
<ul>
|
<ul>
|
||||||
<li>While looking at the logs I see some new bot:</li>
|
<li>So I don’t see any definite cause for this crash, I see a shit ton of abandoned PostgreSQL connections today around 1PM!</li>
|
||||||
|
</ul>
|
||||||
|
|
||||||
|
<pre><code># grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon' /var/log/tomcat7/catalina.out
|
||||||
|
729
|
||||||
|
# grep 'Feb 22, 2018 1' /var/log/tomcat7/catalina.out | grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon'
|
||||||
|
519
|
||||||
|
</code></pre>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>I think the <code>removeAbandonedTimeout</code> might still be too low (I increased it from 60 to 90 seconds last week)</li>
|
||||||
|
<li>Abandoned connections is not a cause but a symptom, though perhaps something more like a few minutes is better?</li>
|
||||||
|
<li>Also, while looking at the logs I see some new bot:</li>
|
||||||
</ul>
|
</ul>
|
||||||
|
|
||||||
<pre><code>Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.4.2661.102 Safari/537.36; 360Spider
|
<pre><code>Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.4.2661.102 Safari/537.36; 360Spider
|
||||||
@ -1019,16 +1031,6 @@ TypeError: 'NoneType' object is not subscriptable
|
|||||||
|
|
||||||
<ul>
|
<ul>
|
||||||
<li>It seems to re-use its user agent but makes tons of useless requests and I wonder if I should add “.<em>spider.</em>” to the Tomcat Crawler Session Manager valve?</li>
|
<li>It seems to re-use its user agent but makes tons of useless requests and I wonder if I should add “.<em>spider.</em>” to the Tomcat Crawler Session Manager valve?</li>
|
||||||
<li>This is definitely not good:</li>
|
|
||||||
</ul>
|
|
||||||
|
|
||||||
<pre><code># grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon' /var/log/tomcat7/catalina.out
|
|
||||||
729
|
|
||||||
</code></pre>
|
|
||||||
|
|
||||||
<ul>
|
|
||||||
<li>I think the <code>removeAbandonedTimeout</code> might still be too low (I increased it from 60 to 90 seconds last week)</li>
|
|
||||||
<li>Perhaps something more like a few minutes is better?</li>
|
|
||||||
</ul>
|
</ul>
|
||||||
|
|
||||||
|
|
||||||
|
@ -4,7 +4,7 @@
|
|||||||
|
|
||||||
<url>
|
<url>
|
||||||
<loc>https://alanorth.github.io/cgspace-notes/2018-02/</loc>
|
<loc>https://alanorth.github.io/cgspace-notes/2018-02/</loc>
|
||||||
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
|
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
|
||||||
</url>
|
</url>
|
||||||
|
|
||||||
<url>
|
<url>
|
||||||
@ -149,7 +149,7 @@
|
|||||||
|
|
||||||
<url>
|
<url>
|
||||||
<loc>https://alanorth.github.io/cgspace-notes/</loc>
|
<loc>https://alanorth.github.io/cgspace-notes/</loc>
|
||||||
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
|
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
|
||||||
<priority>0</priority>
|
<priority>0</priority>
|
||||||
</url>
|
</url>
|
||||||
|
|
||||||
@ -160,7 +160,7 @@
|
|||||||
|
|
||||||
<url>
|
<url>
|
||||||
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
|
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
|
||||||
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
|
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
|
||||||
<priority>0</priority>
|
<priority>0</priority>
|
||||||
</url>
|
</url>
|
||||||
|
|
||||||
@ -172,13 +172,13 @@
|
|||||||
|
|
||||||
<url>
|
<url>
|
||||||
<loc>https://alanorth.github.io/cgspace-notes/post/</loc>
|
<loc>https://alanorth.github.io/cgspace-notes/post/</loc>
|
||||||
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
|
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
|
||||||
<priority>0</priority>
|
<priority>0</priority>
|
||||||
</url>
|
</url>
|
||||||
|
|
||||||
<url>
|
<url>
|
||||||
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
|
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
|
||||||
<lastmod>2018-02-20T15:32:50+02:00</lastmod>
|
<lastmod>2018-02-22T18:10:11+02:00</lastmod>
|
||||||
<priority>0</priority>
|
<priority>0</priority>
|
||||||
</url>
|
</url>
|
||||||
|
|
||||||
|
Loading…
Reference in New Issue
Block a user