diff --git a/content/post/2018-02.md b/content/post/2018-02.md index c5aaa00d4..d8d60a599 100644 --- a/content/post/2018-02.md +++ b/content/post/2018-02.md @@ -532,3 +532,29 @@ UPDATE 1 - And this item doesn't even exist on CGSpace! - Start working on XMLUI item display code for ORCIDs - Send emails to Macaroni Bros and Usman at CIFOR about ORCID metadata +- CGSpace crashed while I was driving to Tel Aviv, and was down for four hours! +- I only looked quickly in the logs but saw a bunch of database errors +- PostgreSQL connections are currently: + +``` +$ psql -c 'select * from pg_stat_activity' | grep -o -E '(dspaceWeb|dspaceApi|dspaceCli)' | uniq -c + 2 dspaceApi + 1 dspaceWeb + 3 dspaceApi +``` + +- I see shitloads of memory errors in Tomcat's logs: + +``` +# grep -c "Java heap space" /var/log/tomcat7/catalina.out +56 +``` + +- And shit tons of database connections abandoned: + +``` +# grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon' /var/log/tomcat7/catalina.out +612 +``` + +- I have no fucking idea why it crashed diff --git a/docs/2018-02/index.html b/docs/2018-02/index.html index 92b62fa34..5e10c89b9 100644 --- a/docs/2018-02/index.html +++ b/docs/2018-02/index.html @@ -23,7 +23,7 @@ I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu’s munin-pl - + @@ -57,9 +57,9 @@ I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu’s munin-pl "@type": "BlogPosting", "headline": "February, 2018", "url": "https://alanorth.github.io/cgspace-notes/2018-02/", - "wordCount": "3581", + "wordCount": "3674", "datePublished": "2018-02-01T16:28:54+02:00", - "dateModified": "2018-02-14T16:45:03+02:00", + "dateModified": "2018-02-15T14:00:34+02:00", "author": { "@type": "Person", "name": "Alan Orth" @@ -722,6 +722,36 @@ UPDATE 1
$ psql -c 'select * from pg_stat_activity' | grep -o -E '(dspaceWeb|dspaceApi|dspaceCli)' | uniq -c
+ 2 dspaceApi
+ 1 dspaceWeb
+ 3 dspaceApi
+
+
+# grep -c "Java heap space" /var/log/tomcat7/catalina.out
+56
+
+
+# grep -c 'org.apache.tomcat.jdbc.pool.ConnectionPool abandon' /var/log/tomcat7/catalina.out
+612
+
+
+