Update notes for 2016-07-18

content/2016-07.md

@@ -92,3 +92,30 @@ $ ./delete-metadata-values.py -f dc.contributor.author -i /tmp/Authors-Delete-UT
 
 - Adjust identifiers in XMLUI item display to be more prominent
 - Add species and breed to the XMLUI item display
+- CGSpace crashed late at night and the DSpace logs were showing:
+
+```
+2016-07-18 20:26:30,941 ERROR org.dspace.storage.rdbms.DatabaseManager @ SQL connection Error - 
+org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error Timeout waiting for idle object
+...
+```
+
+- I suspect it's someone hitting REST too much:
+
+```
+# awk '{print $1}' /var/log/nginx/rest.log  | sort -n | uniq -c | sort -h | tail -n 3
+    710 66.249.78.38
+   1781 181.118.144.29
+  24904 70.32.99.142
+```
+
+- I just blocked access to `/rest` for that last IP for now:
+
+```
+     # log rest requests
+     location /rest {
+         access_log /var/log/nginx/rest.log;
+         proxy_pass http://127.0.0.1:8443;
+         deny 70.32.99.142;
+     }
+```