diff --git a/content/posts/2018-10.md b/content/posts/2018-10.md index e65a8dd84..2baf57274 100644 --- a/content/posts/2018-10.md +++ b/content/posts/2018-10.md @@ -409,4 +409,42 @@ $ exit # dpkg -r postgresql-9.5 postgresql-client-9.5 postgresql-contrib-9.5 ``` +## 2018-10-19 + +- Help Francesca from Bioversity generate a report about items they uploaded in 2015 through 2018 +- Linode emailed me to say that CGSpace (linode18) had high CPU usage for a few hours this afternoon +- Looking at the nginx logs around that time I see the following IPs making the most requests: + +``` +# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "19/Oct/2018:(12|13|14|15)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 361 207.46.13.179 + 395 181.115.248.74 + 485 66.249.64.93 + 535 157.55.39.213 + 536 157.55.39.99 + 551 34.218.226.147 + 580 157.55.39.173 + 1516 35.237.175.180 + 1629 66.249.64.91 + 1758 5.9.6.51 +``` + +- 5.9.6.51 is MegaIndex, which I've seen before... + +## 2018-10-20 + +- I was going to try to run Solr in Docker because I learned I can run Docker on Travis-CI (for testing my dspace-statistics-api), but the oldest official Solr images are for 5.5, and DSpace's Solr configuration is for 4.9 +- This means our existing Solr configuration doesn't run in Solr 5.5: + +``` +$ sudo docker pull solr:5 +$ sudo docker run --name my_solr -v ~/dspace/solr/statistics/conf:/tmp/conf -d -p 8983:8983 -t solr:5 +$ sudo docker logs my_solr +... +ERROR: Error CREATEing SolrCore 'statistics': Unable to create core [statistics] Caused by: solr.IntField +``` + +- Apparently a bunch of variable types were removed in [Solr 5](https://issues.apache.org/jira/browse/SOLR-5936) +- So for now it's actually a huge pain in the ass to run the tests for my dspace-statistics-api + diff --git a/docs/2018-10/index.html b/docs/2018-10/index.html index d3ba02572..82600f16c 100644 --- a/docs/2018-10/index.html +++ b/docs/2018-10/index.html @@ -9,7 +9,7 @@ - + @@ -24,9 +24,9 @@ "@type": "BlogPosting", "headline": "October, 2018", "url": "https://alanorth.github.io/cgspace-notes/2018-10/", - "wordCount": "3156", + "wordCount": "3376", "datePublished": "2018-10-01T22:31:54+03:00", - "dateModified": "2018-10-18T23:24:31+03:00", + "dateModified": "2018-10-18T23:57:22+03:00", "author": { "@type": "Person", "name": "Alan Orth" @@ -557,6 +557,50 @@ $ exit # dpkg -r postgresql-9.5 postgresql-client-9.5 postgresql-contrib-9.5 +
# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "19/Oct/2018:(12|13|14|15)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+ 361 207.46.13.179
+ 395 181.115.248.74
+ 485 66.249.64.93
+ 535 157.55.39.213
+ 536 157.55.39.99
+ 551 34.218.226.147
+ 580 157.55.39.173
+ 1516 35.237.175.180
+ 1629 66.249.64.91
+ 1758 5.9.6.51
+
+
+$ sudo docker pull solr:5
+$ sudo docker run --name my_solr -v ~/dspace/solr/statistics/conf:/tmp/conf -d -p 8983:8983 -t solr:5
+$ sudo docker logs my_solr
+...
+ERROR: Error CREATEing SolrCore 'statistics': Unable to create core [statistics] Caused by: solr.IntField
+
+
+