diff --git a/content/posts/2019-01.md b/content/posts/2019-01.md index 004c1cf48..bc8fec0fe 100644 --- a/content/posts/2019-01.md +++ b/content/posts/2019-01.md @@ -930,4 +930,133 @@ identify: CorruptImageProfile `xmp' @ warning/profile.c/SetImageProfileInternal/ - 70.32.83.92 is CCAFS - 205.186.128.185 is CCAFS or perhaps another Macaroni Bros harvester (new ILRI website?) +## 2019-01-28 + +- Udana from WLE asked me about the interaction between their publication website and their items on CGSpace + - There is an item that is mapped into their collection from IWMI and is missing their `cg.identifier.wletheme` metadata + - I told him that, as far as I remember, when WLE introduced Phase II research themes in 2017 we decided to infer theme ownership from the collection hierarchy and we created a [WLE Phase II Research Themes](https://cgspace.cgiar.org/handle/10568/81268) subCommunity + - Perhaps they need to ask Macaroni Bros about the mapping +- Linode alerted that CGSpace (linode18) was using too much CPU again this morning, here are the active IPs from the web server log at the time: + +``` +# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "28/Jan/2019:0(6|7|8)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 67 207.46.13.50 + 105 41.204.190.40 + 117 34.218.226.147 + 126 35.237.175.180 + 203 213.55.99.121 + 332 45.5.184.72 + 377 5.9.6.51 + 512 45.5.184.2 + 4644 205.186.128.185 + 4644 70.32.83.92 +``` + +- There seems to be a pattern with `70.32.83.92` and `205.186.128.185` lately! +- Every morning at 8AM they are the top users... I should tell them to stagger their requests... +- I signed up for a [VisualPing](https://visualping.io/) of the [PostgreSQL JDBC driver download page](https://jdbc.postgresql.org/download.html) to my CGIAR email address + - Hopefully this will one day alert me that a new driver is released! +- Last night Linode sent an alert that CGSpace (linode18) was using high CPU, here are the most active IPs in the hours just before, during, and after the alert: + +``` +# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "28/Jan/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 310 45.5.184.2 + 425 5.143.231.39 + 526 54.70.40.11 + 1003 199.47.87.141 + 1374 35.237.175.180 + 1455 5.9.6.51 + 1501 66.249.66.223 + 1771 66.249.66.219 + 2107 199.47.87.140 + 2540 45.5.186.2 +``` + +- Of course there is CIAT's `45.5.186.2`, but also `45.5.184.2` appears to be CIAT... I wonder why they have two harvesters? +- `199.47.87.140` and `199.47.87.141` is TurnItIn with the following user agent: + +``` +TurnitinBot (https://turnitin.com/robot/crawlerinfo.html) +``` + +## 2019-01-29 + +- Linode sent an alert about CGSpace (linode18) CPU usage this morning, here are the top IPs in the web server logs just before, during, and after the alert: + +``` +# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "29/Jan/2019:0(3|4|5|6|7)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 334 45.5.184.72 + 429 66.249.66.223 + 522 35.237.175.180 + 555 34.218.226.147 + 655 66.249.66.221 + 844 5.9.6.51 + 2507 66.249.66.219 + 4645 70.32.83.92 + 4646 205.186.128.185 + 9329 45.5.186.2 +``` + +- `45.5.186.2` is CIAT as usual... +- `70.32.83.92` and `205.186.128.185` are CCAFS as usual... +- `66.249.66.219` is Google... +- I'm thinking it might finally be time to increase the threshold of the Linode CPU alerts + - I adjusted the alert threshold from 250% to 275% + +## 2019-01-30 + +- Got another alert from Linode about CGSpace (linode18) this morning, here are the top IPs before, during, and after the alert: + +``` +# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "30/Jan/2019:0(5|6|7|8|9)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 273 46.101.86.248 + 301 35.237.175.180 + 334 45.5.184.72 + 387 5.9.6.51 + 527 2a01:4f8:13b:1296::2 + 1021 34.218.226.147 + 1448 66.249.66.219 + 4649 205.186.128.185 + 4649 70.32.83.92 + 5163 45.5.184.2 +``` + +- I might need to adjust the threshold again, because the load average this morning was 296% and the activity looks pretty normal (as always recently) + +## 2019-01-31 + +- Linode sent alerts about CGSpace (linode18) last night and this morning, here are the top IPs before, during, and after those times: + +``` +# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "30/Jan/2019:(16|17|18|19|20)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 436 18.196.196.108 + 460 157.55.39.168 + 460 207.46.13.96 + 500 197.156.105.116 + 728 54.70.40.11 + 1560 5.9.6.51 + 1562 35.237.175.180 + 1601 85.25.237.71 + 1894 66.249.66.219 + 2610 45.5.184.2 +# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "31/Jan/2019:0(2|3|4|5|6)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 318 207.46.13.242 + 334 45.5.184.72 + 486 35.237.175.180 + 609 34.218.226.147 + 620 66.249.66.219 + 1054 5.9.6.51 + 4391 70.32.83.92 + 4428 205.186.128.185 + 6758 85.25.237.71 + 9239 45.5.186.2 +``` + +- `45.5.186.2` and `45.5.184.2` are CIAT as always +- `85.25.237.71` is some new server in Germany that I've never seen before with the user agent: + +``` +Linguee Bot (http://www.linguee.com/bot; bot@linguee.com) +``` + diff --git a/docs/2015-11/index.html b/docs/2015-11/index.html index 860c58ef3..d300d46a8 100644 --- a/docs/2015-11/index.html +++ b/docs/2015-11/index.html @@ -278,6 +278,8 @@ db.statementpool = true
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -286,8 +288,6 @@ db.statementpool = true
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2015-12/index.html b/docs/2015-12/index.html index 117987854..08ebe70cb 100644 --- a/docs/2015-12/index.html +++ b/docs/2015-12/index.html @@ -295,6 +295,8 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -303,8 +305,6 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2016-01/index.html b/docs/2016-01/index.html index 3c314ab6e..1651da74f 100644 --- a/docs/2016-01/index.html +++ b/docs/2016-01/index.html @@ -210,6 +210,8 @@ $ find SimpleArchiveForBio/ -iname “*.pdf” -exec basename {} \; | so
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -218,8 +220,6 @@ $ find SimpleArchiveForBio/ -iname “*.pdf” -exec basename {} \; | so
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2016-02/index.html b/docs/2016-02/index.html index 6e991e3f7..f151ba913 100644 --- a/docs/2016-02/index.html +++ b/docs/2016-02/index.html @@ -463,6 +463,8 @@ Bitstream: tést señora alimentación.pdf
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -471,8 +473,6 @@ Bitstream: tést señora alimentación.pdf
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2016-03/index.html b/docs/2016-03/index.html index ff64de63e..cc8d5e34c 100644 --- a/docs/2016-03/index.html +++ b/docs/2016-03/index.html @@ -363,6 +363,8 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -371,8 +373,6 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2016-04/index.html b/docs/2016-04/index.html index 661af648b..a480d5bf0 100644 --- a/docs/2016-04/index.html +++ b/docs/2016-04/index.html @@ -580,6 +580,8 @@ dspace.log.2016-04-27:7271
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -588,8 +590,6 @@ dspace.log.2016-04-27:7271
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2016-05/index.html b/docs/2016-05/index.html index 67493abe5..c405c5cf1 100644 --- a/docs/2016-05/index.html +++ b/docs/2016-05/index.html @@ -430,6 +430,8 @@ sys 0m20.540s
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -438,8 +440,6 @@ sys 0m20.540s
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2016-06/index.html b/docs/2016-06/index.html index c6ca3578e..d71c93a01 100644 --- a/docs/2016-06/index.html +++ b/docs/2016-06/index.html @@ -475,6 +475,8 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -483,8 +485,6 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2016-07/index.html b/docs/2016-07/index.html index 6f72662af..7ab41ced3 100644 --- a/docs/2016-07/index.html +++ b/docs/2016-07/index.html @@ -393,6 +393,8 @@ discovery.index.authority.ignore-variants=true
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -401,8 +403,6 @@ discovery.index.authority.ignore-variants=true
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2016-08/index.html b/docs/2016-08/index.html index f394aba81..02a31fa6d 100644 --- a/docs/2016-08/index.html +++ b/docs/2016-08/index.html @@ -466,6 +466,8 @@ $ JAVA_OPTS="-Dfile.encoding=UTF-8 -Xmx512m" /home/cgspace.cgiar.org/b
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -474,8 +476,6 @@ $ JAVA_OPTS="-Dfile.encoding=UTF-8 -Xmx512m" /home/cgspace.cgiar.org/b
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2016-09/index.html b/docs/2016-09/index.html index ffb522199..45763c243 100644 --- a/docs/2016-09/index.html +++ b/docs/2016-09/index.html @@ -766,6 +766,8 @@ $ ./delete-metadata-values.py -i ilrisubjects-delete-13.csv -f cg.subject.ilri -
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -774,8 +776,6 @@ $ ./delete-metadata-values.py -i ilrisubjects-delete-13.csv -f cg.subject.ilri -
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2016-10/index.html b/docs/2016-10/index.html index d00c57de5..31ed0e94d 100644 --- a/docs/2016-10/index.html +++ b/docs/2016-10/index.html @@ -451,6 +451,8 @@ dspace=# update metadatavalue set text_value = regexp_replace(text_value, 'http:
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -459,8 +461,6 @@ dspace=# update metadatavalue set text_value = regexp_replace(text_value, 'http:
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2016-11/index.html b/docs/2016-11/index.html index db840c4e6..b54483573 100644 --- a/docs/2016-11/index.html +++ b/docs/2016-11/index.html @@ -668,6 +668,8 @@ org.dspace.discovery.SearchServiceException: Error executing query
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -676,8 +678,6 @@ org.dspace.discovery.SearchServiceException: Error executing query
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2016-12/index.html b/docs/2016-12/index.html index 8febc5e70..33c493096 100644 --- a/docs/2016-12/index.html +++ b/docs/2016-12/index.html @@ -904,6 +904,8 @@ $ exit
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -912,8 +914,6 @@ $ exit
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2017-01/index.html b/docs/2017-01/index.html index 7035b55f9..1fc3df4f4 100644 --- a/docs/2017-01/index.html +++ b/docs/2017-01/index.html @@ -449,6 +449,8 @@ $ gs -sDEVICE=pdfwrite -dCompatibilityLevel=1.4 -dPDFSETTINGS=/ebook -dNOPAUSE -
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -457,8 +459,6 @@ $ gs -sDEVICE=pdfwrite -dCompatibilityLevel=1.4 -dPDFSETTINGS=/ebook -dNOPAUSE -
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2017-02/index.html b/docs/2017-02/index.html index 925e6ae62..d03ae9708 100644 --- a/docs/2017-02/index.html +++ b/docs/2017-02/index.html @@ -521,6 +521,8 @@ COPY 1968
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -529,8 +531,6 @@ COPY 1968
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2017-03/index.html b/docs/2017-03/index.html index f8101c04d..5ae79b2f9 100644 --- a/docs/2017-03/index.html +++ b/docs/2017-03/index.html @@ -435,6 +435,8 @@ $ ./delete-metadata-values.py -i Investors-Delete-121.csv -f dc.description.spon
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -443,8 +445,6 @@ $ ./delete-metadata-values.py -i Investors-Delete-121.csv -f dc.description.spon
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2017-04/index.html b/docs/2017-04/index.html index 7e751635f..3a35f7317 100644 --- a/docs/2017-04/index.html +++ b/docs/2017-04/index.html @@ -714,6 +714,8 @@ $ gem install compass -v 1.0.3
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -722,8 +724,6 @@ $ gem install compass -v 1.0.3
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2017-05/index.html b/docs/2017-05/index.html index 7d491908b..3e0fc5dd8 100644 --- a/docs/2017-05/index.html +++ b/docs/2017-05/index.html @@ -474,6 +474,8 @@ UPDATE 187
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -482,8 +484,6 @@ UPDATE 187
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2017-06/index.html b/docs/2017-06/index.html index 56cfaeb79..37ec28736 100644 --- a/docs/2017-06/index.html +++ b/docs/2017-06/index.html @@ -292,6 +292,8 @@ $ JAVA_OPTS="-Xmx1024m -Dfile.encoding=UTF-8" [dspace]/bin/dspace impo
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -300,8 +302,6 @@ $ JAVA_OPTS="-Xmx1024m -Dfile.encoding=UTF-8" [dspace]/bin/dspace impo
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2017-07/index.html b/docs/2017-07/index.html index fc7ee2353..a92df23a0 100644 --- a/docs/2017-07/index.html +++ b/docs/2017-07/index.html @@ -321,6 +321,8 @@ delete from metadatavalue where resource_type_id=2 and metadata_field_id=235 and
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -329,8 +331,6 @@ delete from metadatavalue where resource_type_id=2 and metadata_field_id=235 and
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2017-08/index.html b/docs/2017-08/index.html index ff00b9d66..a06445f59 100644 --- a/docs/2017-08/index.html +++ b/docs/2017-08/index.html @@ -607,6 +607,8 @@ org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -615,8 +617,6 @@ org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2017-09/index.html b/docs/2017-09/index.html index b683422f7..14475b9c9 100644 --- a/docs/2017-09/index.html +++ b/docs/2017-09/index.html @@ -779,6 +779,8 @@ Cert Status: good
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -787,8 +789,6 @@ Cert Status: good
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2017-10/index.html b/docs/2017-10/index.html index bc1642607..4a22f10ec 100644 --- a/docs/2017-10/index.html +++ b/docs/2017-10/index.html @@ -544,6 +544,8 @@ session_id=6C30F10B4351A4ED83EC6ED50AFD6B6A
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -552,8 +554,6 @@ session_id=6C30F10B4351A4ED83EC6ED50AFD6B6A
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2017-11/index.html b/docs/2017-11/index.html index d499294fc..812a46960 100644 --- a/docs/2017-11/index.html +++ b/docs/2017-11/index.html @@ -1188,6 +1188,8 @@ $ cat dspace.log.2017-11-28 | grep -o -E 'session_id=[A-Z0-9]{32}' | sort -n | u
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -1196,8 +1198,6 @@ $ cat dspace.log.2017-11-28 | grep -o -E 'session_id=[A-Z0-9]{32}' | sort -n | u
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2017-12/index.html b/docs/2017-12/index.html index 78f62a6cb..e9d27f91e 100644 --- a/docs/2017-12/index.html +++ b/docs/2017-12/index.html @@ -953,6 +953,8 @@ DELETE 20
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -961,8 +963,6 @@ DELETE 20
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2018-01/index.html b/docs/2018-01/index.html index 7d066eb72..b3c3e2bf1 100644 --- a/docs/2018-01/index.html +++ b/docs/2018-01/index.html @@ -1780,6 +1780,8 @@ Catalina:type=Manager,context=/,host=localhost activeSessions 8
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -1788,8 +1790,6 @@ Catalina:type=Manager,context=/,host=localhost activeSessions 8
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2018-02/index.html b/docs/2018-02/index.html index 71f575a81..0f19930f3 100644 --- a/docs/2018-02/index.html +++ b/docs/2018-02/index.html @@ -1299,6 +1299,8 @@ UPDATE 3
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -1307,8 +1309,6 @@ UPDATE 3
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2018-03/index.html b/docs/2018-03/index.html index 370ad15ea..9298e4292 100644 --- a/docs/2018-03/index.html +++ b/docs/2018-03/index.html @@ -726,6 +726,8 @@ Fixed 5 occurences of: GENEBANKS
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -734,8 +736,6 @@ Fixed 5 occurences of: GENEBANKS
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2018-04/index.html b/docs/2018-04/index.html index f0eb7ad47..426107bcc 100644 --- a/docs/2018-04/index.html +++ b/docs/2018-04/index.html @@ -723,6 +723,8 @@ $ pg_restore -O -U dspacetest -d dspacetest -W -h localhost /tmp/dspace_2018-04-
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -731,8 +733,6 @@ $ pg_restore -O -U dspacetest -d dspacetest -W -h localhost /tmp/dspace_2018-04-
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2018-05/index.html b/docs/2018-05/index.html index d22dbc9fb..ffa369b10 100644 --- a/docs/2018-05/index.html +++ b/docs/2018-05/index.html @@ -602,6 +602,8 @@ $ psql -h localhost -U postgres dspacetest
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -610,8 +612,6 @@ $ psql -h localhost -U postgres dspacetest
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2018-06/index.html b/docs/2018-06/index.html index c77cdebd0..49dacc83f 100644 --- a/docs/2018-06/index.html +++ b/docs/2018-06/index.html @@ -582,6 +582,8 @@ $ sed '/^id/d' 10568-*.csv | csvcut -c 1,2 > map-to-cifor-archive.csv
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -590,8 +592,6 @@ $ sed '/^id/d' 10568-*.csv | csvcut -c 1,2 > map-to-cifor-archive.csv
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2018-07/index.html b/docs/2018-07/index.html index 021e208c9..fb12abcd4 100644 --- a/docs/2018-07/index.html +++ b/docs/2018-07/index.html @@ -693,6 +693,8 @@ dspace=# select count(text_value) from metadatavalue where resource_type_id=2 an
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -701,8 +703,6 @@ dspace=# select count(text_value) from metadatavalue where resource_type_id=2 an
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2018-08/index.html b/docs/2018-08/index.html index bf21cc29e..2794ab88d 100644 --- a/docs/2018-08/index.html +++ b/docs/2018-08/index.html @@ -529,6 +529,8 @@ $ dspace database migrate ignored
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -537,8 +539,6 @@ $ dspace database migrate ignored
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2018-09/index.html b/docs/2018-09/index.html index 1cb2ae0c4..81844435e 100644 --- a/docs/2018-09/index.html +++ b/docs/2018-09/index.html @@ -907,6 +907,8 @@ UPDATE metadatavalue SET text_value='ja' WHERE resource_type_id=2 AND metadata_f
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -915,8 +917,6 @@ UPDATE metadatavalue SET text_value='ja' WHERE resource_type_id=2 AND metadata_f
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2018-10/index.html b/docs/2018-10/index.html index d749f56ed..7602b768a 100644 --- a/docs/2018-10/index.html +++ b/docs/2018-10/index.html @@ -810,6 +810,8 @@ $ curl -X GET -H "Content-Type: application/json" -H "Accept: app
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -818,8 +820,6 @@ $ curl -X GET -H "Content-Type: application/json" -H "Accept: app
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2018-11/index.html b/docs/2018-11/index.html index 92a9e0e75..47ebeee27 100644 --- a/docs/2018-11/index.html +++ b/docs/2018-11/index.html @@ -668,6 +668,8 @@ $ dspace dsrun org.dspace.eperson.Groomer -a -b 11/27/2016 -d
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -676,8 +678,6 @@ $ dspace dsrun org.dspace.eperson.Groomer -a -b 11/27/2016 -d
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2018-12/index.html b/docs/2018-12/index.html index b47073230..068e3f8ae 100644 --- a/docs/2018-12/index.html +++ b/docs/2018-12/index.html @@ -733,6 +733,8 @@ UPDATE 1
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -741,8 +743,6 @@ UPDATE 1
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2019-01/index.html b/docs/2019-01/index.html index 90bcc0415..1cfa36d04 100644 --- a/docs/2019-01/index.html +++ b/docs/2019-01/index.html @@ -27,7 +27,7 @@ I don’t see anything interesting in the web server logs around that time t " /> - + @@ -60,9 +60,9 @@ I don’t see anything interesting in the web server logs around that time t "@type": "BlogPosting", "headline": "January, 2019", "url": "https://alanorth.github.io/cgspace-notes/2019-01/", - "wordCount": "4866", + "wordCount": "5532", "datePublished": "2019-01-02T09:48:30+02:00", - "dateModified": "2019-01-25T19:45:15+02:00", + "dateModified": "2019-01-27T17:25:19+02:00", "author": { "@type": "Person", "name": "Alan Orth" @@ -1237,6 +1237,155 @@ identify: CorruptImageProfile `xmp' @ warning/profile.c/SetImageProfileInternal/ +

2019-01-28

+ + + +
# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "28/Jan/2019:0(6|7|8)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+     67 207.46.13.50
+    105 41.204.190.40
+    117 34.218.226.147
+    126 35.237.175.180
+    203 213.55.99.121
+    332 45.5.184.72
+    377 5.9.6.51
+    512 45.5.184.2
+   4644 205.186.128.185
+   4644 70.32.83.92
+
+ + + +
# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "28/Jan/2019:(17|18|19|20|21)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    310 45.5.184.2
+    425 5.143.231.39
+    526 54.70.40.11
+   1003 199.47.87.141
+   1374 35.237.175.180
+   1455 5.9.6.51
+   1501 66.249.66.223
+   1771 66.249.66.219
+   2107 199.47.87.140
+   2540 45.5.186.2
+
+ + + +
TurnitinBot (https://turnitin.com/robot/crawlerinfo.html)
+
+ +

2019-01-29

+ + + +
# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "29/Jan/2019:0(3|4|5|6|7)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    334 45.5.184.72
+    429 66.249.66.223
+    522 35.237.175.180
+    555 34.218.226.147
+    655 66.249.66.221
+    844 5.9.6.51
+   2507 66.249.66.219
+   4645 70.32.83.92
+   4646 205.186.128.185
+   9329 45.5.186.2
+
+ + + +

2019-01-30

+ + + +
# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "30/Jan/2019:0(5|6|7|8|9)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    273 46.101.86.248
+    301 35.237.175.180
+    334 45.5.184.72
+    387 5.9.6.51
+    527 2a01:4f8:13b:1296::2
+   1021 34.218.226.147
+   1448 66.249.66.219
+   4649 205.186.128.185
+   4649 70.32.83.92
+   5163 45.5.184.2
+
+ + + +

2019-01-31

+ + + +
# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "30/Jan/2019:(16|17|18|19|20)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    436 18.196.196.108
+    460 157.55.39.168
+    460 207.46.13.96
+    500 197.156.105.116
+    728 54.70.40.11
+   1560 5.9.6.51
+   1562 35.237.175.180
+   1601 85.25.237.71
+   1894 66.249.66.219
+   2610 45.5.184.2
+# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "31/Jan/2019:0(2|3|4|5|6)" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
+    318 207.46.13.242
+    334 45.5.184.72
+    486 35.237.175.180
+    609 34.218.226.147
+    620 66.249.66.219
+   1054 5.9.6.51
+   4391 70.32.83.92
+   4428 205.186.128.185
+   6758 85.25.237.71
+   9239 45.5.186.2
+
+ + + +
Linguee Bot (http://www.linguee.com/bot; bot@linguee.com)
+
+ @@ -1258,6 +1407,8 @@ identify: CorruptImageProfile `xmp' @ warning/profile.c/SetImageProfileInternal/
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -1266,8 +1417,6 @@ identify: CorruptImageProfile `xmp' @ warning/profile.c/SetImageProfileInternal/
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/2019-02/index.html b/docs/2019-02/index.html new file mode 100644 index 000000000..9bcb79f19 --- /dev/null +++ b/docs/2019-02/index.html @@ -0,0 +1,218 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + February, 2019 | CGSpace Notes + + + + + + + + + + + + + + + + + +
+
+ +
+
+ + + + +
+
+

CGSpace Notes

+

Documenting day-to-day work on the CGSpace repository.

+
+
+ + + + +
+
+
+ + + + +
+
+

February, 2019

+

by Alan Orth in + +  + +

+
+

2019-02-01

+ +
    +
  • Linode has alerted a few times since last night that the CPU usage on CGSpace (linode18) was high despite me increasing the alert threshold last week from 250% to 275%—I might need to increase it again!
    • +
  • The Solr statistics the past few months have been very high and I was wondering if the web server logs also showed an increase
    • +
  • There were just over 3 million accesses in the nginx logs last month:
    • +
+ +
# time zcat --force /var/log/nginx/* | grep -cE "[0-9]{1,2}/Jan/2019"
+3018243
+
+real    0m19.873s
+user    0m22.203s
+sys     0m1.979s
+
+ +
    +
  • Normally I’d say this was very high, but about this time last year I remember thinking the same thing when we had 3.1 million…
    • +
  • I will have to keep an eye on this to see if there is some error in Solr…
    • +
+ + + + + + + +
+ + + +
+ + + + +
+
+ + + + + + + + + diff --git a/docs/404.html b/docs/404.html index 0a35a5a6e..3ebb40c72 100644 --- a/docs/404.html +++ b/docs/404.html @@ -87,6 +87,8 @@
    +
  1. February, 2019
    2. +
  2. January, 2019
  3. December, 2018
    4. @@ -95,8 +97,6 @@
  4. October, 2018
    5. -
  5. September, 2018
    6. -
diff --git a/docs/categories/index.html b/docs/categories/index.html index fa2b4ef9e..b446f7ea9 100644 --- a/docs/categories/index.html +++ b/docs/categories/index.html @@ -89,6 +89,38 @@ +
+
+

February, 2019

+

by Alan Orth in + +  + +

+
+

2019-02-01

+ + + +
# time zcat --force /var/log/nginx/* | grep -cE "[0-9]{1,2}/Jan/2019"
+3018243
+
+real    0m19.873s
+user    0m22.203s
+sys     0m1.979s
+
+ Read more → +
+ + + + + +

January, 2019

@@ -372,29 +404,6 @@ sys 2m7.289s - -
-
-

April, 2018

-

by Alan Orth in - -  - -

-
-

2018-04-01

- -
    -
  • I tried to test something on DSpace Test but noticed that it’s down since god knows when
    • -
  • Catalina logs at least show some memory errors yesterday:
    • -
- Read more → -
- - - - -