diff --git a/content/posts/2019-09.md b/content/posts/2019-09.md new file mode 100644 index 000000000..0fc81a9e4 --- /dev/null +++ b/content/posts/2019-09.md @@ -0,0 +1,66 @@ +--- +title: "September, 2019" +date: 2019-09-01T10:17:51+03:00 +author: "Alan Orth" +tags: ["Notes"] +--- + +## 2019-09-01 + +- Linode emailed to say that CGSpace (linode18) had a high rate of outbound traffic for several hours this morning +- Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning: + +``` +# zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 440 17.58.101.255 + 441 157.55.39.101 + 485 207.46.13.43 + 728 169.60.128.125 + 730 207.46.13.108 + 758 157.55.39.9 + 808 66.160.140.179 + 814 207.46.13.212 + 2472 163.172.71.23 + 6092 3.94.211.189 +# zcat --force /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/oai.log /var/log/nginx/oai.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10 + 33 2a01:7e00::f03c:91ff:fe16:fcb + 57 3.83.192.124 + 57 3.87.77.25 + 57 54.82.1.8 + 822 2a01:9cc0:47:1:1a:4:0:2 + 1223 45.5.184.72 + 1633 172.104.229.92 + 5112 205.186.128.185 + 7249 2a01:7e00::f03c:91ff:fe18:7396 + 9124 45.5.186.2 +``` + + + +- `3.94.211.189` is MauiBot, and most of its requests are to Discovery and get rate limited with HTTP 503 +- `163.172.71.23` is some IP on Online SAS in France and its user agent is: + +``` +Mozilla/5.0 ((Windows; U; Windows NT 6.1; fr; rv:1.9.2) Gecko/20100115 Firefox/3.6) +``` + +- It actually got mostly HTTP 200 responses: + +``` +# zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | grep 163.172.71.23 | awk '{print $9}' | sort | uniq -c + 1775 200 + 703 499 + 72 503 +``` + +- And it was mostly requesting Discover pages: + +``` +# zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | grep 163.172.71.23 | grep -o -E "(bitstream|discover|handle)" | sort | uniq -c + 2350 discover + 71 handle +``` + +- I'm not sure why the outbound traffic rate was so high... + + diff --git a/docs/2015-11/index.html b/docs/2015-11/index.html index 0f3c4833b..790460679 100644 --- a/docs/2015-11/index.html +++ b/docs/2015-11/index.html @@ -278,16 +278,16 @@ db.statementpool = true
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2015-12/index.html b/docs/2015-12/index.html index bdba92465..1cef349dc 100644 --- a/docs/2015-12/index.html +++ b/docs/2015-12/index.html @@ -294,16 +294,16 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2016-01/index.html b/docs/2016-01/index.html index 1a9b04ecd..254b46fd2 100644 --- a/docs/2016-01/index.html +++ b/docs/2016-01/index.html @@ -210,16 +210,16 @@ $ find SimpleArchiveForBio/ -iname “*.pdf” -exec basename {} \; | so
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2016-02/index.html b/docs/2016-02/index.html index 9c12215e3..c09726840 100644 --- a/docs/2016-02/index.html +++ b/docs/2016-02/index.html @@ -455,16 +455,16 @@ Bitstream: tést señora alimentación.pdf
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2016-03/index.html b/docs/2016-03/index.html index aadaac7ed..52c6ddb17 100644 --- a/docs/2016-03/index.html +++ b/docs/2016-03/index.html @@ -361,16 +361,16 @@ metadata_value_id | resource_id | metadata_field_id | text_value | text_lang | p
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2016-04/index.html b/docs/2016-04/index.html index 873c0a260..9441319b6 100644 --- a/docs/2016-04/index.html +++ b/docs/2016-04/index.html @@ -577,16 +577,16 @@ dspace.log.2016-04-27:7271
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2016-05/index.html b/docs/2016-05/index.html index 22f5c6b5e..1cc4b4df7 100644 --- a/docs/2016-05/index.html +++ b/docs/2016-05/index.html @@ -435,16 +435,16 @@ sys 0m20.540s
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2016-06/index.html b/docs/2016-06/index.html index 1e129c7f6..e73cd223b 100644 --- a/docs/2016-06/index.html +++ b/docs/2016-06/index.html @@ -470,16 +470,16 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2016-07/index.html b/docs/2016-07/index.html index 64a90d76e..a8ac47286 100644 --- a/docs/2016-07/index.html +++ b/docs/2016-07/index.html @@ -381,16 +381,16 @@ discovery.index.authority.ignore-variants=true
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2016-08/index.html b/docs/2016-08/index.html index 5545b9623..c935e12a0 100644 --- a/docs/2016-08/index.html +++ b/docs/2016-08/index.html @@ -460,16 +460,16 @@ $ JAVA_OPTS="-Dfile.encoding=UTF-8 -Xmx512m" /home/cgspace.cgiar.org/b
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2016-09/index.html b/docs/2016-09/index.html index 107d0b254..8804112ee 100644 --- a/docs/2016-09/index.html +++ b/docs/2016-09/index.html @@ -734,16 +734,16 @@ $ ./delete-metadata-values.py -i ilrisubjects-delete-13.csv -f cg.subject.ilri -
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2016-10/index.html b/docs/2016-10/index.html index 3c821d5eb..97a76a20e 100644 --- a/docs/2016-10/index.html +++ b/docs/2016-10/index.html @@ -439,16 +439,16 @@ dspace=# update metadatavalue set text_value = regexp_replace(text_value, 'http:
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2016-11/index.html b/docs/2016-11/index.html index 13b11704e..72722ce88 100644 --- a/docs/2016-11/index.html +++ b/docs/2016-11/index.html @@ -640,16 +640,16 @@ org.dspace.discovery.SearchServiceException: Error executing query
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2016-12/index.html b/docs/2016-12/index.html index ff1c4763c..823ddbe94 100644 --- a/docs/2016-12/index.html +++ b/docs/2016-12/index.html @@ -907,16 +907,16 @@ $ exit
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2017-01/index.html b/docs/2017-01/index.html index 84684bec2..7b52ccdee 100644 --- a/docs/2017-01/index.html +++ b/docs/2017-01/index.html @@ -432,16 +432,16 @@ $ gs -sDEVICE=pdfwrite -dCompatibilityLevel=1.4 -dPDFSETTINGS=/ebook -dNOPAUSE -
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2017-02/index.html b/docs/2017-02/index.html index 8d8dc672c..09b4e231a 100644 --- a/docs/2017-02/index.html +++ b/docs/2017-02/index.html @@ -497,16 +497,16 @@ COPY 1968
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2017-03/index.html b/docs/2017-03/index.html index 2b907f28e..d151fb4a9 100644 --- a/docs/2017-03/index.html +++ b/docs/2017-03/index.html @@ -434,16 +434,16 @@ $ ./delete-metadata-values.py -i Investors-Delete-121.csv -f dc.description.spon
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2017-04/index.html b/docs/2017-04/index.html index 7c05cdacb..2b35df655 100644 --- a/docs/2017-04/index.html +++ b/docs/2017-04/index.html @@ -702,16 +702,16 @@ $ gem install compass -v 1.0.3
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2017-05/index.html b/docs/2017-05/index.html index c8d364cfc..6bcb1c084 100644 --- a/docs/2017-05/index.html +++ b/docs/2017-05/index.html @@ -462,16 +462,16 @@ UPDATE 187
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2017-06/index.html b/docs/2017-06/index.html index 8177072bc..3264e646d 100644 --- a/docs/2017-06/index.html +++ b/docs/2017-06/index.html @@ -295,16 +295,16 @@ text_value
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2017-07/index.html b/docs/2017-07/index.html index ea4ac4d9d..89c99e8b6 100644 --- a/docs/2017-07/index.html +++ b/docs/2017-07/index.html @@ -315,16 +315,16 @@ delete from metadatavalue where resource_type_id=2 and metadata_field_id=235 and
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2017-08/index.html b/docs/2017-08/index.html index 389613c5c..f65a06721 100644 --- a/docs/2017-08/index.html +++ b/docs/2017-08/index.html @@ -611,16 +611,16 @@ org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2017-09/index.html b/docs/2017-09/index.html index 7f7c1af12..2eafa3ce3 100644 --- a/docs/2017-09/index.html +++ b/docs/2017-09/index.html @@ -781,16 +781,16 @@ Cert Status: good
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2017-10/index.html b/docs/2017-10/index.html index 391beb632..d1389b61e 100644 --- a/docs/2017-10/index.html +++ b/docs/2017-10/index.html @@ -547,16 +547,16 @@ session_id=6C30F10B4351A4ED83EC6ED50AFD6B6A
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2017-11/index.html b/docs/2017-11/index.html index 6d03894c3..1d74c3bc9 100644 --- a/docs/2017-11/index.html +++ b/docs/2017-11/index.html @@ -1157,16 +1157,16 @@ $ cat dspace.log.2017-11-28 | grep -o -E 'session_id=[A-Z0-9]{32}' | sort -n | u
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2017-12/index.html b/docs/2017-12/index.html index b2ad29406..3c4d808d3 100644 --- a/docs/2017-12/index.html +++ b/docs/2017-12/index.html @@ -938,16 +938,16 @@ DELETE 20
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2018-01/index.html b/docs/2018-01/index.html index da081cf10..1ad93c404 100644 --- a/docs/2018-01/index.html +++ b/docs/2018-01/index.html @@ -1732,16 +1732,16 @@ Catalina:type=Manager,context=/,host=localhost activeSessions 8
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2018-02/index.html b/docs/2018-02/index.html index a631caee9..45ba18420 100644 --- a/docs/2018-02/index.html +++ b/docs/2018-02/index.html @@ -1286,16 +1286,16 @@ UPDATE 3
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2018-03/index.html b/docs/2018-03/index.html index f73eecdb4..53b767312 100644 --- a/docs/2018-03/index.html +++ b/docs/2018-03/index.html @@ -712,16 +712,16 @@ Fixed 5 occurences of: GENEBANKS
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2018-04/index.html b/docs/2018-04/index.html index 952158d1c..6b1434511 100644 --- a/docs/2018-04/index.html +++ b/docs/2018-04/index.html @@ -720,16 +720,16 @@ java.lang.NoSuchMethodError: java.nio.ByteBuffer.position(I)Ljava/nio/ByteBuffer
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2018-05/index.html b/docs/2018-05/index.html index 9a70e0f76..c16d77cc4 100644 --- a/docs/2018-05/index.html +++ b/docs/2018-05/index.html @@ -615,16 +615,16 @@ $ psql -h localhost -U postgres dspacetest
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2018-06/index.html b/docs/2018-06/index.html index 908e87a5b..507c17e78 100644 --- a/docs/2018-06/index.html +++ b/docs/2018-06/index.html @@ -583,16 +583,16 @@ $ sed '/^id/d' 10568-*.csv | csvcut -c 1,2 > map-to-cifor-archive.csv
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2018-07/index.html b/docs/2018-07/index.html index f482a66c5..ba48a1c51 100644 --- a/docs/2018-07/index.html +++ b/docs/2018-07/index.html @@ -674,16 +674,16 @@ count
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2018-08/index.html b/docs/2018-08/index.html index 356cd5ab1..a8dd04afb 100644 --- a/docs/2018-08/index.html +++ b/docs/2018-08/index.html @@ -547,16 +547,16 @@ $ dspace database migrate ignored
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2018-09/index.html b/docs/2018-09/index.html index eaf451ce9..0eae3047e 100644 --- a/docs/2018-09/index.html +++ b/docs/2018-09/index.html @@ -909,16 +909,16 @@ UPDATE metadatavalue SET text_value='ja' WHERE resource_type_id=2 AND metadata_f
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2018-10/index.html b/docs/2018-10/index.html index e997ef553..e9b9162c0 100644 --- a/docs/2018-10/index.html +++ b/docs/2018-10/index.html @@ -796,16 +796,16 @@ $ curl -X GET -H "Content-Type: application/json" -H "Accept: app
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2018-11/index.html b/docs/2018-11/index.html index 09926dbe2..2d6fb88a7 100644 --- a/docs/2018-11/index.html +++ b/docs/2018-11/index.html @@ -651,16 +651,16 @@ $ dspace dsrun org.dspace.eperson.Groomer -a -b 11/27/2016 -d
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2018-12/index.html b/docs/2018-12/index.html index 936ff26b9..002789eff 100644 --- a/docs/2018-12/index.html +++ b/docs/2018-12/index.html @@ -684,16 +684,16 @@ UPDATE 1
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2019-01/index.html b/docs/2019-01/index.html index 0521e4d51..ec32ece04 100644 --- a/docs/2019-01/index.html +++ b/docs/2019-01/index.html @@ -1397,16 +1397,16 @@ identify: CorruptImageProfile `xmp' @ warning/profile.c/SetImageProfileInternal/
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2019-02/index.html b/docs/2019-02/index.html index 4fff78679..649618a20 100644 --- a/docs/2019-02/index.html +++ b/docs/2019-02/index.html @@ -1588,16 +1588,16 @@ Please see the DSpace documentation for assistance.
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2019-03/index.html b/docs/2019-03/index.html index b277fb1e4..52304af82 100644 --- a/docs/2019-03/index.html +++ b/docs/2019-03/index.html @@ -1380,16 +1380,16 @@ sys 0m2.551s
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2019-04/index.html b/docs/2019-04/index.html index 805174b89..cdd516c54 100644 --- a/docs/2019-04/index.html +++ b/docs/2019-04/index.html @@ -1439,16 +1439,16 @@ UPDATE 14
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2019-05/index.html b/docs/2019-05/index.html index feeea9f25..33c945331 100644 --- a/docs/2019-05/index.html +++ b/docs/2019-05/index.html @@ -728,16 +728,16 @@ COPY 64871
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2019-06/index.html b/docs/2019-06/index.html index 081d7d3fb..519caf189 100644 --- a/docs/2019-06/index.html +++ b/docs/2019-06/index.html @@ -341,16 +341,16 @@ UPDATE 2
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2019-07/index.html b/docs/2019-07/index.html index ab27ecc61..3e212a5b4 100644 --- a/docs/2019-07/index.html +++ b/docs/2019-07/index.html @@ -624,16 +624,16 @@ issn.validate('1020-3362')
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2019-08/index.html b/docs/2019-08/index.html index 871f0225d..c2ca58ea9 100644 --- a/docs/2019-08/index.html +++ b/docs/2019-08/index.html @@ -27,7 +27,7 @@ Run system updates on DSpace Test (linode19) and reboot it - + @@ -61,7 +61,7 @@ Run system updates on DSpace Test (linode19) and reboot it "url": "https:\/\/alanorth.github.io\/cgspace-notes\/2019-08\/", "wordCount": "2703", "datePublished": "2019-08-03T12:39:51\x2b03:00", - "dateModified": "2019-08-29T19:25:06\x2b03:00", + "dateModified": "2019-09-01T01:54:55\x2b03:00", "author": { "@type": "Person", "name": "Alan Orth" @@ -626,16 +626,16 @@ sys 2m27.496s
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/2019-09/index.html b/docs/2019-09/index.html new file mode 100644 index 000000000..5521b0620 --- /dev/null +++ b/docs/2019-09/index.html @@ -0,0 +1,287 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + September, 2019 | CGSpace Notes + + + + + + + + + + + + + + + + +
+
+ +
+
+ + + + +
+
+

CGSpace Notes

+

Documenting day-to-day work on the CGSpace repository.

+
+
+ + + + +
+
+
+ + + + +
+
+

September, 2019

+ +
+

2019-09-01

+ +
    +
  • Linode emailed to say that CGSpace (linode18) had a high rate of outbound traffic for several hours this morning
  • + +
  • Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning:

    + +
    # zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
    +440 17.58.101.255
    +441 157.55.39.101
    +485 207.46.13.43
    +728 169.60.128.125
    +730 207.46.13.108
    +758 157.55.39.9
    +808 66.160.140.179
    +814 207.46.13.212
    +2472 163.172.71.23
    +6092 3.94.211.189
    +# zcat --force /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/oai.log /var/log/nginx/oai.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
    + 33 2a01:7e00::f03c:91ff:fe16:fcb
    + 57 3.83.192.124
    + 57 3.87.77.25
    + 57 54.82.1.8
    +822 2a01:9cc0:47:1:1a:4:0:2
    +1223 45.5.184.72
    +1633 172.104.229.92
    +5112 205.186.128.185
    +7249 2a01:7e00::f03c:91ff:fe18:7396
    +9124 45.5.186.2
    +
  • +
+ +
    +
  • 3.94.211.189 is MauiBot, and most of its requests are to Discovery and get rate limited with HTTP 503
  • + +
  • 163.172.71.23 is some IP on Online SAS in France and its user agent is:

    + +
    Mozilla/5.0 ((Windows; U; Windows NT 6.1; fr; rv:1.9.2) Gecko/20100115 Firefox/3.6)
    +
  • + +
  • It actually got mostly HTTP 200 responses:

    + +
    # zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | grep 163.172.71.23 | awk '{print $9}' | sort | uniq -c
    +1775 200
    +703 499
    + 72 503
    +
  • + +
  • And it was mostly requesting Discover pages:

    + +
    # zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | grep 163.172.71.23 | grep -o -E "(bitstream|discover|handle)" | sort | uniq -c 
    +2350 discover
    + 71 handle
    +
  • + +
  • I’m not sure why the outbound traffic rate was so high…

  • +
+ + + + + + + +
+ + + +
+ + + + +
+
+ + + + + + + + + diff --git a/docs/404.html b/docs/404.html index ed0e8bf7c..14a7cfabc 100644 --- a/docs/404.html +++ b/docs/404.html @@ -87,16 +87,16 @@
    -
  1. August, 2019
  2. -
  3. Posts
  4. +
  5. September, 2019
  6. + +
  7. August, 2019
  8. +
  9. July, 2019
  10. June, 2019
  11. -
  12. May, 2019
  13. -
diff --git a/docs/categories/index.html b/docs/categories/index.html index a1c0a65a7..6f5f3841a 100644 --- a/docs/categories/index.html +++ b/docs/categories/index.html @@ -89,6 +89,54 @@ +
+
+

September, 2019

+ +
+

2019-09-01

+ + + Read more → +
+ + + + + +

August, 2019

@@ -414,36 +462,6 @@ sys 0m1.979s - -
-
-

November, 2018

- -
-

2018-11-01

- -
    -
  • Finalize AReS Phase I and Phase II ToRs
  • -
  • Send a note about my dspace-statistics-api to the dspace-tech mailing list
  • -
- -

2018-11-03

- -
    -
  • Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage
  • -
  • Today these are the top 10 IPs:
  • -
- Read more → -
- - - - -