Add notes for 2022-07-06

content/posts/2022-07.md

@@ -82,4 +82,40 @@ Time: 399.751 ms
   - Perhaps we need to update our list of languages to include all instead of the most common ones
 - I wrote a script `ilri/iso-639-value-pairs.py` to extract the names and Alpha 2 codes for all ISO 639-1 languages from pycountry and added them to `input-forms.xml`
 
+## 2022-07-06
+
+- CGSpace went down and up a few times due to high load
+  - I found one host in Romania making very high speed requests with a normal user agent (`Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.2; WOW64; Trident/7.0; .NET4.0E; .NET4.0C`):
+
+```console
+# awk '{print $1}' /var/log/nginx/{access,library-access,oai,rest}.log | sort | uniq -c | sort -h | tail -n 10
+    516 142.132.248.90
+    525 157.55.39.234
+    587 66.249.66.21
+    593 95.108.213.59
+   1372 137.184.159.211
+   4776 54.195.118.125
+   5441 205.186.128.185
+   6267 45.5.186.2
+  15839 2a01:7e00::f03c:91ff:fe9a:3a37
+  36114 146.19.75.141
+```
+
+- I added 146.19.75.141 to the list of bot networks in nginx
+- While looking at the logs I started thinking about Bing again
+  - They apparently [publish a list of all their networks](https://www.bing.com/toolbox/bingbot.json)
+  - I wrote a script to use `prips` to [print the IPs for each network](https://stackoverflow.com/a/52501093/1996540)
+  - The script is `bing-networks-to-ips.sh`
+  - From Bing's IPs alone I purged 145,403 hits... sheesh
+- Delete two items on CGSpace for Margarita because she was getting the "Authorization denied for action OBSOLETE (DELETE) on BITSTREAM:0b26875a-..." error
+  - This is the same DSpace 6 bug I noticed in 2021-03, 2021-04, and 2021-05
+- Update some `cg.audience` metadata to use "Academics" instead of "Academicians":
+
+```console
+dspace=# UPDATE metadatavalue SET text_value='Academics' WHERE dspace_object_id IN (SELECT uuid FROM item) AND metadata_field_id=144 AND text_value='Academicians';
+UPDATE 104
+```
+
+- I will also have to remove "Academicians" from input-forms.xml
+
 <!-- vim: set sw=2 ts=2: -->