Add notes for 2017-07-31

content/post/2017-07.md

@@ -139,3 +139,11 @@ delete from metadatavalue where resource_type_id=2 and metadata_field_id=235 and
 
 - Now just waiting to run them on CGSpace, and then apply the modified input forms after Macaroni Bros give me an updated list
 - Temporarily increase the nginx upload limit to 200MB for Sisay to upload the CIAT presentations
+- Looking at CGSpace activity page, there are 52 Baidu bots concurrently crawling our website (I copied the activity page to a text file and grep it)!
+
+```
+$ grep 180.76. /tmp/status | awk '{print $5}' | sort | uniq | wc -l
+52
+```
+
+- From looking at the `dspace.log` I see they are all using the same session, which means our Crawler Session Manager Valve is working