Update notes for 2020-10-19

content/posts/2020-10.md

@@ -589,4 +589,24 @@ Purging 1282 hits from curl in statistics
 Total number of bot hits purged: 8174
 ```
 
+- Add "Infographic" to types in input form
+- Looking into the spider agent issue from last week, where hits seem to be logged regardless of ANY spider agent patterns being loaded
+  - I changed the following two options:
+    - `usage-statistics.logBots = false`
+    - `usage-statistics.bots.case-insensitive = true`
+  - Then I made several requests with a bot user agent:
+
+```
+$ http --print Hh https://dspacetest.cgiar.org/rest/bitstreams/dfa1d9c3-75d3-4380-a9d3-4c8cbbed2d21/retrieve User-Agent:"RTB website BOT"
+$ curl -s 'http://localhost:8083/solr/statistics/update?softCommit=true'
+```
+
+- And I saw three hits in Solr with `isBot: true`!!!
+  - I made a few more requests with user agent "fumanchu" and it logs them with `isBot: false`...
+  - I made a request with user agent "Delphi 2009" which is in the ilri pattern file, and it was logged with `isBot: true`
+  - I made a few more requests and confirmed that if a pattern is in the list it gets logged with `isBot: true` despite the fact that `usage-statistics.logBots` is false...
+  - So WTF this means that it *knows* they are from a bot, but it logs them anyways
+  - Is this an issue with Atmire's modules?
+  - I sent them feedback on the ticket
+
 <!-- vim: set sw=2 ts=2: -->