content/posts/2019-03.md: Minor grammar

This commit is contained in:
Alan Orth 2020-07-24 21:57:55 +03:00
parent 8c8e87828e
commit 6b75032413
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9

View File

@ -830,7 +830,7 @@ $ psql -c 'select * from pg_stat_activity' | grep -o -E '(dspaceWeb|dspaceApi|ds
784 2a01:4f8:13b:1296::2
```
- The two IPV6 addresses are something called BLEXBot, which seems to check the robots.txt file and the completely ignore it by making thousands of requests to dynamic pages like Browse and Discovery
- The two IPV6 addresses are something called BLEXBot, which seems to check the robots.txt file and then completely ignore it by making thousands of requests to dynamic pages like Browse and Discovery
- Then `35.174.184.209` is MauiBot, which does the same thing
- Also `3.91.79.74` does, which appears to be CCBot
- I will add these three to the "bad bot" rate limiting that I originally used for Baidu