alanorth/cgspace-notes
1
0
Fork 0
mirror of https://github.com/alanorth/cgspace-notes.git synced 2024-11-26 00:18:21 +01:00
Code Issues Projects Releases Wiki Activity

Update notes for 2018-07-12

Browse Source
This commit is contained in:
Alan Orth 2018-07-12 09:00:08 +03:00
parent 323e968c2f
commit 4e85415cca
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
4 changed files with 15 additions and 15 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
content/posts/2018-07.md
View File

@ -309,7 +309,7 @@ $ grep -c -E 'session_id=[A-Z0-9]{32}:ip_addr=95.108.181.88' dspace.log.2018-07-
993 GET /search-filter
804 GET /browse
# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E "Pcore-HTTP" | grep robots
208.110.72.10 - - [12/Jul/2018:00:22:28 +0000] "GET /robots.txt HTTP/1.1" 200 1301 "https://cgspace.cgiar.org/robots.txt" "Pcore-HTTP/v0.44.0
208.110.72.10 - - [12/Jul/2018:00:22:28 +0000] "GET /robots.txt HTTP/1.1" 200 1301 "https://cgspace.cgiar.org/robots.txt" "Pcore-HTTP/v0.44.0"
```
- So this bot is just like Baiduspider, and I need to add it to the nginx rate limiting

6
docs/2018-07/index.html
View File

@ -30,7 +30,7 @@ There is insufficient memory for the Java Runtime Environment to continue.
<meta property="article:published_time" content="2018-07-01T12:56:54&#43;03:00"/>
<meta property="article:modified_time" content="2018-07-11T16:55:30&#43;03:00"/>
<meta property="article:modified_time" content="2018-07-12T08:35:39&#43;03:00"/>
@ -73,7 +73,7 @@ There is insufficient memory for the Java Runtime Environment to continue.
"url": "https://alanorth.github.io/cgspace-notes/2018-07/",
"wordCount": "2079",
"datePublished": "2018-07-01T12:56:54&#43;03:00",
"dateModified": "2018-07-11T16:55:30&#43;03:00",
"dateModified": "2018-07-12T08:35:39&#43;03:00",
"author": {
"@type": "Person",
"name": "Alan Orth"
@ -487,7 +487,7 @@ org.apache.solr.client.solrj.SolrServerException: IOException occured when talki
993 GET /search-filter
804 GET /browse
# zcat --force /var/log/nginx/*.log /var/log/nginx/*.log.1 | grep -E &quot;Pcore-HTTP&quot; | grep robots
208.110.72.10 - - [12/Jul/2018:00:22:28 +0000] &quot;GET /robots.txt HTTP/1.1&quot; 200 1301 &quot;https://cgspace.cgiar.org/robots.txt&quot; &quot;Pcore-HTTP/v0.44.0
208.110.72.10 - - [12/Jul/2018:00:22:28 +0000] &quot;GET /robots.txt HTTP/1.1&quot; 200 1301 &quot;https://cgspace.cgiar.org/robots.txt&quot; &quot;Pcore-HTTP/v0.44.0&quot;
</code></pre>
<ul>

2
docs/robots.txt
View File

@ -37,7 +37,7 @@ Disallow: /cgspace-notes/2015-12/
Disallow: /cgspace-notes/2015-11/
Disallow: /cgspace-notes/
Disallow: /cgspace-notes/categories/
Disallow: /cgspace-notes/tags/notes/
Disallow: /cgspace-notes/categories/notes/
Disallow: /cgspace-notes/tags/notes/
Disallow: /cgspace-notes/posts/
Disallow: /cgspace-notes/tags/

20
docs/sitemap.xml
View File

@ -4,7 +4,7 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/2018-07/</loc>
<lastmod>2018-07-11T16:55:30+03:00</lastmod>
<lastmod>2018-07-12T08:35:39+03:00</lastmod>
</url>
<url>
@ -174,7 +174,7 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/</loc>
<lastmod>2018-07-11T16:55:30+03:00</lastmod>
<lastmod>2018-07-12T08:35:39+03:00</lastmod>
<priority>0</priority>
</url>
@ -183,27 +183,27 @@
<priority>0</priority>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
<lastmod>2018-07-11T16:55:30+03:00</lastmod>
<priority>0</priority>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
<lastmod>2018-03-09T22:10:33+02:00</lastmod>
<priority>0</priority>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
<lastmod>2018-07-12T08:35:39+03:00</lastmod>
<priority>0</priority>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
<lastmod>2018-07-11T16:55:30+03:00</lastmod>
<lastmod>2018-07-12T08:35:39+03:00</lastmod>
<priority>0</priority>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
<lastmod>2018-07-11T16:55:30+03:00</lastmod>
<lastmod>2018-07-12T08:35:39+03:00</lastmod>
<priority>0</priority>
</url>