mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-11-22 14:45:03 +01:00
Update notes
This commit is contained in:
parent
e77e3a13ae
commit
0d698d7ebe
GPG Key ID:
0FB860CC9C45B1B9
@ -599,20 +599,20 @@ Server: nginx
|
||||
|
||||
## 2017-11-13
|
||||
|
||||
- Just a few hours into the day and it really looks like the Baidu rate limiting is working, HTTP 200 vs 503:
|
||||
- At the end of the day I checked the logs and it really looks like the Baidu rate limiting is working, HTTP 200 vs 503:
|
||||
|
||||
```
|
||||
# cat /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep "13/Nov/2017" | grep "Baiduspider" | grep -c " 200 "
|
||||
508
|
||||
# cat /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep "13/Nov/2017" | grep "Baiduspider" | grep -c " 503 "
|
||||
5462
|
||||
# zcat -f -- /var/log/nginx/access.log.1 /var/log/nginx/access.log.2.gz | grep "13/Nov/2017" | grep "Baiduspider" | grep -c " 200 "
|
||||
1132
|
||||
# zcat -f -- /var/log/nginx/access.log.1 /var/log/nginx/access.log.2.gz | grep "13/Nov/2017" | grep "Baiduspider" | grep -c " 503 "
|
||||
10105
|
||||
```
|
||||
|
||||
- Helping Sisay proof 47 records for IITA: https://dspacetest.cgiar.org/handle/10568/97029
|
||||
- From looking at the data in OpenRefine I found:
|
||||
- Errors in `cg.authorship.types`
|
||||
- Errors in `cg.coverage.country` (smart quote in "COTE D’IVOIRE", "HAWAII" is not a country)
|
||||
- Whitespace issues in some `cg.contributor.affiliatio
|
||||
- Whitespace issues in some `cg.contributor.affiliation`
|
||||
- Whitespace issues in some `cg.identifier.doi` fields and most values are using HTTP instead of HTTPS
|
||||
- Whitespace issues in some `dc.contributor.author` fields
|
||||
- Issue with invalid `dc.date.issued` value "2011-3"
|
||||
@ -623,3 +623,10 @@ Server: nginx
|
||||
- Whitespace errors in `dc.subject`
|
||||
- Whitespace errors in `dc.title`
|
||||
- After uploading and looking at the data in DSpace Test I saw more errors with CRPs, subjects (one item had four copies of all of its subjects, another had a "." in it), affiliations, sponsors, etc.
|
||||
- Atmire responded to the [ticket about ORCID stuff](https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=510) a few days ago, today I told them that I need to talk to Peter and the partners to see what we would like to do
|
||||
|
||||
## 2017-11-14
|
||||
|
||||
- Deploy some nginx configuration updates to CGSpace
|
||||
- They had been waiting on a branch for a few months and I think I just forgot about them
|
||||
- I have been running them on DSpace Test for a few days and haven't seen any issues there
|
||||
|
||||
@ -38,7 +38,7 @@ COPY 54701
|
||||
|
||||
<meta property="article:published_time" content="2017-11-02T09:37:54+02:00"/>
|
||||
|
||||
<meta property="article:modified_time" content="2017-11-12T18:48:52+02:00"/>
|
||||
<meta property="article:modified_time" content="2017-11-13T12:04:41+02:00"/>
|
||||
|
||||
|
||||
|
||||
@ -86,9 +86,9 @@ COPY 54701
|
||||
"@type": "BlogPosting",
|
||||
"headline": "November, 2017",
|
||||
"url": "https://alanorth.github.io/cgspace-notes/2017-11/",
|
||||
"wordCount": "3544",
|
||||
"wordCount": "3630",
|
||||
"datePublished": "2017-11-02T09:37:54+02:00",
|
||||
"dateModified": "2017-11-12T18:48:52+02:00",
|
||||
"dateModified": "2017-11-13T12:04:41+02:00",
|
||||
"author": {
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
@ -815,13 +815,13 @@ Server: nginx
|
||||
<h2 id="2017-11-13">2017-11-13</h2>
|
||||
|
||||
<ul>
|
||||
<li>Just a few hours into the day and it really looks like the Baidu rate limiting is working, HTTP 200 vs 503:</li>
|
||||
<li>At the end of the day I checked the logs and it really looks like the Baidu rate limiting is working, HTTP 200 vs 503:</li>
|
||||
</ul>
|
||||
|
||||
<pre><code># cat /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep "13/Nov/2017" | grep "Baiduspider" | grep -c " 200 "
|
||||
508
|
||||
# cat /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep "13/Nov/2017" | grep "Baiduspider" | grep -c " 503 "
|
||||
5462
|
||||
<pre><code># zcat -f -- /var/log/nginx/access.log.1 /var/log/nginx/access.log.2.gz | grep "13/Nov/2017" | grep "Baiduspider" | grep -c " 200 "
|
||||
1132
|
||||
# zcat -f -- /var/log/nginx/access.log.1 /var/log/nginx/access.log.2.gz | grep "13/Nov/2017" | grep "Baiduspider" | grep -c " 503 "
|
||||
10105
|
||||
</code></pre>
|
||||
|
||||
<ul>
|
||||
@ -831,7 +831,7 @@ Server: nginx
|
||||
<ul>
|
||||
<li>Errors in <code>cg.authorship.types</code></li>
|
||||
<li>Errors in <code>cg.coverage.country</code> (smart quote in “COTE D’IVOIRE”, “HAWAII” is not a country)</li>
|
||||
<li>Whitespace issues in some `cg.contributor.affiliatio</li>
|
||||
<li>Whitespace issues in some <code>cg.contributor.affiliation</code></li>
|
||||
<li>Whitespace issues in some <code>cg.identifier.doi</code> fields and most values are using HTTP instead of HTTPS</li>
|
||||
<li>Whitespace issues in some <code>dc.contributor.author</code> fields</li>
|
||||
<li>Issue with invalid <code>dc.date.issued</code> value “2011-3”</li>
|
||||
@ -843,6 +843,15 @@ Server: nginx
|
||||
<li>Whitespace errors in <code>dc.title</code></li>
|
||||
</ul></li>
|
||||
<li>After uploading and looking at the data in DSpace Test I saw more errors with CRPs, subjects (one item had four copies of all of its subjects, another had a “.” in it), affiliations, sponsors, etc.</li>
|
||||
<li>Atmire responded to the <a href="https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=510">ticket about ORCID stuff</a> a few days ago, today I told them that I need to talk to Peter and the partners to see what we would like to do</li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-11-14">2017-11-14</h2>
|
||||
|
||||
<ul>
|
||||
<li>Deploy some nginx configuration updates to CGSpace</li>
|
||||
<li>They had been waiting on a branch for a few months and I think I just forgot about them</li>
|
||||
<li>I have been running them on DSpace Test for a few days and haven’t seen any issues there</li>
|
||||
</ul>
|
||||
|
||||
|
||||
|
||||
@ -4,7 +4,7 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2017-11/</loc>
|
||||
<lastmod>2017-11-12T18:48:52+02:00</lastmod>
|
||||
<lastmod>2017-11-13T12:04:41+02:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
@ -134,7 +134,7 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/</loc>
|
||||
<lastmod>2017-11-12T18:48:52+02:00</lastmod>
|
||||
<lastmod>2017-11-13T12:04:41+02:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
@ -145,7 +145,7 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
|
||||
<lastmod>2017-11-12T18:48:52+02:00</lastmod>
|
||||
<lastmod>2017-11-13T12:04:41+02:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
@ -157,13 +157,13 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/post/</loc>
|
||||
<lastmod>2017-11-12T18:48:52+02:00</lastmod>
|
||||
<lastmod>2017-11-13T12:04:41+02:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
|
||||
<lastmod>2017-11-12T18:48:52+02:00</lastmod>
|
||||
<lastmod>2017-11-13T12:04:41+02:00</lastmod>
|
||||
<priority>0</priority>
|
||||
</url>
|
||||
|
||||
|
||||
Loading…
Reference in New Issue
Block a user