mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2025-01-27 05:49:12 +01:00
Add notes for 2017-11-02
This commit is contained in:
@ -12,7 +12,7 @@
|
||||
|
||||
|
||||
|
||||
<meta property="og:updated_time" content="2017-10-01T08:07:54+03:00"/>
|
||||
<meta property="og:updated_time" content="2017-11-02T09:37:54+02:00"/>
|
||||
|
||||
|
||||
|
||||
@ -39,7 +39,7 @@
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
},
|
||||
"dateModified": "2017-10-01T08:07:54+03:00",
|
||||
"dateModified": "2017-11-02T09:37:54+02:00",
|
||||
"keywords": "notes,notes,",
|
||||
"description": "Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
|
||||
}
|
||||
@ -97,6 +97,48 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2017-11/">November, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-11-02T09:37:54+02:00">Thu Nov 02, 2017</time> by Alan Orth in
|
||||
|
||||
<i class="fa fa-tag" aria-hidden="true"></i> <a href="/cgspace-notes/tags/notes" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-11-01">2017-11-01</h2>
|
||||
|
||||
<ul>
|
||||
<li>The CORE developers responded to say they are looking into their bot not respecting our robots.txt</li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-11-02">2017-11-02</h2>
|
||||
|
||||
<ul>
|
||||
<li>Today there have been no hits by CORE and no alerts from Linode (coincidence?)</li>
|
||||
</ul>
|
||||
|
||||
<pre><code># grep -c "CORE" /var/log/nginx/access.log
|
||||
0
|
||||
</code></pre>
|
||||
|
||||
<ul>
|
||||
<li>Generate list of authors on CGSpace for Peter to go through and correct:</li>
|
||||
</ul>
|
||||
|
||||
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
|
||||
COPY 54701
|
||||
</code></pre>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2017-10/">October, 2017</a></h2>
|
||||
@ -365,46 +407,6 @@
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2017-02/">February, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-02-07T07:04:52-08:00">Tue Feb 07, 2017</time> by Alan Orth in
|
||||
|
||||
<i class="fa fa-tag" aria-hidden="true"></i> <a href="/cgspace-notes/tags/notes" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-02-07">2017-02-07</h2>
|
||||
|
||||
<ul>
|
||||
<li>An item was mapped twice erroneously again, so I had to remove one of the mappings manually:</li>
|
||||
</ul>
|
||||
|
||||
<pre><code>dspace=# select * from collection2item where item_id = '80278';
|
||||
id | collection_id | item_id
|
||||
-------+---------------+---------
|
||||
92551 | 313 | 80278
|
||||
92550 | 313 | 80278
|
||||
90774 | 1051 | 80278
|
||||
(3 rows)
|
||||
dspace=# delete from collection2item where id = 92551 and item_id = 80278;
|
||||
DELETE 1
|
||||
</code></pre>
|
||||
|
||||
<ul>
|
||||
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
|
||||
<li>Looks like we’ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
|
||||
@ -428,6 +430,8 @@ DELETE 1
|
||||
<ol class="list-unstyled">
|
||||
|
||||
|
||||
<li><a href="/cgspace-notes/2017-11/">November, 2017</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-10/">October, 2017</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgiar-library-migration/">CGIAR Library Migration</a></li>
|
||||
@ -436,8 +440,6 @@ DELETE 1
|
||||
|
||||
<li><a href="/cgspace-notes/2017-08/">August, 2017</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-07/">July, 2017</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -6,11 +6,44 @@
|
||||
<description>Recent content in Posts on CGSpace Notes</description>
|
||||
<generator>Hugo -- gohugo.io</generator>
|
||||
<language>en-us</language>
|
||||
<lastBuildDate>Sun, 01 Oct 2017 08:07:54 +0300</lastBuildDate>
|
||||
<lastBuildDate>Thu, 02 Nov 2017 09:37:54 +0200</lastBuildDate>
|
||||
|
||||
<atom:link href="https://alanorth.github.io/cgspace-notes/post/index.xml" rel="self" type="application/rss+xml" />
|
||||
|
||||
|
||||
<item>
|
||||
<title>November, 2017</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2017-11/</link>
|
||||
<pubDate>Thu, 02 Nov 2017 09:37:54 +0200</pubDate>
|
||||
|
||||
<guid>https://alanorth.github.io/cgspace-notes/2017-11/</guid>
|
||||
<description><h2 id="2017-11-01">2017-11-01</h2>
|
||||
|
||||
<ul>
|
||||
<li>The CORE developers responded to say they are looking into their bot not respecting our robots.txt</li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-11-02">2017-11-02</h2>
|
||||
|
||||
<ul>
|
||||
<li>Today there have been no hits by CORE and no alerts from Linode (coincidence?)</li>
|
||||
</ul>
|
||||
|
||||
<pre><code># grep -c &quot;CORE&quot; /var/log/nginx/access.log
|
||||
0
|
||||
</code></pre>
|
||||
|
||||
<ul>
|
||||
<li>Generate list of authors on CGSpace for Peter to go through and correct:</li>
|
||||
</ul>
|
||||
|
||||
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
|
||||
COPY 54701
|
||||
</code></pre>
|
||||
|
||||
<p></p></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
<title>October, 2017</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2017-10/</link>
|
||||
|
||||
@ -12,7 +12,7 @@
|
||||
|
||||
|
||||
|
||||
<meta property="og:updated_time" content="2017-01-02T10:43:00+03:00"/>
|
||||
<meta property="og:updated_time" content="2017-02-07T07:04:52-08:00"/>
|
||||
|
||||
|
||||
|
||||
@ -39,7 +39,7 @@
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
},
|
||||
"dateModified": "2017-01-02T10:43:00+03:00",
|
||||
"dateModified": "2017-02-07T07:04:52-08:00",
|
||||
"keywords": "notes,notes,",
|
||||
"description": "Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
|
||||
}
|
||||
@ -97,6 +97,46 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2017-02/">February, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-02-07T07:04:52-08:00">Tue Feb 07, 2017</time> by Alan Orth in
|
||||
|
||||
<i class="fa fa-tag" aria-hidden="true"></i> <a href="/cgspace-notes/tags/notes" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-02-07">2017-02-07</h2>
|
||||
|
||||
<ul>
|
||||
<li>An item was mapped twice erroneously again, so I had to remove one of the mappings manually:</li>
|
||||
</ul>
|
||||
|
||||
<pre><code>dspace=# select * from collection2item where item_id = '80278';
|
||||
id | collection_id | item_id
|
||||
-------+---------------+---------
|
||||
92551 | 313 | 80278
|
||||
92550 | 313 | 80278
|
||||
90774 | 1051 | 80278
|
||||
(3 rows)
|
||||
dspace=# delete from collection2item where id = 92551 and item_id = 80278;
|
||||
DELETE 1
|
||||
</code></pre>
|
||||
|
||||
<ul>
|
||||
<li>Create issue on GitHub to track the addition of CCAFS Phase II project tags (<a href="https://github.com/ilri/DSpace/issues/301">#301</a>)</li>
|
||||
<li>Looks like we’ll be using <code>cg.identifier.ccafsprojectpii</code> as the field name</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-02/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2017-01/">January, 2017</a></h2>
|
||||
@ -380,34 +420,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2016-04/">April, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-04-04T11:06:00+03:00">Mon Apr 04, 2016</time> by Alan Orth in
|
||||
|
||||
<i class="fa fa-tag" aria-hidden="true"></i> <a href="/cgspace-notes/tags/notes" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-04-04">2016-04-04</h2>
|
||||
|
||||
<ul>
|
||||
<li>Looking at log file use on CGSpace and notice that we need to work on our cron setup a bit</li>
|
||||
<li>We are backing up all logs in the log folder, including useless stuff like solr, cocoon, handle-plugin, etc</li>
|
||||
<li>After running DSpace for over five years I’ve never needed to look in any other log file than dspace.log, leave alone one from last year!</li>
|
||||
<li>This will save us a few gigs of backup space we’re paying for on S3</li>
|
||||
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/post/" rel="prev" role="button">Previous page</a>
|
||||
@ -431,6 +443,8 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
<ol class="list-unstyled">
|
||||
|
||||
|
||||
<li><a href="/cgspace-notes/2017-11/">November, 2017</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-10/">October, 2017</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgiar-library-migration/">CGIAR Library Migration</a></li>
|
||||
@ -439,8 +453,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<li><a href="/cgspace-notes/2017-08/">August, 2017</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-07/">July, 2017</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -12,7 +12,7 @@
|
||||
|
||||
|
||||
|
||||
<meta property="og:updated_time" content="2016-03-02T16:50:00+03:00"/>
|
||||
<meta property="og:updated_time" content="2016-04-04T11:06:00+03:00"/>
|
||||
|
||||
|
||||
|
||||
@ -39,7 +39,7 @@
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
},
|
||||
"dateModified": "2016-03-02T16:50:00+03:00",
|
||||
"dateModified": "2016-04-04T11:06:00+03:00",
|
||||
"keywords": "notes,notes,",
|
||||
"description": "Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."
|
||||
}
|
||||
@ -97,6 +97,34 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2016-04/">April, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-04-04T11:06:00+03:00">Mon Apr 04, 2016</time> by Alan Orth in
|
||||
|
||||
<i class="fa fa-tag" aria-hidden="true"></i> <a href="/cgspace-notes/tags/notes" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-04-04">2016-04-04</h2>
|
||||
|
||||
<ul>
|
||||
<li>Looking at log file use on CGSpace and notice that we need to work on our cron setup a bit</li>
|
||||
<li>We are backing up all logs in the log folder, including useless stuff like solr, cocoon, handle-plugin, etc</li>
|
||||
<li>After running DSpace for over five years I’ve never needed to look in any other log file than dspace.log, leave alone one from last year!</li>
|
||||
<li>This will save us a few gigs of backup space we’re paying for on S3</li>
|
||||
<li>Also, I noticed the <code>checker</code> log has some errors we should pay attention to:</li>
|
||||
</ul>
|
||||
|
||||
<p></p>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title"><a href="https://alanorth.github.io/cgspace-notes/2016-03/">March, 2016</a></h2>
|
||||
@ -265,6 +293,8 @@
|
||||
<ol class="list-unstyled">
|
||||
|
||||
|
||||
<li><a href="/cgspace-notes/2017-11/">November, 2017</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-10/">October, 2017</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgiar-library-migration/">CGIAR Library Migration</a></li>
|
||||
@ -273,8 +303,6 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2017-08/">August, 2017</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2017-07/">July, 2017</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
Reference in New Issue
Block a user