alanorth/cgspace-notes
1
0
Fork 0
mirror of https://github.com/alanorth/cgspace-notes.git synced 2024-11-22 14:45:03 +01:00
Code Issues Projects Releases Wiki Activity

Update notes for 2019-10-13

Browse Source
This commit is contained in:
Alan Orth 2019-10-13 21:17:22 +03:00
parent be1e2a283c
commit 0171ace573
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
3 changed files with 87 additions and 8 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

39
content/posts/2019-10.md
View File

@ -136,5 +136,44 @@ $ ./fix-metadata-values.py -i /tmp/affiliations.csv -db dspace -u dspace -p 'fuu
- More cleanup work on the authors in the Bioversity migration
- Now I sent the final feedback to Francesca, Carol, and Abenet
- Peter is still seeing some authors listed with "|" in the "Top Authors" statistics for some collections
- I looked in some of the items that are listed and the author field does not contain those invalid separators
- I decided to try doing a full Discovery re-indexing on CGSpace (linode18):
```
$ time schedtool -B -e ionice -c2 -n7 nice -n19 dspace index-discovery -b
real 82m35.993s
```
- After the re-indexing the top authors still list the following:
```
Jagwe, J.|Ouma, E.A.|Brandes-van Dorresteijn, D.|Kawuma, Brian|Smith, J.
```
- I looked in the database to find authors that had "|" in them:
```
dspace=# SELECT text_value, resource_id FROM metadatavalue WHERE resource_type_id=2 AND metadata_field_id=3 AND text_value LIKE '%|%';
text_value | resource_id
----------------------------------+-------------
Anandajayasekeram, P.|Puskur, R. | 157
Morales, J.|Renner, I. | 22779
Zahid, A.|Haque, M.A. | 25492
(3 rows)
```
- Then I found their handles and corrected them, for example:
```
dspacetest=# select handle from item, handle where handle.resource_id = item.item_id AND item.item_id = '157' and handle.resource_type_id=2;
handle
-----------
10568/129
(1 row)
```
- So I'm still not sure where these weird authors in the "Top Author" stats are coming from
<!-- vim: set sw=2 ts=2: -->

46
docs/2019-10/index.html
View File

@ -11,7 +11,7 @@
<meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2019-10/" />
<meta property="article:published_time" content="2019-10-01T13:20:51+03:00" />
<meta property="article:modified_time" content="2019-10-12T23:28:50+03:00" />
<meta property="article:modified_time" content="2019-10-13T11:59:11+03:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="October, 2019"/>
@ -27,9 +27,9 @@
"@type": "BlogPosting",
"headline": "October, 2019",
"url": "https:\/\/alanorth.github.io\/cgspace-notes\/2019-10\/",
"wordCount": "1073",
"wordCount": "1250",
"datePublished": "2019-10-01T13:20:51+03:00",
"dateModified": "2019-10-12T23:28:50+03:00",
"dateModified": "2019-10-13T11:59:11+03:00",
"author": {
"@type": "Person",
"name": "Alan Orth"
@ -286,6 +286,46 @@ International Maize and Wheat Improvement Centre,International Maize and Wheat I
<ul>
<li>Now I sent the final feedback to Francesca, Carol, and Abenet</li>
</ul></li>
<li><p>Peter is still seeing some authors listed with &ldquo;|&rdquo; in the &ldquo;Top Authors&rdquo; statistics for some collections</p>
<ul>
<li>I looked in some of the items that are listed and the author field does not contain those invalid separators</li>
<li><p>I decided to try doing a full Discovery re-indexing on CGSpace (linode18):</p>
<pre><code>$ time schedtool -B -e ionice -c2 -n7 nice -n19 dspace index-discovery -b
real 82m35.993s
</code></pre></li>
</ul></li>
<li><p>After the re-indexing the top authors still list the following:</p>
<pre><code>Jagwe, J.|Ouma, E.A.|Brandes-van Dorresteijn, D.|Kawuma, Brian|Smith, J.
</code></pre></li>
<li><p>I looked in the database to find authors that had &ldquo;|&rdquo; in them:</p>
<pre><code>dspace=# SELECT text_value, resource_id FROM metadatavalue WHERE resource_type_id=2 AND metadata_field_id=3 AND text_value LIKE '%|%';
text_value | resource_id
----------------------------------+-------------
Anandajayasekeram, P.|Puskur, R. | 157
Morales, J.|Renner, I. | 22779
Zahid, A.|Haque, M.A. | 25492
(3 rows)
</code></pre></li>
<li><p>Then I found their handles and corrected them, for example:</p>
<pre><code>dspacetest=# select handle from item, handle where handle.resource_id = item.item_id AND item.item_id = '157' and handle.resource_type_id=2;
handle
-----------
10568/129
(1 row)
</code></pre></li>
<li><p>So I&rsquo;m still not sure where these weird authors in the &ldquo;Top Author&rdquo; stats are coming from</p></li>
</ul>
<!-- vim: set sw=2 ts=2: -->

10
docs/sitemap.xml
View File

@ -4,27 +4,27 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/</loc>
<lastmod>2019-10-12T23:28:50+03:00</lastmod>
<lastmod>2019-10-13T11:59:11+03:00</lastmod>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
<lastmod>2019-10-12T23:28:50+03:00</lastmod>
<lastmod>2019-10-13T11:59:11+03:00</lastmod>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/2019-10/</loc>
<lastmod>2019-10-12T23:28:50+03:00</lastmod>
<lastmod>2019-10-13T11:59:11+03:00</lastmod>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
<lastmod>2019-10-12T23:28:50+03:00</lastmod>
<lastmod>2019-10-13T11:59:11+03:00</lastmod>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
<lastmod>2019-10-12T23:28:50+03:00</lastmod>
<lastmod>2019-10-13T11:59:11+03:00</lastmod>
</url>
<url>