2020-11-04 19:41:19 +01:00
|
|
|
---
|
|
|
|
|
title: "November, 2020"
|
|
|
|
|
date: 2020-11-01T13:11:54+02:00
|
|
|
|
|
author: "Alan Orth"
|
|
|
|
|
categories: ["Notes"]
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
## 2020-11-01
|
|
|
|
|
|
|
|
|
|
- Continue with processing the statistics-2019 Solr core with the AtomicStatisticsUpdateCLI tool on DSpace Test
|
|
|
|
|
- So far we've spent at least fifty hours to process the statistics and statistics-2019 core... wow.
|
|
|
|
|
|
|
|
|
|
<!--more-->
|
|
|
|
|
|
|
|
|
|
## 2020-11-02
|
|
|
|
|
|
|
|
|
|
- Talk to Moayad and fix a few issues on OpenRXV:
|
|
|
|
|
- Incorrect views and downloads (caused by Elasticsearch's default result set size of 10)
|
|
|
|
|
- Invalid share link
|
|
|
|
|
- Missing "https://" for Handles in the Simple Excel report (caused by using the `handle` instead of the `uri`)
|
|
|
|
|
- Sorting the list of items by views
|
|
|
|
|
- I resumed the processing of the statistics-2018 Solr core after it spent 20 hours to get to 60%
|
|
|
|
|
|
|
|
|
|
## 2020-11-04
|
|
|
|
|
|
|
|
|
|
- After 29 hours the statistics-2017 core finished processing so I started the statistics-2016 core on DSpace Test
|
|
|
|
|
|
2020-11-05 11:14:50 +01:00
|
|
|
## 2020-11-05
|
|
|
|
|
|
|
|
|
|
- Peter sent me corrections and deletions for the author affiliations
|
|
|
|
|
- I quickly proofed them for UTF-8 issues in OpenRefine and csv-metadata-quality and then tested them locally and then applied them on CGSpace:
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
$ ./fix-metadata-values.py -i 2020-11-05-fix-862-affiliations.csv -db dspace -u dspace -p 'fuuu' -f cg.contributor.affiliation -t 'correct' -m 211
|
|
|
|
|
$ ./delete-metadata-values.py -i 2020-11-05-delete-29-affiliations.csv -db dspace -u dspace -p 'fuuu' -f cg.contributor.affiliation -m 211
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
- Then I started a Discovery re-index on CGSpace:
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
$ time chrt -b 0 ionice -c2 -n7 nice -n19 dspace index-discovery -b
|
2020-11-05 13:04:34 +01:00
|
|
|
|
|
|
|
|
real 92m24.993s
|
|
|
|
|
user 8m11.858s
|
|
|
|
|
sys 2m26.931s
|
2020-11-05 11:14:50 +01:00
|
|
|
```
|
|
|
|
|
|
2020-11-07 15:22:36 +01:00
|
|
|
## 2020-11-06
|
|
|
|
|
|
|
|
|
|
- Restart the AtomicStatisticsUpdateCLI processing of the statistics-2016 core on DSpace Test after 20 hours...
|
|
|
|
|
- This phase finished after five hours so I started it on the statistics-2015 core
|
|
|
|
|
|
|
|
|
|
## 2020-11-07
|
|
|
|
|
|
|
|
|
|
- Atmire responded about the issue with duplicate values in owningComm and containerCommunity etc
|
|
|
|
|
- I told them to please look into it and use some of our credits if need be
|
|
|
|
|
- The statistics-2015 core finished after 20 hours so I started the statistics-2014 core
|
2020-11-05 11:14:50 +01:00
|
|
|
|
2020-11-08 13:43:00 +01:00
|
|
|
## 2020-11-08
|
|
|
|
|
|
|
|
|
|
- Add "Data Paper" to types on CGSpace
|
|
|
|
|
- Add "SCALING CLIMATE-SMART AGRICULTURE" to CCAFS subjects on CGSpace
|
|
|
|
|
- Add "ANDEAN ROOTS AND TUBERS" to CIP subjects on CGSpace
|
|
|
|
|
- Add CGIAR System subjects to Discovery sidebar facets on CGSpace
|
|
|
|
|
- Also add the System subject to item view on CGSpace
|
|
|
|
|
|
2020-11-04 19:41:19 +01:00
|
|
|
<!-- vim: set sw=2 ts=2: -->
|
