mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-06-29 01:23:47 +02:00
4.2 KiB
4.2 KiB
title | date | author | tags | |
---|---|---|---|---|
May, 2019 | 2019-05-06T10:30:43+03:00 | Alan Orth |
|
2019-06-02
- Merge the Solr filterCache and XMLUI ISI journal changes to the
5_x-prod
branch and deploy on CGSpace - Run system updates on CGSpace (linode18) and reboot it
2019-06-03
- Skype with Marie-Angélique and Abenet about CG Core v2
- Here is a list of proposed metadata migrations for CGSpace
- dc.language.iso→DCTERMS.language (and switch to ISO 639-2 Alpha 3)
- dc.description.abstract→DCTERMS.abstract
- dc.identifier.citation→DCTERMS.bibliographicCitation
- dc.contributor.author→DCTERMS.creator (for people)
- dc.description.sponsorship→cg.contributor.donor (values from CrossRef or Grid.ac if possible)
- dc.rights→DCTERMS.license
- cg.identifier.status→DCTERMS.accessRights (values "open" or "restricted")
- cg.creator.id→cg.creator.identifier?
- dc.relation.ispartofseries→DCTERMS.isPartOf
- cg.link.relation→DCTERMS.relation
- Marie agreed that we need to adopt some controlled lists for our values, and pointed out that the MARLO team maintains a list of CRPs and Centers at CLARISA
- There is an API there but it needs a password for access...
2019-06-04
- The MARLO team responded and said they will give us access to the CLARISA API
- Marie-Angélique proposed to integrate
dcterms.isPartOf
,dcterms.abstract
, anddcterms.bibliographicCitation
into the CG Core v2 schema- I told her I would attempt to integrate those and the others above into DSpace Test soon and report back
- We also need to discuss with the ILRI Data Portal, MEL/MELSpace, and users who consume the CGSpace API
- Add Arabic language to input-forms.xml (#427), as Bioversity is adding some Arabic items and noticed it missing
2019-06-05
- Send mail to CGSpace and MELSpace people to let them know about the proposed metadata field migrations after the discussion with Marie-Angélique
2019-06-07
- Thierry noticed that the CUA statistics were missing previous years again, and I see that the Solr admin UI has the following message:
statistics-2018: org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: Error opening new searcher
- I had to restart Tomcat a few times for all the stats cores to get loaded with no issue
2019-06-10
- Rename the AReS repository on GitHub to OpenRXV: https://github.com/ilri/OpenRXV
- Create a new AReS repository: https://github.com/ilri/AReS
- Start looking at the 203 IITA records on DSpace Test from last month (IITA_May_16 aka "20194th.xls") using OpenRefine
- Trim leading, trailing, and consecutive whitespace on all columns, but I didn't notice very many issues
- Validate affiliations against latest list of top 1500 terms using reconcile-csv, correcting and standardizing about twenty-seven
- Validate countries against latest list of countries using reconcile-csv, correcting three
- Convert all DOIs to "https://dx.doi.org" format
- Normalize all
cg.identifier.url
Google book fields to "books.google.com" - Correct some inconsistencies in IITA subjects
- Correct two incorrect "Peer Review" in
dc.description.version
- About fifteen items have incorrect ISBNs (looks like an Excel error because the values look like scientific numbers)
- I managed to get to subjects, so I'll continue from there when I start working next
- Generate a new list of countries from the database for use with reconcile-csv
- After dumping, use csvcut to add line numbers, then change the csv header to match those you use in reconcile-csv, for example
id
andname
:
- After dumping, use csvcut to add line numbers, then change the csv header to match those you use in reconcile-csv, for example
dspace=# \COPY (SELECT DISTINCT text_value, count(*) FROM metadatavalue WHERE metadata_field_id = 228 AND resource_type_id = 2 GROUP BY text_value ORDER BY count DESC) to /tmp/countries.csv WITH CSV HEADER
COPY 192
$ csvcut -l -c 0 /tmp/countries.csv > 2019-06-10-countries.csv