mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2025-01-27 05:49:12 +01:00
Add notes for 2023-03-21
This commit is contained in:
@ -403,4 +403,51 @@ Opened test.csv
|
||||
|
||||
- Start a harvest on AReS
|
||||
|
||||
## 2023-03-20
|
||||
|
||||
- Minor updates to a few of my DSpace Python scripts to fix the logging
|
||||
- Minor updates to some records for Mazingira reported by Sonja
|
||||
- Upgrade PostgreSQL on DSpace Test from version 12 to 14, the same way I did from 10 to 12 last year:
|
||||
- First, I installed the new version of PostgreSQL via the Ansible playbook scripts
|
||||
- Then I stopped Tomcat and all PostgreSQL clusters and used `pg_upgrade` to upgrade the old version:
|
||||
|
||||
```console
|
||||
# systemctl stop tomcat7
|
||||
# pg_ctlcluster 12 main stop
|
||||
# tar -cvzpf var-lib-postgresql-12.tar.gz /var/lib/postgresql/12
|
||||
# tar -cvzpf etc-postgresql-12.tar.gz /etc/postgresql/12
|
||||
# pg_ctlcluster 14 main stop
|
||||
# pg_dropcluster 14 main
|
||||
# pg_upgradecluster 12 main
|
||||
# pg_ctlcluster 14 main start
|
||||
```
|
||||
|
||||
- After that I [re-indexed the database indexes using a query](https://adamj.eu/tech/2021/04/13/reindexing-all-tables-after-upgrading-to-postgresql-13/):
|
||||
|
||||
```console
|
||||
$ su - postgres
|
||||
$ cat /tmp/generate-reindex.sql
|
||||
SELECT 'REINDEX TABLE CONCURRENTLY ' || quote_ident(relname) || ' /*' || pg_size_pretty(pg_total_relation_size(C.oid)) || '*/;'
|
||||
FROM pg_class C
|
||||
LEFT JOIN pg_namespace N ON (N.oid = C.relnamespace)
|
||||
WHERE nspname = 'public'
|
||||
AND C.relkind = 'r'
|
||||
AND nspname !~ '^pg_toast'
|
||||
ORDER BY pg_total_relation_size(C.oid) ASC;
|
||||
$ psql dspace < /tmp/generate-reindex.sql > /tmp/reindex.sql
|
||||
$ <trim the extra stuff from /tmp/reindex.sql>
|
||||
$ psql dspace < /tmp/reindex.sql
|
||||
```
|
||||
|
||||
- The index on `metadatavalue` shrunk by 90MB, and others a bit less
|
||||
- This is nice, but not as drastic as I noticed last year when upgrading to PostgreSQL 12
|
||||
|
||||
## 2023-03-21
|
||||
|
||||
- Leigh sent me a list of IFPRI authors with ORCID identifiers so I combined them with our list and resolved all their names with `resolve_orcids.py`
|
||||
- It adds 154 new ORCID identifiers
|
||||
- I did a follow up to the publisher names from last week using the list from doi.org
|
||||
- Last week I only updated items with a DOI that had *no* publisher, but now I was curious to see how our existing publisher information compared
|
||||
- I checked a dozen or so manually and, other than CIFOR/ICRAF and CIAT/Alliance, the metadata was better than our existing data, so I overwrote them
|
||||
|
||||
<!-- vim: set sw=2 ts=2: -->
|
||||
|
Reference in New Issue
Block a user