mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-11-25 16:08:19 +01:00
Add notes for 2020-11-22
This commit is contained in:
parent
05c4b236f4
commit
26f17edd92
@ -409,4 +409,54 @@ $ psql -c 'SELECT * FROM pg_locks pl LEFT JOIN pg_stat_activity psa ON pl.pid =
|
||||
|
||||
- Very curious that there was such a high number of rolled back transactions after the update
|
||||
|
||||
## 2020-11-22
|
||||
|
||||
- PostgreSQL situation on CGSpace (linode18) looks much better now:
|
||||
|
||||
![PostgreSQL locks week](/cgspace-notes/2020/11/postgres_locks_ALL-week3.png)
|
||||
![PostgreSQL transaction log week](/cgspace-notes/2020/11/postgres_xlog-week2.png)
|
||||
|
||||
- In other news, I noticed that harvesting DSpace 6 works fine in OpenRXV, but the statistics fail on page 1
|
||||
- I filed an issue: https://github.com/ilri/OpenRXV/issues/59
|
||||
- Abenet asked for help trying to add a new user to the Bioversity and CIAT groups on CGSpace
|
||||
- I see that the user search is split on five results, so the user in question appears on page 2
|
||||
- I asked Abenet if she was getting an error or it was simply this...
|
||||
- Maria Garuccio sent me an example report that she wants to be able to generate from AReS
|
||||
- First, she would like to have the option to group by output type
|
||||
- Second, she would like to be able to control the sorting in the template, like sorting the citation alphabetically
|
||||
- I filed an issue: https://github.com/ilri/OpenRXV/issues/60
|
||||
- Mohammad Salem had asked if there was an item ID to UUID mapping for CGSpace
|
||||
- I found a thread on the dspace-tech mailing list that pointed out that there is a new `uuid` column in the item table
|
||||
- Only old items have an `item_id` so we can get a mapping easily:
|
||||
|
||||
```
|
||||
dspace=# \COPY (SELECT item_id,uuid FROM item WHERE in_archive='t' AND withdrawn='f' AND item_id IS NOT NULL) TO /tmp/2020-11-22-item-id2uuid.csv WITH CSV HEADER;
|
||||
COPY 87411
|
||||
```
|
||||
|
||||
- Saving some notes I wrote down about faceting by community and collection in Solr, for potential use in the future in the DSpace Statistics API
|
||||
- Facet by owningComm to see total number of distinct communities (136):
|
||||
|
||||
```
|
||||
facet=true&facet.mincount=1&facet.field=owningComm&facet.limit=1&facet.offset=0&stats=true&stats.field=id&stats.calcdistinct=true
|
||||
```
|
||||
|
||||
- Facet by owningComm and get the first 5 distinct:
|
||||
|
||||
```
|
||||
facet=true&facet.mincount=1&facet.field=owningComm&facet.limit=5&facet.offset=0&facet.pivot=id,countryCode
|
||||
```
|
||||
|
||||
- Facet by owningComm and countryCode using facet.pivot and maybe I can just skip the normal facet params?
|
||||
|
||||
```
|
||||
facet=true&f.owningComm.facet.limit=5&f.owningComm.facet.offset=5&facet.pivot=owningComm,countryCode
|
||||
```
|
||||
|
||||
- Facet by owningComm and countryCode using facet.pivot and limiting to top five countries... fuck it's possible!
|
||||
|
||||
```
|
||||
facet=true&f.owningComm.facet.limit=5&f.owningComm.facet.offset=5&f.countryCode.facet.limit=5&facet.pivot=owningComm,countryCode
|
||||
```
|
||||
|
||||
<!-- vim: set sw=2 ts=2: -->
|
||||
|
@ -410,8 +410,14 @@ $ curl -s "http://localhost:8081/solr/statistics-2010/update?softCommit=true" -H
|
||||
|
||||
### Processing Solr statistics with AtomicStatisticsUpdateCLI
|
||||
|
||||
On 2020-11-18 I finished processing the Solr statistics with solr-upgrade-statistics-6x and I started processing them with AtomicStatisticsUpdateCLI:
|
||||
On 2020-11-18 I finished processing the Solr statistics with solr-upgrade-statistics-6x and I started processing them with AtomicStatisticsUpdateCLI.
|
||||
|
||||
## statistics
|
||||
|
||||
First the current year's statistics core, in 12-hour batches:
|
||||
|
||||
```
|
||||
$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics
|
||||
```
|
||||
|
||||
It took ~38 hours to finish processing this core.
|
||||
|
@ -31,7 +31,7 @@ Last week I had increased the limit from 30 to 60, which seemed to help, but now
|
||||
$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
|
||||
78
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -33,7 +33,7 @@ Replace lzop with xz in log compression cron jobs on DSpace Test—it uses less
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -25,7 +25,7 @@ Move ILRI collection 10568/12503 from 10568/27869 to 10568/27629 using the move_
|
||||
I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.
|
||||
Update GitHub wiki for documentation of maintenance tasks.
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -35,7 +35,7 @@ I noticed we have a very interesting list of countries on CGSpace:
|
||||
Not only are there 49,000 countries, we have some blanks (25)…
|
||||
Also, lots of things like “COTE D`LVOIRE” and “COTE D IVOIRE”
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -25,7 +25,7 @@ Looking at issues with author authorities on CGSpace
|
||||
For some reason we still have the index-lucene-update cron job active on CGSpace, but I’m pretty sure we don’t need it as of the latest few versions of Atmire’s Listings and Reports module
|
||||
Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -29,7 +29,7 @@ After running DSpace for over five years I’ve never needed to look in any
|
||||
This will save us a few gigs of backup space we’re paying for on S3
|
||||
Also, I noticed the checker log has some errors we should pay attention to:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -31,7 +31,7 @@ There are 3,000 IPs accessing the REST API in a 24-hour period!
|
||||
# awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
|
||||
3168
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -31,7 +31,7 @@ This is their publications set: http://ebrary.ifpri.org/oai/oai.php?verb=ListRec
|
||||
You can see the others by using the OAI ListSets verb: http://ebrary.ifpri.org/oai/oai.php?verb=ListSets
|
||||
Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in dc.identifier.fund to cg.identifier.cpwfproject and then the rest to dc.description.sponsorship
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -41,7 +41,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
In this case the select query was showing 95 results before the update
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -39,7 +39,7 @@ $ git checkout -b 55new 5_x-prod
|
||||
$ git reset --hard ilri/5_x-prod
|
||||
$ git rebase -i dspace-5.5
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -31,7 +31,7 @@ It looks like we might be able to use OUs now, instead of DCs:
|
||||
|
||||
$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b "dc=cgiarad,dc=org" -D "admigration1@cgiarad.org" -W "(sAMAccountName=admigration1)"
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -39,7 +39,7 @@ I exported a random item’s metadata as CSV, deleted all columns except id
|
||||
|
||||
0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -23,7 +23,7 @@ Add dc.type to the output options for Atmire’s Listings and Reports module
|
||||
Add dc.type to the output options for Atmire’s Listings and Reports module (#286)
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -43,7 +43,7 @@ I see thousands of them in the logs for the last few months, so it’s not r
|
||||
I’ve raised a ticket with Atmire to ask
|
||||
Another worrying error from dspace.log is:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -25,7 +25,7 @@ I checked to see if the Solr sharding task that is supposed to run on January 1s
|
||||
I tested on DSpace Test as well and it doesn’t work there either
|
||||
I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -47,7 +47,7 @@ DELETE 1
|
||||
Create issue on GitHub to track the addition of CCAFS Phase II project tags (#301)
|
||||
Looks like we’ll be using cg.identifier.ccafsprojectpii as the field name
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -51,7 +51,7 @@ Interestingly, it seems DSpace 4.x’s thumbnails were sRGB, but forcing reg
|
||||
$ identify ~/Desktop/alc_contrastes_desafios.jpg
|
||||
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -37,7 +37,7 @@ Testing the CMYK patch on a collection with 650 items:
|
||||
|
||||
$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -15,7 +15,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="May, 2017"/>
|
||||
<meta name="twitter:description" content="2017-05-01 ICARDA apparently started working on CG Core on their MEL repository They have done a few cg.* fields, but not very consistent and even copy some of CGSpace items: https://mel.cgiar.org/xmlui/handle/20.500.11766/6911?show=full https://cgspace.cgiar.org/handle/10568/73683 2017-05-02 Atmire got back about the Workflow Statistics issue, and apparently it’s a bug in the CUA module so they will send us a pull request 2017-05-04 Sync DSpace Test with database and assetstore from CGSpace Re-deploy DSpace Test with Atmire’s CUA patch for workflow statistics, run system updates, and restart the server Now I can see the workflow statistics and am able to select users, but everything returns 0 items Megan says there are still some mapped items are not appearing since last week, so I forced a full index-discovery -b Need to remember to check if the collection has more items (currently 39 on CGSpace, but 118 on the freshly reindexed DSPace Test) tomorrow: https://cgspace."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -15,7 +15,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="June, 2017"/>
|
||||
<meta name="twitter:description" content="2017-06-01 After discussion with WLE and CGSpace content people, we decided to just add one metadata field for the WLE Research Themes The cg.identifier.wletheme field will be used for both Phase I and Phase II Research Themes Then we’ll create a new sub-community for Phase II and create collections for the research themes there The current “Research Themes” community will be renamed to “WLE Phase I Research Themes” Tagged all items in the current Phase I collections with their appropriate themes Create pull request to add Phase II research themes to the submission form: #328 Add cg."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -33,7 +33,7 @@ Merge changes for WLE Phase II theme rename (#329)
|
||||
Looking at extracting the metadata registries from ICARDA’s MEL DSpace database so we can compare fields with CGSpace
|
||||
We can use PostgreSQL’s extended output format (-x) plus sed to format the output into quasi XML:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -57,7 +57,7 @@ This was due to newline characters in the dc.description.abstract column, which
|
||||
I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using g/^$/d
|
||||
Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -29,7 +29,7 @@ Linode sent an alert that CGSpace (linode18) was using 261% CPU for the past two
|
||||
|
||||
Ask Sisay to clean up the WLE approvers a bit, as Marianne’s user account is both in the approvers step as well as the group
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -31,7 +31,7 @@ http://hdl.handle.net/10568/78495||http://hdl.handle.net/10568/79336
|
||||
There appears to be a pattern but I’ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine
|
||||
Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -45,7 +45,7 @@ Generate list of authors on CGSpace for Peter to go through and correct:
|
||||
dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
|
||||
COPY 54701
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -27,7 +27,7 @@ The logs say “Timeout waiting for idle object”
|
||||
PostgreSQL activity says there are 115 connections currently
|
||||
The list of connections to XMLUI and REST API for today:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -147,7 +147,7 @@ dspace.log.2018-01-02:34
|
||||
|
||||
Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -27,7 +27,7 @@ We don’t need to distinguish between internal and external works, so that
|
||||
Yesterday I figured out how to monitor DSpace sessions using JMX
|
||||
I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu’s munin-plugins-java package and used the stuff I discovered about JMX in 2018-01
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -21,7 +21,7 @@ Export a CSV of the IITA community metadata for Martin Mueller
|
||||
|
||||
Export a CSV of the IITA community metadata for Martin Mueller
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -23,7 +23,7 @@ Catalina logs at least show some memory errors yesterday:
|
||||
I tried to test something on DSpace Test but noticed that it’s down since god knows when
|
||||
Catalina logs at least show some memory errors yesterday:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -35,7 +35,7 @@ http://localhost:3000/solr/statistics/update?stream.body=%3Ccommit/%3E
|
||||
Then I reduced the JVM heap size from 6144 back to 5120m
|
||||
Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the Ansible infrastructure scripts to support hosts choosing which distribution they want to use
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -55,7 +55,7 @@ real 74m42.646s
|
||||
user 8m5.056s
|
||||
sys 2m7.289s
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -33,7 +33,7 @@ During the mvn package stage on the 5.8 branch I kept getting issues with java r
|
||||
|
||||
There is insufficient memory for the Java Runtime Environment to continue.
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -43,7 +43,7 @@ Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did
|
||||
The server only has 8GB of RAM so we’ll eventually need to upgrade to a larger one because we’ll start starving the OS, PostgreSQL, and command line batch processes
|
||||
I ran all system updates on DSpace Test and rebooted it
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -27,7 +27,7 @@ I’ll update the DSpace role in our Ansible infrastructure playbooks and ru
|
||||
Also, I’ll re-run the postgresql tasks because the custom PostgreSQL variables are dynamic according to the system’s RAM, and we never re-ran them after migrating to larger Linodes last month
|
||||
I’m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I’m getting those autowire errors in Tomcat 8.5.30 again:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -23,7 +23,7 @@ I created a GitHub issue to track this #389, because I’m super busy in Nai
|
||||
Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items
|
||||
I created a GitHub issue to track this #389, because I’m super busy in Nairobi right now
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -33,7 +33,7 @@ Send a note about my dspace-statistics-api to the dspace-tech mailing list
|
||||
Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage
|
||||
Today these are the top 10 IPs:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -33,7 +33,7 @@ Then I ran all system updates and restarted the server
|
||||
|
||||
I noticed that there is another issue with PDF thumbnails on CGSpace, and I see there was another Ghostscript vulnerability last week
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -47,7 +47,7 @@ I don’t see anything interesting in the web server logs around that time t
|
||||
357 207.46.13.1
|
||||
903 54.70.40.11
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -69,7 +69,7 @@ real 0m19.873s
|
||||
user 0m22.203s
|
||||
sys 0m1.979s
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -43,7 +43,7 @@ Most worryingly, there are encoding errors in the abstracts for eleven items, fo
|
||||
|
||||
I think I will need to ask Udana to re-copy and paste the abstracts with more care using Google Docs
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -61,7 +61,7 @@ $ ./fix-metadata-values.py -i /tmp/2019-02-21-fix-4-regions.csv -db dspace -u ds
|
||||
$ ./delete-metadata-values.py -i /tmp/2019-02-21-delete-2-countries.csv -db dspace -u dspace -p 'fuuu' -m 228 -f cg.coverage.country -d
|
||||
$ ./delete-metadata-values.py -i /tmp/2019-02-21-delete-1-region.csv -db dspace -u dspace -p 'fuuu' -m 231 -f cg.coverage.region -d
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -45,7 +45,7 @@ DELETE 1
|
||||
|
||||
But after this I tried to delete the item from the XMLUI and it is still present…
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -31,7 +31,7 @@ Run system updates on CGSpace (linode18) and reboot it
|
||||
|
||||
Skype with Marie-Angélique and Abenet about CG Core v2
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -35,7 +35,7 @@ CGSpace
|
||||
|
||||
Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -43,7 +43,7 @@ After rebooting, all statistics cores were loaded… wow, that’s luck
|
||||
|
||||
Run system updates on DSpace Test (linode19) and reboot it
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -69,7 +69,7 @@ Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning:
|
||||
7249 2a01:7e00::f03c:91ff:fe18:7396
|
||||
9124 45.5.186.2
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -15,7 +15,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="October, 2019"/>
|
||||
<meta name="twitter:description" content="2019-10-01 Udana from IWMI asked me for a CSV export of their community on CGSpace I exported it, but a quick run through the csv-metadata-quality tool shows that there are some low-hanging fruits we can fix before I send him the data I will limit the scope to the titles, regions, subregions, and river basins for now to manually fix some non-breaking spaces (U+00A0) there that would otherwise be removed by the csv-metadata-quality script’s “unneccesary Unicode” fix: $ csvcut -c 'id,dc."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -55,7 +55,7 @@ Let’s see how many of the REST API requests were for bitstreams (because t
|
||||
# zcat --force /var/log/nginx/rest.log.*.gz | grep -E "[0-9]{1,2}/Oct/2019" | grep -c -E "/rest/bitstreams"
|
||||
106781
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -43,7 +43,7 @@ Make sure all packages are up to date and the package manager is up to date, the
|
||||
# dpkg -C
|
||||
# reboot
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -53,7 +53,7 @@ I tweeted the CGSpace repository link
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -35,7 +35,7 @@ The code finally builds and runs with a fresh install
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -39,7 +39,7 @@ You need to download this into the DSpace 6.x source and compile it
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -45,7 +45,7 @@ The third item now has a donut with score 1 since I tweeted it last week
|
||||
|
||||
On the same note, the one item Abenet pointed out last week now has a donut with score of 104 after I tweeted it last week
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -31,7 +31,7 @@ I see that CGSpace (linode18) is still using PostgreSQL JDBC driver version 42.2
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -33,7 +33,7 @@ I sent Atmire the dspace.log from today and told them to log into the server to
|
||||
In other news, I checked the statistics API on DSpace 6 and it’s working
|
||||
I tried to build the OAI registry on the freshly migrated DSpace 6 on DSpace Test and I get an error:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -35,7 +35,7 @@ I restarted Tomcat and PostgreSQL and the issue was gone
|
||||
|
||||
Since I was restarting Tomcat anyways I decided to redeploy the latest changes from the 5_x-prod branch and I added a note about COVID-19 items to the CGSpace frontpage at Peter’s request
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -33,7 +33,7 @@ It is class based so I can easily add support for other vocabularies, and the te
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -45,7 +45,7 @@ I filed a bug on OpenRXV: https://github.com/ilri/OpenRXV/issues/39
|
||||
|
||||
I filed an issue on OpenRXV to make some minor edits to the admin UI: https://github.com/ilri/OpenRXV/issues/40
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -41,7 +41,7 @@ During the FlywayDB migration I got an error:
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -17,7 +17,7 @@ So far we’ve spent at least fifty hours to process the statistics and stat
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2020-11/" />
|
||||
<meta property="article:published_time" content="2020-11-01T13:11:54+02:00" />
|
||||
<meta property="article:modified_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="article:modified_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="November, 2020"/>
|
||||
@ -29,7 +29,7 @@ So far we’ve spent at least fifty hours to process the statistics and stat
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
@ -39,9 +39,9 @@ So far we’ve spent at least fifty hours to process the statistics and stat
|
||||
"@type": "BlogPosting",
|
||||
"headline": "November, 2020",
|
||||
"url": "https://alanorth.github.io/cgspace-notes/2020-11/",
|
||||
"wordCount": "2743",
|
||||
"wordCount": "3039",
|
||||
"datePublished": "2020-11-01T13:11:54+02:00",
|
||||
"dateModified": "2020-11-19T22:40:48+02:00",
|
||||
"dateModified": "2020-11-19T22:41:55+02:00",
|
||||
"author": {
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
@ -568,7 +568,58 @@ org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error whil
|
||||
<ul>
|
||||
<li>Very curious that there was such a high number of rolled back transactions after the update</li>
|
||||
</ul>
|
||||
<!-- raw HTML omitted -->
|
||||
<h2 id="2020-11-22">2020-11-22</h2>
|
||||
<ul>
|
||||
<li>PostgreSQL situation on CGSpace (linode18) looks much better now:</li>
|
||||
</ul>
|
||||
<p><img src="/cgspace-notes/2020/11/postgres_locks_ALL-week3.png" alt="PostgreSQL locks week">
|
||||
<img src="/cgspace-notes/2020/11/postgres_xlog-week2.png" alt="PostgreSQL transaction log week"></p>
|
||||
<ul>
|
||||
<li>In other news, I noticed that harvesting DSpace 6 works fine in OpenRXV, but the statistics fail on page 1
|
||||
<ul>
|
||||
<li>I filed an issue: <a href="https://github.com/ilri/OpenRXV/issues/59">https://github.com/ilri/OpenRXV/issues/59</a></li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>Abenet asked for help trying to add a new user to the Bioversity and CIAT groups on CGSpace
|
||||
<ul>
|
||||
<li>I see that the user search is split on five results, so the user in question appears on page 2</li>
|
||||
<li>I asked Abenet if she was getting an error or it was simply this…</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>Maria Garuccio sent me an example report that she wants to be able to generate from AReS
|
||||
<ul>
|
||||
<li>First, she would like to have the option to group by output type</li>
|
||||
<li>Second, she would like to be able to control the sorting in the template, like sorting the citation alphabetically</li>
|
||||
<li>I filed an issue: <a href="https://github.com/ilri/OpenRXV/issues/60">https://github.com/ilri/OpenRXV/issues/60</a></li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>Mohammad Salem had asked if there was an item ID to UUID mapping for CGSpace
|
||||
<ul>
|
||||
<li>I found a thread on the dspace-tech mailing list that pointed out that there is a new <code>uuid</code> column in the item table</li>
|
||||
<li>Only old items have an <code>item_id</code> so we can get a mapping easily:</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<pre><code>dspace=# \COPY (SELECT item_id,uuid FROM item WHERE in_archive='t' AND withdrawn='f' AND item_id IS NOT NULL) TO /tmp/2020-11-22-item-id2uuid.csv WITH CSV HEADER;
|
||||
COPY 87411
|
||||
</code></pre><ul>
|
||||
<li>Saving some notes I wrote down about faceting by community and collection in Solr, for potential use in the future in the DSpace Statistics API</li>
|
||||
<li>Facet by owningComm to see total number of distinct communities (136):</li>
|
||||
</ul>
|
||||
<pre><code> facet=true&facet.mincount=1&facet.field=owningComm&facet.limit=1&facet.offset=0&stats=true&stats.field=id&stats.calcdistinct=true
|
||||
</code></pre><ul>
|
||||
<li>Facet by owningComm and get the first 5 distinct:</li>
|
||||
</ul>
|
||||
<pre><code> facet=true&facet.mincount=1&facet.field=owningComm&facet.limit=5&facet.offset=0&facet.pivot=id,countryCode
|
||||
</code></pre><ul>
|
||||
<li>Facet by owningComm and countryCode using facet.pivot and maybe I can just skip the normal facet params?</li>
|
||||
</ul>
|
||||
<pre><code>facet=true&f.owningComm.facet.limit=5&f.owningComm.facet.offset=5&facet.pivot=owningComm,countryCode
|
||||
</code></pre><ul>
|
||||
<li>Facet by owningComm and countryCode using facet.pivot and limiting to top five countries… fuck it’s possible!</li>
|
||||
</ul>
|
||||
<pre><code>facet=true&f.owningComm.facet.limit=5&f.owningComm.facet.offset=5&f.countryCode.facet.limit=5&facet.pivot=owningComm,countryCode
|
||||
</code></pre><!-- raw HTML omitted -->
|
||||
|
||||
|
||||
|
||||
|
BIN
docs/2020/11/postgres_locks_ALL-week3.png
Normal file
BIN
docs/2020/11/postgres_locks_ALL-week3.png
Normal file
Binary file not shown.
After Width: | Height: | Size: 12 KiB |
BIN
docs/2020/11/postgres_xlog-week2.png
Normal file
BIN
docs/2020/11/postgres_xlog-week2.png
Normal file
Binary file not shown.
After Width: | Height: | Size: 7.7 KiB |
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="404 Page not found"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Categories"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -15,7 +15,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGIAR Library Migration"/>
|
||||
<meta name="twitter:description" content="Notes on the migration of the CGIAR Library to CGSpace"/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -15,7 +15,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace CG Core v2 Migration"/>
|
||||
<meta name="twitter:description" content="Possible changes to CGSpace metadata fields to align more with DC, QDC, and DCTERMS as well as CG Core v2."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -15,7 +15,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace DSpace 6 Upgrade"/>
|
||||
<meta name="twitter:description" content="Documenting the DSpace 6 upgrade."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
@ -25,7 +25,7 @@
|
||||
"@type": "BlogPosting",
|
||||
"headline": "CGSpace DSpace 6 Upgrade",
|
||||
"url": "https://alanorth.github.io/cgspace-notes/cgspace-dspace6-upgrade/",
|
||||
"wordCount": "1281",
|
||||
"wordCount": "1300",
|
||||
"datePublished": "2020-11-15T13:27:35+02:00",
|
||||
"dateModified": "2020-11-18T23:15:06+02:00",
|
||||
"author": {
|
||||
@ -403,9 +403,11 @@ $ chrt -b 0 dspace solr-upgrade-statistics-6x -n 2500000 -i statistics-2018
|
||||
</ul>
|
||||
<pre><code class="language-console" data-lang="console">$ curl -s "http://localhost:8081/solr/statistics-2010/update?softCommit=true" -H "Content-Type: text/xml" --data-binary "<delete><query>*:* NOT id:/.{36}/</query></delete>"
|
||||
</code></pre><h3 id="processing-solr-statistics-with-atomicstatisticsupdatecli">Processing Solr statistics with AtomicStatisticsUpdateCLI</h3>
|
||||
<p>On 2020-11-18 I finished processing the Solr statistics with solr-upgrade-statistics-6x and I started processing them with AtomicStatisticsUpdateCLI:</p>
|
||||
<p>On 2020-11-18 I finished processing the Solr statistics with solr-upgrade-statistics-6x and I started processing them with AtomicStatisticsUpdateCLI.</p>
|
||||
<h2 id="statistics-1">statistics</h2>
|
||||
<p>First the current year’s statistics core, in 12-hour batches:</p>
|
||||
<pre><code>$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics
|
||||
</code></pre>
|
||||
</code></pre><p>It took ~38 hours to finish processing this core.</p>
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -9,12 +9,12 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:40:48+02:00" />
|
||||
<meta property="og:updated_time" content="2020-11-19T22:41:55+02:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -4,7 +4,7 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/</loc>
|
||||
<lastmod>2020-11-19T22:40:48+02:00</lastmod>
|
||||
<lastmod>2020-11-19T22:41:55+02:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
@ -14,7 +14,7 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/</loc>
|
||||
<lastmod>2020-11-19T22:40:48+02:00</lastmod>
|
||||
<lastmod>2020-11-19T22:41:55+02:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
@ -24,12 +24,12 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
|
||||
<lastmod>2020-11-19T22:40:48+02:00</lastmod>
|
||||
<lastmod>2020-11-19T22:41:55+02:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
|
||||
<lastmod>2020-11-19T22:40:48+02:00</lastmod>
|
||||
<lastmod>2020-11-19T22:41:55+02:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
@ -39,7 +39,7 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2020-11/</loc>
|
||||
<lastmod>2020-11-19T22:40:48+02:00</lastmod>
|
||||
<lastmod>2020-11-19T22:41:55+02:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
|
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Tags"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Migration"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
@ -14,7 +14,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.78.1" />
|
||||
<meta name="generator" content="Hugo 0.78.2" />
|
||||
|
||||
|
||||
|
||||
|
BIN
static/2020/11/postgres_locks_ALL-week3.png
Normal file
BIN
static/2020/11/postgres_locks_ALL-week3.png
Normal file
Binary file not shown.
After Width: | Height: | Size: 12 KiB |
BIN
static/2020/11/postgres_xlog-week2.png
Normal file
BIN
static/2020/11/postgres_xlog-week2.png
Normal file
Binary file not shown.
After Width: | Height: | Size: 7.7 KiB |
Loading…
Reference in New Issue
Block a user