mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-12-22 13:12:19 +01:00
Add notes for 2021-07-07
This commit is contained in:
parent
1a9194e460
commit
60cbb34a6a
@ -34,7 +34,7 @@ Last week I had increased the limit from 30 to 60, which seemed to help, but now
|
||||
$ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace
|
||||
78
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -244,14 +244,14 @@ db.statementpool = true
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -36,7 +36,7 @@ Replace lzop with xz in log compression cron jobs on DSpace Test—it uses less
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -266,14 +266,14 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -28,7 +28,7 @@ Move ILRI collection 10568/12503 from 10568/27869 to 10568/27629 using the move_
|
||||
I realized it is only necessary to clear the Cocoon cache after moving collections—rather than reindexing—as no metadata has changed, and therefore no search or browse indexes need to be updated.
|
||||
Update GitHub wiki for documentation of maintenance tasks.
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -202,14 +202,14 @@ $ find SimpleArchiveForBio/ -iname “*.pdf” -exec basename {} ; | sor
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -38,7 +38,7 @@ I noticed we have a very interesting list of countries on CGSpace:
|
||||
Not only are there 49,000 countries, we have some blanks (25)…
|
||||
Also, lots of things like “COTE D`LVOIRE” and “COTE D IVOIRE”
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -380,14 +380,14 @@ Bitstream: tést señora alimentación.pdf
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -28,7 +28,7 @@ Looking at issues with author authorities on CGSpace
|
||||
For some reason we still have the index-lucene-update cron job active on CGSpace, but I’m pretty sure we don’t need it as of the latest few versions of Atmire’s Listings and Reports module
|
||||
Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Java JDK 1.7 to match environment on CGSpace server
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -318,14 +318,14 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -32,7 +32,7 @@ After running DSpace for over five years I’ve never needed to look in any
|
||||
This will save us a few gigs of backup space we’re paying for on S3
|
||||
Also, I noticed the checker log has some errors we should pay attention to:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -497,14 +497,14 @@ dspace.log.2016-04-27:7271
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -34,7 +34,7 @@ There are 3,000 IPs accessing the REST API in a 24-hour period!
|
||||
# awk '{print $1}' /var/log/nginx/rest.log | uniq | wc -l
|
||||
3168
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -373,14 +373,14 @@ sys 0m20.540s
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -34,7 +34,7 @@ This is their publications set: http://ebrary.ifpri.org/oai/oai.php?verb=ListRec
|
||||
You can see the others by using the OAI ListSets verb: http://ebrary.ifpri.org/oai/oai.php?verb=ListSets
|
||||
Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in dc.identifier.fund to cg.identifier.cpwfproject and then the rest to dc.description.sponsorship
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -411,14 +411,14 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -44,7 +44,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
In this case the select query was showing 95 results before the update
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -327,14 +327,14 @@ discovery.index.authority.ignore-variants=true
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -42,7 +42,7 @@ $ git checkout -b 55new 5_x-prod
|
||||
$ git reset --hard ilri/5_x-prod
|
||||
$ git rebase -i dspace-5.5
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -391,14 +391,14 @@ $ JAVA_OPTS="-Dfile.encoding=UTF-8 -Xmx512m" /home/cgspace.cgiar.org/b
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -34,7 +34,7 @@ It looks like we might be able to use OUs now, instead of DCs:
|
||||
|
||||
$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b "dc=cgiarad,dc=org" -D "admigration1@cgiarad.org" -W "(sAMAccountName=admigration1)"
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -608,14 +608,14 @@ $ ./delete-metadata-values.py -i ilrisubjects-delete-13.csv -f cg.subject.ilri -
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -42,7 +42,7 @@ I exported a random item’s metadata as CSV, deleted all columns except id
|
||||
|
||||
0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -374,14 +374,14 @@ dspace=# update metadatavalue set text_value = regexp_replace(text_value, 'http:
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -26,7 +26,7 @@ Add dc.type to the output options for Atmire’s Listings and Reports module
|
||||
Add dc.type to the output options for Atmire’s Listings and Reports module (#286)
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -550,14 +550,14 @@ org.dspace.discovery.SearchServiceException: Error executing query
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -46,7 +46,7 @@ I see thousands of them in the logs for the last few months, so it’s not r
|
||||
I’ve raised a ticket with Atmire to ask
|
||||
Another worrying error from dspace.log is:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -786,14 +786,14 @@ $ exit
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -28,7 +28,7 @@ I checked to see if the Solr sharding task that is supposed to run on January 1s
|
||||
I tested on DSpace Test as well and it doesn’t work there either
|
||||
I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -371,14 +371,14 @@ $ gs -sDEVICE=pdfwrite -dCompatibilityLevel=1.4 -dPDFSETTINGS=/ebook -dNOPAUSE -
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -50,7 +50,7 @@ DELETE 1
|
||||
Create issue on GitHub to track the addition of CCAFS Phase II project tags (#301)
|
||||
Looks like we’ll be using cg.identifier.ccafsprojectpii as the field name
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -426,14 +426,14 @@ COPY 1968
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -54,7 +54,7 @@ Interestingly, it seems DSpace 4.x’s thumbnails were sRGB, but forcing reg
|
||||
$ identify ~/Desktop/alc_contrastes_desafios.jpg
|
||||
/Users/aorth/Desktop/alc_contrastes_desafios.jpg JPEG 464x600 464x600+0+0 8-bit CMYK 168KB 0.000u 0:00.000
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -357,14 +357,14 @@ $ ./delete-metadata-values.py -i Investors-Delete-121.csv -f dc.description.spon
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -40,7 +40,7 @@ Testing the CMYK patch on a collection with 650 items:
|
||||
|
||||
$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -587,14 +587,14 @@ $ gem install compass -v 1.0.3
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -18,7 +18,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="May, 2017"/>
|
||||
<meta name="twitter:description" content="2017-05-01 ICARDA apparently started working on CG Core on their MEL repository They have done a few cg.* fields, but not very consistent and even copy some of CGSpace items: https://mel.cgiar.org/xmlui/handle/20.500.11766/6911?show=full https://cgspace.cgiar.org/handle/10568/73683 2017-05-02 Atmire got back about the Workflow Statistics issue, and apparently it’s a bug in the CUA module so they will send us a pull request 2017-05-04 Sync DSpace Test with database and assetstore from CGSpace Re-deploy DSpace Test with Atmire’s CUA patch for workflow statistics, run system updates, and restart the server Now I can see the workflow statistics and am able to select users, but everything returns 0 items Megan says there are still some mapped items are not appearing since last week, so I forced a full index-discovery -b Need to remember to check if the collection has more items (currently 39 on CGSpace, but 118 on the freshly reindexed DSPace Test) tomorrow: https://cgspace."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -393,14 +393,14 @@ UPDATE 187
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -18,7 +18,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="June, 2017"/>
|
||||
<meta name="twitter:description" content="2017-06-01 After discussion with WLE and CGSpace content people, we decided to just add one metadata field for the WLE Research Themes The cg.identifier.wletheme field will be used for both Phase I and Phase II Research Themes Then we’ll create a new sub-community for Phase II and create collections for the research themes there The current “Research Themes” community will be renamed to “WLE Phase I Research Themes” Tagged all items in the current Phase I collections with their appropriate themes Create pull request to add Phase II research themes to the submission form: #328 Add cg."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -272,14 +272,14 @@ $ JAVA_OPTS="-Xmx1024m -Dfile.encoding=UTF-8" [dspace]/bin/dspace impo
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -36,7 +36,7 @@ Merge changes for WLE Phase II theme rename (#329)
|
||||
Looking at extracting the metadata registries from ICARDA’s MEL DSpace database so we can compare fields with CGSpace
|
||||
We can use PostgreSQL’s extended output format (-x) plus sed to format the output into quasi XML:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -277,14 +277,14 @@ delete from metadatavalue where resource_type_id=2 and metadata_field_id=235 and
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -60,7 +60,7 @@ This was due to newline characters in the dc.description.abstract column, which
|
||||
I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using g/^$/d
|
||||
Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -519,14 +519,14 @@ org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -32,7 +32,7 @@ Linode sent an alert that CGSpace (linode18) was using 261% CPU for the past two
|
||||
|
||||
Ask Sisay to clean up the WLE approvers a bit, as Marianne’s user account is both in the approvers step as well as the group
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -661,14 +661,14 @@ Cert Status: good
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -34,7 +34,7 @@ http://hdl.handle.net/10568/78495||http://hdl.handle.net/10568/79336
|
||||
There appears to be a pattern but I’ll have to look a bit closer and try to clean them up automatically, either in SQL or in OpenRefine
|
||||
Add Katherine Lutz to the groups for content submission and edit steps of the CGIAR System collections
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -445,14 +445,14 @@ session_id=6C30F10B4351A4ED83EC6ED50AFD6B6A
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -48,7 +48,7 @@ Generate list of authors on CGSpace for Peter to go through and correct:
|
||||
dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
|
||||
COPY 54701
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -946,14 +946,14 @@ $ cat dspace.log.2017-11-28 | grep -o -E 'session_id=[A-Z0-9]{32}' | sort -n | u
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -30,7 +30,7 @@ The logs say “Timeout waiting for idle object”
|
||||
PostgreSQL activity says there are 115 connections currently
|
||||
The list of connections to XMLUI and REST API for today:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -785,14 +785,14 @@ DELETE 20
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -150,7 +150,7 @@ dspace.log.2018-01-02:34
|
||||
|
||||
Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -1454,14 +1454,14 @@ Catalina:type=Manager,context=/,host=localhost activeSessions 8
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -30,7 +30,7 @@ We don’t need to distinguish between internal and external works, so that
|
||||
Yesterday I figured out how to monitor DSpace sessions using JMX
|
||||
I copied the logic in the jmx_tomcat_dbpools provided by Ubuntu’s munin-plugins-java package and used the stuff I discovered about JMX in 2018-01
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -1041,14 +1041,14 @@ UPDATE 3
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -24,7 +24,7 @@ Export a CSV of the IITA community metadata for Martin Mueller
|
||||
|
||||
Export a CSV of the IITA community metadata for Martin Mueller
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -587,14 +587,14 @@ Fixed 5 occurences of: GENEBANKS
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -26,7 +26,7 @@ Catalina logs at least show some memory errors yesterday:
|
||||
I tried to test something on DSpace Test but noticed that it’s down since god knows when
|
||||
Catalina logs at least show some memory errors yesterday:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -596,14 +596,14 @@ $ pg_restore -O -U dspacetest -d dspacetest -W -h localhost /tmp/dspace_2018-04-
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -38,7 +38,7 @@ http://localhost:3000/solr/statistics/update?stream.body=%3Ccommit/%3E
|
||||
Then I reduced the JVM heap size from 6144 back to 5120m
|
||||
Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the Ansible infrastructure scripts to support hosts choosing which distribution they want to use
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -525,14 +525,14 @@ $ psql -h localhost -U postgres dspacetest
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -58,7 +58,7 @@ real 74m42.646s
|
||||
user 8m5.056s
|
||||
sys 2m7.289s
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -519,14 +519,14 @@ $ sed '/^id/d' 10568-*.csv | csvcut -c 1,2 > map-to-cifor-archive.csv
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -36,7 +36,7 @@ During the mvn package stage on the 5.8 branch I kept getting issues with java r
|
||||
|
||||
There is insufficient memory for the Java Runtime Environment to continue.
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -571,14 +571,14 @@ dspace=# select count(text_value) from metadatavalue where resource_type_id=2 an
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -46,7 +46,7 @@ Anyways, perhaps I should increase the JVM heap from 5120m to 6144m like we did
|
||||
The server only has 8GB of RAM so we’ll eventually need to upgrade to a larger one because we’ll start starving the OS, PostgreSQL, and command line batch processes
|
||||
I ran all system updates on DSpace Test and rebooted it
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -444,14 +444,14 @@ $ dspace database migrate ignored
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -30,7 +30,7 @@ I’ll update the DSpace role in our Ansible infrastructure playbooks and ru
|
||||
Also, I’ll re-run the postgresql tasks because the custom PostgreSQL variables are dynamic according to the system’s RAM, and we never re-ran them after migrating to larger Linodes last month
|
||||
I’m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I’m getting those autowire errors in Tomcat 8.5.30 again:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -750,14 +750,14 @@ UPDATE metadatavalue SET text_value='ja' WHERE resource_type_id=2 AND metadata_f
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -26,7 +26,7 @@ I created a GitHub issue to track this #389, because I’m super busy in Nai
|
||||
Phil Thornton got an ORCID identifier so we need to add it to the list on CGSpace and tag his existing items
|
||||
I created a GitHub issue to track this #389, because I’m super busy in Nairobi right now
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -658,14 +658,14 @@ $ curl -X GET -H "Content-Type: application/json" -H "Accept: app
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -36,7 +36,7 @@ Send a note about my dspace-statistics-api to the dspace-tech mailing list
|
||||
Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage
|
||||
Today these are the top 10 IPs:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -555,14 +555,14 @@ $ dspace dsrun org.dspace.eperson.Groomer -a -b 11/27/2016 -d
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -36,7 +36,7 @@ Then I ran all system updates and restarted the server
|
||||
|
||||
I noticed that there is another issue with PDF thumbnails on CGSpace, and I see there was another Ghostscript vulnerability last week
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -596,14 +596,14 @@ UPDATE 1
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -50,7 +50,7 @@ I don’t see anything interesting in the web server logs around that time t
|
||||
357 207.46.13.1
|
||||
903 54.70.40.11
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -1266,14 +1266,14 @@ identify: CorruptImageProfile `xmp' @ warning/profile.c/SetImageProfileInternal/
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -72,7 +72,7 @@ real 0m19.873s
|
||||
user 0m22.203s
|
||||
sys 0m1.979s
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -1346,14 +1346,14 @@ Please see the DSpace documentation for assistance.
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -46,7 +46,7 @@ Most worryingly, there are encoding errors in the abstracts for eleven items, fo
|
||||
|
||||
I think I will need to ask Udana to re-copy and paste the abstracts with more care using Google Docs
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -1210,14 +1210,14 @@ sys 0m2.551s
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -64,7 +64,7 @@ $ ./fix-metadata-values.py -i /tmp/2019-02-21-fix-4-regions.csv -db dspace -u ds
|
||||
$ ./delete-metadata-values.py -i /tmp/2019-02-21-delete-2-countries.csv -db dspace -u dspace -p 'fuuu' -m 228 -f cg.coverage.country -d
|
||||
$ ./delete-metadata-values.py -i /tmp/2019-02-21-delete-1-region.csv -db dspace -u dspace -p 'fuuu' -m 231 -f cg.coverage.region -d
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -1301,14 +1301,14 @@ UPDATE 14
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -48,7 +48,7 @@ DELETE 1
|
||||
|
||||
But after this I tried to delete the item from the XMLUI and it is still present…
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -633,14 +633,14 @@ COPY 64871
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -34,7 +34,7 @@ Run system updates on CGSpace (linode18) and reboot it
|
||||
|
||||
Skype with Marie-Angélique and Abenet about CG Core v2
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -319,14 +319,14 @@ UPDATE 2
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -38,7 +38,7 @@ CGSpace
|
||||
|
||||
Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -556,14 +556,14 @@ issn.validate('1020-3362')
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -46,7 +46,7 @@ After rebooting, all statistics cores were loaded… wow, that’s luck
|
||||
|
||||
Run system updates on DSpace Test (linode19) and reboot it
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -575,14 +575,14 @@ sys 2m27.496s
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -72,7 +72,7 @@ Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning:
|
||||
7249 2a01:7e00::f03c:91ff:fe18:7396
|
||||
9124 45.5.186.2
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -583,14 +583,14 @@ $ csv-metadata-quality -i /tmp/clarisa-institutions.csv -o /tmp/clarisa-institut
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -18,7 +18,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="October, 2019"/>
|
||||
<meta name="twitter:description" content="2019-10-01 Udana from IWMI asked me for a CSV export of their community on CGSpace I exported it, but a quick run through the csv-metadata-quality tool shows that there are some low-hanging fruits we can fix before I send him the data I will limit the scope to the titles, regions, subregions, and river basins for now to manually fix some non-breaking spaces (U+00A0) there that would otherwise be removed by the csv-metadata-quality script’s “unneccesary Unicode” fix: $ csvcut -c 'id,dc."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -387,14 +387,14 @@ $ dspace import -a -c 10568/104057 -e fuu@cgiar.org -m 2019-10-15-Bioversity.map
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -58,7 +58,7 @@ Let’s see how many of the REST API requests were for bitstreams (because t
|
||||
# zcat --force /var/log/nginx/rest.log.*.gz | grep -E "[0-9]{1,2}/Oct/2019" | grep -c -E "/rest/bitstreams"
|
||||
106781
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -694,14 +694,14 @@ $ tidy -xml -utf8 -iq -m -w 0 dspace/config/controlled-vocabularies/cg-creator-i
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -46,7 +46,7 @@ Make sure all packages are up to date and the package manager is up to date, the
|
||||
# dpkg -C
|
||||
# reboot
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -406,14 +406,14 @@ UPDATE 1
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -56,7 +56,7 @@ I tweeted the CGSpace repository link
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -606,14 +606,14 @@ COPY 2900
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -38,7 +38,7 @@ The code finally builds and runs with a fresh install
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -1277,14 +1277,14 @@ Moving: 21993 into core statistics-2019
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -42,7 +42,7 @@ You need to download this into the DSpace 6.x source and compile it
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -486,14 +486,14 @@ $ tidy -xml -utf8 -iq -m -w 0 dspace/config/controlled-vocabularies/cg-creator-i
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -48,7 +48,7 @@ The third item now has a donut with score 1 since I tweeted it last week
|
||||
|
||||
On the same note, the one item Abenet pointed out last week now has a donut with score of 104 after I tweeted it last week
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -660,14 +660,14 @@ $ psql -c 'select * from pg_stat_activity' | wc -l
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -34,7 +34,7 @@ I see that CGSpace (linode18) is still using PostgreSQL JDBC driver version 42.2
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -479,14 +479,14 @@ Caused by: java.lang.NullPointerException
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -36,7 +36,7 @@ I sent Atmire the dspace.log from today and told them to log into the server to
|
||||
In other news, I checked the statistics API on DSpace 6 and it’s working
|
||||
I tried to build the OAI registry on the freshly migrated DSpace 6 on DSpace Test and I get an error:
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -813,14 +813,14 @@ $ csvcut -c 'id,cg.subject.ilri[],cg.subject.ilri[en_US],dc.subject[en_US]' /tmp
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -38,7 +38,7 @@ I restarted Tomcat and PostgreSQL and the issue was gone
|
||||
|
||||
Since I was restarting Tomcat anyways I decided to redeploy the latest changes from the 5_x-prod branch and I added a note about COVID-19 items to the CGSpace frontpage at Peter’s request
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -1144,14 +1144,14 @@ Fixed 4 occurences of: Muloi, D.M.
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -36,7 +36,7 @@ It is class based so I can easily add support for other vocabularies, and the te
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -800,14 +800,14 @@ $ grep -c added /tmp/2020-08-27-countrycodetagger.log
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -48,7 +48,7 @@ I filed a bug on OpenRXV: https://github.com/ilri/OpenRXV/issues/39
|
||||
|
||||
I filed an issue on OpenRXV to make some minor edits to the admin UI: https://github.com/ilri/OpenRXV/issues/40
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -719,14 +719,14 @@ solr_query_params = {
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -44,7 +44,7 @@ During the FlywayDB migration I got an error:
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -1243,14 +1243,14 @@ $ ./delete-metadata-values.py -i 2020-10-31-delete-74-sponsors.csv -db dspace -u
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -32,7 +32,7 @@ So far we’ve spent at least fifty hours to process the statistics and stat
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -733,14 +733,14 @@ $ ./fix-metadata-values.py -i 2020-11-30-fix-hung-orcid.csv -db dspace63 -u dspa
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -36,7 +36,7 @@ I started processing those (about 411,000 records):
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -871,14 +871,14 @@ $ curl -XDELETE 'http://localhost:9200/openrxv-items-2020-12-29?pretty'
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -50,7 +50,7 @@ For example, this item has 51 views on CGSpace, but 0 on AReS
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -690,14 +690,14 @@ java.lang.IllegalArgumentException: Invalid character found in the request targe
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -60,7 +60,7 @@ $ curl -s 'http://localhost:9200/openrxv-items-temp/_count?q=*&pretty
|
||||
}
|
||||
}
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -900,14 +900,14 @@ dspace.log.2021-02-28:0
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -34,7 +34,7 @@ Also, we found some issues building and running OpenRXV currently due to ecosyst
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -877,14 +877,14 @@ COPY 3081
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -44,7 +44,7 @@ Perhaps one of the containers crashed, I should have looked closer but I was in
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -1044,14 +1044,14 @@ $ ./ilri/doi-to-handle.py -i /tmp/dois.txt -o /tmp/handles.csv -db dspace63 -u d
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -20,7 +20,7 @@ I will add the RI/1.0 pattern to our DSpace agents overload and purge them from
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2021-05/" />
|
||||
<meta property="article:published_time" content="2021-05-02T09:50:54+03:00" />
|
||||
<meta property="article:modified_time" content="2021-05-30T22:09:06+03:00" />
|
||||
<meta property="article:modified_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
@ -36,7 +36,7 @@ I looked at the top user agents and IPs in the Solr statistics for last month an
|
||||
|
||||
I will add the RI/1.0 pattern to our DSpace agents overload and purge them from Solr (we had previously seen this agent with 9,000 hits or so in 2020-09), but I think I will leave the Microsoft Word one… as that’s an actual user…
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -48,7 +48,7 @@ I will add the RI/1.0 pattern to our DSpace agents overload and purge them from
|
||||
"url": "https://alanorth.github.io/cgspace-notes/2021-05/",
|
||||
"wordCount": "3605",
|
||||
"datePublished": "2021-05-02T09:50:54+03:00",
|
||||
"dateModified": "2021-05-30T22:09:06+03:00",
|
||||
"dateModified": "2021-07-06T17:03:55+03:00",
|
||||
"author": {
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
@ -522,7 +522,7 @@ UPDATE 47405
|
||||
COPY 5000
|
||||
$ csvcut -c 1 /tmp/2021-05-20-agrovoc.csv| sed 1d > /tmp/2021-05-20-agrovoc.txt
|
||||
$ ./ilri/agrovoc-lookup.py -i /tmp/2021-05-20-agrovoc.txt -o /tmp/2021-05-20-agrovoc-results.csv
|
||||
$ csvgrep -c "number of matches" -m 0 /tmp/2021-05-20-agrovoc-results.csv > /tmp/2021-05-20-agrovoc-rejected.csv
|
||||
$ csvgrep -c "number of matches" -r '^0$' /tmp/2021-05-20-agrovoc-results.csv > /tmp/2021-05-20-agrovoc-rejected.csv
|
||||
</code></pre><ul>
|
||||
<li>Meeting with Medha and Pythagoras about the FAIR Workflow tool
|
||||
<ul>
|
||||
@ -687,14 +687,14 @@ Please see the DSpace documentation for assistance.
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -20,7 +20,7 @@ I simply started it and AReS was running again:
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2021-06/" />
|
||||
<meta property="article:published_time" content="2021-06-01T10:51:07+03:00" />
|
||||
<meta property="article:modified_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="article:modified_time" content="2021-07-01T08:53:21+03:00" />
|
||||
|
||||
|
||||
|
||||
@ -36,7 +36,7 @@ I simply started it and AReS was running again:
|
||||
|
||||
|
||||
"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -48,7 +48,7 @@ I simply started it and AReS was running again:
|
||||
"url": "https://alanorth.github.io/cgspace-notes/2021-06/",
|
||||
"wordCount": "3505",
|
||||
"datePublished": "2021-06-01T10:51:07+03:00",
|
||||
"dateModified": "2021-06-30T12:21:16+03:00",
|
||||
"dateModified": "2021-07-01T08:53:21+03:00",
|
||||
"author": {
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
@ -695,14 +695,14 @@ COPY 1710
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -17,7 +17,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="404 Page not found"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -97,14 +97,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Categories"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -110,14 +110,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -108,6 +108,30 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-06/">July, 2021</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2021-06-01T08:53:07+03:00">Tue Jun 01, 2021</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2021-07-01">2021-07-01</h2>
|
||||
<ul>
|
||||
<li>Export another list of ALL subjects on CGSpace, including AGROVOC and non-AGROVOC for Enrico:</li>
|
||||
</ul>
|
||||
<pre><code class="language-console" data-lang="console">localhost/dspace63= > \COPY (SELECT DISTINCT LOWER(text_value) AS subject, count(*) FROM metadatavalue WHERE dspace_object_id in (SELECT dspace_object_id FROM item) AND metadata_field_id IN (119, 120, 127, 122, 128, 125, 135, 203, 208, 210, 215, 123, 236, 242, 187) GROUP BY subject ORDER BY count DESC) to /tmp/2021-07-01-all-subjects.csv WITH CSV HEADER;
|
||||
COPY 20994
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2021-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-05/">May, 2021</a></h2>
|
||||
@ -332,31 +356,6 @@
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-11/">November, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-11-01T13:11:54+02:00">Sun Nov 01, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-11-01">2020-11-01</h2>
|
||||
<ul>
|
||||
<li>Continue with processing the statistics-2019 Solr core with the AtomicStatisticsUpdateCLI tool on DSpace Test
|
||||
<ul>
|
||||
<li>So far we’ve spent at least fifty hours to process the statistics and statistics-2019 core… wow.</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
|
||||
@ -383,14 +382,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -25,6 +25,21 @@
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
<title>July, 2021</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2021-06/</link>
|
||||
<pubDate>Tue, 01 Jun 2021 08:53:07 +0300</pubDate>
|
||||
|
||||
<guid>https://alanorth.github.io/cgspace-notes/2021-06/</guid>
|
||||
<description><h2 id="2021-07-01">2021-07-01</h2>
|
||||
<ul>
|
||||
<li>Export another list of ALL subjects on CGSpace, including AGROVOC and non-AGROVOC for Enrico:</li>
|
||||
</ul>
|
||||
<pre><code class="language-console" data-lang="console">localhost/dspace63= &gt; \COPY (SELECT DISTINCT LOWER(text_value) AS subject, count(*) FROM metadatavalue WHERE dspace_object_id in (SELECT dspace_object_id FROM item) AND metadata_field_id IN (119, 120, 127, 122, 128, 125, 135, 203, 208, 210, 215, 123, 236, 242, 187) GROUP BY subject ORDER BY count DESC) to /tmp/2021-07-01-all-subjects.csv WITH CSV HEADER;
|
||||
COPY 20994
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
<title>May, 2021</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2021-05/</link>
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -81,6 +81,31 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-11/">November, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-11-01T13:11:54+02:00">Sun Nov 01, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-11-01">2020-11-01</h2>
|
||||
<ul>
|
||||
<li>Continue with processing the statistics-2019 Solr core with the AtomicStatisticsUpdateCLI tool on DSpace Test
|
||||
<ul>
|
||||
<li>So far we’ve spent at least fifty hours to process the statistics and statistics-2019 core… wow.</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-10/">October, 2020</a></h2>
|
||||
@ -343,43 +368,6 @@
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-01/">January, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-01-06T10:48:30+02:00">Mon Jan 06, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-01-06">2020-01-06</h2>
|
||||
<ul>
|
||||
<li>Open <a href="https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=706">a ticket</a> with Atmire to request a quote for the upgrade to DSpace 6</li>
|
||||
<li>Last week Altmetric responded about the <a href="https://hdl.handle.net/10568/97087">item</a> that had a lower score than than its DOI
|
||||
<ul>
|
||||
<li>The score is now linked to the DOI</li>
|
||||
<li>Another <a href="https://handle.hdl.net/10568/91278">item</a> that had the same problem in 2019 has now also linked to the score for its DOI</li>
|
||||
<li>Another <a href="https://hdl.handle.net/10568/81236">item</a> that had the same problem in 2019 has also been fixed</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<h2 id="2020-01-07">2020-01-07</h2>
|
||||
<ul>
|
||||
<li>Peter Ballantyne highlighted one more WLE <a href="https://hdl.handle.net/10568/101286">item</a> that is missing the Altmetric score that its DOI has
|
||||
<ul>
|
||||
<li>The DOI has a score of 259, but the Handle has no score at all</li>
|
||||
<li>I <a href="https://twitter.com/mralanorth/status/1214471427157626881">tweeted</a> the CGSpace repository link</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/" rel="prev" role="button">Previous page</a>
|
||||
@ -406,14 +394,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -81,6 +81,43 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-01/">January, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-01-06T10:48:30+02:00">Mon Jan 06, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-01-06">2020-01-06</h2>
|
||||
<ul>
|
||||
<li>Open <a href="https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=706">a ticket</a> with Atmire to request a quote for the upgrade to DSpace 6</li>
|
||||
<li>Last week Altmetric responded about the <a href="https://hdl.handle.net/10568/97087">item</a> that had a lower score than than its DOI
|
||||
<ul>
|
||||
<li>The score is now linked to the DOI</li>
|
||||
<li>Another <a href="https://handle.hdl.net/10568/91278">item</a> that had the same problem in 2019 has now also linked to the score for its DOI</li>
|
||||
<li>Another <a href="https://hdl.handle.net/10568/81236">item</a> that had the same problem in 2019 has also been fixed</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<h2 id="2020-01-07">2020-01-07</h2>
|
||||
<ul>
|
||||
<li>Peter Ballantyne highlighted one more WLE <a href="https://hdl.handle.net/10568/101286">item</a> that is missing the Altmetric score that its DOI has
|
||||
<ul>
|
||||
<li>The DOI has a score of 259, but the Handle has no score at all</li>
|
||||
<li>I <a href="https://twitter.com/mralanorth/status/1214471427157626881">tweeted</a> the CGSpace repository link</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-12/">December, 2019</a></h2>
|
||||
@ -373,38 +410,6 @@ $ ./delete-metadata-values.py -i /tmp/2019-02-21-delete-1-region.csv -db dspace
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-03/">March, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-03-01T12:16:30+01:00">Fri Mar 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-03-01">2019-03-01</h2>
|
||||
<ul>
|
||||
<li>I checked IITA’s 259 Feb 14 records from last month for duplicates using Atmire’s Duplicate Checker on a fresh snapshot of CGSpace on my local machine and everything looks good</li>
|
||||
<li>I am now only waiting to hear from her about where the items should go, though I assume Journal Articles go to IITA Journal Articles collection, etc…</li>
|
||||
<li>Looking at the other half of Udana’s WLE records from 2018-11
|
||||
<ul>
|
||||
<li>I finished the ones for Restoring Degraded Landscapes (RDL), but these are for Variability, Risks and Competing Uses (VRC)</li>
|
||||
<li>I did the usual cleanups for whitespace, added regions where they made sense for certain countries, cleaned up the DOI link formats, added rights information based on the publications page for a few items</li>
|
||||
<li>Most worryingly, there are encoding errors in the abstracts for eleven items, for example:</li>
|
||||
<li>68.15% <20> 9.45 instead of 68.15% ± 9.45</li>
|
||||
<li>2003<EFBFBD>2013 instead of 2003–2013</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>I think I will need to ask Udana to re-copy and paste the abstracts with more care using Google Docs</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/page/2/" rel="prev" role="button">Previous page</a>
|
||||
@ -431,14 +436,14 @@ $ ./delete-metadata-values.py -i /tmp/2019-02-21-delete-1-region.csv -db dspace
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -81,6 +81,38 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-03/">March, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-03-01T12:16:30+01:00">Fri Mar 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-03-01">2019-03-01</h2>
|
||||
<ul>
|
||||
<li>I checked IITA’s 259 Feb 14 records from last month for duplicates using Atmire’s Duplicate Checker on a fresh snapshot of CGSpace on my local machine and everything looks good</li>
|
||||
<li>I am now only waiting to hear from her about where the items should go, though I assume Journal Articles go to IITA Journal Articles collection, etc…</li>
|
||||
<li>Looking at the other half of Udana’s WLE records from 2018-11
|
||||
<ul>
|
||||
<li>I finished the ones for Restoring Degraded Landscapes (RDL), but these are for Variability, Risks and Competing Uses (VRC)</li>
|
||||
<li>I did the usual cleanups for whitespace, added regions where they made sense for certain countries, cleaned up the DOI link formats, added rights information based on the publications page for a few items</li>
|
||||
<li>Most worryingly, there are encoding errors in the abstracts for eleven items, for example:</li>
|
||||
<li>68.15% <20> 9.45 instead of 68.15% ± 9.45</li>
|
||||
<li>2003<EFBFBD>2013 instead of 2003–2013</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>I think I will need to ask Udana to re-copy and paste the abstracts with more care using Google Docs</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-02/">February, 2019</a></h2>
|
||||
@ -356,34 +388,6 @@ sys 2m7.289s
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-05/">May, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-05-01T16:43:54+03:00">Tue May 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-05-01">2018-05-01</h2>
|
||||
<ul>
|
||||
<li>I cleared the Solr statistics core on DSpace Test by issuing two commands directly to the Solr admin interface:
|
||||
<ul>
|
||||
<li>http://localhost:3000/solr/statistics/update?stream.body=%3Cdelete%3E%3Cquery%3E*:*%3C/query%3E%3C/delete%3E</li>
|
||||
<li>http://localhost:3000/solr/statistics/update?stream.body=%3Ccommit/%3E</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/page/3/" rel="prev" role="button">Previous page</a>
|
||||
@ -410,14 +414,14 @@ sys 2m7.289s
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -81,6 +81,34 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-05/">May, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-05-01T16:43:54+03:00">Tue May 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-05-01">2018-05-01</h2>
|
||||
<ul>
|
||||
<li>I cleared the Solr statistics core on DSpace Test by issuing two commands directly to the Solr admin interface:
|
||||
<ul>
|
||||
<li>http://localhost:3000/solr/statistics/update?stream.body=%3Cdelete%3E%3Cquery%3E*:*%3C/query%3E%3C/delete%3E</li>
|
||||
<li>http://localhost:3000/solr/statistics/update?stream.body=%3Ccommit/%3E</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-04/">April, 2018</a></h2>
|
||||
@ -360,14 +388,14 @@ COPY 54701
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -18,7 +18,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGIAR Library Migration"/>
|
||||
<meta name="twitter:description" content="Notes on the migration of the CGIAR Library to CGSpace"/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -284,14 +284,14 @@ dspace=# select setval('handle_seq',86873);
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -18,7 +18,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace CG Core v2 Migration"/>
|
||||
<meta name="twitter:description" content="Possible changes to CGSpace metadata fields to align more with DC, QDC, and DCTERMS as well as CG Core v2."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -464,14 +464,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -18,7 +18,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace DSpace 6 Upgrade"/>
|
||||
<meta name="twitter:description" content="Documenting the DSpace 6 upgrade."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -473,14 +473,14 @@ $ chrt -b 0 dspace solr-upgrade-statistics-6x -n 2500000 -i statistics-2018
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -123,6 +123,30 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-06/">July, 2021</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2021-06-01T08:53:07+03:00">Tue Jun 01, 2021</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2021-07-01">2021-07-01</h2>
|
||||
<ul>
|
||||
<li>Export another list of ALL subjects on CGSpace, including AGROVOC and non-AGROVOC for Enrico:</li>
|
||||
</ul>
|
||||
<pre><code class="language-console" data-lang="console">localhost/dspace63= > \COPY (SELECT DISTINCT LOWER(text_value) AS subject, count(*) FROM metadatavalue WHERE dspace_object_id in (SELECT dspace_object_id FROM item) AND metadata_field_id IN (119, 120, 127, 122, 128, 125, 135, 203, 208, 210, 215, 123, 236, 242, 187) GROUP BY subject ORDER BY count DESC) to /tmp/2021-07-01-all-subjects.csv WITH CSV HEADER;
|
||||
COPY 20994
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2021-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-05/">May, 2021</a></h2>
|
||||
@ -347,31 +371,6 @@
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-11/">November, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-11-01T13:11:54+02:00">Sun Nov 01, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-11-01">2020-11-01</h2>
|
||||
<ul>
|
||||
<li>Continue with processing the statistics-2019 Solr core with the AtomicStatisticsUpdateCLI tool on DSpace Test
|
||||
<ul>
|
||||
<li>So far we’ve spent at least fifty hours to process the statistics and statistics-2019 core… wow.</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
|
||||
@ -398,14 +397,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -25,6 +25,21 @@
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
<title>July, 2021</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2021-06/</link>
|
||||
<pubDate>Tue, 01 Jun 2021 08:53:07 +0300</pubDate>
|
||||
|
||||
<guid>https://alanorth.github.io/cgspace-notes/2021-06/</guid>
|
||||
<description><h2 id="2021-07-01">2021-07-01</h2>
|
||||
<ul>
|
||||
<li>Export another list of ALL subjects on CGSpace, including AGROVOC and non-AGROVOC for Enrico:</li>
|
||||
</ul>
|
||||
<pre><code class="language-console" data-lang="console">localhost/dspace63= &gt; \COPY (SELECT DISTINCT LOWER(text_value) AS subject, count(*) FROM metadatavalue WHERE dspace_object_id in (SELECT dspace_object_id FROM item) AND metadata_field_id IN (119, 120, 127, 122, 128, 125, 135, 203, 208, 210, 215, 123, 236, 242, 187) GROUP BY subject ORDER BY count DESC) to /tmp/2021-07-01-all-subjects.csv WITH CSV HEADER;
|
||||
COPY 20994
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
<title>May, 2021</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2021-05/</link>
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -96,6 +96,31 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-11/">November, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-11-01T13:11:54+02:00">Sun Nov 01, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-11-01">2020-11-01</h2>
|
||||
<ul>
|
||||
<li>Continue with processing the statistics-2019 Solr core with the AtomicStatisticsUpdateCLI tool on DSpace Test
|
||||
<ul>
|
||||
<li>So far we’ve spent at least fifty hours to process the statistics and statistics-2019 core… wow.</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-10/">October, 2020</a></h2>
|
||||
@ -358,43 +383,6 @@
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-01/">January, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-01-06T10:48:30+02:00">Mon Jan 06, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-01-06">2020-01-06</h2>
|
||||
<ul>
|
||||
<li>Open <a href="https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=706">a ticket</a> with Atmire to request a quote for the upgrade to DSpace 6</li>
|
||||
<li>Last week Altmetric responded about the <a href="https://hdl.handle.net/10568/97087">item</a> that had a lower score than than its DOI
|
||||
<ul>
|
||||
<li>The score is now linked to the DOI</li>
|
||||
<li>Another <a href="https://handle.hdl.net/10568/91278">item</a> that had the same problem in 2019 has now also linked to the score for its DOI</li>
|
||||
<li>Another <a href="https://hdl.handle.net/10568/81236">item</a> that had the same problem in 2019 has also been fixed</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<h2 id="2020-01-07">2020-01-07</h2>
|
||||
<ul>
|
||||
<li>Peter Ballantyne highlighted one more WLE <a href="https://hdl.handle.net/10568/101286">item</a> that is missing the Altmetric score that its DOI has
|
||||
<ul>
|
||||
<li>The DOI has a score of 259, but the Handle has no score at all</li>
|
||||
<li>I <a href="https://twitter.com/mralanorth/status/1214471427157626881">tweeted</a> the CGSpace repository link</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/" rel="prev" role="button">Previous page</a>
|
||||
@ -421,14 +409,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -96,6 +96,43 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-01/">January, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-01-06T10:48:30+02:00">Mon Jan 06, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-01-06">2020-01-06</h2>
|
||||
<ul>
|
||||
<li>Open <a href="https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=706">a ticket</a> with Atmire to request a quote for the upgrade to DSpace 6</li>
|
||||
<li>Last week Altmetric responded about the <a href="https://hdl.handle.net/10568/97087">item</a> that had a lower score than than its DOI
|
||||
<ul>
|
||||
<li>The score is now linked to the DOI</li>
|
||||
<li>Another <a href="https://handle.hdl.net/10568/91278">item</a> that had the same problem in 2019 has now also linked to the score for its DOI</li>
|
||||
<li>Another <a href="https://hdl.handle.net/10568/81236">item</a> that had the same problem in 2019 has also been fixed</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<h2 id="2020-01-07">2020-01-07</h2>
|
||||
<ul>
|
||||
<li>Peter Ballantyne highlighted one more WLE <a href="https://hdl.handle.net/10568/101286">item</a> that is missing the Altmetric score that its DOI has
|
||||
<ul>
|
||||
<li>The DOI has a score of 259, but the Handle has no score at all</li>
|
||||
<li>I <a href="https://twitter.com/mralanorth/status/1214471427157626881">tweeted</a> the CGSpace repository link</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-12/">December, 2019</a></h2>
|
||||
@ -388,38 +425,6 @@ $ ./delete-metadata-values.py -i /tmp/2019-02-21-delete-1-region.csv -db dspace
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-03/">March, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-03-01T12:16:30+01:00">Fri Mar 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-03-01">2019-03-01</h2>
|
||||
<ul>
|
||||
<li>I checked IITA’s 259 Feb 14 records from last month for duplicates using Atmire’s Duplicate Checker on a fresh snapshot of CGSpace on my local machine and everything looks good</li>
|
||||
<li>I am now only waiting to hear from her about where the items should go, though I assume Journal Articles go to IITA Journal Articles collection, etc…</li>
|
||||
<li>Looking at the other half of Udana’s WLE records from 2018-11
|
||||
<ul>
|
||||
<li>I finished the ones for Restoring Degraded Landscapes (RDL), but these are for Variability, Risks and Competing Uses (VRC)</li>
|
||||
<li>I did the usual cleanups for whitespace, added regions where they made sense for certain countries, cleaned up the DOI link formats, added rights information based on the publications page for a few items</li>
|
||||
<li>Most worryingly, there are encoding errors in the abstracts for eleven items, for example:</li>
|
||||
<li>68.15% <20> 9.45 instead of 68.15% ± 9.45</li>
|
||||
<li>2003<EFBFBD>2013 instead of 2003–2013</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>I think I will need to ask Udana to re-copy and paste the abstracts with more care using Google Docs</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/page/2/" rel="prev" role="button">Previous page</a>
|
||||
@ -446,14 +451,14 @@ $ ./delete-metadata-values.py -i /tmp/2019-02-21-delete-1-region.csv -db dspace
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -96,6 +96,38 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-03/">March, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-03-01T12:16:30+01:00">Fri Mar 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-03-01">2019-03-01</h2>
|
||||
<ul>
|
||||
<li>I checked IITA’s 259 Feb 14 records from last month for duplicates using Atmire’s Duplicate Checker on a fresh snapshot of CGSpace on my local machine and everything looks good</li>
|
||||
<li>I am now only waiting to hear from her about where the items should go, though I assume Journal Articles go to IITA Journal Articles collection, etc…</li>
|
||||
<li>Looking at the other half of Udana’s WLE records from 2018-11
|
||||
<ul>
|
||||
<li>I finished the ones for Restoring Degraded Landscapes (RDL), but these are for Variability, Risks and Competing Uses (VRC)</li>
|
||||
<li>I did the usual cleanups for whitespace, added regions where they made sense for certain countries, cleaned up the DOI link formats, added rights information based on the publications page for a few items</li>
|
||||
<li>Most worryingly, there are encoding errors in the abstracts for eleven items, for example:</li>
|
||||
<li>68.15% <20> 9.45 instead of 68.15% ± 9.45</li>
|
||||
<li>2003<EFBFBD>2013 instead of 2003–2013</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>I think I will need to ask Udana to re-copy and paste the abstracts with more care using Google Docs</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-02/">February, 2019</a></h2>
|
||||
@ -371,34 +403,6 @@ sys 2m7.289s
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-05/">May, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-05-01T16:43:54+03:00">Tue May 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-05-01">2018-05-01</h2>
|
||||
<ul>
|
||||
<li>I cleared the Solr statistics core on DSpace Test by issuing two commands directly to the Solr admin interface:
|
||||
<ul>
|
||||
<li>http://localhost:3000/solr/statistics/update?stream.body=%3Cdelete%3E%3Cquery%3E*:*%3C/query%3E%3C/delete%3E</li>
|
||||
<li>http://localhost:3000/solr/statistics/update?stream.body=%3Ccommit/%3E</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/page/3/" rel="prev" role="button">Previous page</a>
|
||||
@ -425,14 +429,14 @@ sys 2m7.289s
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -96,6 +96,34 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-05/">May, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-05-01T16:43:54+03:00">Tue May 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-05-01">2018-05-01</h2>
|
||||
<ul>
|
||||
<li>I cleared the Solr statistics core on DSpace Test by issuing two commands directly to the Solr admin interface:
|
||||
<ul>
|
||||
<li>http://localhost:3000/solr/statistics/update?stream.body=%3Cdelete%3E%3Cquery%3E*:*%3C/query%3E%3C/delete%3E</li>
|
||||
<li>http://localhost:3000/solr/statistics/update?stream.body=%3Ccommit/%3E</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-04/">April, 2018</a></h2>
|
||||
@ -374,45 +402,6 @@ COPY 54701
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-08/">August, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-08-01T11:51:52+03:00">Tue Aug 01, 2017</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-08-01">2017-08-01</h2>
|
||||
<ul>
|
||||
<li>Linode sent an alert that CGSpace (linode18) was using 350% CPU for the past two hours</li>
|
||||
<li>I looked in the Activity pane of the Admin Control Panel and it seems that Google, Baidu, Yahoo, and Bing are all crawling with massive numbers of bots concurrently (~100 total, mostly Baidu and Google)</li>
|
||||
<li>The good thing is that, according to <code>dspace.log.2017-08-01</code>, they are all using the same Tomcat session</li>
|
||||
<li>This means our Tomcat Crawler Session Valve is working</li>
|
||||
<li>But many of the bots are browsing dynamic URLs like:
|
||||
<ul>
|
||||
<li>/handle/10568/3353/discover</li>
|
||||
<li>/handle/10568/16510/browse</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>The <code>robots.txt</code> only blocks the top-level <code>/discover</code> and <code>/browse</code> URLs… we will need to find a way to forbid them from accessing these!</li>
|
||||
<li>Relevant issue from DSpace Jira (semi resolved in DSpace 6.0): <a href="https://jira.duraspace.org/browse/DS-2962">https://jira.duraspace.org/browse/DS-2962</a></li>
|
||||
<li>It turns out that we’re already adding the <code>X-Robots-Tag "none"</code> HTTP header, but this only forbids the search engine from <em>indexing</em> the page, not crawling it!</li>
|
||||
<li>Also, the bot has to successfully browse the page first so it can receive the HTTP header…</li>
|
||||
<li>We might actually have to <em>block</em> these requests with HTTP 403 depending on the user agent</li>
|
||||
<li>Abenet pointed out that the CGIAR Library Historical Archive collection I sent July 20th only had ~100 entries, instead of 2415</li>
|
||||
<li>This was due to newline characters in the <code>dc.description.abstract</code> column, which caused OpenRefine to choke when exporting the CSV</li>
|
||||
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
|
||||
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/page/4/" rel="prev" role="button">Previous page</a>
|
||||
@ -439,14 +428,14 @@ COPY 54701
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -96,6 +96,45 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-08/">August, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-08-01T11:51:52+03:00">Tue Aug 01, 2017</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-08-01">2017-08-01</h2>
|
||||
<ul>
|
||||
<li>Linode sent an alert that CGSpace (linode18) was using 350% CPU for the past two hours</li>
|
||||
<li>I looked in the Activity pane of the Admin Control Panel and it seems that Google, Baidu, Yahoo, and Bing are all crawling with massive numbers of bots concurrently (~100 total, mostly Baidu and Google)</li>
|
||||
<li>The good thing is that, according to <code>dspace.log.2017-08-01</code>, they are all using the same Tomcat session</li>
|
||||
<li>This means our Tomcat Crawler Session Valve is working</li>
|
||||
<li>But many of the bots are browsing dynamic URLs like:
|
||||
<ul>
|
||||
<li>/handle/10568/3353/discover</li>
|
||||
<li>/handle/10568/16510/browse</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>The <code>robots.txt</code> only blocks the top-level <code>/discover</code> and <code>/browse</code> URLs… we will need to find a way to forbid them from accessing these!</li>
|
||||
<li>Relevant issue from DSpace Jira (semi resolved in DSpace 6.0): <a href="https://jira.duraspace.org/browse/DS-2962">https://jira.duraspace.org/browse/DS-2962</a></li>
|
||||
<li>It turns out that we’re already adding the <code>X-Robots-Tag "none"</code> HTTP header, but this only forbids the search engine from <em>indexing</em> the page, not crawling it!</li>
|
||||
<li>Also, the bot has to successfully browse the page first so it can receive the HTTP header…</li>
|
||||
<li>We might actually have to <em>block</em> these requests with HTTP 403 depending on the user agent</li>
|
||||
<li>Abenet pointed out that the CGIAR Library Historical Archive collection I sent July 20th only had ~100 entries, instead of 2415</li>
|
||||
<li>This was due to newline characters in the <code>dc.description.abstract</code> column, which caused OpenRefine to choke when exporting the CSV</li>
|
||||
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
|
||||
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-07/">July, 2017</a></h2>
|
||||
@ -334,36 +373,6 @@ DELETE 1
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-10/">October, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-10-03T15:53:00+03:00">Mon Oct 03, 2016</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-10-03">2016-10-03</h2>
|
||||
<ul>
|
||||
<li>Testing adding <a href="https://wiki.lyrasis.org/display/DSDOC5x/ORCID+Integration#ORCIDIntegration-EditingexistingitemsusingBatchCSVEditing">ORCIDs to a CSV</a> file for a single item to see if the author orders get messed up</li>
|
||||
<li>Need to test the following scenarios to see how author order is affected:
|
||||
<ul>
|
||||
<li>ORCIDs only</li>
|
||||
<li>ORCIDs plus normal authors</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>I exported a random item’s metadata as CSV, deleted <em>all columns</em> except id and collection, and made a new coloum called <code>ORCID:dc.contributor.author</code> with the following random ORCIDs from the ORCID registry:</li>
|
||||
</ul>
|
||||
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/page/5/" rel="prev" role="button">Previous page</a>
|
||||
@ -390,14 +399,14 @@ DELETE 1
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -96,6 +96,36 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-10/">October, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-10-03T15:53:00+03:00">Mon Oct 03, 2016</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-10-03">2016-10-03</h2>
|
||||
<ul>
|
||||
<li>Testing adding <a href="https://wiki.lyrasis.org/display/DSDOC5x/ORCID+Integration#ORCIDIntegration-EditingexistingitemsusingBatchCSVEditing">ORCIDs to a CSV</a> file for a single item to see if the author orders get messed up</li>
|
||||
<li>Need to test the following scenarios to see how author order is affected:
|
||||
<ul>
|
||||
<li>ORCIDs only</li>
|
||||
<li>ORCIDs plus normal authors</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>I exported a random item’s metadata as CSV, deleted <em>all columns</em> except id and collection, and made a new coloum called <code>ORCID:dc.contributor.author</code> with the following random ORCIDs from the ORCID registry:</li>
|
||||
</ul>
|
||||
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-09/">September, 2016</a></h2>
|
||||
@ -333,33 +363,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2015-12/">December, 2015</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2015-12-02T13:18:00+03:00">Wed Dec 02, 2015</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2015-12-02">2015-12-02</h2>
|
||||
<ul>
|
||||
<li>Replace <code>lzop</code> with <code>xz</code> in log compression cron jobs on DSpace Test—it uses less space:</li>
|
||||
</ul>
|
||||
<pre><code># cd /home/dspacetest.cgiar.org/log
|
||||
# ls -lh dspace.log.2015-11-18*
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/page/6/" rel="prev" role="button">Previous page</a>
|
||||
@ -386,14 +389,14 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -96,6 +96,33 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2015-12/">December, 2015</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2015-12-02T13:18:00+03:00">Wed Dec 02, 2015</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2015-12-02">2015-12-02</h2>
|
||||
<ul>
|
||||
<li>Replace <code>lzop</code> with <code>xz</code> in log compression cron jobs on DSpace Test—it uses less space:</li>
|
||||
</ul>
|
||||
<pre><code># cd /home/dspacetest.cgiar.org/log
|
||||
# ls -lh dspace.log.2015-11-18*
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2015-11/">November, 2015</a></h2>
|
||||
@ -147,14 +174,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -123,6 +123,30 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-06/">July, 2021</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2021-06-01T08:53:07+03:00">Tue Jun 01, 2021</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2021-07-01">2021-07-01</h2>
|
||||
<ul>
|
||||
<li>Export another list of ALL subjects on CGSpace, including AGROVOC and non-AGROVOC for Enrico:</li>
|
||||
</ul>
|
||||
<pre><code class="language-console" data-lang="console">localhost/dspace63= > \COPY (SELECT DISTINCT LOWER(text_value) AS subject, count(*) FROM metadatavalue WHERE dspace_object_id in (SELECT dspace_object_id FROM item) AND metadata_field_id IN (119, 120, 127, 122, 128, 125, 135, 203, 208, 210, 215, 123, 236, 242, 187) GROUP BY subject ORDER BY count DESC) to /tmp/2021-07-01-all-subjects.csv WITH CSV HEADER;
|
||||
COPY 20994
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2021-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2021-05/">May, 2021</a></h2>
|
||||
@ -347,31 +371,6 @@
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-11/">November, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-11-01T13:11:54+02:00">Sun Nov 01, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-11-01">2020-11-01</h2>
|
||||
<ul>
|
||||
<li>Continue with processing the statistics-2019 Solr core with the AtomicStatisticsUpdateCLI tool on DSpace Test
|
||||
<ul>
|
||||
<li>So far we’ve spent at least fifty hours to process the statistics and statistics-2019 core… wow.</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
|
||||
@ -398,14 +397,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -25,6 +25,21 @@
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
<title>July, 2021</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2021-06/</link>
|
||||
<pubDate>Tue, 01 Jun 2021 08:53:07 +0300</pubDate>
|
||||
|
||||
<guid>https://alanorth.github.io/cgspace-notes/2021-06/</guid>
|
||||
<description><h2 id="2021-07-01">2021-07-01</h2>
|
||||
<ul>
|
||||
<li>Export another list of ALL subjects on CGSpace, including AGROVOC and non-AGROVOC for Enrico:</li>
|
||||
</ul>
|
||||
<pre><code class="language-console" data-lang="console">localhost/dspace63= &gt; \COPY (SELECT DISTINCT LOWER(text_value) AS subject, count(*) FROM metadatavalue WHERE dspace_object_id in (SELECT dspace_object_id FROM item) AND metadata_field_id IN (119, 120, 127, 122, 128, 125, 135, 203, 208, 210, 215, 123, 236, 242, 187) GROUP BY subject ORDER BY count DESC) to /tmp/2021-07-01-all-subjects.csv WITH CSV HEADER;
|
||||
COPY 20994
|
||||
</code></pre></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
<title>May, 2021</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2021-05/</link>
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -96,6 +96,31 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-11/">November, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-11-01T13:11:54+02:00">Sun Nov 01, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-11-01">2020-11-01</h2>
|
||||
<ul>
|
||||
<li>Continue with processing the statistics-2019 Solr core with the AtomicStatisticsUpdateCLI tool on DSpace Test
|
||||
<ul>
|
||||
<li>So far we’ve spent at least fifty hours to process the statistics and statistics-2019 core… wow.</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-10/">October, 2020</a></h2>
|
||||
@ -358,43 +383,6 @@
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-01/">January, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-01-06T10:48:30+02:00">Mon Jan 06, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-01-06">2020-01-06</h2>
|
||||
<ul>
|
||||
<li>Open <a href="https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=706">a ticket</a> with Atmire to request a quote for the upgrade to DSpace 6</li>
|
||||
<li>Last week Altmetric responded about the <a href="https://hdl.handle.net/10568/97087">item</a> that had a lower score than than its DOI
|
||||
<ul>
|
||||
<li>The score is now linked to the DOI</li>
|
||||
<li>Another <a href="https://handle.hdl.net/10568/91278">item</a> that had the same problem in 2019 has now also linked to the score for its DOI</li>
|
||||
<li>Another <a href="https://hdl.handle.net/10568/81236">item</a> that had the same problem in 2019 has also been fixed</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<h2 id="2020-01-07">2020-01-07</h2>
|
||||
<ul>
|
||||
<li>Peter Ballantyne highlighted one more WLE <a href="https://hdl.handle.net/10568/101286">item</a> that is missing the Altmetric score that its DOI has
|
||||
<ul>
|
||||
<li>The DOI has a score of 259, but the Handle has no score at all</li>
|
||||
<li>I <a href="https://twitter.com/mralanorth/status/1214471427157626881">tweeted</a> the CGSpace repository link</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/posts/" rel="prev" role="button">Previous page</a>
|
||||
@ -421,14 +409,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -96,6 +96,43 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-01/">January, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-01-06T10:48:30+02:00">Mon Jan 06, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-01-06">2020-01-06</h2>
|
||||
<ul>
|
||||
<li>Open <a href="https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=706">a ticket</a> with Atmire to request a quote for the upgrade to DSpace 6</li>
|
||||
<li>Last week Altmetric responded about the <a href="https://hdl.handle.net/10568/97087">item</a> that had a lower score than than its DOI
|
||||
<ul>
|
||||
<li>The score is now linked to the DOI</li>
|
||||
<li>Another <a href="https://handle.hdl.net/10568/91278">item</a> that had the same problem in 2019 has now also linked to the score for its DOI</li>
|
||||
<li>Another <a href="https://hdl.handle.net/10568/81236">item</a> that had the same problem in 2019 has also been fixed</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<h2 id="2020-01-07">2020-01-07</h2>
|
||||
<ul>
|
||||
<li>Peter Ballantyne highlighted one more WLE <a href="https://hdl.handle.net/10568/101286">item</a> that is missing the Altmetric score that its DOI has
|
||||
<ul>
|
||||
<li>The DOI has a score of 259, but the Handle has no score at all</li>
|
||||
<li>I <a href="https://twitter.com/mralanorth/status/1214471427157626881">tweeted</a> the CGSpace repository link</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-12/">December, 2019</a></h2>
|
||||
@ -388,38 +425,6 @@ $ ./delete-metadata-values.py -i /tmp/2019-02-21-delete-1-region.csv -db dspace
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-03/">March, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-03-01T12:16:30+01:00">Fri Mar 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-03-01">2019-03-01</h2>
|
||||
<ul>
|
||||
<li>I checked IITA’s 259 Feb 14 records from last month for duplicates using Atmire’s Duplicate Checker on a fresh snapshot of CGSpace on my local machine and everything looks good</li>
|
||||
<li>I am now only waiting to hear from her about where the items should go, though I assume Journal Articles go to IITA Journal Articles collection, etc…</li>
|
||||
<li>Looking at the other half of Udana’s WLE records from 2018-11
|
||||
<ul>
|
||||
<li>I finished the ones for Restoring Degraded Landscapes (RDL), but these are for Variability, Risks and Competing Uses (VRC)</li>
|
||||
<li>I did the usual cleanups for whitespace, added regions where they made sense for certain countries, cleaned up the DOI link formats, added rights information based on the publications page for a few items</li>
|
||||
<li>Most worryingly, there are encoding errors in the abstracts for eleven items, for example:</li>
|
||||
<li>68.15% <20> 9.45 instead of 68.15% ± 9.45</li>
|
||||
<li>2003<EFBFBD>2013 instead of 2003–2013</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>I think I will need to ask Udana to re-copy and paste the abstracts with more care using Google Docs</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/posts/page/2/" rel="prev" role="button">Previous page</a>
|
||||
@ -446,14 +451,14 @@ $ ./delete-metadata-values.py -i /tmp/2019-02-21-delete-1-region.csv -db dspace
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -96,6 +96,38 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-03/">March, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-03-01T12:16:30+01:00">Fri Mar 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-03-01">2019-03-01</h2>
|
||||
<ul>
|
||||
<li>I checked IITA’s 259 Feb 14 records from last month for duplicates using Atmire’s Duplicate Checker on a fresh snapshot of CGSpace on my local machine and everything looks good</li>
|
||||
<li>I am now only waiting to hear from her about where the items should go, though I assume Journal Articles go to IITA Journal Articles collection, etc…</li>
|
||||
<li>Looking at the other half of Udana’s WLE records from 2018-11
|
||||
<ul>
|
||||
<li>I finished the ones for Restoring Degraded Landscapes (RDL), but these are for Variability, Risks and Competing Uses (VRC)</li>
|
||||
<li>I did the usual cleanups for whitespace, added regions where they made sense for certain countries, cleaned up the DOI link formats, added rights information based on the publications page for a few items</li>
|
||||
<li>Most worryingly, there are encoding errors in the abstracts for eleven items, for example:</li>
|
||||
<li>68.15% <20> 9.45 instead of 68.15% ± 9.45</li>
|
||||
<li>2003<EFBFBD>2013 instead of 2003–2013</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>I think I will need to ask Udana to re-copy and paste the abstracts with more care using Google Docs</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-03/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-02/">February, 2019</a></h2>
|
||||
@ -371,34 +403,6 @@ sys 2m7.289s
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-05/">May, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-05-01T16:43:54+03:00">Tue May 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-05-01">2018-05-01</h2>
|
||||
<ul>
|
||||
<li>I cleared the Solr statistics core on DSpace Test by issuing two commands directly to the Solr admin interface:
|
||||
<ul>
|
||||
<li>http://localhost:3000/solr/statistics/update?stream.body=%3Cdelete%3E%3Cquery%3E*:*%3C/query%3E%3C/delete%3E</li>
|
||||
<li>http://localhost:3000/solr/statistics/update?stream.body=%3Ccommit/%3E</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/posts/page/3/" rel="prev" role="button">Previous page</a>
|
||||
@ -425,14 +429,14 @@ sys 2m7.289s
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -96,6 +96,34 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-05/">May, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-05-01T16:43:54+03:00">Tue May 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-05-01">2018-05-01</h2>
|
||||
<ul>
|
||||
<li>I cleared the Solr statistics core on DSpace Test by issuing two commands directly to the Solr admin interface:
|
||||
<ul>
|
||||
<li>http://localhost:3000/solr/statistics/update?stream.body=%3Cdelete%3E%3Cquery%3E*:*%3C/query%3E%3C/delete%3E</li>
|
||||
<li>http://localhost:3000/solr/statistics/update?stream.body=%3Ccommit/%3E</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>Then I reduced the JVM heap size from 6144 back to 5120m</li>
|
||||
<li>Also, I switched it to use OpenJDK instead of Oracle Java, as well as re-worked the <a href="https://github.com/ilri/rmg-ansible-public">Ansible infrastructure scripts</a> to support hosts choosing which distribution they want to use</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-04/">April, 2018</a></h2>
|
||||
@ -374,45 +402,6 @@ COPY 54701
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-08/">August, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-08-01T11:51:52+03:00">Tue Aug 01, 2017</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-08-01">2017-08-01</h2>
|
||||
<ul>
|
||||
<li>Linode sent an alert that CGSpace (linode18) was using 350% CPU for the past two hours</li>
|
||||
<li>I looked in the Activity pane of the Admin Control Panel and it seems that Google, Baidu, Yahoo, and Bing are all crawling with massive numbers of bots concurrently (~100 total, mostly Baidu and Google)</li>
|
||||
<li>The good thing is that, according to <code>dspace.log.2017-08-01</code>, they are all using the same Tomcat session</li>
|
||||
<li>This means our Tomcat Crawler Session Valve is working</li>
|
||||
<li>But many of the bots are browsing dynamic URLs like:
|
||||
<ul>
|
||||
<li>/handle/10568/3353/discover</li>
|
||||
<li>/handle/10568/16510/browse</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>The <code>robots.txt</code> only blocks the top-level <code>/discover</code> and <code>/browse</code> URLs… we will need to find a way to forbid them from accessing these!</li>
|
||||
<li>Relevant issue from DSpace Jira (semi resolved in DSpace 6.0): <a href="https://jira.duraspace.org/browse/DS-2962">https://jira.duraspace.org/browse/DS-2962</a></li>
|
||||
<li>It turns out that we’re already adding the <code>X-Robots-Tag "none"</code> HTTP header, but this only forbids the search engine from <em>indexing</em> the page, not crawling it!</li>
|
||||
<li>Also, the bot has to successfully browse the page first so it can receive the HTTP header…</li>
|
||||
<li>We might actually have to <em>block</em> these requests with HTTP 403 depending on the user agent</li>
|
||||
<li>Abenet pointed out that the CGIAR Library Historical Archive collection I sent July 20th only had ~100 entries, instead of 2415</li>
|
||||
<li>This was due to newline characters in the <code>dc.description.abstract</code> column, which caused OpenRefine to choke when exporting the CSV</li>
|
||||
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
|
||||
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/posts/page/4/" rel="prev" role="button">Previous page</a>
|
||||
@ -439,14 +428,14 @@ COPY 54701
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -96,6 +96,45 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-08/">August, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-08-01T11:51:52+03:00">Tue Aug 01, 2017</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-08-01">2017-08-01</h2>
|
||||
<ul>
|
||||
<li>Linode sent an alert that CGSpace (linode18) was using 350% CPU for the past two hours</li>
|
||||
<li>I looked in the Activity pane of the Admin Control Panel and it seems that Google, Baidu, Yahoo, and Bing are all crawling with massive numbers of bots concurrently (~100 total, mostly Baidu and Google)</li>
|
||||
<li>The good thing is that, according to <code>dspace.log.2017-08-01</code>, they are all using the same Tomcat session</li>
|
||||
<li>This means our Tomcat Crawler Session Valve is working</li>
|
||||
<li>But many of the bots are browsing dynamic URLs like:
|
||||
<ul>
|
||||
<li>/handle/10568/3353/discover</li>
|
||||
<li>/handle/10568/16510/browse</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>The <code>robots.txt</code> only blocks the top-level <code>/discover</code> and <code>/browse</code> URLs… we will need to find a way to forbid them from accessing these!</li>
|
||||
<li>Relevant issue from DSpace Jira (semi resolved in DSpace 6.0): <a href="https://jira.duraspace.org/browse/DS-2962">https://jira.duraspace.org/browse/DS-2962</a></li>
|
||||
<li>It turns out that we’re already adding the <code>X-Robots-Tag "none"</code> HTTP header, but this only forbids the search engine from <em>indexing</em> the page, not crawling it!</li>
|
||||
<li>Also, the bot has to successfully browse the page first so it can receive the HTTP header…</li>
|
||||
<li>We might actually have to <em>block</em> these requests with HTTP 403 depending on the user agent</li>
|
||||
<li>Abenet pointed out that the CGIAR Library Historical Archive collection I sent July 20th only had ~100 entries, instead of 2415</li>
|
||||
<li>This was due to newline characters in the <code>dc.description.abstract</code> column, which caused OpenRefine to choke when exporting the CSV</li>
|
||||
<li>I exported a new CSV from the collection on DSpace Test and then manually removed the characters in vim using <code>g/^$/d</code></li>
|
||||
<li>Then I cleaned up the author authorities and HTML characters in OpenRefine and sent the file back to Abenet</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-08/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-07/">July, 2017</a></h2>
|
||||
@ -334,36 +373,6 @@ DELETE 1
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-10/">October, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-10-03T15:53:00+03:00">Mon Oct 03, 2016</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-10-03">2016-10-03</h2>
|
||||
<ul>
|
||||
<li>Testing adding <a href="https://wiki.lyrasis.org/display/DSDOC5x/ORCID+Integration#ORCIDIntegration-EditingexistingitemsusingBatchCSVEditing">ORCIDs to a CSV</a> file for a single item to see if the author orders get messed up</li>
|
||||
<li>Need to test the following scenarios to see how author order is affected:
|
||||
<ul>
|
||||
<li>ORCIDs only</li>
|
||||
<li>ORCIDs plus normal authors</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>I exported a random item’s metadata as CSV, deleted <em>all columns</em> except id and collection, and made a new coloum called <code>ORCID:dc.contributor.author</code> with the following random ORCIDs from the ORCID registry:</li>
|
||||
</ul>
|
||||
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/posts/page/5/" rel="prev" role="button">Previous page</a>
|
||||
@ -390,14 +399,14 @@ DELETE 1
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -96,6 +96,36 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-10/">October, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-10-03T15:53:00+03:00">Mon Oct 03, 2016</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-10-03">2016-10-03</h2>
|
||||
<ul>
|
||||
<li>Testing adding <a href="https://wiki.lyrasis.org/display/DSDOC5x/ORCID+Integration#ORCIDIntegration-EditingexistingitemsusingBatchCSVEditing">ORCIDs to a CSV</a> file for a single item to see if the author orders get messed up</li>
|
||||
<li>Need to test the following scenarios to see how author order is affected:
|
||||
<ul>
|
||||
<li>ORCIDs only</li>
|
||||
<li>ORCIDs plus normal authors</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>I exported a random item’s metadata as CSV, deleted <em>all columns</em> except id and collection, and made a new coloum called <code>ORCID:dc.contributor.author</code> with the following random ORCIDs from the ORCID registry:</li>
|
||||
</ul>
|
||||
<pre><code>0000-0002-6115-0956||0000-0002-3812-8793||0000-0001-7462-405X
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-10/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-09/">September, 2016</a></h2>
|
||||
@ -333,33 +363,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2015-12/">December, 2015</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2015-12-02T13:18:00+03:00">Wed Dec 02, 2015</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2015-12-02">2015-12-02</h2>
|
||||
<ul>
|
||||
<li>Replace <code>lzop</code> with <code>xz</code> in log compression cron jobs on DSpace Test—it uses less space:</li>
|
||||
</ul>
|
||||
<pre><code># cd /home/dspacetest.cgiar.org/log
|
||||
# ls -lh dspace.log.2015-11-18*
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/posts/page/6/" rel="prev" role="button">Previous page</a>
|
||||
@ -386,14 +389,14 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -10,14 +10,14 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2021-06-30T12:21:16+03:00" />
|
||||
<meta property="og:updated_time" content="2021-07-06T17:03:55+03:00" />
|
||||
|
||||
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -96,6 +96,33 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2015-12/">December, 2015</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2015-12-02T13:18:00+03:00">Wed Dec 02, 2015</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2015-12-02">2015-12-02</h2>
|
||||
<ul>
|
||||
<li>Replace <code>lzop</code> with <code>xz</code> in log compression cron jobs on DSpace Test—it uses less space:</li>
|
||||
</ul>
|
||||
<pre><code># cd /home/dspacetest.cgiar.org/log
|
||||
# ls -lh dspace.log.2015-11-18*
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 2.0M Nov 18 23:59 dspace.log.2015-11-18
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 387K Nov 18 23:59 dspace.log.2015-11-18.lzo
|
||||
-rw-rw-r-- 1 tomcat7 tomcat7 169K Nov 18 23:59 dspace.log.2015-11-18.xz
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2015-12/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2015-11/">November, 2015</a></h2>
|
||||
@ -147,14 +174,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
@ -6,6 +6,7 @@ Disallow: /cgspace-notes/
|
||||
Disallow: /cgspace-notes/2021-06/
|
||||
Disallow: /cgspace-notes/categories/notes/
|
||||
Disallow: /cgspace-notes/posts/
|
||||
Disallow: /cgspace-notes/2021-06/
|
||||
Disallow: /cgspace-notes/2021-05/
|
||||
Disallow: /cgspace-notes/2021-04/
|
||||
Disallow: /cgspace-notes/2021-03/
|
||||
|
@ -3,22 +3,25 @@
|
||||
xmlns:xhtml="http://www.w3.org/1999/xhtml">
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/</loc>
|
||||
<lastmod>2021-06-30T12:21:16+03:00</lastmod>
|
||||
<lastmod>2021-07-06T17:03:55+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/</loc>
|
||||
<lastmod>2021-06-30T12:21:16+03:00</lastmod>
|
||||
<lastmod>2021-07-06T17:03:55+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2021-06/</loc>
|
||||
<lastmod>2021-06-30T12:21:16+03:00</lastmod>
|
||||
<lastmod>2021-07-01T08:53:21+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
|
||||
<lastmod>2021-06-30T12:21:16+03:00</lastmod>
|
||||
<lastmod>2021-07-06T17:03:55+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
|
||||
<lastmod>2021-06-30T12:21:16+03:00</lastmod>
|
||||
<lastmod>2021-07-06T17:03:55+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2021-06/</loc>
|
||||
<lastmod>2021-06-01T08:53:07+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2021-05/</loc>
|
||||
<lastmod>2021-05-30T22:09:06+03:00</lastmod>
|
||||
<lastmod>2021-07-06T17:03:55+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2021-04/</loc>
|
||||
<lastmod>2021-04-28T18:57:48+03:00</lastmod>
|
||||
|
@ -17,7 +17,7 @@
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Tags"/>
|
||||
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
|
||||
<meta name="generator" content="Hugo 0.84.3" />
|
||||
<meta name="generator" content="Hugo 0.84.4" />
|
||||
|
||||
|
||||
|
||||
@ -124,14 +124,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">June, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-06/">July, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-05/">May, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-04/">April, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2021-03/">March, 2021</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/cgspace-cgcorev2-migration/">CGSpace CG Core v2 Migration</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
Some files were not shown because too many files have changed in this diff Show More
Loading…
Reference in New Issue
Block a user