mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-11-22 14:45:03 +01:00
Add notes for 2020-06-01
This commit is contained in:
parent
f8a6881f12
commit
a819589a6d
GPG Key ID:
0FB860CC9C45B1B9
41
content/posts/2020-06.md
Normal file
41
content/posts/2020-06.md
Normal file
@ -0,0 +1,41 @@
|
||||
---
|
||||
title: "June, 2020"
|
||||
date: 2020-05-01T13:55:39+03:00
|
||||
author: "Alan Orth"
|
||||
categories: ["Notes"]
|
||||
---
|
||||
|
||||
## 2020-06-01
|
||||
|
||||
- I tried to run the `AtomicStatisticsUpdateCLI` CUA migration script on DSpace Test (linode26) again and it is still going very slowly and has tons of errors like I noticed yesterday
|
||||
- I sent Atmire the dspace.log from today and told them to log into the server to debug the process
|
||||
- In other news, I checked the statistics API on DSpace 6 and it's working
|
||||
- I tried to build the OAI registry on the freshly migrated DSpace 6 on DSpace Test and I get an error:
|
||||
|
||||
<!--more-->
|
||||
|
||||
```
|
||||
$ dspace oai import -c
|
||||
OAI 2.0 manager action started
|
||||
Loading @mire database changes for module MQM
|
||||
Changes have been processed
|
||||
Clearing index
|
||||
Index cleared
|
||||
Using full import.
|
||||
Full import
|
||||
java.lang.NullPointerException
|
||||
at org.dspace.xoai.app.XOAI.willChangeStatus(XOAI.java:438)
|
||||
at org.dspace.xoai.app.XOAI.index(XOAI.java:368)
|
||||
at org.dspace.xoai.app.XOAI.index(XOAI.java:280)
|
||||
at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:227)
|
||||
at org.dspace.xoai.app.XOAI.index(XOAI.java:134)
|
||||
at org.dspace.xoai.app.XOAI.main(XOAI.java:560)
|
||||
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
|
||||
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
|
||||
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
|
||||
at java.lang.reflect.Method.invoke(Method.java:498)
|
||||
at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229)
|
||||
at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81)
|
||||
```
|
||||
|
||||
<!-- vim: set sw=2 ts=2: -->
|
||||
@ -241,14 +241,14 @@ db.statementpool = true
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -263,14 +263,14 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -199,14 +199,14 @@ $ find SimpleArchiveForBio/ -iname “*.pdf” -exec basename {} ; | sor
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -377,14 +377,14 @@ Bitstream: tést señora alimentación.pdf
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -315,14 +315,14 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -494,14 +494,14 @@ dspace.log.2016-04-27:7271
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -370,14 +370,14 @@ sys 0m20.540s
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -408,14 +408,14 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -324,14 +324,14 @@ discovery.index.authority.ignore-variants=true
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -388,14 +388,14 @@ $ JAVA_OPTS="-Dfile.encoding=UTF-8 -Xmx512m" /home/cgspace.cgiar.org/b
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -605,14 +605,14 @@ $ ./delete-metadata-values.py -i ilrisubjects-delete-13.csv -f cg.subject.ilri -
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -371,14 +371,14 @@ dspace=# update metadatavalue set text_value = regexp_replace(text_value, 'http:
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -547,14 +547,14 @@ org.dspace.discovery.SearchServiceException: Error executing query
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -783,14 +783,14 @@ $ exit
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -368,14 +368,14 @@ $ gs -sDEVICE=pdfwrite -dCompatibilityLevel=1.4 -dPDFSETTINGS=/ebook -dNOPAUSE -
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -423,14 +423,14 @@ COPY 1968
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -354,14 +354,14 @@ $ ./delete-metadata-values.py -i Investors-Delete-121.csv -f dc.description.spon
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -584,14 +584,14 @@ $ gem install compass -v 1.0.3
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -390,14 +390,14 @@ UPDATE 187
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -269,14 +269,14 @@ $ JAVA_OPTS="-Xmx1024m -Dfile.encoding=UTF-8" [dspace]/bin/dspace impo
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -274,14 +274,14 @@ delete from metadatavalue where resource_type_id=2 and metadata_field_id=235 and
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -516,14 +516,14 @@ org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -658,14 +658,14 @@ Cert Status: good
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -442,14 +442,14 @@ session_id=6C30F10B4351A4ED83EC6ED50AFD6B6A
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -943,14 +943,14 @@ $ cat dspace.log.2017-11-28 | grep -o -E 'session_id=[A-Z0-9]{32}' | sort -n | u
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -782,14 +782,14 @@ DELETE 20
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -1451,14 +1451,14 @@ Catalina:type=Manager,context=/,host=localhost activeSessions 8
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -1038,14 +1038,14 @@ UPDATE 3
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -584,14 +584,14 @@ Fixed 5 occurences of: GENEBANKS
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -593,14 +593,14 @@ $ pg_restore -O -U dspacetest -d dspacetest -W -h localhost /tmp/dspace_2018-04-
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -522,14 +522,14 @@ $ psql -h localhost -U postgres dspacetest
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -516,14 +516,14 @@ $ sed '/^id/d' 10568-*.csv | csvcut -c 1,2 > map-to-cifor-archive.csv
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -568,14 +568,14 @@ dspace=# select count(text_value) from metadatavalue where resource_type_id=2 an
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -441,14 +441,14 @@ $ dspace database migrate ignored
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -747,14 +747,14 @@ UPDATE metadatavalue SET text_value='ja' WHERE resource_type_id=2 AND metadata_f
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -655,14 +655,14 @@ $ curl -X GET -H "Content-Type: application/json" -H "Accept: app
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -552,14 +552,14 @@ $ dspace dsrun org.dspace.eperson.Groomer -a -b 11/27/2016 -d
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -593,14 +593,14 @@ UPDATE 1
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -1263,14 +1263,14 @@ identify: CorruptImageProfile `xmp' @ warning/profile.c/SetImageProfileInternal/
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -1343,14 +1343,14 @@ Please see the DSpace documentation for assistance.
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -1207,14 +1207,14 @@ sys 0m2.551s
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -1298,14 +1298,14 @@ UPDATE 14
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -630,14 +630,14 @@ COPY 64871
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -316,14 +316,14 @@ UPDATE 2
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -553,14 +553,14 @@ issn.validate('1020-3362')
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -572,14 +572,14 @@ sys 2m27.496s
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -580,14 +580,14 @@ $ csv-metadata-quality -i /tmp/clarisa-institutions.csv -o /tmp/clarisa-institut
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -384,14 +384,14 @@ $ dspace import -a -c 10568/104057 -e fuu@cgiar.org -m 2019-10-15-Bioversity.map
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -691,14 +691,14 @@ $ tidy -xml -utf8 -iq -m -w 0 dspace/config/controlled-vocabularies/cg-creator-i
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -403,14 +403,14 @@ UPDATE 1
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -603,14 +603,14 @@ COPY 2900
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -1274,14 +1274,14 @@ Moving: 21993 into core statistics-2019
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -483,14 +483,14 @@ $ tidy -xml -utf8 -iq -m -w 0 dspace/config/controlled-vocabularies/cg-creator-i
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -657,14 +657,14 @@ $ psql -c 'select * from pg_stat_activity' | wc -l
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -18,7 +18,7 @@ I see that CGSpace (linode18) is still using PostgreSQL JDBC driver version 42.2
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2020-05/" />
|
||||
<meta property="article:published_time" content="2020-05-02T09:52:04+03:00" />
|
||||
<meta property="article:modified_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="article:modified_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="May, 2020"/>
|
||||
@ -43,7 +43,7 @@ I see that CGSpace (linode18) is still using PostgreSQL JDBC driver version 42.2
|
||||
"url": "https://alanorth.github.io/cgspace-notes/2020-05/",
|
||||
"wordCount": "2154",
|
||||
"datePublished": "2020-05-02T09:52:04+03:00",
|
||||
"dateModified": "2020-05-31T20:49:41+03:00",
|
||||
"dateModified": "2020-06-01T13:55:08+03:00",
|
||||
"author": {
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
@ -476,14 +476,14 @@ Caused by: java.lang.NullPointerException
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -96,14 +96,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Categories"/>
|
||||
@ -121,6 +121,33 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-05/">June, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-05-01T13:55:39+03:00">Fri May 01, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-06-01">2020-06-01</h2>
|
||||
<ul>
|
||||
<li>I tried to run the <code>AtomicStatisticsUpdateCLI</code> CUA migration script on DSpace Test (linode26) again and it is still going very slowly and has tons of errors like I noticed yesterday
|
||||
<ul>
|
||||
<li>I sent Atmire the dspace.log from today and told them to log into the server to debug the process</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>In other news, I checked the statistics API on DSpace 6 and it’s working</li>
|
||||
<li>I tried to build the OAI registry on the freshly migrated DSpace 6 on DSpace Test and I get an error:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-04/">April, 2020</a></h2>
|
||||
@ -357,51 +384,6 @@
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-09/">September, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-09-01T10:17:51+03:00">Sun Sep 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-09-01">2019-09-01</h2>
|
||||
<ul>
|
||||
<li>Linode emailed to say that CGSpace (linode18) had a high rate of outbound traffic for several hours this morning</li>
|
||||
<li>Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning:</li>
|
||||
</ul>
|
||||
<pre><code># zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
440 17.58.101.255
|
||||
441 157.55.39.101
|
||||
485 207.46.13.43
|
||||
728 169.60.128.125
|
||||
730 207.46.13.108
|
||||
758 157.55.39.9
|
||||
808 66.160.140.179
|
||||
814 207.46.13.212
|
||||
2472 163.172.71.23
|
||||
6092 3.94.211.189
|
||||
# zcat --force /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/oai.log /var/log/nginx/oai.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
33 2a01:7e00::f03c:91ff:fe16:fcb
|
||||
57 3.83.192.124
|
||||
57 3.87.77.25
|
||||
57 54.82.1.8
|
||||
822 2a01:9cc0:47:1:1a:4:0:2
|
||||
1223 45.5.184.72
|
||||
1633 172.104.229.92
|
||||
5112 205.186.128.185
|
||||
7249 2a01:7e00::f03c:91ff:fe18:7396
|
||||
9124 45.5.186.2
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
|
||||
@ -428,14 +410,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
@ -106,6 +106,33 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-05/">June, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-05-01T13:55:39+03:00">Fri May 01, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-06-01">2020-06-01</h2>
|
||||
<ul>
|
||||
<li>I tried to run the <code>AtomicStatisticsUpdateCLI</code> CUA migration script on DSpace Test (linode26) again and it is still going very slowly and has tons of errors like I noticed yesterday
|
||||
<ul>
|
||||
<li>I sent Atmire the dspace.log from today and told them to log into the server to debug the process</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>In other news, I checked the statistics API on DSpace 6 and it’s working</li>
|
||||
<li>I tried to build the OAI registry on the freshly migrated DSpace 6 on DSpace Test and I get an error:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-04/">April, 2020</a></h2>
|
||||
@ -342,51 +369,6 @@
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-09/">September, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-09-01T10:17:51+03:00">Sun Sep 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-09-01">2019-09-01</h2>
|
||||
<ul>
|
||||
<li>Linode emailed to say that CGSpace (linode18) had a high rate of outbound traffic for several hours this morning</li>
|
||||
<li>Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning:</li>
|
||||
</ul>
|
||||
<pre><code># zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
440 17.58.101.255
|
||||
441 157.55.39.101
|
||||
485 207.46.13.43
|
||||
728 169.60.128.125
|
||||
730 207.46.13.108
|
||||
758 157.55.39.9
|
||||
808 66.160.140.179
|
||||
814 207.46.13.212
|
||||
2472 163.172.71.23
|
||||
6092 3.94.211.189
|
||||
# zcat --force /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/oai.log /var/log/nginx/oai.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
33 2a01:7e00::f03c:91ff:fe16:fcb
|
||||
57 3.83.192.124
|
||||
57 3.87.77.25
|
||||
57 54.82.1.8
|
||||
822 2a01:9cc0:47:1:1a:4:0:2
|
||||
1223 45.5.184.72
|
||||
1633 172.104.229.92
|
||||
5112 205.186.128.185
|
||||
7249 2a01:7e00::f03c:91ff:fe18:7396
|
||||
9124 45.5.186.2
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
|
||||
@ -413,14 +395,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -28,6 +28,24 @@
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
<title>June, 2020</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2020-05/</link>
|
||||
<pubDate>Fri, 01 May 2020 13:55:39 +0300</pubDate>
|
||||
|
||||
<guid>https://alanorth.github.io/cgspace-notes/2020-05/</guid>
|
||||
<description><h2 id="2020-06-01">2020-06-01</h2>
|
||||
<ul>
|
||||
<li>I tried to run the <code>AtomicStatisticsUpdateCLI</code> CUA migration script on DSpace Test (linode26) again and it is still going very slowly and has tons of errors like I noticed yesterday
|
||||
<ul>
|
||||
<li>I sent Atmire the dspace.log from today and told them to log into the server to debug the process</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>In other news, I checked the statistics API on DSpace 6 and it&rsquo;s working</li>
|
||||
<li>I tried to build the OAI registry on the freshly migrated DSpace 6 on DSpace Test and I get an error:</li>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
<title>April, 2020</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2020-04/</link>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
@ -80,6 +80,51 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-09/">September, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-09-01T10:17:51+03:00">Sun Sep 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-09-01">2019-09-01</h2>
|
||||
<ul>
|
||||
<li>Linode emailed to say that CGSpace (linode18) had a high rate of outbound traffic for several hours this morning</li>
|
||||
<li>Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning:</li>
|
||||
</ul>
|
||||
<pre><code># zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
440 17.58.101.255
|
||||
441 157.55.39.101
|
||||
485 207.46.13.43
|
||||
728 169.60.128.125
|
||||
730 207.46.13.108
|
||||
758 157.55.39.9
|
||||
808 66.160.140.179
|
||||
814 207.46.13.212
|
||||
2472 163.172.71.23
|
||||
6092 3.94.211.189
|
||||
# zcat --force /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/oai.log /var/log/nginx/oai.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
33 2a01:7e00::f03c:91ff:fe16:fcb
|
||||
57 3.83.192.124
|
||||
57 3.87.77.25
|
||||
57 54.82.1.8
|
||||
822 2a01:9cc0:47:1:1a:4:0:2
|
||||
1223 45.5.184.72
|
||||
1633 172.104.229.92
|
||||
5112 205.186.128.185
|
||||
7249 2a01:7e00::f03c:91ff:fe18:7396
|
||||
9124 45.5.186.2
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-08/">August, 2019</a></h2>
|
||||
@ -377,33 +422,6 @@ sys 0m1.979s
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-11/">November, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-11-01T16:41:30+02:00">Thu Nov 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-11-01">2018-11-01</h2>
|
||||
<ul>
|
||||
<li>Finalize AReS Phase I and Phase II ToRs</li>
|
||||
<li>Send a note about my <a href="https://github.com/ilri/dspace-statistics-api">dspace-statistics-api</a> to the dspace-tech mailing list</li>
|
||||
</ul>
|
||||
<h2 id="2018-11-03">2018-11-03</h2>
|
||||
<ul>
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/" rel="prev" role="button">Previous page</a>
|
||||
@ -430,14 +448,14 @@ sys 0m1.979s
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
@ -80,6 +80,33 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-11/">November, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-11-01T16:41:30+02:00">Thu Nov 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-11-01">2018-11-01</h2>
|
||||
<ul>
|
||||
<li>Finalize AReS Phase I and Phase II ToRs</li>
|
||||
<li>Send a note about my <a href="https://github.com/ilri/dspace-statistics-api">dspace-statistics-api</a> to the dspace-tech mailing list</li>
|
||||
</ul>
|
||||
<h2 id="2018-11-03">2018-11-03</h2>
|
||||
<ul>
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-10/">October, 2018</a></h2>
|
||||
@ -317,90 +344,6 @@ sys 2m7.289s
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-01/">January, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-01-02T08:35:54-08:00">Tue Jan 02, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-01-02">2018-01-02</h2>
|
||||
<ul>
|
||||
<li>Uptime Robot noticed that CGSpace went down and up a few times last night, for a few minutes each time</li>
|
||||
<li>I didn’t get any load alerts from Linode and the REST and XMLUI logs don’t show anything out of the ordinary</li>
|
||||
<li>The nginx logs show HTTP 200s until <code>02/Jan/2018:11:27:17 +0000</code> when Uptime Robot got an HTTP 500</li>
|
||||
<li>In dspace.log around that time I see many errors like “Client closed the connection before file download was complete”</li>
|
||||
<li>And just before that I see this:</li>
|
||||
</ul>
|
||||
<pre><code>Caused by: org.apache.tomcat.jdbc.pool.PoolExhaustedException: [http-bio-127.0.0.1-8443-exec-980] Timeout: Pool empty. Unable to fetch a connection in 5 seconds, none available[size:50; busy:50; idle:0; lastwait:5000].
|
||||
</code></pre><ul>
|
||||
<li>Ah hah! So the pool was actually empty!</li>
|
||||
<li>I need to increase that, let’s try to bump it up from 50 to 75</li>
|
||||
<li>After that one client got an HTTP 499 but then the rest were HTTP 200, so I don’t know what the hell Uptime Robot saw</li>
|
||||
<li>I notice this error quite a few times in dspace.log:</li>
|
||||
</ul>
|
||||
<pre><code>2018-01-02 01:21:19,137 ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ Error while searching for sidebar facets
|
||||
org.dspace.discovery.SearchServiceException: org.apache.solr.search.SyntaxError: Cannot parse 'dateIssued_keyword:[1976+TO+1979]': Encountered " "]" "] "" at line 1, column 32.
|
||||
</code></pre><ul>
|
||||
<li>And there are many of these errors every day for the past month:</li>
|
||||
</ul>
|
||||
<pre><code>$ grep -c "Error while searching for sidebar facets" dspace.log.*
|
||||
dspace.log.2017-11-21:4
|
||||
dspace.log.2017-11-22:1
|
||||
dspace.log.2017-11-23:4
|
||||
dspace.log.2017-11-24:11
|
||||
dspace.log.2017-11-25:0
|
||||
dspace.log.2017-11-26:1
|
||||
dspace.log.2017-11-27:7
|
||||
dspace.log.2017-11-28:21
|
||||
dspace.log.2017-11-29:31
|
||||
dspace.log.2017-11-30:15
|
||||
dspace.log.2017-12-01:15
|
||||
dspace.log.2017-12-02:20
|
||||
dspace.log.2017-12-03:38
|
||||
dspace.log.2017-12-04:65
|
||||
dspace.log.2017-12-05:43
|
||||
dspace.log.2017-12-06:72
|
||||
dspace.log.2017-12-07:27
|
||||
dspace.log.2017-12-08:15
|
||||
dspace.log.2017-12-09:29
|
||||
dspace.log.2017-12-10:35
|
||||
dspace.log.2017-12-11:20
|
||||
dspace.log.2017-12-12:44
|
||||
dspace.log.2017-12-13:36
|
||||
dspace.log.2017-12-14:59
|
||||
dspace.log.2017-12-15:104
|
||||
dspace.log.2017-12-16:53
|
||||
dspace.log.2017-12-17:66
|
||||
dspace.log.2017-12-18:83
|
||||
dspace.log.2017-12-19:101
|
||||
dspace.log.2017-12-20:74
|
||||
dspace.log.2017-12-21:55
|
||||
dspace.log.2017-12-22:66
|
||||
dspace.log.2017-12-23:50
|
||||
dspace.log.2017-12-24:85
|
||||
dspace.log.2017-12-25:62
|
||||
dspace.log.2017-12-26:49
|
||||
dspace.log.2017-12-27:30
|
||||
dspace.log.2017-12-28:54
|
||||
dspace.log.2017-12-29:68
|
||||
dspace.log.2017-12-30:89
|
||||
dspace.log.2017-12-31:53
|
||||
dspace.log.2018-01-01:45
|
||||
dspace.log.2018-01-02:34
|
||||
</code></pre><ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/categories/notes/page/2/" rel="prev" role="button">Previous page</a>
|
||||
@ -427,14 +370,14 @@ dspace.log.2018-01-02:34
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Notes"/>
|
||||
@ -80,6 +80,90 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-01/">January, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-01-02T08:35:54-08:00">Tue Jan 02, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-01-02">2018-01-02</h2>
|
||||
<ul>
|
||||
<li>Uptime Robot noticed that CGSpace went down and up a few times last night, for a few minutes each time</li>
|
||||
<li>I didn’t get any load alerts from Linode and the REST and XMLUI logs don’t show anything out of the ordinary</li>
|
||||
<li>The nginx logs show HTTP 200s until <code>02/Jan/2018:11:27:17 +0000</code> when Uptime Robot got an HTTP 500</li>
|
||||
<li>In dspace.log around that time I see many errors like “Client closed the connection before file download was complete”</li>
|
||||
<li>And just before that I see this:</li>
|
||||
</ul>
|
||||
<pre><code>Caused by: org.apache.tomcat.jdbc.pool.PoolExhaustedException: [http-bio-127.0.0.1-8443-exec-980] Timeout: Pool empty. Unable to fetch a connection in 5 seconds, none available[size:50; busy:50; idle:0; lastwait:5000].
|
||||
</code></pre><ul>
|
||||
<li>Ah hah! So the pool was actually empty!</li>
|
||||
<li>I need to increase that, let’s try to bump it up from 50 to 75</li>
|
||||
<li>After that one client got an HTTP 499 but then the rest were HTTP 200, so I don’t know what the hell Uptime Robot saw</li>
|
||||
<li>I notice this error quite a few times in dspace.log:</li>
|
||||
</ul>
|
||||
<pre><code>2018-01-02 01:21:19,137 ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ Error while searching for sidebar facets
|
||||
org.dspace.discovery.SearchServiceException: org.apache.solr.search.SyntaxError: Cannot parse 'dateIssued_keyword:[1976+TO+1979]': Encountered " "]" "] "" at line 1, column 32.
|
||||
</code></pre><ul>
|
||||
<li>And there are many of these errors every day for the past month:</li>
|
||||
</ul>
|
||||
<pre><code>$ grep -c "Error while searching for sidebar facets" dspace.log.*
|
||||
dspace.log.2017-11-21:4
|
||||
dspace.log.2017-11-22:1
|
||||
dspace.log.2017-11-23:4
|
||||
dspace.log.2017-11-24:11
|
||||
dspace.log.2017-11-25:0
|
||||
dspace.log.2017-11-26:1
|
||||
dspace.log.2017-11-27:7
|
||||
dspace.log.2017-11-28:21
|
||||
dspace.log.2017-11-29:31
|
||||
dspace.log.2017-11-30:15
|
||||
dspace.log.2017-12-01:15
|
||||
dspace.log.2017-12-02:20
|
||||
dspace.log.2017-12-03:38
|
||||
dspace.log.2017-12-04:65
|
||||
dspace.log.2017-12-05:43
|
||||
dspace.log.2017-12-06:72
|
||||
dspace.log.2017-12-07:27
|
||||
dspace.log.2017-12-08:15
|
||||
dspace.log.2017-12-09:29
|
||||
dspace.log.2017-12-10:35
|
||||
dspace.log.2017-12-11:20
|
||||
dspace.log.2017-12-12:44
|
||||
dspace.log.2017-12-13:36
|
||||
dspace.log.2017-12-14:59
|
||||
dspace.log.2017-12-15:104
|
||||
dspace.log.2017-12-16:53
|
||||
dspace.log.2017-12-17:66
|
||||
dspace.log.2017-12-18:83
|
||||
dspace.log.2017-12-19:101
|
||||
dspace.log.2017-12-20:74
|
||||
dspace.log.2017-12-21:55
|
||||
dspace.log.2017-12-22:66
|
||||
dspace.log.2017-12-23:50
|
||||
dspace.log.2017-12-24:85
|
||||
dspace.log.2017-12-25:62
|
||||
dspace.log.2017-12-26:49
|
||||
dspace.log.2017-12-27:30
|
||||
dspace.log.2017-12-28:54
|
||||
dspace.log.2017-12-29:68
|
||||
dspace.log.2017-12-30:89
|
||||
dspace.log.2017-12-31:53
|
||||
dspace.log.2018-01-01:45
|
||||
dspace.log.2018-01-02:34
|
||||
</code></pre><ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-12/">December, 2017</a></h2>
|
||||
@ -208,14 +292,14 @@ COPY 54701
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Categories"/>
|
||||
@ -95,6 +95,51 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-09/">September, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-09-01T10:17:51+03:00">Sun Sep 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-09-01">2019-09-01</h2>
|
||||
<ul>
|
||||
<li>Linode emailed to say that CGSpace (linode18) had a high rate of outbound traffic for several hours this morning</li>
|
||||
<li>Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning:</li>
|
||||
</ul>
|
||||
<pre><code># zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
440 17.58.101.255
|
||||
441 157.55.39.101
|
||||
485 207.46.13.43
|
||||
728 169.60.128.125
|
||||
730 207.46.13.108
|
||||
758 157.55.39.9
|
||||
808 66.160.140.179
|
||||
814 207.46.13.212
|
||||
2472 163.172.71.23
|
||||
6092 3.94.211.189
|
||||
# zcat --force /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/oai.log /var/log/nginx/oai.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
33 2a01:7e00::f03c:91ff:fe16:fcb
|
||||
57 3.83.192.124
|
||||
57 3.87.77.25
|
||||
57 54.82.1.8
|
||||
822 2a01:9cc0:47:1:1a:4:0:2
|
||||
1223 45.5.184.72
|
||||
1633 172.104.229.92
|
||||
5112 205.186.128.185
|
||||
7249 2a01:7e00::f03c:91ff:fe18:7396
|
||||
9124 45.5.186.2
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-08/">August, 2019</a></h2>
|
||||
@ -392,33 +437,6 @@ sys 0m1.979s
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-11/">November, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-11-01T16:41:30+02:00">Thu Nov 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-11-01">2018-11-01</h2>
|
||||
<ul>
|
||||
<li>Finalize AReS Phase I and Phase II ToRs</li>
|
||||
<li>Send a note about my <a href="https://github.com/ilri/dspace-statistics-api">dspace-statistics-api</a> to the dspace-tech mailing list</li>
|
||||
</ul>
|
||||
<h2 id="2018-11-03">2018-11-03</h2>
|
||||
<ul>
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/categories/" rel="prev" role="button">Previous page</a>
|
||||
@ -445,14 +463,14 @@ sys 0m1.979s
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Categories"/>
|
||||
@ -95,6 +95,33 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-11/">November, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-11-01T16:41:30+02:00">Thu Nov 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-11-01">2018-11-01</h2>
|
||||
<ul>
|
||||
<li>Finalize AReS Phase I and Phase II ToRs</li>
|
||||
<li>Send a note about my <a href="https://github.com/ilri/dspace-statistics-api">dspace-statistics-api</a> to the dspace-tech mailing list</li>
|
||||
</ul>
|
||||
<h2 id="2018-11-03">2018-11-03</h2>
|
||||
<ul>
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-10/">October, 2018</a></h2>
|
||||
@ -332,90 +359,6 @@ sys 2m7.289s
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-01/">January, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-01-02T08:35:54-08:00">Tue Jan 02, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-01-02">2018-01-02</h2>
|
||||
<ul>
|
||||
<li>Uptime Robot noticed that CGSpace went down and up a few times last night, for a few minutes each time</li>
|
||||
<li>I didn’t get any load alerts from Linode and the REST and XMLUI logs don’t show anything out of the ordinary</li>
|
||||
<li>The nginx logs show HTTP 200s until <code>02/Jan/2018:11:27:17 +0000</code> when Uptime Robot got an HTTP 500</li>
|
||||
<li>In dspace.log around that time I see many errors like “Client closed the connection before file download was complete”</li>
|
||||
<li>And just before that I see this:</li>
|
||||
</ul>
|
||||
<pre><code>Caused by: org.apache.tomcat.jdbc.pool.PoolExhaustedException: [http-bio-127.0.0.1-8443-exec-980] Timeout: Pool empty. Unable to fetch a connection in 5 seconds, none available[size:50; busy:50; idle:0; lastwait:5000].
|
||||
</code></pre><ul>
|
||||
<li>Ah hah! So the pool was actually empty!</li>
|
||||
<li>I need to increase that, let’s try to bump it up from 50 to 75</li>
|
||||
<li>After that one client got an HTTP 499 but then the rest were HTTP 200, so I don’t know what the hell Uptime Robot saw</li>
|
||||
<li>I notice this error quite a few times in dspace.log:</li>
|
||||
</ul>
|
||||
<pre><code>2018-01-02 01:21:19,137 ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ Error while searching for sidebar facets
|
||||
org.dspace.discovery.SearchServiceException: org.apache.solr.search.SyntaxError: Cannot parse 'dateIssued_keyword:[1976+TO+1979]': Encountered " "]" "] "" at line 1, column 32.
|
||||
</code></pre><ul>
|
||||
<li>And there are many of these errors every day for the past month:</li>
|
||||
</ul>
|
||||
<pre><code>$ grep -c "Error while searching for sidebar facets" dspace.log.*
|
||||
dspace.log.2017-11-21:4
|
||||
dspace.log.2017-11-22:1
|
||||
dspace.log.2017-11-23:4
|
||||
dspace.log.2017-11-24:11
|
||||
dspace.log.2017-11-25:0
|
||||
dspace.log.2017-11-26:1
|
||||
dspace.log.2017-11-27:7
|
||||
dspace.log.2017-11-28:21
|
||||
dspace.log.2017-11-29:31
|
||||
dspace.log.2017-11-30:15
|
||||
dspace.log.2017-12-01:15
|
||||
dspace.log.2017-12-02:20
|
||||
dspace.log.2017-12-03:38
|
||||
dspace.log.2017-12-04:65
|
||||
dspace.log.2017-12-05:43
|
||||
dspace.log.2017-12-06:72
|
||||
dspace.log.2017-12-07:27
|
||||
dspace.log.2017-12-08:15
|
||||
dspace.log.2017-12-09:29
|
||||
dspace.log.2017-12-10:35
|
||||
dspace.log.2017-12-11:20
|
||||
dspace.log.2017-12-12:44
|
||||
dspace.log.2017-12-13:36
|
||||
dspace.log.2017-12-14:59
|
||||
dspace.log.2017-12-15:104
|
||||
dspace.log.2017-12-16:53
|
||||
dspace.log.2017-12-17:66
|
||||
dspace.log.2017-12-18:83
|
||||
dspace.log.2017-12-19:101
|
||||
dspace.log.2017-12-20:74
|
||||
dspace.log.2017-12-21:55
|
||||
dspace.log.2017-12-22:66
|
||||
dspace.log.2017-12-23:50
|
||||
dspace.log.2017-12-24:85
|
||||
dspace.log.2017-12-25:62
|
||||
dspace.log.2017-12-26:49
|
||||
dspace.log.2017-12-27:30
|
||||
dspace.log.2017-12-28:54
|
||||
dspace.log.2017-12-29:68
|
||||
dspace.log.2017-12-30:89
|
||||
dspace.log.2017-12-31:53
|
||||
dspace.log.2018-01-01:45
|
||||
dspace.log.2018-01-02:34
|
||||
</code></pre><ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/categories/page/2/" rel="prev" role="button">Previous page</a>
|
||||
@ -442,14 +385,14 @@ dspace.log.2018-01-02:34
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Categories"/>
|
||||
@ -95,6 +95,90 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-01/">January, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-01-02T08:35:54-08:00">Tue Jan 02, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-01-02">2018-01-02</h2>
|
||||
<ul>
|
||||
<li>Uptime Robot noticed that CGSpace went down and up a few times last night, for a few minutes each time</li>
|
||||
<li>I didn’t get any load alerts from Linode and the REST and XMLUI logs don’t show anything out of the ordinary</li>
|
||||
<li>The nginx logs show HTTP 200s until <code>02/Jan/2018:11:27:17 +0000</code> when Uptime Robot got an HTTP 500</li>
|
||||
<li>In dspace.log around that time I see many errors like “Client closed the connection before file download was complete”</li>
|
||||
<li>And just before that I see this:</li>
|
||||
</ul>
|
||||
<pre><code>Caused by: org.apache.tomcat.jdbc.pool.PoolExhaustedException: [http-bio-127.0.0.1-8443-exec-980] Timeout: Pool empty. Unable to fetch a connection in 5 seconds, none available[size:50; busy:50; idle:0; lastwait:5000].
|
||||
</code></pre><ul>
|
||||
<li>Ah hah! So the pool was actually empty!</li>
|
||||
<li>I need to increase that, let’s try to bump it up from 50 to 75</li>
|
||||
<li>After that one client got an HTTP 499 but then the rest were HTTP 200, so I don’t know what the hell Uptime Robot saw</li>
|
||||
<li>I notice this error quite a few times in dspace.log:</li>
|
||||
</ul>
|
||||
<pre><code>2018-01-02 01:21:19,137 ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ Error while searching for sidebar facets
|
||||
org.dspace.discovery.SearchServiceException: org.apache.solr.search.SyntaxError: Cannot parse 'dateIssued_keyword:[1976+TO+1979]': Encountered " "]" "] "" at line 1, column 32.
|
||||
</code></pre><ul>
|
||||
<li>And there are many of these errors every day for the past month:</li>
|
||||
</ul>
|
||||
<pre><code>$ grep -c "Error while searching for sidebar facets" dspace.log.*
|
||||
dspace.log.2017-11-21:4
|
||||
dspace.log.2017-11-22:1
|
||||
dspace.log.2017-11-23:4
|
||||
dspace.log.2017-11-24:11
|
||||
dspace.log.2017-11-25:0
|
||||
dspace.log.2017-11-26:1
|
||||
dspace.log.2017-11-27:7
|
||||
dspace.log.2017-11-28:21
|
||||
dspace.log.2017-11-29:31
|
||||
dspace.log.2017-11-30:15
|
||||
dspace.log.2017-12-01:15
|
||||
dspace.log.2017-12-02:20
|
||||
dspace.log.2017-12-03:38
|
||||
dspace.log.2017-12-04:65
|
||||
dspace.log.2017-12-05:43
|
||||
dspace.log.2017-12-06:72
|
||||
dspace.log.2017-12-07:27
|
||||
dspace.log.2017-12-08:15
|
||||
dspace.log.2017-12-09:29
|
||||
dspace.log.2017-12-10:35
|
||||
dspace.log.2017-12-11:20
|
||||
dspace.log.2017-12-12:44
|
||||
dspace.log.2017-12-13:36
|
||||
dspace.log.2017-12-14:59
|
||||
dspace.log.2017-12-15:104
|
||||
dspace.log.2017-12-16:53
|
||||
dspace.log.2017-12-17:66
|
||||
dspace.log.2017-12-18:83
|
||||
dspace.log.2017-12-19:101
|
||||
dspace.log.2017-12-20:74
|
||||
dspace.log.2017-12-21:55
|
||||
dspace.log.2017-12-22:66
|
||||
dspace.log.2017-12-23:50
|
||||
dspace.log.2017-12-24:85
|
||||
dspace.log.2017-12-25:62
|
||||
dspace.log.2017-12-26:49
|
||||
dspace.log.2017-12-27:30
|
||||
dspace.log.2017-12-28:54
|
||||
dspace.log.2017-12-29:68
|
||||
dspace.log.2017-12-30:89
|
||||
dspace.log.2017-12-31:53
|
||||
dspace.log.2018-01-01:45
|
||||
dspace.log.2018-01-02:34
|
||||
</code></pre><ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-12/">December, 2017</a></h2>
|
||||
@ -324,35 +408,6 @@ COPY 54701
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-04/">April, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-04-02T17:08:52+02:00">Sun Apr 02, 2017</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-04-02">2017-04-02</h2>
|
||||
<ul>
|
||||
<li>Merge one change to CCAFS flagships that I had forgotten to remove last month (“MANAGING CLIMATE RISK”): <a href="https://github.com/ilri/DSpace/pull/317">https://github.com/ilri/DSpace/pull/317</a></li>
|
||||
<li>Quick proof-of-concept hack to add <code>dc.rights</code> to the input form, including some inline instructions/hints:</li>
|
||||
</ul>
|
||||
<p><img src="/cgspace-notes/2017/04/dc-rights.png" alt="dc.rights in the submission form"></p>
|
||||
<ul>
|
||||
<li>Remove redundant/duplicate text in the DSpace submission license</li>
|
||||
<li>Testing the CMYK patch on a collection with 650 items:</li>
|
||||
</ul>
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/categories/page/3/" rel="prev" role="button">Previous page</a>
|
||||
@ -379,14 +434,14 @@ COPY 54701
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Categories"/>
|
||||
@ -95,6 +95,35 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-04/">April, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-04-02T17:08:52+02:00">Sun Apr 02, 2017</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-04-02">2017-04-02</h2>
|
||||
<ul>
|
||||
<li>Merge one change to CCAFS flagships that I had forgotten to remove last month (“MANAGING CLIMATE RISK”): <a href="https://github.com/ilri/DSpace/pull/317">https://github.com/ilri/DSpace/pull/317</a></li>
|
||||
<li>Quick proof-of-concept hack to add <code>dc.rights</code> to the input form, including some inline instructions/hints:</li>
|
||||
</ul>
|
||||
<p><img src="/cgspace-notes/2017/04/dc-rights.png" alt="dc.rights in the submission form"></p>
|
||||
<ul>
|
||||
<li>Remove redundant/duplicate text in the DSpace submission license</li>
|
||||
<li>Testing the CMYK patch on a collection with 650 items:</li>
|
||||
</ul>
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-03/">March, 2017</a></h2>
|
||||
@ -358,32 +387,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-06/">June, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-06-01T10:53:00+03:00">Wed Jun 01, 2016</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-06-01">2016-06-01</h2>
|
||||
<ul>
|
||||
<li>Experimenting with IFPRI OAI (we want to harvest their publications)</li>
|
||||
<li>After reading the <a href="https://www.oclc.org/support/services/contentdm/help/server-admin-help/oai-support.en.html">ContentDM documentation</a> I found IFPRI’s OAI endpoint: <a href="http://ebrary.ifpri.org/oai/oai.php">http://ebrary.ifpri.org/oai/oai.php</a></li>
|
||||
<li>After reading the <a href="https://www.openarchives.org/OAI/openarchivesprotocol.html">OAI documentation</a> and testing with an <a href="http://validator.oaipmh.com/">OAI validator</a> I found out how to get their publications</li>
|
||||
<li>This is their publications set: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc">http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc</a></li>
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/categories/page/4/" rel="prev" role="button">Previous page</a>
|
||||
@ -410,14 +413,14 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Categories"/>
|
||||
@ -95,6 +95,32 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-06/">June, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-06-01T10:53:00+03:00">Wed Jun 01, 2016</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-06-01">2016-06-01</h2>
|
||||
<ul>
|
||||
<li>Experimenting with IFPRI OAI (we want to harvest their publications)</li>
|
||||
<li>After reading the <a href="https://www.oclc.org/support/services/contentdm/help/server-admin-help/oai-support.en.html">ContentDM documentation</a> I found IFPRI’s OAI endpoint: <a href="http://ebrary.ifpri.org/oai/oai.php">http://ebrary.ifpri.org/oai/oai.php</a></li>
|
||||
<li>After reading the <a href="https://www.openarchives.org/OAI/openarchivesprotocol.html">OAI documentation</a> and testing with an <a href="http://validator.oaipmh.com/">OAI validator</a> I found out how to get their publications</li>
|
||||
<li>This is their publications set: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc">http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc</a></li>
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-05/">May, 2016</a></h2>
|
||||
@ -298,14 +324,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -281,14 +281,14 @@ dspace=# select setval('handle_seq',86873);
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -453,14 +453,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
@ -121,6 +121,33 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-05/">June, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-05-01T13:55:39+03:00">Fri May 01, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-06-01">2020-06-01</h2>
|
||||
<ul>
|
||||
<li>I tried to run the <code>AtomicStatisticsUpdateCLI</code> CUA migration script on DSpace Test (linode26) again and it is still going very slowly and has tons of errors like I noticed yesterday
|
||||
<ul>
|
||||
<li>I sent Atmire the dspace.log from today and told them to log into the server to debug the process</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>In other news, I checked the statistics API on DSpace 6 and it’s working</li>
|
||||
<li>I tried to build the OAI registry on the freshly migrated DSpace 6 on DSpace Test and I get an error:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-04/">April, 2020</a></h2>
|
||||
@ -357,51 +384,6 @@
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-09/">September, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-09-01T10:17:51+03:00">Sun Sep 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-09-01">2019-09-01</h2>
|
||||
<ul>
|
||||
<li>Linode emailed to say that CGSpace (linode18) had a high rate of outbound traffic for several hours this morning</li>
|
||||
<li>Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning:</li>
|
||||
</ul>
|
||||
<pre><code># zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
440 17.58.101.255
|
||||
441 157.55.39.101
|
||||
485 207.46.13.43
|
||||
728 169.60.128.125
|
||||
730 207.46.13.108
|
||||
758 157.55.39.9
|
||||
808 66.160.140.179
|
||||
814 207.46.13.212
|
||||
2472 163.172.71.23
|
||||
6092 3.94.211.189
|
||||
# zcat --force /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/oai.log /var/log/nginx/oai.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
33 2a01:7e00::f03c:91ff:fe16:fcb
|
||||
57 3.83.192.124
|
||||
57 3.87.77.25
|
||||
57 54.82.1.8
|
||||
822 2a01:9cc0:47:1:1a:4:0:2
|
||||
1223 45.5.184.72
|
||||
1633 172.104.229.92
|
||||
5112 205.186.128.185
|
||||
7249 2a01:7e00::f03c:91ff:fe18:7396
|
||||
9124 45.5.186.2
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
|
||||
@ -428,14 +410,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -28,6 +28,24 @@
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
<title>June, 2020</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2020-05/</link>
|
||||
<pubDate>Fri, 01 May 2020 13:55:39 +0300</pubDate>
|
||||
|
||||
<guid>https://alanorth.github.io/cgspace-notes/2020-05/</guid>
|
||||
<description><h2 id="2020-06-01">2020-06-01</h2>
|
||||
<ul>
|
||||
<li>I tried to run the <code>AtomicStatisticsUpdateCLI</code> CUA migration script on DSpace Test (linode26) again and it is still going very slowly and has tons of errors like I noticed yesterday
|
||||
<ul>
|
||||
<li>I sent Atmire the dspace.log from today and told them to log into the server to debug the process</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>In other news, I checked the statistics API on DSpace 6 and it&rsquo;s working</li>
|
||||
<li>I tried to build the OAI registry on the freshly migrated DSpace 6 on DSpace Test and I get an error:</li>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
<title>April, 2020</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2020-04/</link>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
@ -95,6 +95,51 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-09/">September, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-09-01T10:17:51+03:00">Sun Sep 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-09-01">2019-09-01</h2>
|
||||
<ul>
|
||||
<li>Linode emailed to say that CGSpace (linode18) had a high rate of outbound traffic for several hours this morning</li>
|
||||
<li>Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning:</li>
|
||||
</ul>
|
||||
<pre><code># zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
440 17.58.101.255
|
||||
441 157.55.39.101
|
||||
485 207.46.13.43
|
||||
728 169.60.128.125
|
||||
730 207.46.13.108
|
||||
758 157.55.39.9
|
||||
808 66.160.140.179
|
||||
814 207.46.13.212
|
||||
2472 163.172.71.23
|
||||
6092 3.94.211.189
|
||||
# zcat --force /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/oai.log /var/log/nginx/oai.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
33 2a01:7e00::f03c:91ff:fe16:fcb
|
||||
57 3.83.192.124
|
||||
57 3.87.77.25
|
||||
57 54.82.1.8
|
||||
822 2a01:9cc0:47:1:1a:4:0:2
|
||||
1223 45.5.184.72
|
||||
1633 172.104.229.92
|
||||
5112 205.186.128.185
|
||||
7249 2a01:7e00::f03c:91ff:fe18:7396
|
||||
9124 45.5.186.2
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-08/">August, 2019</a></h2>
|
||||
@ -392,33 +437,6 @@ sys 0m1.979s
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-11/">November, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-11-01T16:41:30+02:00">Thu Nov 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-11-01">2018-11-01</h2>
|
||||
<ul>
|
||||
<li>Finalize AReS Phase I and Phase II ToRs</li>
|
||||
<li>Send a note about my <a href="https://github.com/ilri/dspace-statistics-api">dspace-statistics-api</a> to the dspace-tech mailing list</li>
|
||||
</ul>
|
||||
<h2 id="2018-11-03">2018-11-03</h2>
|
||||
<ul>
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/" rel="prev" role="button">Previous page</a>
|
||||
@ -445,14 +463,14 @@ sys 0m1.979s
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
@ -95,6 +95,33 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-11/">November, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-11-01T16:41:30+02:00">Thu Nov 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-11-01">2018-11-01</h2>
|
||||
<ul>
|
||||
<li>Finalize AReS Phase I and Phase II ToRs</li>
|
||||
<li>Send a note about my <a href="https://github.com/ilri/dspace-statistics-api">dspace-statistics-api</a> to the dspace-tech mailing list</li>
|
||||
</ul>
|
||||
<h2 id="2018-11-03">2018-11-03</h2>
|
||||
<ul>
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-10/">October, 2018</a></h2>
|
||||
@ -332,90 +359,6 @@ sys 2m7.289s
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-01/">January, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-01-02T08:35:54-08:00">Tue Jan 02, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-01-02">2018-01-02</h2>
|
||||
<ul>
|
||||
<li>Uptime Robot noticed that CGSpace went down and up a few times last night, for a few minutes each time</li>
|
||||
<li>I didn’t get any load alerts from Linode and the REST and XMLUI logs don’t show anything out of the ordinary</li>
|
||||
<li>The nginx logs show HTTP 200s until <code>02/Jan/2018:11:27:17 +0000</code> when Uptime Robot got an HTTP 500</li>
|
||||
<li>In dspace.log around that time I see many errors like “Client closed the connection before file download was complete”</li>
|
||||
<li>And just before that I see this:</li>
|
||||
</ul>
|
||||
<pre><code>Caused by: org.apache.tomcat.jdbc.pool.PoolExhaustedException: [http-bio-127.0.0.1-8443-exec-980] Timeout: Pool empty. Unable to fetch a connection in 5 seconds, none available[size:50; busy:50; idle:0; lastwait:5000].
|
||||
</code></pre><ul>
|
||||
<li>Ah hah! So the pool was actually empty!</li>
|
||||
<li>I need to increase that, let’s try to bump it up from 50 to 75</li>
|
||||
<li>After that one client got an HTTP 499 but then the rest were HTTP 200, so I don’t know what the hell Uptime Robot saw</li>
|
||||
<li>I notice this error quite a few times in dspace.log:</li>
|
||||
</ul>
|
||||
<pre><code>2018-01-02 01:21:19,137 ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ Error while searching for sidebar facets
|
||||
org.dspace.discovery.SearchServiceException: org.apache.solr.search.SyntaxError: Cannot parse 'dateIssued_keyword:[1976+TO+1979]': Encountered " "]" "] "" at line 1, column 32.
|
||||
</code></pre><ul>
|
||||
<li>And there are many of these errors every day for the past month:</li>
|
||||
</ul>
|
||||
<pre><code>$ grep -c "Error while searching for sidebar facets" dspace.log.*
|
||||
dspace.log.2017-11-21:4
|
||||
dspace.log.2017-11-22:1
|
||||
dspace.log.2017-11-23:4
|
||||
dspace.log.2017-11-24:11
|
||||
dspace.log.2017-11-25:0
|
||||
dspace.log.2017-11-26:1
|
||||
dspace.log.2017-11-27:7
|
||||
dspace.log.2017-11-28:21
|
||||
dspace.log.2017-11-29:31
|
||||
dspace.log.2017-11-30:15
|
||||
dspace.log.2017-12-01:15
|
||||
dspace.log.2017-12-02:20
|
||||
dspace.log.2017-12-03:38
|
||||
dspace.log.2017-12-04:65
|
||||
dspace.log.2017-12-05:43
|
||||
dspace.log.2017-12-06:72
|
||||
dspace.log.2017-12-07:27
|
||||
dspace.log.2017-12-08:15
|
||||
dspace.log.2017-12-09:29
|
||||
dspace.log.2017-12-10:35
|
||||
dspace.log.2017-12-11:20
|
||||
dspace.log.2017-12-12:44
|
||||
dspace.log.2017-12-13:36
|
||||
dspace.log.2017-12-14:59
|
||||
dspace.log.2017-12-15:104
|
||||
dspace.log.2017-12-16:53
|
||||
dspace.log.2017-12-17:66
|
||||
dspace.log.2017-12-18:83
|
||||
dspace.log.2017-12-19:101
|
||||
dspace.log.2017-12-20:74
|
||||
dspace.log.2017-12-21:55
|
||||
dspace.log.2017-12-22:66
|
||||
dspace.log.2017-12-23:50
|
||||
dspace.log.2017-12-24:85
|
||||
dspace.log.2017-12-25:62
|
||||
dspace.log.2017-12-26:49
|
||||
dspace.log.2017-12-27:30
|
||||
dspace.log.2017-12-28:54
|
||||
dspace.log.2017-12-29:68
|
||||
dspace.log.2017-12-30:89
|
||||
dspace.log.2017-12-31:53
|
||||
dspace.log.2018-01-01:45
|
||||
dspace.log.2018-01-02:34
|
||||
</code></pre><ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/page/2/" rel="prev" role="button">Previous page</a>
|
||||
@ -442,14 +385,14 @@ dspace.log.2018-01-02:34
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
@ -95,6 +95,90 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-01/">January, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-01-02T08:35:54-08:00">Tue Jan 02, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-01-02">2018-01-02</h2>
|
||||
<ul>
|
||||
<li>Uptime Robot noticed that CGSpace went down and up a few times last night, for a few minutes each time</li>
|
||||
<li>I didn’t get any load alerts from Linode and the REST and XMLUI logs don’t show anything out of the ordinary</li>
|
||||
<li>The nginx logs show HTTP 200s until <code>02/Jan/2018:11:27:17 +0000</code> when Uptime Robot got an HTTP 500</li>
|
||||
<li>In dspace.log around that time I see many errors like “Client closed the connection before file download was complete”</li>
|
||||
<li>And just before that I see this:</li>
|
||||
</ul>
|
||||
<pre><code>Caused by: org.apache.tomcat.jdbc.pool.PoolExhaustedException: [http-bio-127.0.0.1-8443-exec-980] Timeout: Pool empty. Unable to fetch a connection in 5 seconds, none available[size:50; busy:50; idle:0; lastwait:5000].
|
||||
</code></pre><ul>
|
||||
<li>Ah hah! So the pool was actually empty!</li>
|
||||
<li>I need to increase that, let’s try to bump it up from 50 to 75</li>
|
||||
<li>After that one client got an HTTP 499 but then the rest were HTTP 200, so I don’t know what the hell Uptime Robot saw</li>
|
||||
<li>I notice this error quite a few times in dspace.log:</li>
|
||||
</ul>
|
||||
<pre><code>2018-01-02 01:21:19,137 ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ Error while searching for sidebar facets
|
||||
org.dspace.discovery.SearchServiceException: org.apache.solr.search.SyntaxError: Cannot parse 'dateIssued_keyword:[1976+TO+1979]': Encountered " "]" "] "" at line 1, column 32.
|
||||
</code></pre><ul>
|
||||
<li>And there are many of these errors every day for the past month:</li>
|
||||
</ul>
|
||||
<pre><code>$ grep -c "Error while searching for sidebar facets" dspace.log.*
|
||||
dspace.log.2017-11-21:4
|
||||
dspace.log.2017-11-22:1
|
||||
dspace.log.2017-11-23:4
|
||||
dspace.log.2017-11-24:11
|
||||
dspace.log.2017-11-25:0
|
||||
dspace.log.2017-11-26:1
|
||||
dspace.log.2017-11-27:7
|
||||
dspace.log.2017-11-28:21
|
||||
dspace.log.2017-11-29:31
|
||||
dspace.log.2017-11-30:15
|
||||
dspace.log.2017-12-01:15
|
||||
dspace.log.2017-12-02:20
|
||||
dspace.log.2017-12-03:38
|
||||
dspace.log.2017-12-04:65
|
||||
dspace.log.2017-12-05:43
|
||||
dspace.log.2017-12-06:72
|
||||
dspace.log.2017-12-07:27
|
||||
dspace.log.2017-12-08:15
|
||||
dspace.log.2017-12-09:29
|
||||
dspace.log.2017-12-10:35
|
||||
dspace.log.2017-12-11:20
|
||||
dspace.log.2017-12-12:44
|
||||
dspace.log.2017-12-13:36
|
||||
dspace.log.2017-12-14:59
|
||||
dspace.log.2017-12-15:104
|
||||
dspace.log.2017-12-16:53
|
||||
dspace.log.2017-12-17:66
|
||||
dspace.log.2017-12-18:83
|
||||
dspace.log.2017-12-19:101
|
||||
dspace.log.2017-12-20:74
|
||||
dspace.log.2017-12-21:55
|
||||
dspace.log.2017-12-22:66
|
||||
dspace.log.2017-12-23:50
|
||||
dspace.log.2017-12-24:85
|
||||
dspace.log.2017-12-25:62
|
||||
dspace.log.2017-12-26:49
|
||||
dspace.log.2017-12-27:30
|
||||
dspace.log.2017-12-28:54
|
||||
dspace.log.2017-12-29:68
|
||||
dspace.log.2017-12-30:89
|
||||
dspace.log.2017-12-31:53
|
||||
dspace.log.2018-01-01:45
|
||||
dspace.log.2018-01-02:34
|
||||
</code></pre><ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-12/">December, 2017</a></h2>
|
||||
@ -324,35 +408,6 @@ COPY 54701
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-04/">April, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-04-02T17:08:52+02:00">Sun Apr 02, 2017</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-04-02">2017-04-02</h2>
|
||||
<ul>
|
||||
<li>Merge one change to CCAFS flagships that I had forgotten to remove last month (“MANAGING CLIMATE RISK”): <a href="https://github.com/ilri/DSpace/pull/317">https://github.com/ilri/DSpace/pull/317</a></li>
|
||||
<li>Quick proof-of-concept hack to add <code>dc.rights</code> to the input form, including some inline instructions/hints:</li>
|
||||
</ul>
|
||||
<p><img src="/cgspace-notes/2017/04/dc-rights.png" alt="dc.rights in the submission form"></p>
|
||||
<ul>
|
||||
<li>Remove redundant/duplicate text in the DSpace submission license</li>
|
||||
<li>Testing the CMYK patch on a collection with 650 items:</li>
|
||||
</ul>
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/page/3/" rel="prev" role="button">Previous page</a>
|
||||
@ -379,14 +434,14 @@ COPY 54701
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
@ -95,6 +95,35 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-04/">April, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-04-02T17:08:52+02:00">Sun Apr 02, 2017</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-04-02">2017-04-02</h2>
|
||||
<ul>
|
||||
<li>Merge one change to CCAFS flagships that I had forgotten to remove last month (“MANAGING CLIMATE RISK”): <a href="https://github.com/ilri/DSpace/pull/317">https://github.com/ilri/DSpace/pull/317</a></li>
|
||||
<li>Quick proof-of-concept hack to add <code>dc.rights</code> to the input form, including some inline instructions/hints:</li>
|
||||
</ul>
|
||||
<p><img src="/cgspace-notes/2017/04/dc-rights.png" alt="dc.rights in the submission form"></p>
|
||||
<ul>
|
||||
<li>Remove redundant/duplicate text in the DSpace submission license</li>
|
||||
<li>Testing the CMYK patch on a collection with 650 items:</li>
|
||||
</ul>
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-03/">March, 2017</a></h2>
|
||||
@ -358,32 +387,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-06/">June, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-06-01T10:53:00+03:00">Wed Jun 01, 2016</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-06-01">2016-06-01</h2>
|
||||
<ul>
|
||||
<li>Experimenting with IFPRI OAI (we want to harvest their publications)</li>
|
||||
<li>After reading the <a href="https://www.oclc.org/support/services/contentdm/help/server-admin-help/oai-support.en.html">ContentDM documentation</a> I found IFPRI’s OAI endpoint: <a href="http://ebrary.ifpri.org/oai/oai.php">http://ebrary.ifpri.org/oai/oai.php</a></li>
|
||||
<li>After reading the <a href="https://www.openarchives.org/OAI/openarchivesprotocol.html">OAI documentation</a> and testing with an <a href="http://validator.oaipmh.com/">OAI validator</a> I found out how to get their publications</li>
|
||||
<li>This is their publications set: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc">http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc</a></li>
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/page/4/" rel="prev" role="button">Previous page</a>
|
||||
@ -410,14 +413,14 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="CGSpace Notes"/>
|
||||
@ -95,6 +95,32 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-06/">June, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-06-01T10:53:00+03:00">Wed Jun 01, 2016</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-06-01">2016-06-01</h2>
|
||||
<ul>
|
||||
<li>Experimenting with IFPRI OAI (we want to harvest their publications)</li>
|
||||
<li>After reading the <a href="https://www.oclc.org/support/services/contentdm/help/server-admin-help/oai-support.en.html">ContentDM documentation</a> I found IFPRI’s OAI endpoint: <a href="http://ebrary.ifpri.org/oai/oai.php">http://ebrary.ifpri.org/oai/oai.php</a></li>
|
||||
<li>After reading the <a href="https://www.openarchives.org/OAI/openarchivesprotocol.html">OAI documentation</a> and testing with an <a href="http://validator.oaipmh.com/">OAI validator</a> I found out how to get their publications</li>
|
||||
<li>This is their publications set: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc">http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc</a></li>
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-05/">May, 2016</a></h2>
|
||||
@ -298,14 +324,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
@ -121,6 +121,33 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-05/">June, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-05-01T13:55:39+03:00">Fri May 01, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-06-01">2020-06-01</h2>
|
||||
<ul>
|
||||
<li>I tried to run the <code>AtomicStatisticsUpdateCLI</code> CUA migration script on DSpace Test (linode26) again and it is still going very slowly and has tons of errors like I noticed yesterday
|
||||
<ul>
|
||||
<li>I sent Atmire the dspace.log from today and told them to log into the server to debug the process</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>In other news, I checked the statistics API on DSpace 6 and it’s working</li>
|
||||
<li>I tried to build the OAI registry on the freshly migrated DSpace 6 on DSpace Test and I get an error:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-04/">April, 2020</a></h2>
|
||||
@ -357,51 +384,6 @@
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-09/">September, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-09-01T10:17:51+03:00">Sun Sep 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-09-01">2019-09-01</h2>
|
||||
<ul>
|
||||
<li>Linode emailed to say that CGSpace (linode18) had a high rate of outbound traffic for several hours this morning</li>
|
||||
<li>Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning:</li>
|
||||
</ul>
|
||||
<pre><code># zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
440 17.58.101.255
|
||||
441 157.55.39.101
|
||||
485 207.46.13.43
|
||||
728 169.60.128.125
|
||||
730 207.46.13.108
|
||||
758 157.55.39.9
|
||||
808 66.160.140.179
|
||||
814 207.46.13.212
|
||||
2472 163.172.71.23
|
||||
6092 3.94.211.189
|
||||
# zcat --force /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/oai.log /var/log/nginx/oai.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
33 2a01:7e00::f03c:91ff:fe16:fcb
|
||||
57 3.83.192.124
|
||||
57 3.87.77.25
|
||||
57 54.82.1.8
|
||||
822 2a01:9cc0:47:1:1a:4:0:2
|
||||
1223 45.5.184.72
|
||||
1633 172.104.229.92
|
||||
5112 205.186.128.185
|
||||
7249 2a01:7e00::f03c:91ff:fe18:7396
|
||||
9124 45.5.186.2
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
|
||||
@ -428,14 +410,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -28,6 +28,24 @@
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
<title>June, 2020</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2020-05/</link>
|
||||
<pubDate>Fri, 01 May 2020 13:55:39 +0300</pubDate>
|
||||
|
||||
<guid>https://alanorth.github.io/cgspace-notes/2020-05/</guid>
|
||||
<description><h2 id="2020-06-01">2020-06-01</h2>
|
||||
<ul>
|
||||
<li>I tried to run the <code>AtomicStatisticsUpdateCLI</code> CUA migration script on DSpace Test (linode26) again and it is still going very slowly and has tons of errors like I noticed yesterday
|
||||
<ul>
|
||||
<li>I sent Atmire the dspace.log from today and told them to log into the server to debug the process</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>In other news, I checked the statistics API on DSpace 6 and it&rsquo;s working</li>
|
||||
<li>I tried to build the OAI registry on the freshly migrated DSpace 6 on DSpace Test and I get an error:</li>
|
||||
</ul></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
<title>April, 2020</title>
|
||||
<link>https://alanorth.github.io/cgspace-notes/2020-04/</link>
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
@ -95,6 +95,51 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-09/">September, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-09-01T10:17:51+03:00">Sun Sep 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-09-01">2019-09-01</h2>
|
||||
<ul>
|
||||
<li>Linode emailed to say that CGSpace (linode18) had a high rate of outbound traffic for several hours this morning</li>
|
||||
<li>Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning:</li>
|
||||
</ul>
|
||||
<pre><code># zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
440 17.58.101.255
|
||||
441 157.55.39.101
|
||||
485 207.46.13.43
|
||||
728 169.60.128.125
|
||||
730 207.46.13.108
|
||||
758 157.55.39.9
|
||||
808 66.160.140.179
|
||||
814 207.46.13.212
|
||||
2472 163.172.71.23
|
||||
6092 3.94.211.189
|
||||
# zcat --force /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/oai.log /var/log/nginx/oai.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
33 2a01:7e00::f03c:91ff:fe16:fcb
|
||||
57 3.83.192.124
|
||||
57 3.87.77.25
|
||||
57 54.82.1.8
|
||||
822 2a01:9cc0:47:1:1a:4:0:2
|
||||
1223 45.5.184.72
|
||||
1633 172.104.229.92
|
||||
5112 205.186.128.185
|
||||
7249 2a01:7e00::f03c:91ff:fe18:7396
|
||||
9124 45.5.186.2
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-08/">August, 2019</a></h2>
|
||||
@ -392,33 +437,6 @@ sys 0m1.979s
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-11/">November, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-11-01T16:41:30+02:00">Thu Nov 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-11-01">2018-11-01</h2>
|
||||
<ul>
|
||||
<li>Finalize AReS Phase I and Phase II ToRs</li>
|
||||
<li>Send a note about my <a href="https://github.com/ilri/dspace-statistics-api">dspace-statistics-api</a> to the dspace-tech mailing list</li>
|
||||
</ul>
|
||||
<h2 id="2018-11-03">2018-11-03</h2>
|
||||
<ul>
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/posts/" rel="prev" role="button">Previous page</a>
|
||||
@ -445,14 +463,14 @@ sys 0m1.979s
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
@ -95,6 +95,33 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-11/">November, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-11-01T16:41:30+02:00">Thu Nov 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-11-01">2018-11-01</h2>
|
||||
<ul>
|
||||
<li>Finalize AReS Phase I and Phase II ToRs</li>
|
||||
<li>Send a note about my <a href="https://github.com/ilri/dspace-statistics-api">dspace-statistics-api</a> to the dspace-tech mailing list</li>
|
||||
</ul>
|
||||
<h2 id="2018-11-03">2018-11-03</h2>
|
||||
<ul>
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-10/">October, 2018</a></h2>
|
||||
@ -332,90 +359,6 @@ sys 2m7.289s
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-01/">January, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-01-02T08:35:54-08:00">Tue Jan 02, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-01-02">2018-01-02</h2>
|
||||
<ul>
|
||||
<li>Uptime Robot noticed that CGSpace went down and up a few times last night, for a few minutes each time</li>
|
||||
<li>I didn’t get any load alerts from Linode and the REST and XMLUI logs don’t show anything out of the ordinary</li>
|
||||
<li>The nginx logs show HTTP 200s until <code>02/Jan/2018:11:27:17 +0000</code> when Uptime Robot got an HTTP 500</li>
|
||||
<li>In dspace.log around that time I see many errors like “Client closed the connection before file download was complete”</li>
|
||||
<li>And just before that I see this:</li>
|
||||
</ul>
|
||||
<pre><code>Caused by: org.apache.tomcat.jdbc.pool.PoolExhaustedException: [http-bio-127.0.0.1-8443-exec-980] Timeout: Pool empty. Unable to fetch a connection in 5 seconds, none available[size:50; busy:50; idle:0; lastwait:5000].
|
||||
</code></pre><ul>
|
||||
<li>Ah hah! So the pool was actually empty!</li>
|
||||
<li>I need to increase that, let’s try to bump it up from 50 to 75</li>
|
||||
<li>After that one client got an HTTP 499 but then the rest were HTTP 200, so I don’t know what the hell Uptime Robot saw</li>
|
||||
<li>I notice this error quite a few times in dspace.log:</li>
|
||||
</ul>
|
||||
<pre><code>2018-01-02 01:21:19,137 ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ Error while searching for sidebar facets
|
||||
org.dspace.discovery.SearchServiceException: org.apache.solr.search.SyntaxError: Cannot parse 'dateIssued_keyword:[1976+TO+1979]': Encountered " "]" "] "" at line 1, column 32.
|
||||
</code></pre><ul>
|
||||
<li>And there are many of these errors every day for the past month:</li>
|
||||
</ul>
|
||||
<pre><code>$ grep -c "Error while searching for sidebar facets" dspace.log.*
|
||||
dspace.log.2017-11-21:4
|
||||
dspace.log.2017-11-22:1
|
||||
dspace.log.2017-11-23:4
|
||||
dspace.log.2017-11-24:11
|
||||
dspace.log.2017-11-25:0
|
||||
dspace.log.2017-11-26:1
|
||||
dspace.log.2017-11-27:7
|
||||
dspace.log.2017-11-28:21
|
||||
dspace.log.2017-11-29:31
|
||||
dspace.log.2017-11-30:15
|
||||
dspace.log.2017-12-01:15
|
||||
dspace.log.2017-12-02:20
|
||||
dspace.log.2017-12-03:38
|
||||
dspace.log.2017-12-04:65
|
||||
dspace.log.2017-12-05:43
|
||||
dspace.log.2017-12-06:72
|
||||
dspace.log.2017-12-07:27
|
||||
dspace.log.2017-12-08:15
|
||||
dspace.log.2017-12-09:29
|
||||
dspace.log.2017-12-10:35
|
||||
dspace.log.2017-12-11:20
|
||||
dspace.log.2017-12-12:44
|
||||
dspace.log.2017-12-13:36
|
||||
dspace.log.2017-12-14:59
|
||||
dspace.log.2017-12-15:104
|
||||
dspace.log.2017-12-16:53
|
||||
dspace.log.2017-12-17:66
|
||||
dspace.log.2017-12-18:83
|
||||
dspace.log.2017-12-19:101
|
||||
dspace.log.2017-12-20:74
|
||||
dspace.log.2017-12-21:55
|
||||
dspace.log.2017-12-22:66
|
||||
dspace.log.2017-12-23:50
|
||||
dspace.log.2017-12-24:85
|
||||
dspace.log.2017-12-25:62
|
||||
dspace.log.2017-12-26:49
|
||||
dspace.log.2017-12-27:30
|
||||
dspace.log.2017-12-28:54
|
||||
dspace.log.2017-12-29:68
|
||||
dspace.log.2017-12-30:89
|
||||
dspace.log.2017-12-31:53
|
||||
dspace.log.2018-01-01:45
|
||||
dspace.log.2018-01-02:34
|
||||
</code></pre><ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/posts/page/2/" rel="prev" role="button">Previous page</a>
|
||||
@ -442,14 +385,14 @@ dspace.log.2018-01-02:34
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
@ -95,6 +95,90 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-01/">January, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-01-02T08:35:54-08:00">Tue Jan 02, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-01-02">2018-01-02</h2>
|
||||
<ul>
|
||||
<li>Uptime Robot noticed that CGSpace went down and up a few times last night, for a few minutes each time</li>
|
||||
<li>I didn’t get any load alerts from Linode and the REST and XMLUI logs don’t show anything out of the ordinary</li>
|
||||
<li>The nginx logs show HTTP 200s until <code>02/Jan/2018:11:27:17 +0000</code> when Uptime Robot got an HTTP 500</li>
|
||||
<li>In dspace.log around that time I see many errors like “Client closed the connection before file download was complete”</li>
|
||||
<li>And just before that I see this:</li>
|
||||
</ul>
|
||||
<pre><code>Caused by: org.apache.tomcat.jdbc.pool.PoolExhaustedException: [http-bio-127.0.0.1-8443-exec-980] Timeout: Pool empty. Unable to fetch a connection in 5 seconds, none available[size:50; busy:50; idle:0; lastwait:5000].
|
||||
</code></pre><ul>
|
||||
<li>Ah hah! So the pool was actually empty!</li>
|
||||
<li>I need to increase that, let’s try to bump it up from 50 to 75</li>
|
||||
<li>After that one client got an HTTP 499 but then the rest were HTTP 200, so I don’t know what the hell Uptime Robot saw</li>
|
||||
<li>I notice this error quite a few times in dspace.log:</li>
|
||||
</ul>
|
||||
<pre><code>2018-01-02 01:21:19,137 ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ Error while searching for sidebar facets
|
||||
org.dspace.discovery.SearchServiceException: org.apache.solr.search.SyntaxError: Cannot parse 'dateIssued_keyword:[1976+TO+1979]': Encountered " "]" "] "" at line 1, column 32.
|
||||
</code></pre><ul>
|
||||
<li>And there are many of these errors every day for the past month:</li>
|
||||
</ul>
|
||||
<pre><code>$ grep -c "Error while searching for sidebar facets" dspace.log.*
|
||||
dspace.log.2017-11-21:4
|
||||
dspace.log.2017-11-22:1
|
||||
dspace.log.2017-11-23:4
|
||||
dspace.log.2017-11-24:11
|
||||
dspace.log.2017-11-25:0
|
||||
dspace.log.2017-11-26:1
|
||||
dspace.log.2017-11-27:7
|
||||
dspace.log.2017-11-28:21
|
||||
dspace.log.2017-11-29:31
|
||||
dspace.log.2017-11-30:15
|
||||
dspace.log.2017-12-01:15
|
||||
dspace.log.2017-12-02:20
|
||||
dspace.log.2017-12-03:38
|
||||
dspace.log.2017-12-04:65
|
||||
dspace.log.2017-12-05:43
|
||||
dspace.log.2017-12-06:72
|
||||
dspace.log.2017-12-07:27
|
||||
dspace.log.2017-12-08:15
|
||||
dspace.log.2017-12-09:29
|
||||
dspace.log.2017-12-10:35
|
||||
dspace.log.2017-12-11:20
|
||||
dspace.log.2017-12-12:44
|
||||
dspace.log.2017-12-13:36
|
||||
dspace.log.2017-12-14:59
|
||||
dspace.log.2017-12-15:104
|
||||
dspace.log.2017-12-16:53
|
||||
dspace.log.2017-12-17:66
|
||||
dspace.log.2017-12-18:83
|
||||
dspace.log.2017-12-19:101
|
||||
dspace.log.2017-12-20:74
|
||||
dspace.log.2017-12-21:55
|
||||
dspace.log.2017-12-22:66
|
||||
dspace.log.2017-12-23:50
|
||||
dspace.log.2017-12-24:85
|
||||
dspace.log.2017-12-25:62
|
||||
dspace.log.2017-12-26:49
|
||||
dspace.log.2017-12-27:30
|
||||
dspace.log.2017-12-28:54
|
||||
dspace.log.2017-12-29:68
|
||||
dspace.log.2017-12-30:89
|
||||
dspace.log.2017-12-31:53
|
||||
dspace.log.2018-01-01:45
|
||||
dspace.log.2018-01-02:34
|
||||
</code></pre><ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-12/">December, 2017</a></h2>
|
||||
@ -324,35 +408,6 @@ COPY 54701
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-04/">April, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-04-02T17:08:52+02:00">Sun Apr 02, 2017</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-04-02">2017-04-02</h2>
|
||||
<ul>
|
||||
<li>Merge one change to CCAFS flagships that I had forgotten to remove last month (“MANAGING CLIMATE RISK”): <a href="https://github.com/ilri/DSpace/pull/317">https://github.com/ilri/DSpace/pull/317</a></li>
|
||||
<li>Quick proof-of-concept hack to add <code>dc.rights</code> to the input form, including some inline instructions/hints:</li>
|
||||
</ul>
|
||||
<p><img src="/cgspace-notes/2017/04/dc-rights.png" alt="dc.rights in the submission form"></p>
|
||||
<ul>
|
||||
<li>Remove redundant/duplicate text in the DSpace submission license</li>
|
||||
<li>Testing the CMYK patch on a collection with 650 items:</li>
|
||||
</ul>
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/posts/page/3/" rel="prev" role="button">Previous page</a>
|
||||
@ -379,14 +434,14 @@ COPY 54701
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
@ -95,6 +95,35 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-04/">April, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-04-02T17:08:52+02:00">Sun Apr 02, 2017</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-04-02">2017-04-02</h2>
|
||||
<ul>
|
||||
<li>Merge one change to CCAFS flagships that I had forgotten to remove last month (“MANAGING CLIMATE RISK”): <a href="https://github.com/ilri/DSpace/pull/317">https://github.com/ilri/DSpace/pull/317</a></li>
|
||||
<li>Quick proof-of-concept hack to add <code>dc.rights</code> to the input form, including some inline instructions/hints:</li>
|
||||
</ul>
|
||||
<p><img src="/cgspace-notes/2017/04/dc-rights.png" alt="dc.rights in the submission form"></p>
|
||||
<ul>
|
||||
<li>Remove redundant/duplicate text in the DSpace submission license</li>
|
||||
<li>Testing the CMYK patch on a collection with 650 items:</li>
|
||||
</ul>
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-03/">March, 2017</a></h2>
|
||||
@ -358,32 +387,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-06/">June, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-06-01T10:53:00+03:00">Wed Jun 01, 2016</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-06-01">2016-06-01</h2>
|
||||
<ul>
|
||||
<li>Experimenting with IFPRI OAI (we want to harvest their publications)</li>
|
||||
<li>After reading the <a href="https://www.oclc.org/support/services/contentdm/help/server-admin-help/oai-support.en.html">ContentDM documentation</a> I found IFPRI’s OAI endpoint: <a href="http://ebrary.ifpri.org/oai/oai.php">http://ebrary.ifpri.org/oai/oai.php</a></li>
|
||||
<li>After reading the <a href="https://www.openarchives.org/OAI/openarchivesprotocol.html">OAI documentation</a> and testing with an <a href="http://validator.oaipmh.com/">OAI validator</a> I found out how to get their publications</li>
|
||||
<li>This is their publications set: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc">http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc</a></li>
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/posts/page/4/" rel="prev" role="button">Previous page</a>
|
||||
@ -410,14 +413,14 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -9,7 +9,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2020-05-31T20:49:41+03:00" />
|
||||
<meta property="og:updated_time" content="2020-06-01T13:55:08+03:00" />
|
||||
|
||||
<meta name="twitter:card" content="summary"/>
|
||||
<meta name="twitter:title" content="Posts"/>
|
||||
@ -95,6 +95,32 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-06/">June, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-06-01T10:53:00+03:00">Wed Jun 01, 2016</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-06-01">2016-06-01</h2>
|
||||
<ul>
|
||||
<li>Experimenting with IFPRI OAI (we want to harvest their publications)</li>
|
||||
<li>After reading the <a href="https://www.oclc.org/support/services/contentdm/help/server-admin-help/oai-support.en.html">ContentDM documentation</a> I found IFPRI’s OAI endpoint: <a href="http://ebrary.ifpri.org/oai/oai.php">http://ebrary.ifpri.org/oai/oai.php</a></li>
|
||||
<li>After reading the <a href="https://www.openarchives.org/OAI/openarchivesprotocol.html">OAI documentation</a> and testing with an <a href="http://validator.oaipmh.com/">OAI validator</a> I found out how to get their publications</li>
|
||||
<li>This is their publications set: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc">http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc</a></li>
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-05/">May, 2016</a></h2>
|
||||
@ -298,14 +324,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -6,6 +6,7 @@ Disallow: /cgspace-notes/
|
||||
Disallow: /cgspace-notes/2020-05/
|
||||
Disallow: /cgspace-notes/categories/notes/
|
||||
Disallow: /cgspace-notes/posts/
|
||||
Disallow: /cgspace-notes/2020-05/
|
||||
Disallow: /cgspace-notes/2020-04/
|
||||
Disallow: /cgspace-notes/2020-03/
|
||||
Disallow: /cgspace-notes/2020-02/
|
||||
|
||||
@ -4,27 +4,32 @@
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/</loc>
|
||||
<lastmod>2020-05-31T20:49:41+03:00</lastmod>
|
||||
<lastmod>2020-06-01T13:55:08+03:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/</loc>
|
||||
<lastmod>2020-05-31T20:49:41+03:00</lastmod>
|
||||
<lastmod>2020-06-01T13:55:08+03:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2020-05/</loc>
|
||||
<lastmod>2020-05-31T20:49:41+03:00</lastmod>
|
||||
<lastmod>2020-06-01T13:55:08+03:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
|
||||
<lastmod>2020-05-31T20:49:41+03:00</lastmod>
|
||||
<lastmod>2020-06-01T13:55:08+03:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
|
||||
<lastmod>2020-05-31T20:49:41+03:00</lastmod>
|
||||
<lastmod>2020-06-01T13:55:08+03:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2020-05/</loc>
|
||||
<lastmod>2020-05-01T13:55:39+03:00</lastmod>
|
||||
</url>
|
||||
|
||||
<url>
|
||||
|
||||
@ -121,6 +121,33 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-05/">June, 2020</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2020-05-01T13:55:39+03:00">Fri May 01, 2020</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2020-06-01">2020-06-01</h2>
|
||||
<ul>
|
||||
<li>I tried to run the <code>AtomicStatisticsUpdateCLI</code> CUA migration script on DSpace Test (linode26) again and it is still going very slowly and has tons of errors like I noticed yesterday
|
||||
<ul>
|
||||
<li>I sent Atmire the dspace.log from today and told them to log into the server to debug the process</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>In other news, I checked the statistics API on DSpace 6 and it’s working</li>
|
||||
<li>I tried to build the OAI registry on the freshly migrated DSpace 6 on DSpace Test and I get an error:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2020-05/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2020-04/">April, 2020</a></h2>
|
||||
@ -357,51 +384,6 @@
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-09/">September, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-09-01T10:17:51+03:00">Sun Sep 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-09-01">2019-09-01</h2>
|
||||
<ul>
|
||||
<li>Linode emailed to say that CGSpace (linode18) had a high rate of outbound traffic for several hours this morning</li>
|
||||
<li>Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning:</li>
|
||||
</ul>
|
||||
<pre><code># zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
440 17.58.101.255
|
||||
441 157.55.39.101
|
||||
485 207.46.13.43
|
||||
728 169.60.128.125
|
||||
730 207.46.13.108
|
||||
758 157.55.39.9
|
||||
808 66.160.140.179
|
||||
814 207.46.13.212
|
||||
2472 163.172.71.23
|
||||
6092 3.94.211.189
|
||||
# zcat --force /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/oai.log /var/log/nginx/oai.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
33 2a01:7e00::f03c:91ff:fe16:fcb
|
||||
57 3.83.192.124
|
||||
57 3.87.77.25
|
||||
57 54.82.1.8
|
||||
822 2a01:9cc0:47:1:1a:4:0:2
|
||||
1223 45.5.184.72
|
||||
1633 172.104.229.92
|
||||
5112 205.186.128.185
|
||||
7249 2a01:7e00::f03c:91ff:fe18:7396
|
||||
9124 45.5.186.2
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
|
||||
@ -428,14 +410,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -136,14 +136,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -386,14 +386,14 @@ DELETE 1
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -372,14 +372,14 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -181,14 +181,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -95,6 +95,51 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-09/">September, 2019</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2019-09-01T10:17:51+03:00">Sun Sep 01, 2019</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2019-09-01">2019-09-01</h2>
|
||||
<ul>
|
||||
<li>Linode emailed to say that CGSpace (linode18) had a high rate of outbound traffic for several hours this morning</li>
|
||||
<li>Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning:</li>
|
||||
</ul>
|
||||
<pre><code># zcat --force /var/log/nginx/access.log /var/log/nginx/access.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
440 17.58.101.255
|
||||
441 157.55.39.101
|
||||
485 207.46.13.43
|
||||
728 169.60.128.125
|
||||
730 207.46.13.108
|
||||
758 157.55.39.9
|
||||
808 66.160.140.179
|
||||
814 207.46.13.212
|
||||
2472 163.172.71.23
|
||||
6092 3.94.211.189
|
||||
# zcat --force /var/log/nginx/rest.log /var/log/nginx/rest.log.1 /var/log/nginx/oai.log /var/log/nginx/oai.log.1 | grep -E "01/Sep/2019:0" | awk '{print $1}' | sort | uniq -c | sort -n | tail -n 10
|
||||
33 2a01:7e00::f03c:91ff:fe16:fcb
|
||||
57 3.83.192.124
|
||||
57 3.87.77.25
|
||||
57 54.82.1.8
|
||||
822 2a01:9cc0:47:1:1a:4:0:2
|
||||
1223 45.5.184.72
|
||||
1633 172.104.229.92
|
||||
5112 205.186.128.185
|
||||
7249 2a01:7e00::f03c:91ff:fe18:7396
|
||||
9124 45.5.186.2
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2019-09/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2019-08/">August, 2019</a></h2>
|
||||
@ -392,33 +437,6 @@ sys 0m1.979s
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-11/">November, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-11-01T16:41:30+02:00">Thu Nov 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-11-01">2018-11-01</h2>
|
||||
<ul>
|
||||
<li>Finalize AReS Phase I and Phase II ToRs</li>
|
||||
<li>Send a note about my <a href="https://github.com/ilri/dspace-statistics-api">dspace-statistics-api</a> to the dspace-tech mailing list</li>
|
||||
</ul>
|
||||
<h2 id="2018-11-03">2018-11-03</h2>
|
||||
<ul>
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/tags/" rel="prev" role="button">Previous page</a>
|
||||
@ -445,14 +463,14 @@ sys 0m1.979s
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -95,6 +95,33 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-11/">November, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-11-01T16:41:30+02:00">Thu Nov 01, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-11-01">2018-11-01</h2>
|
||||
<ul>
|
||||
<li>Finalize AReS Phase I and Phase II ToRs</li>
|
||||
<li>Send a note about my <a href="https://github.com/ilri/dspace-statistics-api">dspace-statistics-api</a> to the dspace-tech mailing list</li>
|
||||
</ul>
|
||||
<h2 id="2018-11-03">2018-11-03</h2>
|
||||
<ul>
|
||||
<li>Linode has been sending mails a few times a day recently that CGSpace (linode18) has had high CPU usage</li>
|
||||
<li>Today these are the top 10 IPs:</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-11/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-10/">October, 2018</a></h2>
|
||||
@ -332,90 +359,6 @@ sys 2m7.289s
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-01/">January, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-01-02T08:35:54-08:00">Tue Jan 02, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-01-02">2018-01-02</h2>
|
||||
<ul>
|
||||
<li>Uptime Robot noticed that CGSpace went down and up a few times last night, for a few minutes each time</li>
|
||||
<li>I didn’t get any load alerts from Linode and the REST and XMLUI logs don’t show anything out of the ordinary</li>
|
||||
<li>The nginx logs show HTTP 200s until <code>02/Jan/2018:11:27:17 +0000</code> when Uptime Robot got an HTTP 500</li>
|
||||
<li>In dspace.log around that time I see many errors like “Client closed the connection before file download was complete”</li>
|
||||
<li>And just before that I see this:</li>
|
||||
</ul>
|
||||
<pre><code>Caused by: org.apache.tomcat.jdbc.pool.PoolExhaustedException: [http-bio-127.0.0.1-8443-exec-980] Timeout: Pool empty. Unable to fetch a connection in 5 seconds, none available[size:50; busy:50; idle:0; lastwait:5000].
|
||||
</code></pre><ul>
|
||||
<li>Ah hah! So the pool was actually empty!</li>
|
||||
<li>I need to increase that, let’s try to bump it up from 50 to 75</li>
|
||||
<li>After that one client got an HTTP 499 but then the rest were HTTP 200, so I don’t know what the hell Uptime Robot saw</li>
|
||||
<li>I notice this error quite a few times in dspace.log:</li>
|
||||
</ul>
|
||||
<pre><code>2018-01-02 01:21:19,137 ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ Error while searching for sidebar facets
|
||||
org.dspace.discovery.SearchServiceException: org.apache.solr.search.SyntaxError: Cannot parse 'dateIssued_keyword:[1976+TO+1979]': Encountered " "]" "] "" at line 1, column 32.
|
||||
</code></pre><ul>
|
||||
<li>And there are many of these errors every day for the past month:</li>
|
||||
</ul>
|
||||
<pre><code>$ grep -c "Error while searching for sidebar facets" dspace.log.*
|
||||
dspace.log.2017-11-21:4
|
||||
dspace.log.2017-11-22:1
|
||||
dspace.log.2017-11-23:4
|
||||
dspace.log.2017-11-24:11
|
||||
dspace.log.2017-11-25:0
|
||||
dspace.log.2017-11-26:1
|
||||
dspace.log.2017-11-27:7
|
||||
dspace.log.2017-11-28:21
|
||||
dspace.log.2017-11-29:31
|
||||
dspace.log.2017-11-30:15
|
||||
dspace.log.2017-12-01:15
|
||||
dspace.log.2017-12-02:20
|
||||
dspace.log.2017-12-03:38
|
||||
dspace.log.2017-12-04:65
|
||||
dspace.log.2017-12-05:43
|
||||
dspace.log.2017-12-06:72
|
||||
dspace.log.2017-12-07:27
|
||||
dspace.log.2017-12-08:15
|
||||
dspace.log.2017-12-09:29
|
||||
dspace.log.2017-12-10:35
|
||||
dspace.log.2017-12-11:20
|
||||
dspace.log.2017-12-12:44
|
||||
dspace.log.2017-12-13:36
|
||||
dspace.log.2017-12-14:59
|
||||
dspace.log.2017-12-15:104
|
||||
dspace.log.2017-12-16:53
|
||||
dspace.log.2017-12-17:66
|
||||
dspace.log.2017-12-18:83
|
||||
dspace.log.2017-12-19:101
|
||||
dspace.log.2017-12-20:74
|
||||
dspace.log.2017-12-21:55
|
||||
dspace.log.2017-12-22:66
|
||||
dspace.log.2017-12-23:50
|
||||
dspace.log.2017-12-24:85
|
||||
dspace.log.2017-12-25:62
|
||||
dspace.log.2017-12-26:49
|
||||
dspace.log.2017-12-27:30
|
||||
dspace.log.2017-12-28:54
|
||||
dspace.log.2017-12-29:68
|
||||
dspace.log.2017-12-30:89
|
||||
dspace.log.2017-12-31:53
|
||||
dspace.log.2018-01-01:45
|
||||
dspace.log.2018-01-02:34
|
||||
</code></pre><ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/tags/page/2/" rel="prev" role="button">Previous page</a>
|
||||
@ -442,14 +385,14 @@ dspace.log.2018-01-02:34
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -95,6 +95,90 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2018-01/">January, 2018</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2018-01-02T08:35:54-08:00">Tue Jan 02, 2018</time> by Alan Orth in
|
||||
<span class="fas fa-folder" aria-hidden="true"></span> <a href="/cgspace-notes/categories/notes/" rel="category tag">Notes</a>
|
||||
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2018-01-02">2018-01-02</h2>
|
||||
<ul>
|
||||
<li>Uptime Robot noticed that CGSpace went down and up a few times last night, for a few minutes each time</li>
|
||||
<li>I didn’t get any load alerts from Linode and the REST and XMLUI logs don’t show anything out of the ordinary</li>
|
||||
<li>The nginx logs show HTTP 200s until <code>02/Jan/2018:11:27:17 +0000</code> when Uptime Robot got an HTTP 500</li>
|
||||
<li>In dspace.log around that time I see many errors like “Client closed the connection before file download was complete”</li>
|
||||
<li>And just before that I see this:</li>
|
||||
</ul>
|
||||
<pre><code>Caused by: org.apache.tomcat.jdbc.pool.PoolExhaustedException: [http-bio-127.0.0.1-8443-exec-980] Timeout: Pool empty. Unable to fetch a connection in 5 seconds, none available[size:50; busy:50; idle:0; lastwait:5000].
|
||||
</code></pre><ul>
|
||||
<li>Ah hah! So the pool was actually empty!</li>
|
||||
<li>I need to increase that, let’s try to bump it up from 50 to 75</li>
|
||||
<li>After that one client got an HTTP 499 but then the rest were HTTP 200, so I don’t know what the hell Uptime Robot saw</li>
|
||||
<li>I notice this error quite a few times in dspace.log:</li>
|
||||
</ul>
|
||||
<pre><code>2018-01-02 01:21:19,137 ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ Error while searching for sidebar facets
|
||||
org.dspace.discovery.SearchServiceException: org.apache.solr.search.SyntaxError: Cannot parse 'dateIssued_keyword:[1976+TO+1979]': Encountered " "]" "] "" at line 1, column 32.
|
||||
</code></pre><ul>
|
||||
<li>And there are many of these errors every day for the past month:</li>
|
||||
</ul>
|
||||
<pre><code>$ grep -c "Error while searching for sidebar facets" dspace.log.*
|
||||
dspace.log.2017-11-21:4
|
||||
dspace.log.2017-11-22:1
|
||||
dspace.log.2017-11-23:4
|
||||
dspace.log.2017-11-24:11
|
||||
dspace.log.2017-11-25:0
|
||||
dspace.log.2017-11-26:1
|
||||
dspace.log.2017-11-27:7
|
||||
dspace.log.2017-11-28:21
|
||||
dspace.log.2017-11-29:31
|
||||
dspace.log.2017-11-30:15
|
||||
dspace.log.2017-12-01:15
|
||||
dspace.log.2017-12-02:20
|
||||
dspace.log.2017-12-03:38
|
||||
dspace.log.2017-12-04:65
|
||||
dspace.log.2017-12-05:43
|
||||
dspace.log.2017-12-06:72
|
||||
dspace.log.2017-12-07:27
|
||||
dspace.log.2017-12-08:15
|
||||
dspace.log.2017-12-09:29
|
||||
dspace.log.2017-12-10:35
|
||||
dspace.log.2017-12-11:20
|
||||
dspace.log.2017-12-12:44
|
||||
dspace.log.2017-12-13:36
|
||||
dspace.log.2017-12-14:59
|
||||
dspace.log.2017-12-15:104
|
||||
dspace.log.2017-12-16:53
|
||||
dspace.log.2017-12-17:66
|
||||
dspace.log.2017-12-18:83
|
||||
dspace.log.2017-12-19:101
|
||||
dspace.log.2017-12-20:74
|
||||
dspace.log.2017-12-21:55
|
||||
dspace.log.2017-12-22:66
|
||||
dspace.log.2017-12-23:50
|
||||
dspace.log.2017-12-24:85
|
||||
dspace.log.2017-12-25:62
|
||||
dspace.log.2017-12-26:49
|
||||
dspace.log.2017-12-27:30
|
||||
dspace.log.2017-12-28:54
|
||||
dspace.log.2017-12-29:68
|
||||
dspace.log.2017-12-30:89
|
||||
dspace.log.2017-12-31:53
|
||||
dspace.log.2018-01-01:45
|
||||
dspace.log.2018-01-02:34
|
||||
</code></pre><ul>
|
||||
<li>Danny wrote to ask for help renewing the wildcard ilri.org certificate and I advised that we should probably use Let’s Encrypt if it’s just a handful of domains</li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2018-01/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-12/">December, 2017</a></h2>
|
||||
@ -324,35 +408,6 @@ COPY 54701
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-04/">April, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-04-02T17:08:52+02:00">Sun Apr 02, 2017</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-04-02">2017-04-02</h2>
|
||||
<ul>
|
||||
<li>Merge one change to CCAFS flagships that I had forgotten to remove last month (“MANAGING CLIMATE RISK”): <a href="https://github.com/ilri/DSpace/pull/317">https://github.com/ilri/DSpace/pull/317</a></li>
|
||||
<li>Quick proof-of-concept hack to add <code>dc.rights</code> to the input form, including some inline instructions/hints:</li>
|
||||
</ul>
|
||||
<p><img src="/cgspace-notes/2017/04/dc-rights.png" alt="dc.rights in the submission form"></p>
|
||||
<ul>
|
||||
<li>Remove redundant/duplicate text in the DSpace submission license</li>
|
||||
<li>Testing the CMYK patch on a collection with 650 items:</li>
|
||||
</ul>
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/tags/page/3/" rel="prev" role="button">Previous page</a>
|
||||
@ -379,14 +434,14 @@ COPY 54701
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -95,6 +95,35 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-04/">April, 2017</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2017-04-02T17:08:52+02:00">Sun Apr 02, 2017</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2017-04-02">2017-04-02</h2>
|
||||
<ul>
|
||||
<li>Merge one change to CCAFS flagships that I had forgotten to remove last month (“MANAGING CLIMATE RISK”): <a href="https://github.com/ilri/DSpace/pull/317">https://github.com/ilri/DSpace/pull/317</a></li>
|
||||
<li>Quick proof-of-concept hack to add <code>dc.rights</code> to the input form, including some inline instructions/hints:</li>
|
||||
</ul>
|
||||
<p><img src="/cgspace-notes/2017/04/dc-rights.png" alt="dc.rights in the submission form"></p>
|
||||
<ul>
|
||||
<li>Remove redundant/duplicate text in the DSpace submission license</li>
|
||||
<li>Testing the CMYK patch on a collection with 650 items:</li>
|
||||
</ul>
|
||||
<pre><code>$ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p "ImageMagick PDF Thumbnail" -v >& /tmp/filter-media-cmyk.txt
|
||||
</code></pre>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2017-04/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2017-03/">March, 2017</a></h2>
|
||||
@ -358,32 +387,6 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-06/">June, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-06-01T10:53:00+03:00">Wed Jun 01, 2016</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-06-01">2016-06-01</h2>
|
||||
<ul>
|
||||
<li>Experimenting with IFPRI OAI (we want to harvest their publications)</li>
|
||||
<li>After reading the <a href="https://www.oclc.org/support/services/contentdm/help/server-admin-help/oai-support.en.html">ContentDM documentation</a> I found IFPRI’s OAI endpoint: <a href="http://ebrary.ifpri.org/oai/oai.php">http://ebrary.ifpri.org/oai/oai.php</a></li>
|
||||
<li>After reading the <a href="https://www.openarchives.org/OAI/openarchivesprotocol.html">OAI documentation</a> and testing with an <a href="http://validator.oaipmh.com/">OAI validator</a> I found out how to get their publications</li>
|
||||
<li>This is their publications set: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc">http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc</a></li>
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<nav class="blog-pagination">
|
||||
|
||||
<a class="btn btn-outline-primary" href="/cgspace-notes/tags/page/4/" rel="prev" role="button">Previous page</a>
|
||||
@ -410,14 +413,14 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
@ -95,6 +95,32 @@
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-06/">June, 2016</a></h2>
|
||||
<p class="blog-post-meta"><time datetime="2016-06-01T10:53:00+03:00">Wed Jun 01, 2016</time> by Alan Orth in
|
||||
|
||||
<span class="fas fa-tag" aria-hidden="true"></span> <a href="/cgspace-notes/tags/notes/" rel="tag">Notes</a>
|
||||
|
||||
</p>
|
||||
</header>
|
||||
<h2 id="2016-06-01">2016-06-01</h2>
|
||||
<ul>
|
||||
<li>Experimenting with IFPRI OAI (we want to harvest their publications)</li>
|
||||
<li>After reading the <a href="https://www.oclc.org/support/services/contentdm/help/server-admin-help/oai-support.en.html">ContentDM documentation</a> I found IFPRI’s OAI endpoint: <a href="http://ebrary.ifpri.org/oai/oai.php">http://ebrary.ifpri.org/oai/oai.php</a></li>
|
||||
<li>After reading the <a href="https://www.openarchives.org/OAI/openarchivesprotocol.html">OAI documentation</a> and testing with an <a href="http://validator.oaipmh.com/">OAI validator</a> I found out how to get their publications</li>
|
||||
<li>This is their publications set: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc">http://ebrary.ifpri.org/oai/oai.php?verb=ListRecords&from=2016-01-01&set=p15738coll2&metadataPrefix=oai_dc</a></li>
|
||||
<li>You can see the others by using the OAI <code>ListSets</code> verb: <a href="http://ebrary.ifpri.org/oai/oai.php?verb=ListSets">http://ebrary.ifpri.org/oai/oai.php?verb=ListSets</a></li>
|
||||
<li>Working on second phase of metadata migration, looks like this will work for moving CPWF-specific data in <code>dc.identifier.fund</code> to <code>cg.identifier.cpwfproject</code> and then the rest to <code>dc.description.sponsorship</code></li>
|
||||
</ul>
|
||||
<a href='https://alanorth.github.io/cgspace-notes/2016-06/'>Read more →</a>
|
||||
</article>
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<article class="blog-post">
|
||||
<header>
|
||||
<h2 class="blog-post-title" dir="auto"><a href="https://alanorth.github.io/cgspace-notes/2016-05/">May, 2016</a></h2>
|
||||
@ -298,14 +324,14 @@
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">May, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-05/">June, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-04/">April, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-03/">March, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-02/">February, 2020</a></li>
|
||||
|
||||
<li><a href="/cgspace-notes/2020-01/">January, 2020</a></li>
|
||||
|
||||
</ol>
|
||||
</section>
|
||||
|
||||
|
||||
Loading…
Reference in New Issue
Block a user