alanorth/cgspace-notes
1
0
Fork 0
mirror of https://github.com/alanorth/cgspace-notes.git synced 2024-11-25 16:08:19 +01:00
Code Issues Projects Releases Wiki Activity

Update notes

Browse Source
This commit is contained in:
Alan Orth 2018-01-12 06:07:03 +02:00
parent d5ec4072eb
commit 21acf07165
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
42 changed files with 114 additions and 54 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
content/post/2017-11.md
View File

@ -640,7 +640,7 @@ dspace6=# CREATE EXTENSION pgcrypto;
- Also, local settings are no longer in `build.properties`, they are now in `local.cfg`
- I'm not sure if we can use separate profiles like we did before with `mvn -Denv=blah` to use blah.properties
- It seems we need to use "system properties" to override settings, ie: `-Ddspace.dir=/Users/aorth/dspace7`
- It seems we need to use "system properties" to override settings, ie: `-Ddspace.dir=/Users/aorth/dspace6`
## 2017-11-15

28
content/post/2018-01.md
View File

@ -488,3 +488,31 @@ cache_alignment : 64
111535 2607:fa98:40:9:26b6:fdff:feff:1c96
161797 2607:fa98:40:9:26b6:fdff:feff:1888
```
- Wow, I just figured out how to set the application name of each database pool in the JNDI config of Tomcat's `server.xml`:
```
<Resource name="jdbc/dspaceWeb" auth="Container" type="javax.sql.DataSource"
driverClassName="org.postgresql.Driver"
url="jdbc:postgresql://localhost:5432/dspacetest?ApplicationName=dspaceWeb"
username="dspace"
password="dspace"
initialSize='5'
maxActive='75'
maxIdle='15'
minIdle='5'
maxWait='5000'
validationQuery='SELECT 1'
testOnBorrow='true' />
```
- So theoretically I could name each connection "xmlui" or "dspaceWeb" or something meaningful and it would show up in PostgreSQL's `pg_stat_activity` table!
- This would be super helpful for figuring out where load was coming from (now I wonder if I could figure out how to graph this)
- Also, I realized that the `db.jndi` parameter in dspace.cfg needs to match the `name` value in your applicaiton's context—not the `global` one
- Ah hah! Also, I can name the default DSpace connection pool in dspace.cfg as well, like:
```
db.url = jdbc:postgresql://localhost:5432/dspacetest?ApplicationName=dspaceDefault
```
- With that it is super easy to see where PostgreSQL connections are coming from in `pg_stat_activity`

2
public/2015-11/index.html
View File

@ -52,7 +52,7 @@ $ psql -c &#39;SELECT * from pg_stat_activity;&#39; | grep idle | grep -c cgspac
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2015-12/index.html
View File

@ -54,7 +54,7 @@ Replace lzop with xz in log compression cron jobs on DSpace Test—it uses less
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2016-01/index.html
View File

@ -44,7 +44,7 @@ Update GitHub wiki for documentation of maintenance tasks.
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2016-02/index.html
View File

@ -58,7 +58,7 @@ Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&r
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2016-03/index.html
View File

@ -44,7 +44,7 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2016-04/index.html
View File

@ -48,7 +48,7 @@ Also, I noticed the checker log has some errors we should pay attention to:
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2016-05/index.html
View File

@ -52,7 +52,7 @@ There are 3,000 IPs accessing the REST API in a 24-hour period!
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2016-06/index.html
View File

@ -50,7 +50,7 @@ Working on second phase of metadata migration, looks like this will work for mov
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2016-07/index.html
View File

@ -66,7 +66,7 @@ In this case the select query was showing 95 results before the update
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2016-08/index.html
View File

@ -60,7 +60,7 @@ $ git rebase -i dspace-5.5
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2016-09/index.html
View File

@ -52,7 +52,7 @@ $ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=or
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2016-10/index.html
View File

@ -60,7 +60,7 @@ I exported a random item&rsquo;s metadata as CSV, deleted all columns except id
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2016-11/index.html
View File

@ -44,7 +44,7 @@ Add dc.type to the output options for Atmire&rsquo;s Listings and Reports module
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2016-12/index.html
View File

@ -68,7 +68,7 @@ Another worrying error from dspace.log is:
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2017-01/index.html
View File

@ -44,7 +44,7 @@ I asked on the dspace-tech mailing list because it seems to be broken, and actua
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2017-02/index.html
View File

@ -72,7 +72,7 @@ Looks like we&rsquo;ll be using cg.identifier.ccafsprojectpii as the field name
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2017-03/index.html
View File

@ -76,7 +76,7 @@ $ identify ~/Desktop/alc_contrastes_desafios.jpg
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2017-04/index.html
View File

@ -62,7 +62,7 @@ $ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Th
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2017-05/index.html
View File

@ -28,7 +28,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="May, 2017"/>
<meta name="twitter:description" content="2017-05-01 ICARDA apparently started working on CG Core on their MEL repository They have done a few cg.* fields, but not very consistent and even copy some of CGSpace items: https://mel.cgiar.org/xmlui/handle/20.500.11766/6911?show=full https://cgspace.cgiar.org/handle/10568/73683 2017-05-02 Atmire got back about the Workflow Statistics issue, and apparently it&rsquo;s a bug in the CUA module so they will send us a pull request 2017-05-04 Sync DSpace Test with database and assetstore from CGSpace Re-deploy DSpace Test with Atmire&rsquo;s CUA patch for workflow statistics, run system updates, and restart the server Now I can see the workflow statistics and am able to select users, but everything returns 0 items Megan says there are still some mapped items are not appearing since last week, so I forced a full index-discovery -b Need to remember to check if the collection has more items (currently 39 on CGSpace, but 118 on the freshly reindexed DSPace Test) tomorrow: https://cgspace."/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2017-06/index.html
View File

@ -28,7 +28,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="June, 2017"/>
<meta name="twitter:description" content="2017-06-01 After discussion with WLE and CGSpace content people, we decided to just add one metadata field for the WLE Research Themes The cg.identifier.wletheme field will be used for both Phase I and Phase II Research Themes Then we&rsquo;ll create a new sub-community for Phase II and create collections for the research themes there The current &ldquo;Research Themes&rdquo; community will be renamed to &ldquo;WLE Phase I Research Themes&rdquo; Tagged all items in the current Phase I collections with their appropriate themes Create pull request to add Phase II research themes to the submission form: #328 Add cg."/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2017-07/index.html
View File

@ -56,7 +56,7 @@ We can use PostgreSQL&rsquo;s extended output format (-x) plus sed to format the
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2017-08/index.html
View File

@ -76,7 +76,7 @@ Then I cleaned up the author authorities and HTML characters in OpenRefine and s
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2017-09/index.html
View File

@ -52,7 +52,7 @@ Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/2017-10/index.html
View File

@ -56,7 +56,7 @@ Add Katherine Lutz to the groups for content submission and edit steps of the CG
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

4
public/2017-11/index.html
View File

@ -76,7 +76,7 @@ COPY 54701
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />
@ -863,7 +863,7 @@ dspace6=# CREATE EXTENSION pgcrypto;
<ul>
<li>Also, local settings are no longer in <code>build.properties</code>, they are now in <code>local.cfg</code></li>
<li>I&rsquo;m not sure if we can use separate profiles like we did before with <code>mvn -Denv=blah</code> to use blah.properties</li>
<li>It seems we need to use &ldquo;system properties&rdquo; to override settings, ie: <code>-Ddspace.dir=/Users/aorth/dspace7</code></li>
<li>It seems we need to use &ldquo;system properties&rdquo; to override settings, ie: <code>-Ddspace.dir=/Users/aorth/dspace6</code></li>
</ul>
<h2 id="2017-11-15">2017-11-15</h2>

2
public/2017-12/index.html
View File

@ -46,7 +46,7 @@ The list of connections to XMLUI and REST API for today:
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

40
public/2018-01/index.html
View File

@ -92,7 +92,7 @@ Danny wrote to ask for help renewing the wildcard ilri.org certificate and I adv
<meta property="article:published_time" content="2018-01-02T08:35:54-08:00"/>
<meta property="article:modified_time" content="2018-01-11T08:36:59&#43;02:00"/>
<meta property="article:modified_time" content="2018-01-11T10:42:35&#43;02:00"/>
@ -184,7 +184,7 @@ Danny wrote to ask for help renewing the wildcard ilri.org certificate and I adv
"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />
@ -194,9 +194,9 @@ Danny wrote to ask for help renewing the wildcard ilri.org certificate and I adv
"@type": "BlogPosting",
"headline": "January, 2018",
"url": "https://alanorth.github.io/cgspace-notes/2018-01/",
"wordCount": "2324",
"wordCount": "2467",
"datePublished": "2018-01-02T08:35:54-08:00",
"dateModified": "2018-01-11T08:36:59&#43;02:00",
"dateModified": "2018-01-11T10:42:35&#43;02:00",
"author": {
"@type": "Person",
"name": "Alan Orth"
@ -789,6 +789,38 @@ cache_alignment : 64
161797 2607:fa98:40:9:26b6:fdff:feff:1888
</code></pre>
<ul>
<li>Wow, I just figured out how to set the application name of each database pool in the JNDI config of Tomcat&rsquo;s <code>server.xml</code>:</li>
</ul>
<pre><code>&lt;Resource name=&quot;jdbc/dspaceWeb&quot; auth=&quot;Container&quot; type=&quot;javax.sql.DataSource&quot;
driverClassName=&quot;org.postgresql.Driver&quot;
url=&quot;jdbc:postgresql://localhost:5432/dspacetest?ApplicationName=dspaceWeb&quot;
username=&quot;dspace&quot;
password=&quot;dspace&quot;
initialSize='5'
maxActive='75'
maxIdle='15'
minIdle='5'
maxWait='5000'
validationQuery='SELECT 1'
testOnBorrow='true' /&gt;
</code></pre>
<ul>
<li>So theoretically I could name each connection &ldquo;xmlui&rdquo; or &ldquo;dspaceWeb&rdquo; or something meaningful and it would show up in PostgreSQL&rsquo;s <code>pg_stat_activity</code> table!</li>
<li>This would be super helpful for figuring out where load was coming from (now I wonder if I could figure out how to graph this)</li>
<li>Also, I realized that the <code>db.jndi</code> parameter in dspace.cfg needs to match the <code>name</code> value in your applicaiton&rsquo;s context—not the <code>global</code> one</li>
<li>Ah hah! Also, I can name the default DSpace connection pool in dspace.cfg as well, like:</li>
</ul>
<pre><code>db.url = jdbc:postgresql://localhost:5432/dspacetest?ApplicationName=dspaceDefault
</code></pre>
<ul>
<li>With that it is super easy to see where PostgreSQL connections are coming from in <code>pg_stat_activity</code></li>
</ul>

2
public/categories/notes/index.html
View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/cgiar-library-migration/index.html
View File

@ -28,7 +28,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="CGIAR Library Migration"/>
<meta name="twitter:description" content="Notes on the migration of the CGIAR Library to CGSpace"/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/index.html
View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="CGSpace Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/page/2/index.html
View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="CGSpace Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/page/3/index.html
View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="CGSpace Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/post/index.html
View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Posts"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/post/page/2/index.html
View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Posts"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/post/page/3/index.html
View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Posts"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/robots.txt
View File

@ -31,7 +31,7 @@ Disallow: /cgspace-notes/2015-12/
Disallow: /cgspace-notes/2015-11/
Disallow: /cgspace-notes/
Disallow: /cgspace-notes/categories/
Disallow: /cgspace-notes/categories/notes/
Disallow: /cgspace-notes/tags/notes/
Disallow: /cgspace-notes/categories/notes/
Disallow: /cgspace-notes/post/
Disallow: /cgspace-notes/tags/

20
public/sitemap.xml
View File

@ -4,7 +4,7 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/2018-01/</loc>
<lastmod>2018-01-11T08:36:59+02:00</lastmod>
<lastmod>2018-01-11T10:42:35+02:00</lastmod>
</url>
<url>
@ -144,7 +144,7 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/</loc>
<lastmod>2018-01-11T08:36:59+02:00</lastmod>
<lastmod>2018-01-11T10:42:35+02:00</lastmod>
<priority>0</priority>
</url>
@ -153,27 +153,27 @@
<priority>0</priority>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
<lastmod>2018-01-11T10:42:35+02:00</lastmod>
<priority>0</priority>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
<lastmod>2017-09-28T12:00:49+03:00</lastmod>
<priority>0</priority>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
<lastmod>2018-01-11T08:36:59+02:00</lastmod>
<priority>0</priority>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/post/</loc>
<lastmod>2018-01-11T08:36:59+02:00</lastmod>
<lastmod>2018-01-11T10:42:35+02:00</lastmod>
<priority>0</priority>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
<lastmod>2018-01-11T08:36:59+02:00</lastmod>
<lastmod>2018-01-11T10:42:35+02:00</lastmod>
<priority>0</priority>
</url>

2
public/tags/notes/index.html
View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/tags/notes/page/2/index.html
View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />

2
public/tags/notes/page/3/index.html
View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.32.3" />
<meta name="generator" content="Hugo 0.32.4" />