Add notes for 2017-11-20 and regenerate public

This commit is contained in:
Alan Orth 2017-11-20 15:56:01 +02:00
parent 936d7b543d
commit ec54ad6844
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
38 changed files with 58 additions and 44 deletions

View File

@ -742,3 +742,9 @@ $ grep -c com.atmire.utils.UpdateSolrStatsMetadata dspace.log.2017-11-19
- It's been a few days since I enabled the G1GC on DSpace Test and the JVM graph definitely changed: - It's been a few days since I enabled the G1GC on DSpace Test and the JVM graph definitely changed:
![Tomcat G1GC](/cgspace-notes/2017/11/tomcat-jvm-g1gc.png) ![Tomcat G1GC](/cgspace-notes/2017/11/tomcat-jvm-g1gc.png)
## 2017-11-20
- I found [an article about JVM tuning](https://www.cakesolutions.net/teamblogs/low-pause-gc-on-the-jvm) that gives some pointers how to enable logging and tools to analyze logs for you
- Also notes on [rotating GC logs](https://blog.gceasy.io/2016/11/15/rotating-gc-log-files/)
- I decided to switch DSpace Test back to the CMS garbage collector because it is designed for low pauses and high throughput (like G1GC!) and because we haven't even tried to monitor or tune it

View File

@ -52,7 +52,7 @@ $ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspac
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -54,7 +54,7 @@ Replace lzop with xz in log compression cron jobs on DSpace Test—it uses less
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -44,7 +44,7 @@ Update GitHub wiki for documentation of maintenance tasks.
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -58,7 +58,7 @@ Also, lots of things like &ldquo;COTE D`LVOIRE&rdquo; and &ldquo;COTE D IVOIRE&r
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -44,7 +44,7 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -48,7 +48,7 @@ Also, I noticed the checker log has some errors we should pay attention to:
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -52,7 +52,7 @@ There are 3,000 IPs accessing the REST API in a 24-hour period!
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -50,7 +50,7 @@ Working on second phase of metadata migration, looks like this will work for mov
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -66,7 +66,7 @@ In this case the select query was showing 95 results before the update
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -60,7 +60,7 @@ $ git rebase -i dspace-5.5
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -52,7 +52,7 @@ $ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=or
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -60,7 +60,7 @@ I exported a random item&rsquo;s metadata as CSV, deleted all columns except id
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -44,7 +44,7 @@ Add dc.type to the output options for Atmire&rsquo;s Listings and Reports module
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -68,7 +68,7 @@ Another worrying error from dspace.log is:
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -44,7 +44,7 @@ I asked on the dspace-tech mailing list because it seems to be broken, and actua
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -72,7 +72,7 @@ Looks like we&rsquo;ll be using cg.identifier.ccafsprojectpii as the field name
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -76,7 +76,7 @@ $ identify ~/Desktop/alc_contrastes_desafios.jpg
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -62,7 +62,7 @@ $ [dspace]/bin/dspace filter-media -f -i 10568/16498 -p &quot;ImageMagick PDF Th
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -28,7 +28,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="May, 2017"/> <meta name="twitter:card" content="summary"/><meta name="twitter:title" content="May, 2017"/>
<meta name="twitter:description" content="2017-05-01 ICARDA apparently started working on CG Core on their MEL repository They have done a few cg.* fields, but not very consistent and even copy some of CGSpace items: https://mel.cgiar.org/xmlui/handle/20.500.11766/6911?show=full https://cgspace.cgiar.org/handle/10568/73683 2017-05-02 Atmire got back about the Workflow Statistics issue, and apparently it&rsquo;s a bug in the CUA module so they will send us a pull request 2017-05-04 Sync DSpace Test with database and assetstore from CGSpace Re-deploy DSpace Test with Atmire&rsquo;s CUA patch for workflow statistics, run system updates, and restart the server Now I can see the workflow statistics and am able to select users, but everything returns 0 items Megan says there are still some mapped items are not appearing since last week, so I forced a full index-discovery -b Need to remember to check if the collection has more items (currently 39 on CGSpace, but 118 on the freshly reindexed DSPace Test) tomorrow: https://cgspace."/> <meta name="twitter:description" content="2017-05-01 ICARDA apparently started working on CG Core on their MEL repository They have done a few cg.* fields, but not very consistent and even copy some of CGSpace items: https://mel.cgiar.org/xmlui/handle/20.500.11766/6911?show=full https://cgspace.cgiar.org/handle/10568/73683 2017-05-02 Atmire got back about the Workflow Statistics issue, and apparently it&rsquo;s a bug in the CUA module so they will send us a pull request 2017-05-04 Sync DSpace Test with database and assetstore from CGSpace Re-deploy DSpace Test with Atmire&rsquo;s CUA patch for workflow statistics, run system updates, and restart the server Now I can see the workflow statistics and am able to select users, but everything returns 0 items Megan says there are still some mapped items are not appearing since last week, so I forced a full index-discovery -b Need to remember to check if the collection has more items (currently 39 on CGSpace, but 118 on the freshly reindexed DSPace Test) tomorrow: https://cgspace."/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -28,7 +28,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="June, 2017"/> <meta name="twitter:card" content="summary"/><meta name="twitter:title" content="June, 2017"/>
<meta name="twitter:description" content="2017-06-01 After discussion with WLE and CGSpace content people, we decided to just add one metadata field for the WLE Research Themes The cg.identifier.wletheme field will be used for both Phase I and Phase II Research Themes Then we&rsquo;ll create a new sub-community for Phase II and create collections for the research themes there The current &ldquo;Research Themes&rdquo; community will be renamed to &ldquo;WLE Phase I Research Themes&rdquo; Tagged all items in the current Phase I collections with their appropriate themes Create pull request to add Phase II research themes to the submission form: #328 Add cg."/> <meta name="twitter:description" content="2017-06-01 After discussion with WLE and CGSpace content people, we decided to just add one metadata field for the WLE Research Themes The cg.identifier.wletheme field will be used for both Phase I and Phase II Research Themes Then we&rsquo;ll create a new sub-community for Phase II and create collections for the research themes there The current &ldquo;Research Themes&rdquo; community will be renamed to &ldquo;WLE Phase I Research Themes&rdquo; Tagged all items in the current Phase I collections with their appropriate themes Create pull request to add Phase II research themes to the submission form: #328 Add cg."/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -56,7 +56,7 @@ We can use PostgreSQL&rsquo;s extended output format (-x) plus sed to format the
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -76,7 +76,7 @@ Then I cleaned up the author authorities and HTML characters in OpenRefine and s
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -52,7 +52,7 @@ Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -56,7 +56,7 @@ Add Katherine Lutz to the groups for content submission and edit steps of the CG
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -38,7 +38,7 @@ COPY 54701
<meta property="article:published_time" content="2017-11-02T09:37:54&#43;02:00"/> <meta property="article:published_time" content="2017-11-02T09:37:54&#43;02:00"/>
<meta property="article:modified_time" content="2017-11-19T23:10:58&#43;02:00"/> <meta property="article:modified_time" content="2017-11-20T09:19:44&#43;02:00"/>
@ -76,7 +76,7 @@ COPY 54701
"/> "/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />
@ -86,9 +86,9 @@ COPY 54701
"@type": "BlogPosting", "@type": "BlogPosting",
"headline": "November, 2017", "headline": "November, 2017",
"url": "https://alanorth.github.io/cgspace-notes/2017-11/", "url": "https://alanorth.github.io/cgspace-notes/2017-11/",
"wordCount": "4327", "wordCount": "4391",
"datePublished": "2017-11-02T09:37:54&#43;02:00", "datePublished": "2017-11-02T09:37:54&#43;02:00",
"dateModified": "2017-11-19T23:10:58&#43;02:00", "dateModified": "2017-11-20T09:19:44&#43;02:00",
"author": { "author": {
"@type": "Person", "@type": "Person",
"name": "Alan Orth" "name": "Alan Orth"
@ -981,6 +981,14 @@ $ grep -c com.atmire.utils.UpdateSolrStatsMetadata dspace.log.2017-11-19
<p><img src="/cgspace-notes/2017/11/tomcat-jvm-g1gc.png" alt="Tomcat G1GC" /></p> <p><img src="/cgspace-notes/2017/11/tomcat-jvm-g1gc.png" alt="Tomcat G1GC" /></p>
<h2 id="2017-11-20">2017-11-20</h2>
<ul>
<li>I found <a href="https://www.cakesolutions.net/teamblogs/low-pause-gc-on-the-jvm">an article about JVM tuning</a> that gives some pointers how to enable logging and tools to analyze logs for you</li>
<li>Also notes on <a href="https://blog.gceasy.io/2016/11/15/rotating-gc-log-files/">rotating GC logs</a></li>
<li>I decided to switch DSpace Test back to the CMS garbage collector because it is designed for low pauses and high throughput (like G1GC!) and because we haven&rsquo;t even tried to monitor or tune it</li>
</ul>

View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Notes"/> <meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -28,7 +28,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="CGIAR Library Migration"/> <meta name="twitter:card" content="summary"/><meta name="twitter:title" content="CGIAR Library Migration"/>
<meta name="twitter:description" content="Notes on the migration of the CGIAR Library to CGSpace"/> <meta name="twitter:description" content="Notes on the migration of the CGIAR Library to CGSpace"/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="CGSpace Notes"/> <meta name="twitter:card" content="summary"/><meta name="twitter:title" content="CGSpace Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="CGSpace Notes"/> <meta name="twitter:card" content="summary"/><meta name="twitter:title" content="CGSpace Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="CGSpace Notes"/> <meta name="twitter:card" content="summary"/><meta name="twitter:title" content="CGSpace Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Posts"/> <meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Posts"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Posts"/> <meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Posts"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Posts"/> <meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Posts"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -4,7 +4,7 @@
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/2017-11/</loc> <loc>https://alanorth.github.io/cgspace-notes/2017-11/</loc>
<lastmod>2017-11-19T23:10:58+02:00</lastmod> <lastmod>2017-11-20T09:19:44+02:00</lastmod>
</url> </url>
<url> <url>
@ -134,7 +134,7 @@
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/</loc> <loc>https://alanorth.github.io/cgspace-notes/</loc>
<lastmod>2017-11-19T23:10:58+02:00</lastmod> <lastmod>2017-11-20T09:19:44+02:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>
@ -145,7 +145,7 @@
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc> <loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
<lastmod>2017-11-19T23:10:58+02:00</lastmod> <lastmod>2017-11-20T09:19:44+02:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>
@ -157,13 +157,13 @@
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/post/</loc> <loc>https://alanorth.github.io/cgspace-notes/post/</loc>
<lastmod>2017-11-19T23:10:58+02:00</lastmod> <lastmod>2017-11-20T09:19:44+02:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc> <loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
<lastmod>2017-11-19T23:10:58+02:00</lastmod> <lastmod>2017-11-20T09:19:44+02:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>

View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Notes"/> <meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Notes"/> <meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />

View File

@ -25,7 +25,7 @@
<meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Notes"/> <meta name="twitter:card" content="summary"/><meta name="twitter:title" content="Notes"/>
<meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/> <meta name="twitter:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository."/>
<meta name="generator" content="Hugo 0.30.2" /> <meta name="generator" content="Hugo 0.31" />