Add notes for 2017-08-17

This commit is contained in:
Alan Orth 2017-08-17 11:43:00 +03:00
parent 692ef98cbb
commit 513fda2f8c
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
3 changed files with 103 additions and 8 deletions

View File

@ -237,3 +237,47 @@ isNotNull(value.match(/(.+?)\|\|\1/))
- Abenet was asking if there was some way to hide certain internal items from the "ILRI Research Outputs" RSS feed (which is the top-level ILRI community feed), because Shirley was complaining - Abenet was asking if there was some way to hide certain internal items from the "ILRI Research Outputs" RSS feed (which is the top-level ILRI community feed), because Shirley was complaining
- I think we could use `harvest.includerestricted.rss = false` but the items might need to be 100% restricted, not just the metadata - I think we could use `harvest.includerestricted.rss = false` but the items might need to be 100% restricted, not just the metadata
- Adjust Ansible postgres role to use `max_connections` from a template variable and deploy a new limit of 123 on CGSpace - Adjust Ansible postgres role to use `max_connections` from a template variable and deploy a new limit of 123 on CGSpace
## 2017-08-17
- Run Peter's edits to the CGIAR System Organization community on DSpace Test
- Uptime Robot said CGSpace went down for 1 minute, not sure why
- Looking in `dspace.log.2017-08-17` I see some weird errors that might be related?
```
2017-08-17 07:55:31,396 ERROR net.sf.ehcache.store.DiskStore @ cocoon-ehcacheCache: Could not read disk store element for key PK_G-aspect-cocoon://DRI/12/handle/10568/65885?pipelinehash=823411183535858997_T-Navigation-3368194896954203241. Error was invalid stream header: 00000000
java.io.StreamCorruptedException: invalid stream header: 00000000
```
- Weird that these errors seem to have started on August 11th, the same day we had capacity issues with PostgreSQL:
```
# grep -c "ERROR net.sf.ehcache.store.DiskStore" dspace.log.2017-08-*
dspace.log.2017-08-01:0
dspace.log.2017-08-02:0
dspace.log.2017-08-03:0
dspace.log.2017-08-04:0
dspace.log.2017-08-05:0
dspace.log.2017-08-06:0
dspace.log.2017-08-07:0
dspace.log.2017-08-08:0
dspace.log.2017-08-09:0
dspace.log.2017-08-10:0
dspace.log.2017-08-11:8806
dspace.log.2017-08-12:5496
dspace.log.2017-08-13:2925
dspace.log.2017-08-14:2135
dspace.log.2017-08-15:1506
dspace.log.2017-08-16:1935
dspace.log.2017-08-17:584
```
- There are none in 2017-07 either...
- A few posts on the dspace-tech mailing list say this is related to the Cocoon cache somehow
- I will clear the XMLUI cache for now and see if the errors continue (though perpaps shutting down Tomcat and removing the cache is more effective somehow?)
- We tested the option for limiting restricted items from the RSS feeds on DSpace Test
- I created four items, and only the two with public metadata showed up in the community's RSS feed:
- Public metadata, public bitstream ✓
- Public metadata, restricted bitstream ✓
- Restricted metadata, restricted bitstream ✗
- Private item ✗

View File

@ -37,7 +37,7 @@ Then I cleaned up the author authorities and HTML characters in OpenRefine and s
<meta property="article:published_time" content="2017-08-01T11:51:52&#43;03:00"/> <meta property="article:published_time" content="2017-08-01T11:51:52&#43;03:00"/>
<meta property="article:modified_time" content="2017-08-16T12:50:03&#43;03:00"/> <meta property="article:modified_time" content="2017-08-16T18:24:41&#43;03:00"/>
@ -85,9 +85,9 @@ Then I cleaned up the author authorities and HTML characters in OpenRefine and s
"@type": "BlogPosting", "@type": "BlogPosting",
"headline": "August, 2017", "headline": "August, 2017",
"url": "https://alanorth.github.io/cgspace-notes/2017-08/", "url": "https://alanorth.github.io/cgspace-notes/2017-08/",
"wordCount": "2619", "wordCount": "2826",
"datePublished": "2017-08-01T11:51:52&#43;03:00", "datePublished": "2017-08-01T11:51:52&#43;03:00",
"dateModified": "2017-08-16T12:50:03&#43;03:00", "dateModified": "2017-08-16T18:24:41&#43;03:00",
"author": { "author": {
"@type": "Person", "@type": "Person",
"name": "Alan Orth" "name": "Alan Orth"
@ -433,6 +433,57 @@ UPDATE 4899
<li>Adjust Ansible postgres role to use <code>max_connections</code> from a template variable and deploy a new limit of 123 on CGSpace</li> <li>Adjust Ansible postgres role to use <code>max_connections</code> from a template variable and deploy a new limit of 123 on CGSpace</li>
</ul> </ul>
<h2 id="2017-08-17">2017-08-17</h2>
<ul>
<li>Run Peter&rsquo;s edits to the CGIAR System Organization community on DSpace Test</li>
<li>Uptime Robot said CGSpace went down for 1 minute, not sure why</li>
<li>Looking in <code>dspace.log.2017-08-17</code> I see some weird errors that might be related?</li>
</ul>
<pre><code>2017-08-17 07:55:31,396 ERROR net.sf.ehcache.store.DiskStore @ cocoon-ehcacheCache: Could not read disk store element for key PK_G-aspect-cocoon://DRI/12/handle/10568/65885?pipelinehash=823411183535858997_T-Navigation-3368194896954203241. Error was invalid stream header: 00000000
java.io.StreamCorruptedException: invalid stream header: 00000000
</code></pre>
<ul>
<li>Weird that these errors seem to have started on August 11th, the same day we had capacity issues with PostgreSQL:</li>
</ul>
<pre><code># grep -c &quot;ERROR net.sf.ehcache.store.DiskStore&quot; dspace.log.2017-08-*
dspace.log.2017-08-01:0
dspace.log.2017-08-02:0
dspace.log.2017-08-03:0
dspace.log.2017-08-04:0
dspace.log.2017-08-05:0
dspace.log.2017-08-06:0
dspace.log.2017-08-07:0
dspace.log.2017-08-08:0
dspace.log.2017-08-09:0
dspace.log.2017-08-10:0
dspace.log.2017-08-11:8806
dspace.log.2017-08-12:5496
dspace.log.2017-08-13:2925
dspace.log.2017-08-14:2135
dspace.log.2017-08-15:1506
dspace.log.2017-08-16:1935
dspace.log.2017-08-17:584
</code></pre>
<ul>
<li>There are none in 2017-07 either&hellip;</li>
<li>A few posts on the dspace-tech mailing list say this is related to the Cocoon cache somehow</li>
<li>I will clear the XMLUI cache for now and see if the errors continue (though perpaps shutting down Tomcat and removing the cache is more effective somehow?)</li>
<li>We tested the option for limiting restricted items from the RSS feeds on DSpace Test</li>
<li>I created four items, and only the two with public metadata showed up in the community&rsquo;s RSS feed:
<ul>
<li>Public metadata, public bitstream ✓</li>
<li>Public metadata, restricted bitstream ✓</li>
<li>Restricted metadata, restricted bitstream ✗</li>
<li>Private item ✗</li>
</ul></li>
</ul>

View File

@ -4,7 +4,7 @@
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/2017-08/</loc> <loc>https://alanorth.github.io/cgspace-notes/2017-08/</loc>
<lastmod>2017-08-16T12:50:03+03:00</lastmod> <lastmod>2017-08-16T18:24:41+03:00</lastmod>
</url> </url>
<url> <url>
@ -114,7 +114,7 @@
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/</loc> <loc>https://alanorth.github.io/cgspace-notes/</loc>
<lastmod>2017-08-16T12:50:03+03:00</lastmod> <lastmod>2017-08-16T18:24:41+03:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>
@ -125,19 +125,19 @@
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc> <loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
<lastmod>2017-08-16T12:50:03+03:00</lastmod> <lastmod>2017-08-16T18:24:41+03:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/post/</loc> <loc>https://alanorth.github.io/cgspace-notes/post/</loc>
<lastmod>2017-08-16T12:50:03+03:00</lastmod> <lastmod>2017-08-16T18:24:41+03:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>
<url> <url>
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc> <loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
<lastmod>2017-08-16T12:50:03+03:00</lastmod> <lastmod>2017-08-16T18:24:41+03:00</lastmod>
<priority>0</priority> <priority>0</priority>
</url> </url>