mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-11-21 22:25:02 +01:00
Regenerate public
This commit is contained in:
parent
af2d6b3d8f
commit
5545aa5ca6
@ -307,6 +307,7 @@ db.statementpool = true
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -326,6 +327,8 @@ db.statementpool = true
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -224,7 +224,7 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
|
||||
<li>CCAFS noticed that one of their items displays only the Atmire statlets: <a href="https://cgspace.cgiar.org/handle/10568/42445">https://cgspace.cgiar.org/handle/10568/42445</a></li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2015/12/ccafs-item-no-metadata.png" alt="CCAFS item" /></p>
|
||||
<p><img src="/cgspace-notes/2015/12/ccafs-item-no-metadata.png" alt="CCAFS item" /></p>
|
||||
|
||||
<ul>
|
||||
<li>The authorizations for the item are all public READ, and I don’t see any errors in dspace.log when browsing that item</li>
|
||||
@ -280,10 +280,10 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
|
||||
<li>The PostgreSQL stats from Munin all point to something database-related with the DSpace 5 upgrade around mid–late November</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2015/12/postgres_bgwriter-year.png" alt="PostgreSQL bgwriter (year)" />
|
||||
<img src="2015/12/postgres_cache_cgspace-year.png" alt="PostgreSQL cache (year)" />
|
||||
<img src="2015/12/postgres_locks_cgspace-year.png" alt="PostgreSQL locks (year)" />
|
||||
<img src="2015/12/postgres_scans_cgspace-year.png" alt="PostgreSQL scans (year)" /></p>
|
||||
<p><img src="/cgspace-notes/2015/12/postgres_bgwriter-year.png" alt="PostgreSQL bgwriter (year)" />
|
||||
<img src="/cgspace-notes/2015/12/postgres_cache_cgspace-year.png" alt="PostgreSQL cache (year)" />
|
||||
<img src="/cgspace-notes/2015/12/postgres_locks_cgspace-year.png" alt="PostgreSQL locks (year)" />
|
||||
<img src="/cgspace-notes/2015/12/postgres_scans_cgspace-year.png" alt="PostgreSQL scans (year)" /></p>
|
||||
|
||||
<h2 id="2015-12-07">2015-12-07</h2>
|
||||
|
||||
@ -325,6 +325,7 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -344,6 +345,8 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -213,13 +213,13 @@ $ find SimpleArchiveForBio/ -iname “*.pdf” -exec basename {} \; | so
|
||||
<li>This <a href="https://cgspace.cgiar.org/handle/10568/67062">CCAFS item</a> Before:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/01/xmlui-subjects-before.png" alt="XMLUI subjects before" /></p>
|
||||
<p><img src="/cgspace-notes/2016/01/xmlui-subjects-before.png" alt="XMLUI subjects before" /></p>
|
||||
|
||||
<ul>
|
||||
<li>After:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/01/xmlui-subjects-after.png" alt="XMLUI subjects after" /></p>
|
||||
<p><img src="/cgspace-notes/2016/01/xmlui-subjects-after.png" alt="XMLUI subjects after" /></p>
|
||||
|
||||
|
||||
|
||||
@ -235,6 +235,7 @@ $ find SimpleArchiveForBio/ -iname “*.pdf” -exec basename {} \; | so
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -254,6 +255,8 @@ $ find SimpleArchiveForBio/ -iname “*.pdf” -exec basename {} \; | so
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -163,7 +163,7 @@ Also, lots of things like “COTE D`LVOIRE” and “COTE D IVOIRE&r
|
||||
<li>I noticed we have a very <em>interesting</em> list of countries on CGSpace:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/02/cgspace-countries.png" alt="CGSpace country list" /></p>
|
||||
<p><img src="/cgspace-notes/2016/02/cgspace-countries.png" alt="CGSpace country list" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)…</li>
|
||||
@ -274,8 +274,8 @@ $ /opt/brew/Cellar/tomcat/8.0.30/bin/catalina start
|
||||
<li>Whip up some quick CSS to make the button in the submission workflow use the XMLUI theme’s brand colors (<a href="https://github.com/ilri/DSpace/issues/154">#154</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/02/submit-button-ilri.png" alt="ILRI submission buttons" />
|
||||
<img src="2016/02/submit-button-drylands.png" alt="Drylands submission buttons" /></p>
|
||||
<p><img src="/cgspace-notes/2016/02/submit-button-ilri.png" alt="ILRI submission buttons" />
|
||||
<img src="/cgspace-notes/2016/02/submit-button-drylands.png" alt="Drylands submission buttons" /></p>
|
||||
|
||||
<h2 id="2016-02-09">2016-02-09</h2>
|
||||
|
||||
@ -495,6 +495,7 @@ Bitstream: tést señora alimentación.pdf
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -514,6 +515,8 @@ Bitstream: tést señora alimentación.pdf
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -175,7 +175,7 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
|
||||
<li>It is very messed up because some labels are incorrect, fields are missing, etc</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/cua-label-mixup.png" alt="Mixed up label in Atmire CUA" /></p>
|
||||
<p><img src="/cgspace-notes/2016/03/cua-label-mixup.png" alt="Mixed up label in Atmire CUA" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Update documentation for Atmire modules</li>
|
||||
@ -200,7 +200,7 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
|
||||
<li>Also four or so center-specific subject strings were missing for Discovery</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/missing-xmlui-string.png" alt="Missing XMLUI string" /></p>
|
||||
<p><img src="/cgspace-notes/2016/03/missing-xmlui-string.png" alt="Missing XMLUI string" /></p>
|
||||
|
||||
<h2 id="2016-03-15">2016-03-15</h2>
|
||||
|
||||
@ -257,13 +257,13 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
|
||||
<li>Some of their items end up with thumbnails that have a big white border around them:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/bioversity-thumbnail-bad.jpg" alt="Excessive whitespace in thumbnail" /></p>
|
||||
<p><img src="/cgspace-notes/2016/03/bioversity-thumbnail-bad.jpg" alt="Excessive whitespace in thumbnail" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Turns out we can add <code>-trim</code> to the GraphicsMagick options to trim the whitespace</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/bioversity-thumbnail-good.jpg" alt="Trimmed thumbnail" /></p>
|
||||
<p><img src="/cgspace-notes/2016/03/bioversity-thumbnail-good.jpg" alt="Trimmed thumbnail" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Command used:</li>
|
||||
@ -297,7 +297,7 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
|
||||
<li>On a related note, we have 51,000 items indexed from the sitemap, but 500,000 items in the Google index, so we DEFINITELY have a problem with duplicate content</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/google-index.png" alt="CGSpace pages in Google index" /></p>
|
||||
<p><img src="/cgspace-notes/2016/03/google-index.png" alt="CGSpace pages in Google index" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Turns out this is a problem with DSpace’s <code>robots.txt</code>, and there’s a Jira ticket since December, 2015: <a href="https://jira.duraspace.org/browse/DS-2962">https://jira.duraspace.org/browse/DS-2962</a></li>
|
||||
@ -305,8 +305,8 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
|
||||
<li>For now I’ve just set a bunch of these dynamic pages to not appear in search results by using the URL Parameters tool in Webmaster Tools</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/url-parameters.png" alt="URL parameters cause millions of dynamic pages" />
|
||||
<img src="2016/03/url-parameters2.png" alt="Setting pages with the filter_0 param not to show in search results" /></p>
|
||||
<p><img src="/cgspace-notes/2016/03/url-parameters.png" alt="URL parameters cause millions of dynamic pages" />
|
||||
<img src="/cgspace-notes/2016/03/url-parameters2.png" alt="Setting pages with the filter_0 param not to show in search results" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Move AVCD collection to new community and update <code>move_collection.sh</code> script: <a href="https://gist.github.com/alanorth/392c4660e8b022d99dfa">https://gist.github.com/alanorth/392c4660e8b022d99dfa</a></li>
|
||||
@ -388,6 +388,7 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -407,6 +408,8 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -607,6 +607,7 @@ dspace.log.2016-04-27:7271
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -626,6 +627,8 @@ dspace.log.2016-04-27:7271
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -180,7 +180,7 @@ There are 3,000 IPs accessing the REST API in a 24-hour period!
|
||||
<li>Fix a reference to <code>dc.type.output</code> in Discovery that I had missed when we migrated to <code>dc.type</code> last month (<a href="https://github.com/ilri/DSpace/pull/223">#223</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/05/discovery-types.png" alt="Item type in Discovery results" /></p>
|
||||
<p><img src="/cgspace-notes/2016/05/discovery-types.png" alt="Item type in Discovery results" /></p>
|
||||
|
||||
<h2 id="2016-05-06">2016-05-06</h2>
|
||||
|
||||
@ -459,6 +459,7 @@ sys 0m20.540s
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -478,6 +479,8 @@ sys 0m20.540s
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -466,7 +466,7 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
|
||||
<li>Now the sharing and Altmetric bits are more prominent:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/06/xmlui-altmetric-sharing.png" alt="DSpace 5.1 XMLUI With Altmetric Badge" /></p>
|
||||
<p><img src="/cgspace-notes/2016/06/xmlui-altmetric-sharing.png" alt="DSpace 5.1 XMLUI With Altmetric Badge" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Run all system updates on the servers and reboot</li>
|
||||
@ -503,6 +503,7 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -522,6 +523,8 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -390,7 +390,7 @@ index.authority.ignore-variants=true
|
||||
<li>Integrate and massively clean up About page (<a href="https://github.com/ilri/DSpace/pull/256">#256</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/07/cgspace-about-page.png" alt="About page" /></p>
|
||||
<p><img src="/cgspace-notes/2016/07/cgspace-about-page.png" alt="About page" /></p>
|
||||
|
||||
<ul>
|
||||
<li>The DSpace source code mentions the configuration key <code>discovery.index.authority.ignore-prefered.*</code> (with prefix of discovery, despite the docs saying otherwise), so I’m trying the following on DSpace Test:</li>
|
||||
@ -429,6 +429,7 @@ discovery.index.authority.ignore-variants=true
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -448,6 +449,8 @@ discovery.index.authority.ignore-variants=true
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -279,7 +279,7 @@ $ ln -sv ~/dspace/webapps/solr /opt/brew/Cellar/tomcat/8.5.4/libexec/webapps/sol
|
||||
<li>Finally got DSpace (5.5) running on Ubuntu 16.04, Tomcat 7, Java 8, PostgreSQL 9.5 via the updated Ansible stuff</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/08/dspace55-ubuntu16.04.png" alt="DSpace 5.5 on Ubuntu 16.04, Tomcat 7, Java 8, PostgreSQL 9.5" /></p>
|
||||
<p><img src="/cgspace-notes/2016/08/dspace55-ubuntu16.04.png" alt="DSpace 5.5 on Ubuntu 16.04, Tomcat 7, Java 8, PostgreSQL 9.5" /></p>
|
||||
|
||||
<h2 id="2016-08-14">2016-08-14</h2>
|
||||
|
||||
@ -293,7 +293,7 @@ $ ln -sv ~/dspace/webapps/solr /opt/brew/Cellar/tomcat/8.5.4/libexec/webapps/sol
|
||||
<li>Notes on NodeJS + nginx + systemd: <a href="https://gist.github.com/alanorth/51acd476891c67dfe27725848cf5ace1">https://gist.github.com/alanorth/51acd476891c67dfe27725848cf5ace1</a></li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/08/nodejs-nginx.png" alt="ExpressJS running behind nginx" /></p>
|
||||
<p><img src="/cgspace-notes/2016/08/nodejs-nginx.png" alt="ExpressJS running behind nginx" /></p>
|
||||
|
||||
<h2 id="2016-08-16">2016-08-16</h2>
|
||||
|
||||
@ -499,6 +499,7 @@ $ JAVA_OPTS="-Dfile.encoding=UTF-8 -Xmx512m" /home/cgspace.cgiar.org/b
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -518,6 +519,8 @@ $ JAVA_OPTS="-Dfile.encoding=UTF-8 -Xmx512m" /home/cgspace.cgiar.org/b
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -172,7 +172,7 @@ distinguishedName: CN=Last\, First (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Eth
|
||||
<li>Changing the DSpace LDAP config to use <code>OU=ILRIHUB</code> seems to work:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/ilri-ldap-users.png" alt="DSpace groups based on LDAP DN" /></p>
|
||||
<p><img src="/cgspace-notes/2016/09/ilri-ldap-users.png" alt="DSpace groups based on LDAP DN" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Notes for local PostgreSQL database recreation from production snapshot:</li>
|
||||
@ -519,9 +519,9 @@ java.util.Map does not have a no-arg default constructor.
|
||||
<li>Perhaps these particular issues <em>are</em> memory issues, the munin graphs definitely show some weird purging/allocating behavior starting this week</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/tomcat_jvm-day.png" alt="Tomcat JVM usage day" />
|
||||
<img src="2016/09/tomcat_jvm-week.png" alt="Tomcat JVM usage week" />
|
||||
<img src="2016/09/tomcat_jvm-month.png" alt="Tomcat JVM usage month" /></p>
|
||||
<p><img src="/cgspace-notes/2016/09/tomcat_jvm-day.png" alt="Tomcat JVM usage day" />
|
||||
<img src="/cgspace-notes/2016/09/tomcat_jvm-week.png" alt="Tomcat JVM usage week" />
|
||||
<img src="/cgspace-notes/2016/09/tomcat_jvm-month.png" alt="Tomcat JVM usage month" /></p>
|
||||
|
||||
<ul>
|
||||
<li>And really, we did reduce the memory of CGSpace in late 2015, so maybe we should just increase it again, now that our usage is higher and we are having memory errors in the logs</li>
|
||||
@ -543,7 +543,7 @@ java.util.Map does not have a no-arg default constructor.
|
||||
<li>Looking at Google Webmaster Tools again, it seems the work I did on URL query parameters and blocking via the <code>X-Robots-Tag</code> HTTP header in March, 2016 seem to have had a positive effect on Google’s index for CGSpace</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/google-webmaster-tools-index.png" alt="Google Webmaster Tools for CGSpace" /></p>
|
||||
<p><img src="/cgspace-notes/2016/09/google-webmaster-tools-index.png" alt="Google Webmaster Tools for CGSpace" /></p>
|
||||
|
||||
<h2 id="2016-09-16">2016-09-16</h2>
|
||||
|
||||
@ -631,8 +631,8 @@ $ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2
|
||||
<li>It actually works really well, and search results return much less hits now (before, after):</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/cgspace-search.png" alt="CGSpace search with "OR" boolean logic" />
|
||||
<img src="2016/09/dspacetest-search.png" alt="DSpace Test search with "AND" boolean logic" /></p>
|
||||
<p><img src="/cgspace-notes/2016/09/cgspace-search.png" alt="CGSpace search with "OR" boolean logic" />
|
||||
<img src="/cgspace-notes/2016/09/dspacetest-search.png" alt="DSpace Test search with "AND" boolean logic" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Found a way to improve the configuration of Atmire’s Content and Usage Analysis (CUA) module for date fields</li>
|
||||
@ -795,6 +795,7 @@ $ ./delete-metadata-values.py -i ilrisubjects-delete-13.csv -f cg.subject.ilri -
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -814,6 +815,8 @@ $ ./delete-metadata-values.py -i ilrisubjects-delete-13.csv -f cg.subject.ilri -
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -134,7 +134,7 @@
|
||||
<li>I added the <a href="https://github.com/ilri/DSpace/issues/234">disclaimer text</a> to the About page, then added a footer link to the disclaimer’s ID, but there is a Bootstrap issue that causes the page content to disappear when using in-page anchors: <a href="https://github.com/twbs/bootstrap/issues/1768">https://github.com/twbs/bootstrap/issues/1768</a></li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/10/bootstrap-issue.png" alt="Bootstrap issue with in-page anchors" /></p>
|
||||
<p><img src="/cgspace-notes/2016/10/bootstrap-issue.png" alt="Bootstrap issue with in-page anchors" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Looks like we’ll just have to add the text to the About page (without a link) or add a separate page</li>
|
||||
@ -182,7 +182,7 @@ $ ./delete-metadata-values.py -i authors-delete-3.csv -f dc.contributor.author -
|
||||
<li>Magdalena from CCAFS asked why the colors in the thumbnails for these <a href="https://cgspace.cgiar.org/handle/10568/71249">two</a> <a href="https://cgspace.cgiar.org/handle/10568/71259">items</a> look different, even though they are the same in the PDF itself</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/10/cmyk-vs-srgb.jpg" alt="CMYK vs sRGB colors" /></p>
|
||||
<p><img src="/cgspace-notes/2016/10/cmyk-vs-srgb.jpg" alt="CMYK vs sRGB colors" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Turns out the first PDF was exported from InDesign using CMYK and the second one was using sRGB</li>
|
||||
@ -364,8 +364,8 @@ UPDATE 0
|
||||
<li>Looks much better now:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/10/cgspace-icons.png" alt="CGSpace with old icons" />
|
||||
<img src="2016/10/dspacetest-fontawesome-icons.png" alt="DSpace Test with Font Awesome icons" /></p>
|
||||
<p><img src="/cgspace-notes/2016/10/cgspace-icons.png" alt="CGSpace with old icons" />
|
||||
<img src="/cgspace-notes/2016/10/dspacetest-fontawesome-icons.png" alt="DSpace Test with Font Awesome icons" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Run the same replacements on CGSpace</li>
|
||||
@ -438,6 +438,7 @@ dspace=# update metadatavalue set text_value = regexp_replace(text_value, 'http:
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -457,6 +458,8 @@ dspace=# update metadatavalue set text_value = regexp_replace(text_value, 'http:
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -118,7 +118,7 @@
|
||||
<li>Add <code>dc.type</code> to the output options for Atmire’s Listings and Reports module (<a href="https://github.com/ilri/DSpace/pull/286">#286</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
<p><img src="/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
|
||||
<h2 id="2016-11-02">2016-11-02</h2>
|
||||
|
||||
@ -204,7 +204,7 @@ COPY 22
|
||||
<li>Atmire’s Listings and Reports module seems to be broken on DSpace 5.5</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/11/listings-and-reports-55.png" alt="Listings and Reports broken in DSpace 5.5" /></p>
|
||||
<p><img src="/cgspace-notes/2016/11/listings-and-reports-55.png" alt="Listings and Reports broken in DSpace 5.5" /></p>
|
||||
|
||||
<ul>
|
||||
<li>I’ve filed a ticket with Atmire</li>
|
||||
@ -402,8 +402,8 @@ X-Cocoon-Version: 2.2.0
|
||||
<li>The Tomcat JVM heap looks really good after applying the Crawler Session Manager fix on DSpace Test last night:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/11/dspacetest-tomcat-jvm-day.png" alt="Tomcat JVM heap (day) after setting up the Crawler Session Manager" />
|
||||
<img src="2016/11/dspacetest-tomcat-jvm-week.png" alt="Tomcat JVM heap (week) after setting up the Crawler Session Manager" /></p>
|
||||
<p><img src="/cgspace-notes/2016/11/dspacetest-tomcat-jvm-day.png" alt="Tomcat JVM heap (day) after setting up the Crawler Session Manager" />
|
||||
<img src="/cgspace-notes/2016/11/dspacetest-tomcat-jvm-week.png" alt="Tomcat JVM heap (week) after setting up the Crawler Session Manager" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Seems the default regex doesn’t catch Baidu, though:</li>
|
||||
@ -670,6 +670,7 @@ org.dspace.discovery.SearchServiceException: Error executing query
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -689,6 +690,8 @@ org.dspace.discovery.SearchServiceException: Error executing query
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -584,8 +584,8 @@ dspace=# update metadatavalue set authority='2df8136e-d8f4-4142-b58c-562337cab76
|
||||
<li>After enabling a sizable <code>shared_buffers</code> for CGSpace’s PostgreSQL configuration the number of connections to the database dropped significantly</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/12/postgres_bgwriter-week.png" alt="postgres_bgwriter-week" />
|
||||
<img src="2016/12/postgres_connections_ALL-week.png" alt="postgres_connections_ALL-week" /></p>
|
||||
<p><img src="/cgspace-notes/2016/12/postgres_bgwriter-week.png" alt="postgres_bgwriter-week" />
|
||||
<img src="/cgspace-notes/2016/12/postgres_connections_ALL-week.png" alt="postgres_connections_ALL-week" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Looking at CIAT records from last week again, they have a lot of double authors like:</li>
|
||||
@ -630,8 +630,8 @@ UPDATE 35
|
||||
<li>Checking in on CGSpace postgres stats again, looks like the <code>shared_buffers</code> change from a few days ago really made a big impact:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/12/postgres_bgwriter-week-2016-12-13.png" alt="postgres_bgwriter-week" />
|
||||
<img src="2016/12/postgres_connections_ALL-week-2016-12-13.png" alt="postgres_connections_ALL-week" /></p>
|
||||
<p><img src="/cgspace-notes/2016/12/postgres_bgwriter-week-2016-12-13.png" alt="postgres_bgwriter-week" />
|
||||
<img src="/cgspace-notes/2016/12/postgres_connections_ALL-week-2016-12-13.png" alt="postgres_connections_ALL-week" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Looking at logs, it seems we need to evaluate which logs we keep and for how long</li>
|
||||
@ -748,8 +748,8 @@ Caused by: java.lang.NoSuchMethodError: com.atmire.statistics.generator.DSpaceOb
|
||||
<li>Run a batch edit to add “RANGELANDS” ILRI subject to all items containing the word “RANGELANDS” in their metadata for Peter Ballantyne</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/12/batch-edit1.png" alt="Select all items with "rangelands" in metadata" />
|
||||
<img src="2016/12/batch-edit2.png" alt="Add RANGELANDS ILRI subject" /></p>
|
||||
<p><img src="/cgspace-notes/2016/12/batch-edit1.png" alt="Select all items with "rangelands" in metadata" />
|
||||
<img src="/cgspace-notes/2016/12/batch-edit2.png" alt="Add RANGELANDS ILRI subject" /></p>
|
||||
|
||||
<h2 id="2016-12-18">2016-12-18</h2>
|
||||
|
||||
@ -882,6 +882,7 @@ $ exit
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -901,6 +902,8 @@ $ exit
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -30,7 +30,7 @@
|
||||
|
||||
|
||||
<meta itemprop="dateModified" content="2017-01-02T10:43:00+03:00" />
|
||||
<meta itemprop="wordCount" content="413">
|
||||
<meta itemprop="wordCount" content="453">
|
||||
|
||||
|
||||
|
||||
@ -208,6 +208,15 @@ Caused by: java.net.SocketException: Broken pipe (Write failed)
|
||||
<li>Put Sisay’s <code>item-view.xsl</code> code to show mapped collections on CGSpace (<a href="https://github.com/ilri/DSpace/pull/295">#295</a>)</li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-01-09">2017-01-09</h2>
|
||||
|
||||
<ul>
|
||||
<li>A user wrote to tell me that the new display of an item’s mappings had a crazy bug for at least one item: <a href="https://cgspace.cgiar.org/handle/10568/78596">https://cgspace.cgiar.org/handle/10568/78596</a></li>
|
||||
<li>She said she only mapped it once, but it appears to be mapped 184 times</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="/cgspace-notes/2017/01/mapping-crazy-duplicate.png" alt="Crazy item mapping" /></p>
|
||||
|
||||
|
||||
|
||||
|
||||
@ -223,6 +232,7 @@ Caused by: java.net.SocketException: Broken pipe (Write failed)
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -242,6 +252,8 @@ Caused by: java.net.SocketException: Broken pipe (Write failed)
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
BIN
public/2017/01/mapping-crazy-duplicate.png
Normal file
BIN
public/2017/01/mapping-crazy-duplicate.png
Normal file
Binary file not shown.
After Width: | Height: | Size: 5.3 KiB |
File diff suppressed because one or more lines are too long
@ -347,6 +347,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -366,6 +367,8 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -112,6 +112,15 @@ Caused by: java.net.SocketException: Broken pipe (Write failed)
|
||||
<ul>
|
||||
<li>Put Sisay&rsquo;s <code>item-view.xsl</code> code to show mapped collections on CGSpace (<a href="https://github.com/ilri/DSpace/pull/295">#295</a>)</li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-01-09">2017-01-09</h2>
|
||||
|
||||
<ul>
|
||||
<li>A user wrote to tell me that the new display of an item&rsquo;s mappings had a crazy bug for at least one item: <a href="https://cgspace.cgiar.org/handle/10568/78596">https://cgspace.cgiar.org/handle/10568/78596</a></li>
|
||||
<li>She said she only mapped it once, but it appears to be mapped 184 times</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2017/01/mapping-crazy-duplicate.png" alt="Crazy item mapping" /></p>
|
||||
</description>
|
||||
</item>
|
||||
|
||||
@ -595,8 +604,8 @@ dspace=# update metadatavalue set authority='2df8136e-d8f4-4142-b58c-562337c
|
||||
<li>After enabling a sizable <code>shared_buffers</code> for CGSpace&rsquo;s PostgreSQL configuration the number of connections to the database dropped significantly</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/12/postgres_bgwriter-week.png" alt="postgres_bgwriter-week" />
|
||||
<img src="2016/12/postgres_connections_ALL-week.png" alt="postgres_connections_ALL-week" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/postgres_bgwriter-week.png" alt="postgres_bgwriter-week" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/postgres_connections_ALL-week.png" alt="postgres_connections_ALL-week" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Looking at CIAT records from last week again, they have a lot of double authors like:</li>
|
||||
@ -641,8 +650,8 @@ UPDATE 35
|
||||
<li>Checking in on CGSpace postgres stats again, looks like the <code>shared_buffers</code> change from a few days ago really made a big impact:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/12/postgres_bgwriter-week-2016-12-13.png" alt="postgres_bgwriter-week" />
|
||||
<img src="2016/12/postgres_connections_ALL-week-2016-12-13.png" alt="postgres_connections_ALL-week" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/postgres_bgwriter-week-2016-12-13.png" alt="postgres_bgwriter-week" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/postgres_connections_ALL-week-2016-12-13.png" alt="postgres_connections_ALL-week" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Looking at logs, it seems we need to evaluate which logs we keep and for how long</li>
|
||||
@ -759,8 +768,8 @@ Caused by: java.lang.NoSuchMethodError: com.atmire.statistics.generator.DSpaceOb
|
||||
<li>Run a batch edit to add &ldquo;RANGELANDS&rdquo; ILRI subject to all items containing the word &ldquo;RANGELANDS&rdquo; in their metadata for Peter Ballantyne</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/12/batch-edit1.png" alt="Select all items with &quot;rangelands&quot; in metadata" />
|
||||
<img src="2016/12/batch-edit2.png" alt="Add RANGELANDS ILRI subject" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/batch-edit1.png" alt="Select all items with &quot;rangelands&quot; in metadata" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/batch-edit2.png" alt="Add RANGELANDS ILRI subject" /></p>
|
||||
|
||||
<h2 id="2016-12-18">2016-12-18</h2>
|
||||
|
||||
@ -894,7 +903,7 @@ $ exit
|
||||
<li>Add <code>dc.type</code> to the output options for Atmire&rsquo;s Listings and Reports module (<a href="https://github.com/ilri/DSpace/pull/286">#286</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
|
||||
<h2 id="2016-11-02">2016-11-02</h2>
|
||||
|
||||
@ -980,7 +989,7 @@ COPY 22
|
||||
<li>Atmire&rsquo;s Listings and Reports module seems to be broken on DSpace 5.5</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/11/listings-and-reports-55.png" alt="Listings and Reports broken in DSpace 5.5" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports-55.png" alt="Listings and Reports broken in DSpace 5.5" /></p>
|
||||
|
||||
<ul>
|
||||
<li>I&rsquo;ve filed a ticket with Atmire</li>
|
||||
@ -1178,8 +1187,8 @@ X-Cocoon-Version: 2.2.0
|
||||
<li>The Tomcat JVM heap looks really good after applying the Crawler Session Manager fix on DSpace Test last night:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/11/dspacetest-tomcat-jvm-day.png" alt="Tomcat JVM heap (day) after setting up the Crawler Session Manager" />
|
||||
<img src="2016/11/dspacetest-tomcat-jvm-week.png" alt="Tomcat JVM heap (week) after setting up the Crawler Session Manager" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/dspacetest-tomcat-jvm-day.png" alt="Tomcat JVM heap (day) after setting up the Crawler Session Manager" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/dspacetest-tomcat-jvm-week.png" alt="Tomcat JVM heap (week) after setting up the Crawler Session Manager" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Seems the default regex doesn&rsquo;t catch Baidu, though:</li>
|
||||
@ -1463,7 +1472,7 @@ org.dspace.discovery.SearchServiceException: Error executing query
|
||||
<li>I added the <a href="https://github.com/ilri/DSpace/issues/234">disclaimer text</a> to the About page, then added a footer link to the disclaimer&rsquo;s ID, but there is a Bootstrap issue that causes the page content to disappear when using in-page anchors: <a href="https://github.com/twbs/bootstrap/issues/1768">https://github.com/twbs/bootstrap/issues/1768</a></li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/10/bootstrap-issue.png" alt="Bootstrap issue with in-page anchors" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/10/bootstrap-issue.png" alt="Bootstrap issue with in-page anchors" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Looks like we&rsquo;ll just have to add the text to the About page (without a link) or add a separate page</li>
|
||||
@ -1511,7 +1520,7 @@ $ ./delete-metadata-values.py -i authors-delete-3.csv -f dc.contributor.author -
|
||||
<li>Magdalena from CCAFS asked why the colors in the thumbnails for these <a href="https://cgspace.cgiar.org/handle/10568/71249">two</a> <a href="https://cgspace.cgiar.org/handle/10568/71259">items</a> look different, even though they are the same in the PDF itself</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/10/cmyk-vs-srgb.jpg" alt="CMYK vs sRGB colors" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/10/cmyk-vs-srgb.jpg" alt="CMYK vs sRGB colors" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Turns out the first PDF was exported from InDesign using CMYK and the second one was using sRGB</li>
|
||||
@ -1693,8 +1702,8 @@ UPDATE 0
|
||||
<li>Looks much better now:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/10/cgspace-icons.png" alt="CGSpace with old icons" />
|
||||
<img src="2016/10/dspacetest-fontawesome-icons.png" alt="DSpace Test with Font Awesome icons" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/10/cgspace-icons.png" alt="CGSpace with old icons" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/10/dspacetest-fontawesome-icons.png" alt="DSpace Test with Font Awesome icons" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Run the same replacements on CGSpace</li>
|
||||
@ -1786,7 +1795,7 @@ distinguishedName: CN=Last\, First (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Eth
|
||||
<li>Changing the DSpace LDAP config to use <code>OU=ILRIHUB</code> seems to work:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/ilri-ldap-users.png" alt="DSpace groups based on LDAP DN" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/ilri-ldap-users.png" alt="DSpace groups based on LDAP DN" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Notes for local PostgreSQL database recreation from production snapshot:</li>
|
||||
@ -2133,9 +2142,9 @@ java.util.Map does not have a no-arg default constructor.
|
||||
<li>Perhaps these particular issues <em>are</em> memory issues, the munin graphs definitely show some weird purging/allocating behavior starting this week</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/tomcat_jvm-day.png" alt="Tomcat JVM usage day" />
|
||||
<img src="2016/09/tomcat_jvm-week.png" alt="Tomcat JVM usage week" />
|
||||
<img src="2016/09/tomcat_jvm-month.png" alt="Tomcat JVM usage month" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/tomcat_jvm-day.png" alt="Tomcat JVM usage day" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/tomcat_jvm-week.png" alt="Tomcat JVM usage week" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/tomcat_jvm-month.png" alt="Tomcat JVM usage month" /></p>
|
||||
|
||||
<ul>
|
||||
<li>And really, we did reduce the memory of CGSpace in late 2015, so maybe we should just increase it again, now that our usage is higher and we are having memory errors in the logs</li>
|
||||
@ -2157,7 +2166,7 @@ java.util.Map does not have a no-arg default constructor.
|
||||
<li>Looking at Google Webmaster Tools again, it seems the work I did on URL query parameters and blocking via the <code>X-Robots-Tag</code> HTTP header in March, 2016 seem to have had a positive effect on Google&rsquo;s index for CGSpace</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/google-webmaster-tools-index.png" alt="Google Webmaster Tools for CGSpace" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/google-webmaster-tools-index.png" alt="Google Webmaster Tools for CGSpace" /></p>
|
||||
|
||||
<h2 id="2016-09-16">2016-09-16</h2>
|
||||
|
||||
@ -2245,8 +2254,8 @@ $ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2
|
||||
<li>It actually works really well, and search results return much less hits now (before, after):</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/cgspace-search.png" alt="CGSpace search with &quot;OR&quot; boolean logic" />
|
||||
<img src="2016/09/dspacetest-search.png" alt="DSpace Test search with &quot;AND&quot; boolean logic" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/cgspace-search.png" alt="CGSpace search with &quot;OR&quot; boolean logic" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/dspacetest-search.png" alt="DSpace Test search with &quot;AND&quot; boolean logic" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Found a way to improve the configuration of Atmire&rsquo;s Content and Usage Analysis (CUA) module for date fields</li>
|
||||
@ -2523,7 +2532,7 @@ $ ln -sv ~/dspace/webapps/solr /opt/brew/Cellar/tomcat/8.5.4/libexec/webapps/sol
|
||||
<li>Finally got DSpace (5.5) running on Ubuntu 16.04, Tomcat 7, Java 8, PostgreSQL 9.5 via the updated Ansible stuff</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/08/dspace55-ubuntu16.04.png" alt="DSpace 5.5 on Ubuntu 16.04, Tomcat 7, Java 8, PostgreSQL 9.5" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/08/dspace55-ubuntu16.04.png" alt="DSpace 5.5 on Ubuntu 16.04, Tomcat 7, Java 8, PostgreSQL 9.5" /></p>
|
||||
|
||||
<h2 id="2016-08-14">2016-08-14</h2>
|
||||
|
||||
@ -2537,7 +2546,7 @@ $ ln -sv ~/dspace/webapps/solr /opt/brew/Cellar/tomcat/8.5.4/libexec/webapps/sol
|
||||
<li>Notes on NodeJS + nginx + systemd: <a href="https://gist.github.com/alanorth/51acd476891c67dfe27725848cf5ace1">https://gist.github.com/alanorth/51acd476891c67dfe27725848cf5ace1</a></li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/08/nodejs-nginx.png" alt="ExpressJS running behind nginx" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/08/nodejs-nginx.png" alt="ExpressJS running behind nginx" /></p>
|
||||
|
||||
<h2 id="2016-08-16">2016-08-16</h2>
|
||||
|
||||
@ -2959,7 +2968,7 @@ index.authority.ignore-variants=true
|
||||
<li>Integrate and massively clean up About page (<a href="https://github.com/ilri/DSpace/pull/256">#256</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/07/cgspace-about-page.png" alt="About page" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/07/cgspace-about-page.png" alt="About page" /></p>
|
||||
|
||||
<ul>
|
||||
<li>The DSpace source code mentions the configuration key <code>discovery.index.authority.ignore-prefered.*</code> (with prefix of discovery, despite the docs saying otherwise), so I&rsquo;m trying the following on DSpace Test:</li>
|
||||
@ -3314,7 +3323,7 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
|
||||
<li>Now the sharing and Altmetric bits are more prominent:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/06/xmlui-altmetric-sharing.png" alt="DSpace 5.1 XMLUI With Altmetric Badge" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/06/xmlui-altmetric-sharing.png" alt="DSpace 5.1 XMLUI With Altmetric Badge" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Run all system updates on the servers and reboot</li>
|
||||
@ -3378,7 +3387,7 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
|
||||
<li>Fix a reference to <code>dc.type.output</code> in Discovery that I had missed when we migrated to <code>dc.type</code> last month (<a href="https://github.com/ilri/DSpace/pull/223">#223</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/05/discovery-types.png" alt="Item type in Discovery results" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/05/discovery-types.png" alt="Item type in Discovery results" /></p>
|
||||
|
||||
<h2 id="2016-05-06">2016-05-06</h2>
|
||||
|
||||
@ -4151,7 +4160,7 @@ dspace.log.2016-04-27:7271
|
||||
<li>It is very messed up because some labels are incorrect, fields are missing, etc</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/cua-label-mixup.png" alt="Mixed up label in Atmire CUA" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/cua-label-mixup.png" alt="Mixed up label in Atmire CUA" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Update documentation for Atmire modules</li>
|
||||
@ -4176,7 +4185,7 @@ dspace.log.2016-04-27:7271
|
||||
<li>Also four or so center-specific subject strings were missing for Discovery</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/missing-xmlui-string.png" alt="Missing XMLUI string" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/missing-xmlui-string.png" alt="Missing XMLUI string" /></p>
|
||||
|
||||
<h2 id="2016-03-15">2016-03-15</h2>
|
||||
|
||||
@ -4233,13 +4242,13 @@ dspace.log.2016-04-27:7271
|
||||
<li>Some of their items end up with thumbnails that have a big white border around them:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/bioversity-thumbnail-bad.jpg" alt="Excessive whitespace in thumbnail" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/bioversity-thumbnail-bad.jpg" alt="Excessive whitespace in thumbnail" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Turns out we can add <code>-trim</code> to the GraphicsMagick options to trim the whitespace</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/bioversity-thumbnail-good.jpg" alt="Trimmed thumbnail" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/bioversity-thumbnail-good.jpg" alt="Trimmed thumbnail" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Command used:</li>
|
||||
@ -4273,7 +4282,7 @@ dspace.log.2016-04-27:7271
|
||||
<li>On a related note, we have 51,000 items indexed from the sitemap, but 500,000 items in the Google index, so we DEFINITELY have a problem with duplicate content</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/google-index.png" alt="CGSpace pages in Google index" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/google-index.png" alt="CGSpace pages in Google index" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Turns out this is a problem with DSpace&rsquo;s <code>robots.txt</code>, and there&rsquo;s a Jira ticket since December, 2015: <a href="https://jira.duraspace.org/browse/DS-2962">https://jira.duraspace.org/browse/DS-2962</a></li>
|
||||
@ -4281,8 +4290,8 @@ dspace.log.2016-04-27:7271
|
||||
<li>For now I&rsquo;ve just set a bunch of these dynamic pages to not appear in search results by using the URL Parameters tool in Webmaster Tools</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/url-parameters.png" alt="URL parameters cause millions of dynamic pages" />
|
||||
<img src="2016/03/url-parameters2.png" alt="Setting pages with the filter_0 param not to show in search results" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/url-parameters.png" alt="URL parameters cause millions of dynamic pages" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/url-parameters2.png" alt="Setting pages with the filter_0 param not to show in search results" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Move AVCD collection to new community and update <code>move_collection.sh</code> script: <a href="https://gist.github.com/alanorth/392c4660e8b022d99dfa">https://gist.github.com/alanorth/392c4660e8b022d99dfa</a></li>
|
||||
@ -4365,7 +4374,7 @@ dspace.log.2016-04-27:7271
|
||||
<li>I noticed we have a very <em>interesting</em> list of countries on CGSpace:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/02/cgspace-countries.png" alt="CGSpace country list" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/02/cgspace-countries.png" alt="CGSpace country list" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li>
|
||||
@ -4476,8 +4485,8 @@ $ /opt/brew/Cellar/tomcat/8.0.30/bin/catalina start
|
||||
<li>Whip up some quick CSS to make the button in the submission workflow use the XMLUI theme&rsquo;s brand colors (<a href="https://github.com/ilri/DSpace/issues/154">#154</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/02/submit-button-ilri.png" alt="ILRI submission buttons" />
|
||||
<img src="2016/02/submit-button-drylands.png" alt="Drylands submission buttons" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/02/submit-button-ilri.png" alt="ILRI submission buttons" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/02/submit-button-drylands.png" alt="Drylands submission buttons" /></p>
|
||||
|
||||
<h2 id="2016-02-09">2016-02-09</h2>
|
||||
|
||||
@ -4769,13 +4778,13 @@ $ find SimpleArchiveForBio/ -iname &ldquo;*.pdf&rdquo; -exec basename {}
|
||||
<li>This <a href="https://cgspace.cgiar.org/handle/10568/67062">CCAFS item</a> Before:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/01/xmlui-subjects-before.png" alt="XMLUI subjects before" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/01/xmlui-subjects-before.png" alt="XMLUI subjects before" /></p>
|
||||
|
||||
<ul>
|
||||
<li>After:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/01/xmlui-subjects-after.png" alt="XMLUI subjects after" /></p></description>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/01/xmlui-subjects-after.png" alt="XMLUI subjects after" /></p></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -4859,7 +4868,7 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
|
||||
<li>CCAFS noticed that one of their items displays only the Atmire statlets: <a href="https://cgspace.cgiar.org/handle/10568/42445">https://cgspace.cgiar.org/handle/10568/42445</a></li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2015/12/ccafs-item-no-metadata.png" alt="CCAFS item" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/ccafs-item-no-metadata.png" alt="CCAFS item" /></p>
|
||||
|
||||
<ul>
|
||||
<li>The authorizations for the item are all public READ, and I don&rsquo;t see any errors in dspace.log when browsing that item</li>
|
||||
@ -4915,10 +4924,10 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
|
||||
<li>The PostgreSQL stats from Munin all point to something database-related with the DSpace 5 upgrade around mid–late November</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2015/12/postgres_bgwriter-year.png" alt="PostgreSQL bgwriter (year)" />
|
||||
<img src="2015/12/postgres_cache_cgspace-year.png" alt="PostgreSQL cache (year)" />
|
||||
<img src="2015/12/postgres_locks_cgspace-year.png" alt="PostgreSQL locks (year)" />
|
||||
<img src="2015/12/postgres_scans_cgspace-year.png" alt="PostgreSQL scans (year)" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/postgres_bgwriter-year.png" alt="PostgreSQL bgwriter (year)" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/postgres_cache_cgspace-year.png" alt="PostgreSQL cache (year)" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/postgres_locks_cgspace-year.png" alt="PostgreSQL locks (year)" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/postgres_scans_cgspace-year.png" alt="PostgreSQL scans (year)" /></p>
|
||||
|
||||
<h2 id="2015-12-07">2015-12-07</h2>
|
||||
|
||||
|
@ -130,7 +130,7 @@
|
||||
<li>I noticed we have a very <em>interesting</em> list of countries on CGSpace:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/02/cgspace-countries.png" alt="CGSpace country list" /></p>
|
||||
<p><img src="/cgspace-notes/2016/02/cgspace-countries.png" alt="CGSpace country list" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)…</li>
|
||||
@ -243,6 +243,7 @@
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -262,6 +263,8 @@
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -347,6 +347,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -366,6 +367,8 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -112,6 +112,15 @@ Caused by: java.net.SocketException: Broken pipe (Write failed)
|
||||
<ul>
|
||||
<li>Put Sisay&rsquo;s <code>item-view.xsl</code> code to show mapped collections on CGSpace (<a href="https://github.com/ilri/DSpace/pull/295">#295</a>)</li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-01-09">2017-01-09</h2>
|
||||
|
||||
<ul>
|
||||
<li>A user wrote to tell me that the new display of an item&rsquo;s mappings had a crazy bug for at least one item: <a href="https://cgspace.cgiar.org/handle/10568/78596">https://cgspace.cgiar.org/handle/10568/78596</a></li>
|
||||
<li>She said she only mapped it once, but it appears to be mapped 184 times</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2017/01/mapping-crazy-duplicate.png" alt="Crazy item mapping" /></p>
|
||||
</description>
|
||||
</item>
|
||||
|
||||
@ -595,8 +604,8 @@ dspace=# update metadatavalue set authority='2df8136e-d8f4-4142-b58c-562337c
|
||||
<li>After enabling a sizable <code>shared_buffers</code> for CGSpace&rsquo;s PostgreSQL configuration the number of connections to the database dropped significantly</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/12/postgres_bgwriter-week.png" alt="postgres_bgwriter-week" />
|
||||
<img src="2016/12/postgres_connections_ALL-week.png" alt="postgres_connections_ALL-week" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/postgres_bgwriter-week.png" alt="postgres_bgwriter-week" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/postgres_connections_ALL-week.png" alt="postgres_connections_ALL-week" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Looking at CIAT records from last week again, they have a lot of double authors like:</li>
|
||||
@ -641,8 +650,8 @@ UPDATE 35
|
||||
<li>Checking in on CGSpace postgres stats again, looks like the <code>shared_buffers</code> change from a few days ago really made a big impact:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/12/postgres_bgwriter-week-2016-12-13.png" alt="postgres_bgwriter-week" />
|
||||
<img src="2016/12/postgres_connections_ALL-week-2016-12-13.png" alt="postgres_connections_ALL-week" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/postgres_bgwriter-week-2016-12-13.png" alt="postgres_bgwriter-week" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/postgres_connections_ALL-week-2016-12-13.png" alt="postgres_connections_ALL-week" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Looking at logs, it seems we need to evaluate which logs we keep and for how long</li>
|
||||
@ -759,8 +768,8 @@ Caused by: java.lang.NoSuchMethodError: com.atmire.statistics.generator.DSpaceOb
|
||||
<li>Run a batch edit to add &ldquo;RANGELANDS&rdquo; ILRI subject to all items containing the word &ldquo;RANGELANDS&rdquo; in their metadata for Peter Ballantyne</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/12/batch-edit1.png" alt="Select all items with &quot;rangelands&quot; in metadata" />
|
||||
<img src="2016/12/batch-edit2.png" alt="Add RANGELANDS ILRI subject" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/batch-edit1.png" alt="Select all items with &quot;rangelands&quot; in metadata" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/batch-edit2.png" alt="Add RANGELANDS ILRI subject" /></p>
|
||||
|
||||
<h2 id="2016-12-18">2016-12-18</h2>
|
||||
|
||||
@ -894,7 +903,7 @@ $ exit
|
||||
<li>Add <code>dc.type</code> to the output options for Atmire&rsquo;s Listings and Reports module (<a href="https://github.com/ilri/DSpace/pull/286">#286</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
|
||||
<h2 id="2016-11-02">2016-11-02</h2>
|
||||
|
||||
@ -980,7 +989,7 @@ COPY 22
|
||||
<li>Atmire&rsquo;s Listings and Reports module seems to be broken on DSpace 5.5</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/11/listings-and-reports-55.png" alt="Listings and Reports broken in DSpace 5.5" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports-55.png" alt="Listings and Reports broken in DSpace 5.5" /></p>
|
||||
|
||||
<ul>
|
||||
<li>I&rsquo;ve filed a ticket with Atmire</li>
|
||||
@ -1178,8 +1187,8 @@ X-Cocoon-Version: 2.2.0
|
||||
<li>The Tomcat JVM heap looks really good after applying the Crawler Session Manager fix on DSpace Test last night:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/11/dspacetest-tomcat-jvm-day.png" alt="Tomcat JVM heap (day) after setting up the Crawler Session Manager" />
|
||||
<img src="2016/11/dspacetest-tomcat-jvm-week.png" alt="Tomcat JVM heap (week) after setting up the Crawler Session Manager" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/dspacetest-tomcat-jvm-day.png" alt="Tomcat JVM heap (day) after setting up the Crawler Session Manager" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/dspacetest-tomcat-jvm-week.png" alt="Tomcat JVM heap (week) after setting up the Crawler Session Manager" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Seems the default regex doesn&rsquo;t catch Baidu, though:</li>
|
||||
@ -1463,7 +1472,7 @@ org.dspace.discovery.SearchServiceException: Error executing query
|
||||
<li>I added the <a href="https://github.com/ilri/DSpace/issues/234">disclaimer text</a> to the About page, then added a footer link to the disclaimer&rsquo;s ID, but there is a Bootstrap issue that causes the page content to disappear when using in-page anchors: <a href="https://github.com/twbs/bootstrap/issues/1768">https://github.com/twbs/bootstrap/issues/1768</a></li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/10/bootstrap-issue.png" alt="Bootstrap issue with in-page anchors" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/10/bootstrap-issue.png" alt="Bootstrap issue with in-page anchors" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Looks like we&rsquo;ll just have to add the text to the About page (without a link) or add a separate page</li>
|
||||
@ -1511,7 +1520,7 @@ $ ./delete-metadata-values.py -i authors-delete-3.csv -f dc.contributor.author -
|
||||
<li>Magdalena from CCAFS asked why the colors in the thumbnails for these <a href="https://cgspace.cgiar.org/handle/10568/71249">two</a> <a href="https://cgspace.cgiar.org/handle/10568/71259">items</a> look different, even though they are the same in the PDF itself</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/10/cmyk-vs-srgb.jpg" alt="CMYK vs sRGB colors" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/10/cmyk-vs-srgb.jpg" alt="CMYK vs sRGB colors" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Turns out the first PDF was exported from InDesign using CMYK and the second one was using sRGB</li>
|
||||
@ -1693,8 +1702,8 @@ UPDATE 0
|
||||
<li>Looks much better now:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/10/cgspace-icons.png" alt="CGSpace with old icons" />
|
||||
<img src="2016/10/dspacetest-fontawesome-icons.png" alt="DSpace Test with Font Awesome icons" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/10/cgspace-icons.png" alt="CGSpace with old icons" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/10/dspacetest-fontawesome-icons.png" alt="DSpace Test with Font Awesome icons" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Run the same replacements on CGSpace</li>
|
||||
@ -1786,7 +1795,7 @@ distinguishedName: CN=Last\, First (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Eth
|
||||
<li>Changing the DSpace LDAP config to use <code>OU=ILRIHUB</code> seems to work:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/ilri-ldap-users.png" alt="DSpace groups based on LDAP DN" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/ilri-ldap-users.png" alt="DSpace groups based on LDAP DN" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Notes for local PostgreSQL database recreation from production snapshot:</li>
|
||||
@ -2133,9 +2142,9 @@ java.util.Map does not have a no-arg default constructor.
|
||||
<li>Perhaps these particular issues <em>are</em> memory issues, the munin graphs definitely show some weird purging/allocating behavior starting this week</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/tomcat_jvm-day.png" alt="Tomcat JVM usage day" />
|
||||
<img src="2016/09/tomcat_jvm-week.png" alt="Tomcat JVM usage week" />
|
||||
<img src="2016/09/tomcat_jvm-month.png" alt="Tomcat JVM usage month" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/tomcat_jvm-day.png" alt="Tomcat JVM usage day" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/tomcat_jvm-week.png" alt="Tomcat JVM usage week" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/tomcat_jvm-month.png" alt="Tomcat JVM usage month" /></p>
|
||||
|
||||
<ul>
|
||||
<li>And really, we did reduce the memory of CGSpace in late 2015, so maybe we should just increase it again, now that our usage is higher and we are having memory errors in the logs</li>
|
||||
@ -2157,7 +2166,7 @@ java.util.Map does not have a no-arg default constructor.
|
||||
<li>Looking at Google Webmaster Tools again, it seems the work I did on URL query parameters and blocking via the <code>X-Robots-Tag</code> HTTP header in March, 2016 seem to have had a positive effect on Google&rsquo;s index for CGSpace</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/google-webmaster-tools-index.png" alt="Google Webmaster Tools for CGSpace" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/google-webmaster-tools-index.png" alt="Google Webmaster Tools for CGSpace" /></p>
|
||||
|
||||
<h2 id="2016-09-16">2016-09-16</h2>
|
||||
|
||||
@ -2245,8 +2254,8 @@ $ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2
|
||||
<li>It actually works really well, and search results return much less hits now (before, after):</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/cgspace-search.png" alt="CGSpace search with &quot;OR&quot; boolean logic" />
|
||||
<img src="2016/09/dspacetest-search.png" alt="DSpace Test search with &quot;AND&quot; boolean logic" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/cgspace-search.png" alt="CGSpace search with &quot;OR&quot; boolean logic" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/dspacetest-search.png" alt="DSpace Test search with &quot;AND&quot; boolean logic" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Found a way to improve the configuration of Atmire&rsquo;s Content and Usage Analysis (CUA) module for date fields</li>
|
||||
@ -2523,7 +2532,7 @@ $ ln -sv ~/dspace/webapps/solr /opt/brew/Cellar/tomcat/8.5.4/libexec/webapps/sol
|
||||
<li>Finally got DSpace (5.5) running on Ubuntu 16.04, Tomcat 7, Java 8, PostgreSQL 9.5 via the updated Ansible stuff</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/08/dspace55-ubuntu16.04.png" alt="DSpace 5.5 on Ubuntu 16.04, Tomcat 7, Java 8, PostgreSQL 9.5" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/08/dspace55-ubuntu16.04.png" alt="DSpace 5.5 on Ubuntu 16.04, Tomcat 7, Java 8, PostgreSQL 9.5" /></p>
|
||||
|
||||
<h2 id="2016-08-14">2016-08-14</h2>
|
||||
|
||||
@ -2537,7 +2546,7 @@ $ ln -sv ~/dspace/webapps/solr /opt/brew/Cellar/tomcat/8.5.4/libexec/webapps/sol
|
||||
<li>Notes on NodeJS + nginx + systemd: <a href="https://gist.github.com/alanorth/51acd476891c67dfe27725848cf5ace1">https://gist.github.com/alanorth/51acd476891c67dfe27725848cf5ace1</a></li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/08/nodejs-nginx.png" alt="ExpressJS running behind nginx" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/08/nodejs-nginx.png" alt="ExpressJS running behind nginx" /></p>
|
||||
|
||||
<h2 id="2016-08-16">2016-08-16</h2>
|
||||
|
||||
@ -2959,7 +2968,7 @@ index.authority.ignore-variants=true
|
||||
<li>Integrate and massively clean up About page (<a href="https://github.com/ilri/DSpace/pull/256">#256</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/07/cgspace-about-page.png" alt="About page" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/07/cgspace-about-page.png" alt="About page" /></p>
|
||||
|
||||
<ul>
|
||||
<li>The DSpace source code mentions the configuration key <code>discovery.index.authority.ignore-prefered.*</code> (with prefix of discovery, despite the docs saying otherwise), so I&rsquo;m trying the following on DSpace Test:</li>
|
||||
@ -3314,7 +3323,7 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
|
||||
<li>Now the sharing and Altmetric bits are more prominent:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/06/xmlui-altmetric-sharing.png" alt="DSpace 5.1 XMLUI With Altmetric Badge" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/06/xmlui-altmetric-sharing.png" alt="DSpace 5.1 XMLUI With Altmetric Badge" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Run all system updates on the servers and reboot</li>
|
||||
@ -3378,7 +3387,7 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
|
||||
<li>Fix a reference to <code>dc.type.output</code> in Discovery that I had missed when we migrated to <code>dc.type</code> last month (<a href="https://github.com/ilri/DSpace/pull/223">#223</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/05/discovery-types.png" alt="Item type in Discovery results" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/05/discovery-types.png" alt="Item type in Discovery results" /></p>
|
||||
|
||||
<h2 id="2016-05-06">2016-05-06</h2>
|
||||
|
||||
@ -4151,7 +4160,7 @@ dspace.log.2016-04-27:7271
|
||||
<li>It is very messed up because some labels are incorrect, fields are missing, etc</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/cua-label-mixup.png" alt="Mixed up label in Atmire CUA" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/cua-label-mixup.png" alt="Mixed up label in Atmire CUA" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Update documentation for Atmire modules</li>
|
||||
@ -4176,7 +4185,7 @@ dspace.log.2016-04-27:7271
|
||||
<li>Also four or so center-specific subject strings were missing for Discovery</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/missing-xmlui-string.png" alt="Missing XMLUI string" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/missing-xmlui-string.png" alt="Missing XMLUI string" /></p>
|
||||
|
||||
<h2 id="2016-03-15">2016-03-15</h2>
|
||||
|
||||
@ -4233,13 +4242,13 @@ dspace.log.2016-04-27:7271
|
||||
<li>Some of their items end up with thumbnails that have a big white border around them:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/bioversity-thumbnail-bad.jpg" alt="Excessive whitespace in thumbnail" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/bioversity-thumbnail-bad.jpg" alt="Excessive whitespace in thumbnail" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Turns out we can add <code>-trim</code> to the GraphicsMagick options to trim the whitespace</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/bioversity-thumbnail-good.jpg" alt="Trimmed thumbnail" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/bioversity-thumbnail-good.jpg" alt="Trimmed thumbnail" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Command used:</li>
|
||||
@ -4273,7 +4282,7 @@ dspace.log.2016-04-27:7271
|
||||
<li>On a related note, we have 51,000 items indexed from the sitemap, but 500,000 items in the Google index, so we DEFINITELY have a problem with duplicate content</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/google-index.png" alt="CGSpace pages in Google index" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/google-index.png" alt="CGSpace pages in Google index" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Turns out this is a problem with DSpace&rsquo;s <code>robots.txt</code>, and there&rsquo;s a Jira ticket since December, 2015: <a href="https://jira.duraspace.org/browse/DS-2962">https://jira.duraspace.org/browse/DS-2962</a></li>
|
||||
@ -4281,8 +4290,8 @@ dspace.log.2016-04-27:7271
|
||||
<li>For now I&rsquo;ve just set a bunch of these dynamic pages to not appear in search results by using the URL Parameters tool in Webmaster Tools</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/url-parameters.png" alt="URL parameters cause millions of dynamic pages" />
|
||||
<img src="2016/03/url-parameters2.png" alt="Setting pages with the filter_0 param not to show in search results" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/url-parameters.png" alt="URL parameters cause millions of dynamic pages" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/url-parameters2.png" alt="Setting pages with the filter_0 param not to show in search results" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Move AVCD collection to new community and update <code>move_collection.sh</code> script: <a href="https://gist.github.com/alanorth/392c4660e8b022d99dfa">https://gist.github.com/alanorth/392c4660e8b022d99dfa</a></li>
|
||||
@ -4365,7 +4374,7 @@ dspace.log.2016-04-27:7271
|
||||
<li>I noticed we have a very <em>interesting</em> list of countries on CGSpace:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/02/cgspace-countries.png" alt="CGSpace country list" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/02/cgspace-countries.png" alt="CGSpace country list" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li>
|
||||
@ -4476,8 +4485,8 @@ $ /opt/brew/Cellar/tomcat/8.0.30/bin/catalina start
|
||||
<li>Whip up some quick CSS to make the button in the submission workflow use the XMLUI theme&rsquo;s brand colors (<a href="https://github.com/ilri/DSpace/issues/154">#154</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/02/submit-button-ilri.png" alt="ILRI submission buttons" />
|
||||
<img src="2016/02/submit-button-drylands.png" alt="Drylands submission buttons" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/02/submit-button-ilri.png" alt="ILRI submission buttons" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/02/submit-button-drylands.png" alt="Drylands submission buttons" /></p>
|
||||
|
||||
<h2 id="2016-02-09">2016-02-09</h2>
|
||||
|
||||
@ -4769,13 +4778,13 @@ $ find SimpleArchiveForBio/ -iname &ldquo;*.pdf&rdquo; -exec basename {}
|
||||
<li>This <a href="https://cgspace.cgiar.org/handle/10568/67062">CCAFS item</a> Before:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/01/xmlui-subjects-before.png" alt="XMLUI subjects before" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/01/xmlui-subjects-before.png" alt="XMLUI subjects before" /></p>
|
||||
|
||||
<ul>
|
||||
<li>After:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/01/xmlui-subjects-after.png" alt="XMLUI subjects after" /></p></description>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/01/xmlui-subjects-after.png" alt="XMLUI subjects after" /></p></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -4859,7 +4868,7 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
|
||||
<li>CCAFS noticed that one of their items displays only the Atmire statlets: <a href="https://cgspace.cgiar.org/handle/10568/42445">https://cgspace.cgiar.org/handle/10568/42445</a></li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2015/12/ccafs-item-no-metadata.png" alt="CCAFS item" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/ccafs-item-no-metadata.png" alt="CCAFS item" /></p>
|
||||
|
||||
<ul>
|
||||
<li>The authorizations for the item are all public READ, and I don&rsquo;t see any errors in dspace.log when browsing that item</li>
|
||||
@ -4915,10 +4924,10 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
|
||||
<li>The PostgreSQL stats from Munin all point to something database-related with the DSpace 5 upgrade around mid–late November</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2015/12/postgres_bgwriter-year.png" alt="PostgreSQL bgwriter (year)" />
|
||||
<img src="2015/12/postgres_cache_cgspace-year.png" alt="PostgreSQL cache (year)" />
|
||||
<img src="2015/12/postgres_locks_cgspace-year.png" alt="PostgreSQL locks (year)" />
|
||||
<img src="2015/12/postgres_scans_cgspace-year.png" alt="PostgreSQL scans (year)" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/postgres_bgwriter-year.png" alt="PostgreSQL bgwriter (year)" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/postgres_cache_cgspace-year.png" alt="PostgreSQL cache (year)" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/postgres_locks_cgspace-year.png" alt="PostgreSQL locks (year)" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/postgres_scans_cgspace-year.png" alt="PostgreSQL scans (year)" /></p>
|
||||
|
||||
<h2 id="2015-12-07">2015-12-07</h2>
|
||||
|
||||
|
@ -130,7 +130,7 @@
|
||||
<li>I noticed we have a very <em>interesting</em> list of countries on CGSpace:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/02/cgspace-countries.png" alt="CGSpace country list" /></p>
|
||||
<p><img src="/cgspace-notes/2016/02/cgspace-countries.png" alt="CGSpace country list" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)…</li>
|
||||
@ -243,6 +243,7 @@
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -262,6 +263,8 @@
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -347,6 +347,7 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -366,6 +367,8 @@ dspacetest=# select text_value from metadatavalue where metadata_field_id=3 and
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
@ -111,6 +111,15 @@ Caused by: java.net.SocketException: Broken pipe (Write failed)
|
||||
<ul>
|
||||
<li>Put Sisay&rsquo;s <code>item-view.xsl</code> code to show mapped collections on CGSpace (<a href="https://github.com/ilri/DSpace/pull/295">#295</a>)</li>
|
||||
</ul>
|
||||
|
||||
<h2 id="2017-01-09">2017-01-09</h2>
|
||||
|
||||
<ul>
|
||||
<li>A user wrote to tell me that the new display of an item&rsquo;s mappings had a crazy bug for at least one item: <a href="https://cgspace.cgiar.org/handle/10568/78596">https://cgspace.cgiar.org/handle/10568/78596</a></li>
|
||||
<li>She said she only mapped it once, but it appears to be mapped 184 times</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2017/01/mapping-crazy-duplicate.png" alt="Crazy item mapping" /></p>
|
||||
</description>
|
||||
</item>
|
||||
|
||||
@ -594,8 +603,8 @@ dspace=# update metadatavalue set authority='2df8136e-d8f4-4142-b58c-562337c
|
||||
<li>After enabling a sizable <code>shared_buffers</code> for CGSpace&rsquo;s PostgreSQL configuration the number of connections to the database dropped significantly</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/12/postgres_bgwriter-week.png" alt="postgres_bgwriter-week" />
|
||||
<img src="2016/12/postgres_connections_ALL-week.png" alt="postgres_connections_ALL-week" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/postgres_bgwriter-week.png" alt="postgres_bgwriter-week" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/postgres_connections_ALL-week.png" alt="postgres_connections_ALL-week" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Looking at CIAT records from last week again, they have a lot of double authors like:</li>
|
||||
@ -640,8 +649,8 @@ UPDATE 35
|
||||
<li>Checking in on CGSpace postgres stats again, looks like the <code>shared_buffers</code> change from a few days ago really made a big impact:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/12/postgres_bgwriter-week-2016-12-13.png" alt="postgres_bgwriter-week" />
|
||||
<img src="2016/12/postgres_connections_ALL-week-2016-12-13.png" alt="postgres_connections_ALL-week" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/postgres_bgwriter-week-2016-12-13.png" alt="postgres_bgwriter-week" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/postgres_connections_ALL-week-2016-12-13.png" alt="postgres_connections_ALL-week" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Looking at logs, it seems we need to evaluate which logs we keep and for how long</li>
|
||||
@ -758,8 +767,8 @@ Caused by: java.lang.NoSuchMethodError: com.atmire.statistics.generator.DSpaceOb
|
||||
<li>Run a batch edit to add &ldquo;RANGELANDS&rdquo; ILRI subject to all items containing the word &ldquo;RANGELANDS&rdquo; in their metadata for Peter Ballantyne</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/12/batch-edit1.png" alt="Select all items with &quot;rangelands&quot; in metadata" />
|
||||
<img src="2016/12/batch-edit2.png" alt="Add RANGELANDS ILRI subject" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/batch-edit1.png" alt="Select all items with &quot;rangelands&quot; in metadata" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/12/batch-edit2.png" alt="Add RANGELANDS ILRI subject" /></p>
|
||||
|
||||
<h2 id="2016-12-18">2016-12-18</h2>
|
||||
|
||||
@ -893,7 +902,7 @@ $ exit
|
||||
<li>Add <code>dc.type</code> to the output options for Atmire&rsquo;s Listings and Reports module (<a href="https://github.com/ilri/DSpace/pull/286">#286</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports.png" alt="Listings and Reports with output type" /></p>
|
||||
|
||||
<h2 id="2016-11-02">2016-11-02</h2>
|
||||
|
||||
@ -979,7 +988,7 @@ COPY 22
|
||||
<li>Atmire&rsquo;s Listings and Reports module seems to be broken on DSpace 5.5</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/11/listings-and-reports-55.png" alt="Listings and Reports broken in DSpace 5.5" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/listings-and-reports-55.png" alt="Listings and Reports broken in DSpace 5.5" /></p>
|
||||
|
||||
<ul>
|
||||
<li>I&rsquo;ve filed a ticket with Atmire</li>
|
||||
@ -1177,8 +1186,8 @@ X-Cocoon-Version: 2.2.0
|
||||
<li>The Tomcat JVM heap looks really good after applying the Crawler Session Manager fix on DSpace Test last night:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/11/dspacetest-tomcat-jvm-day.png" alt="Tomcat JVM heap (day) after setting up the Crawler Session Manager" />
|
||||
<img src="2016/11/dspacetest-tomcat-jvm-week.png" alt="Tomcat JVM heap (week) after setting up the Crawler Session Manager" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/dspacetest-tomcat-jvm-day.png" alt="Tomcat JVM heap (day) after setting up the Crawler Session Manager" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/11/dspacetest-tomcat-jvm-week.png" alt="Tomcat JVM heap (week) after setting up the Crawler Session Manager" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Seems the default regex doesn&rsquo;t catch Baidu, though:</li>
|
||||
@ -1462,7 +1471,7 @@ org.dspace.discovery.SearchServiceException: Error executing query
|
||||
<li>I added the <a href="https://github.com/ilri/DSpace/issues/234">disclaimer text</a> to the About page, then added a footer link to the disclaimer&rsquo;s ID, but there is a Bootstrap issue that causes the page content to disappear when using in-page anchors: <a href="https://github.com/twbs/bootstrap/issues/1768">https://github.com/twbs/bootstrap/issues/1768</a></li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/10/bootstrap-issue.png" alt="Bootstrap issue with in-page anchors" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/10/bootstrap-issue.png" alt="Bootstrap issue with in-page anchors" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Looks like we&rsquo;ll just have to add the text to the About page (without a link) or add a separate page</li>
|
||||
@ -1510,7 +1519,7 @@ $ ./delete-metadata-values.py -i authors-delete-3.csv -f dc.contributor.author -
|
||||
<li>Magdalena from CCAFS asked why the colors in the thumbnails for these <a href="https://cgspace.cgiar.org/handle/10568/71249">two</a> <a href="https://cgspace.cgiar.org/handle/10568/71259">items</a> look different, even though they are the same in the PDF itself</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/10/cmyk-vs-srgb.jpg" alt="CMYK vs sRGB colors" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/10/cmyk-vs-srgb.jpg" alt="CMYK vs sRGB colors" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Turns out the first PDF was exported from InDesign using CMYK and the second one was using sRGB</li>
|
||||
@ -1692,8 +1701,8 @@ UPDATE 0
|
||||
<li>Looks much better now:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/10/cgspace-icons.png" alt="CGSpace with old icons" />
|
||||
<img src="2016/10/dspacetest-fontawesome-icons.png" alt="DSpace Test with Font Awesome icons" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/10/cgspace-icons.png" alt="CGSpace with old icons" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/10/dspacetest-fontawesome-icons.png" alt="DSpace Test with Font Awesome icons" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Run the same replacements on CGSpace</li>
|
||||
@ -1785,7 +1794,7 @@ distinguishedName: CN=Last\, First (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Eth
|
||||
<li>Changing the DSpace LDAP config to use <code>OU=ILRIHUB</code> seems to work:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/ilri-ldap-users.png" alt="DSpace groups based on LDAP DN" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/ilri-ldap-users.png" alt="DSpace groups based on LDAP DN" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Notes for local PostgreSQL database recreation from production snapshot:</li>
|
||||
@ -2132,9 +2141,9 @@ java.util.Map does not have a no-arg default constructor.
|
||||
<li>Perhaps these particular issues <em>are</em> memory issues, the munin graphs definitely show some weird purging/allocating behavior starting this week</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/tomcat_jvm-day.png" alt="Tomcat JVM usage day" />
|
||||
<img src="2016/09/tomcat_jvm-week.png" alt="Tomcat JVM usage week" />
|
||||
<img src="2016/09/tomcat_jvm-month.png" alt="Tomcat JVM usage month" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/tomcat_jvm-day.png" alt="Tomcat JVM usage day" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/tomcat_jvm-week.png" alt="Tomcat JVM usage week" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/tomcat_jvm-month.png" alt="Tomcat JVM usage month" /></p>
|
||||
|
||||
<ul>
|
||||
<li>And really, we did reduce the memory of CGSpace in late 2015, so maybe we should just increase it again, now that our usage is higher and we are having memory errors in the logs</li>
|
||||
@ -2156,7 +2165,7 @@ java.util.Map does not have a no-arg default constructor.
|
||||
<li>Looking at Google Webmaster Tools again, it seems the work I did on URL query parameters and blocking via the <code>X-Robots-Tag</code> HTTP header in March, 2016 seem to have had a positive effect on Google&rsquo;s index for CGSpace</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/google-webmaster-tools-index.png" alt="Google Webmaster Tools for CGSpace" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/google-webmaster-tools-index.png" alt="Google Webmaster Tools for CGSpace" /></p>
|
||||
|
||||
<h2 id="2016-09-16">2016-09-16</h2>
|
||||
|
||||
@ -2244,8 +2253,8 @@ $ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2
|
||||
<li>It actually works really well, and search results return much less hits now (before, after):</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/09/cgspace-search.png" alt="CGSpace search with &quot;OR&quot; boolean logic" />
|
||||
<img src="2016/09/dspacetest-search.png" alt="DSpace Test search with &quot;AND&quot; boolean logic" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/cgspace-search.png" alt="CGSpace search with &quot;OR&quot; boolean logic" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/09/dspacetest-search.png" alt="DSpace Test search with &quot;AND&quot; boolean logic" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Found a way to improve the configuration of Atmire&rsquo;s Content and Usage Analysis (CUA) module for date fields</li>
|
||||
@ -2522,7 +2531,7 @@ $ ln -sv ~/dspace/webapps/solr /opt/brew/Cellar/tomcat/8.5.4/libexec/webapps/sol
|
||||
<li>Finally got DSpace (5.5) running on Ubuntu 16.04, Tomcat 7, Java 8, PostgreSQL 9.5 via the updated Ansible stuff</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/08/dspace55-ubuntu16.04.png" alt="DSpace 5.5 on Ubuntu 16.04, Tomcat 7, Java 8, PostgreSQL 9.5" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/08/dspace55-ubuntu16.04.png" alt="DSpace 5.5 on Ubuntu 16.04, Tomcat 7, Java 8, PostgreSQL 9.5" /></p>
|
||||
|
||||
<h2 id="2016-08-14">2016-08-14</h2>
|
||||
|
||||
@ -2536,7 +2545,7 @@ $ ln -sv ~/dspace/webapps/solr /opt/brew/Cellar/tomcat/8.5.4/libexec/webapps/sol
|
||||
<li>Notes on NodeJS + nginx + systemd: <a href="https://gist.github.com/alanorth/51acd476891c67dfe27725848cf5ace1">https://gist.github.com/alanorth/51acd476891c67dfe27725848cf5ace1</a></li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/08/nodejs-nginx.png" alt="ExpressJS running behind nginx" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/08/nodejs-nginx.png" alt="ExpressJS running behind nginx" /></p>
|
||||
|
||||
<h2 id="2016-08-16">2016-08-16</h2>
|
||||
|
||||
@ -2958,7 +2967,7 @@ index.authority.ignore-variants=true
|
||||
<li>Integrate and massively clean up About page (<a href="https://github.com/ilri/DSpace/pull/256">#256</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/07/cgspace-about-page.png" alt="About page" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/07/cgspace-about-page.png" alt="About page" /></p>
|
||||
|
||||
<ul>
|
||||
<li>The DSpace source code mentions the configuration key <code>discovery.index.authority.ignore-prefered.*</code> (with prefix of discovery, despite the docs saying otherwise), so I&rsquo;m trying the following on DSpace Test:</li>
|
||||
@ -3313,7 +3322,7 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
|
||||
<li>Now the sharing and Altmetric bits are more prominent:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/06/xmlui-altmetric-sharing.png" alt="DSpace 5.1 XMLUI With Altmetric Badge" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/06/xmlui-altmetric-sharing.png" alt="DSpace 5.1 XMLUI With Altmetric Badge" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Run all system updates on the servers and reboot</li>
|
||||
@ -3377,7 +3386,7 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
|
||||
<li>Fix a reference to <code>dc.type.output</code> in Discovery that I had missed when we migrated to <code>dc.type</code> last month (<a href="https://github.com/ilri/DSpace/pull/223">#223</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/05/discovery-types.png" alt="Item type in Discovery results" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/05/discovery-types.png" alt="Item type in Discovery results" /></p>
|
||||
|
||||
<h2 id="2016-05-06">2016-05-06</h2>
|
||||
|
||||
@ -4150,7 +4159,7 @@ dspace.log.2016-04-27:7271
|
||||
<li>It is very messed up because some labels are incorrect, fields are missing, etc</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/cua-label-mixup.png" alt="Mixed up label in Atmire CUA" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/cua-label-mixup.png" alt="Mixed up label in Atmire CUA" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Update documentation for Atmire modules</li>
|
||||
@ -4175,7 +4184,7 @@ dspace.log.2016-04-27:7271
|
||||
<li>Also four or so center-specific subject strings were missing for Discovery</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/missing-xmlui-string.png" alt="Missing XMLUI string" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/missing-xmlui-string.png" alt="Missing XMLUI string" /></p>
|
||||
|
||||
<h2 id="2016-03-15">2016-03-15</h2>
|
||||
|
||||
@ -4232,13 +4241,13 @@ dspace.log.2016-04-27:7271
|
||||
<li>Some of their items end up with thumbnails that have a big white border around them:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/bioversity-thumbnail-bad.jpg" alt="Excessive whitespace in thumbnail" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/bioversity-thumbnail-bad.jpg" alt="Excessive whitespace in thumbnail" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Turns out we can add <code>-trim</code> to the GraphicsMagick options to trim the whitespace</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/bioversity-thumbnail-good.jpg" alt="Trimmed thumbnail" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/bioversity-thumbnail-good.jpg" alt="Trimmed thumbnail" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Command used:</li>
|
||||
@ -4272,7 +4281,7 @@ dspace.log.2016-04-27:7271
|
||||
<li>On a related note, we have 51,000 items indexed from the sitemap, but 500,000 items in the Google index, so we DEFINITELY have a problem with duplicate content</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/google-index.png" alt="CGSpace pages in Google index" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/google-index.png" alt="CGSpace pages in Google index" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Turns out this is a problem with DSpace&rsquo;s <code>robots.txt</code>, and there&rsquo;s a Jira ticket since December, 2015: <a href="https://jira.duraspace.org/browse/DS-2962">https://jira.duraspace.org/browse/DS-2962</a></li>
|
||||
@ -4280,8 +4289,8 @@ dspace.log.2016-04-27:7271
|
||||
<li>For now I&rsquo;ve just set a bunch of these dynamic pages to not appear in search results by using the URL Parameters tool in Webmaster Tools</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/03/url-parameters.png" alt="URL parameters cause millions of dynamic pages" />
|
||||
<img src="2016/03/url-parameters2.png" alt="Setting pages with the filter_0 param not to show in search results" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/url-parameters.png" alt="URL parameters cause millions of dynamic pages" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/03/url-parameters2.png" alt="Setting pages with the filter_0 param not to show in search results" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Move AVCD collection to new community and update <code>move_collection.sh</code> script: <a href="https://gist.github.com/alanorth/392c4660e8b022d99dfa">https://gist.github.com/alanorth/392c4660e8b022d99dfa</a></li>
|
||||
@ -4364,7 +4373,7 @@ dspace.log.2016-04-27:7271
|
||||
<li>I noticed we have a very <em>interesting</em> list of countries on CGSpace:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/02/cgspace-countries.png" alt="CGSpace country list" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/02/cgspace-countries.png" alt="CGSpace country list" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)&hellip;</li>
|
||||
@ -4475,8 +4484,8 @@ $ /opt/brew/Cellar/tomcat/8.0.30/bin/catalina start
|
||||
<li>Whip up some quick CSS to make the button in the submission workflow use the XMLUI theme&rsquo;s brand colors (<a href="https://github.com/ilri/DSpace/issues/154">#154</a>)</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/02/submit-button-ilri.png" alt="ILRI submission buttons" />
|
||||
<img src="2016/02/submit-button-drylands.png" alt="Drylands submission buttons" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/02/submit-button-ilri.png" alt="ILRI submission buttons" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/02/submit-button-drylands.png" alt="Drylands submission buttons" /></p>
|
||||
|
||||
<h2 id="2016-02-09">2016-02-09</h2>
|
||||
|
||||
@ -4768,13 +4777,13 @@ $ find SimpleArchiveForBio/ -iname &ldquo;*.pdf&rdquo; -exec basename {}
|
||||
<li>This <a href="https://cgspace.cgiar.org/handle/10568/67062">CCAFS item</a> Before:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/01/xmlui-subjects-before.png" alt="XMLUI subjects before" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/01/xmlui-subjects-before.png" alt="XMLUI subjects before" /></p>
|
||||
|
||||
<ul>
|
||||
<li>After:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/01/xmlui-subjects-after.png" alt="XMLUI subjects after" /></p></description>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2016/01/xmlui-subjects-after.png" alt="XMLUI subjects after" /></p></description>
|
||||
</item>
|
||||
|
||||
<item>
|
||||
@ -4858,7 +4867,7 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
|
||||
<li>CCAFS noticed that one of their items displays only the Atmire statlets: <a href="https://cgspace.cgiar.org/handle/10568/42445">https://cgspace.cgiar.org/handle/10568/42445</a></li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2015/12/ccafs-item-no-metadata.png" alt="CCAFS item" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/ccafs-item-no-metadata.png" alt="CCAFS item" /></p>
|
||||
|
||||
<ul>
|
||||
<li>The authorizations for the item are all public READ, and I don&rsquo;t see any errors in dspace.log when browsing that item</li>
|
||||
@ -4914,10 +4923,10 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
|
||||
<li>The PostgreSQL stats from Munin all point to something database-related with the DSpace 5 upgrade around mid–late November</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2015/12/postgres_bgwriter-year.png" alt="PostgreSQL bgwriter (year)" />
|
||||
<img src="2015/12/postgres_cache_cgspace-year.png" alt="PostgreSQL cache (year)" />
|
||||
<img src="2015/12/postgres_locks_cgspace-year.png" alt="PostgreSQL locks (year)" />
|
||||
<img src="2015/12/postgres_scans_cgspace-year.png" alt="PostgreSQL scans (year)" /></p>
|
||||
<p><img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/postgres_bgwriter-year.png" alt="PostgreSQL bgwriter (year)" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/postgres_cache_cgspace-year.png" alt="PostgreSQL cache (year)" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/postgres_locks_cgspace-year.png" alt="PostgreSQL locks (year)" />
|
||||
<img src="https://alanorth.github.io/cgspace-notes/cgspace-notes/2015/12/postgres_scans_cgspace-year.png" alt="PostgreSQL scans (year)" /></p>
|
||||
|
||||
<h2 id="2015-12-07">2015-12-07</h2>
|
||||
|
||||
|
@ -130,7 +130,7 @@
|
||||
<li>I noticed we have a very <em>interesting</em> list of countries on CGSpace:</li>
|
||||
</ul>
|
||||
|
||||
<p><img src="2016/02/cgspace-countries.png" alt="CGSpace country list" /></p>
|
||||
<p><img src="/cgspace-notes/2016/02/cgspace-countries.png" alt="CGSpace country list" /></p>
|
||||
|
||||
<ul>
|
||||
<li>Not only are there 49,000 countries, we have some blanks (25)…</li>
|
||||
@ -243,6 +243,7 @@
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Recent Posts</h4>
|
||||
@ -262,6 +263,8 @@
|
||||
</section>
|
||||
|
||||
|
||||
|
||||
|
||||
<section class="sidebar-module">
|
||||
<h4>Links</h4>
|
||||
<ol class="list-unstyled">
|
||||
|
Loading…
Reference in New Issue
Block a user