Add notes for 2016-09-01

This commit is contained in:
Alan Orth 2016-09-02 11:44:44 +03:00
parent 9786ebf3e0
commit bcef5d32da
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
10 changed files with 486 additions and 34 deletions

37
content/2016-09.md Normal file
View File

@ -0,0 +1,37 @@
+++
date = "2016-09-01T15:53:00+03:00"
author = "Alan Orth"
title = "September, 2016"
tags = ["notes"]
image = "../images/bg.jpg"
+++
## 2016-09-01
- Discuss helping CCAFS with some batch tagging of ORCID IDs for their authors
- Discuss how the migration of CGIAR's Active Directory to a flat structure will break our LDAP groups in DSpace
- We had been using `DC=ILRI` to determine whether a user was ILRI or not
- It looks like we might be able to use OUs now, instead of DCs:
```
$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b "dc=cgiarad,dc=org" -D "admigration1@cgiarad.org" -W "(sAMAccountName=admigration1)"
```
- User who has been migrated to the root vs user still in the hierarchical structure:
```
distinguishedName: CN=Last\, First (ILRI),OU=ILRI Kenya Employees,OU=ILRI Kenya,OU=ILRIHUB,DC=CGIARAD,DC=ORG
distinguishedName: CN=Last\, First (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG
```
- Notes for local PostgreSQL database recreation from production snapshot:
```
$ dropdb dspacetest
$ createdb -O dspacetest --encoding=UNICODE dspacetest
$ psql dspacetest -c 'alter user dspacetest createuser;'
$ pg_restore -O -U dspacetest -d dspacetest ~/Downloads/cgspace_2016-09-01.backup
$ psql dspacetest -c 'alter user dspacetest nocreateuser;'
$ psql -U dspacetest -f ~/src/git/DSpace/dspace/etc/postgres/update-sequences.sql dspacetest -h localhost
$ vacuumdb dspacetest
```

View File

@ -424,7 +424,7 @@ $ JAVA_OPTS="-Dfile.encoding=UTF-8 -Xmx512m" /home/cgspace.cgiar.org/b
<li class="previous"><a href="https://alanorth.github.io/cgspace-notes/2016-07/"><span aria-hidden="true">&larr;</span> Older</a></li>
<li class="next disabled"><a href="#">Newer <span aria-hidden="true">&rarr;</span></a></li>
<li class="next"><a href="https://alanorth.github.io/cgspace-notes/2016-09/">Newer <span aria-hidden="true">&rarr;</span></a></li>
</ul>
</footer>

168
public/2016-09/index.html Normal file
View File

@ -0,0 +1,168 @@
<!DOCTYPE html>
<html lang="en-us">
<head prefix="og: http://ogp.me/ns#">
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0, maximum-scale=1" />
<meta property="og:title" content=" September, 2016 &middot; CGSpace Notes" />
<meta property="og:site_name" content="CGSpace Notes" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2016-09/" />
<meta property="og:type" content="article" />
<meta property="og:article:published_time" content="2016-09-01T15:53:00&#43;03:00" />
<meta property="og:article:tag" content="notes" />
<title>
September, 2016 &middot; CGSpace Notes
</title>
<link rel="stylesheet" href="https://alanorth.github.io/cgspace-notes/css/bootstrap.min.css" />
<link rel="stylesheet" href="https://alanorth.github.io/cgspace-notes/css/main.css" />
<link rel="stylesheet" href="https://alanorth.github.io/cgspace-notes/css/font-awesome.min.css" />
<link rel="stylesheet" href="https://alanorth.github.io/cgspace-notes/css/github.css" />
<link rel="stylesheet" href="//fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400" type="text/css">
<link rel="shortcut icon" href="https://alanorth.github.io/cgspace-notes/images/favicon.ico" />
<link rel="apple-touch-icon" href="https://alanorth.github.io/cgspace-notes/images/apple-touch-icon.png" />
</head>
<body>
<header class="global-header" style="background-image:url(../images/bg.jpg )">
<section class="header-text">
<h1><a href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a></h1>
<div class="sns-links hidden-print">
</div>
<a href="https://alanorth.github.io/cgspace-notes/" class="btn-header btn-back hidden-xs">
<i class="fa fa-angle-left" aria-hidden="true"></i>
&nbsp;Home
</a>
</section>
</header>
<main class="container">
<article>
<header>
<h1 class="text-primary">September, 2016</h1>
<div class="post-meta clearfix">
<div class="post-date pull-left">
Posted on
<time datetime="2016-09-01T15:53:00&#43;03:00">
Sep 1, 2016
</time>
</div>
<div class="pull-right">
<span class="post-tag small"><a href="https://alanorth.github.io/cgspace-notes//tags/notes">#notes</a></span>
</div>
</div>
</header>
<section>
<h2 id="2016-09-01">2016-09-01</h2>
<ul>
<li>Discuss helping CCAFS with some batch tagging of ORCID IDs for their authors</li>
<li>Discuss how the migration of CGIAR&rsquo;s Active Directory to a flat structure will break our LDAP groups in DSpace</li>
<li>We had been using <code>DC=ILRI</code> to determine whether a user was ILRI or not</li>
<li>It looks like we might be able to use OUs now, instead of DCs:</li>
</ul>
<pre><code>$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot; -W &quot;(sAMAccountName=admigration1)&quot;
</code></pre>
<ul>
<li>User who has been migrated to the root vs user still in the hierarchical structure:</li>
</ul>
<pre><code>distinguishedName: CN=Last\, First (ILRI),OU=ILRI Kenya Employees,OU=ILRI Kenya,OU=ILRIHUB,DC=CGIARAD,DC=ORG
distinguishedName: CN=Last\, First (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG
</code></pre>
<ul>
<li>Notes for local PostgreSQL database recreation from production snapshot:</li>
</ul>
<pre><code>$ dropdb dspacetest
$ createdb -O dspacetest --encoding=UNICODE dspacetest
$ psql dspacetest -c 'alter user dspacetest createuser;'
$ pg_restore -O -U dspacetest -d dspacetest ~/Downloads/cgspace_2016-09-01.backup
$ psql dspacetest -c 'alter user dspacetest nocreateuser;'
$ psql -U dspacetest -f ~/src/git/DSpace/dspace/etc/postgres/update-sequences.sql dspacetest -h localhost
$ vacuumdb dspacetest
</code></pre>
</section>
<footer>
<section class="author-info row">
<div class="author-avatar col-md-2">
</div>
<div class="author-meta col-md-6">
<h1 class="author-name text-primary">Alan Orth</h1>
</div>
</section>
<ul class="pager">
<li class="previous"><a href="https://alanorth.github.io/cgspace-notes/2016-08/"><span aria-hidden="true">&larr;</span> Older</a></li>
<li class="next disabled"><a href="#">Newer <span aria-hidden="true">&rarr;</span></a></li>
</ul>
</footer>
</article>
</main>
<footer class="container global-footer">
<div class="copyright-note pull-left">
</div>
<div class="sns-links hidden-print">
</div>
</footer>
<script src="https://alanorth.github.io/cgspace-notes/js/highlight.pack.js"></script>
<script>
hljs.initHighlightingOnLoad();
</script>
</body>
</html>

View File

@ -58,6 +58,34 @@
<div class="article-list">
<article>
<header>
<h2><a href="https://alanorth.github.io/cgspace-notes/2016-09/">September, 2016</a></h2>
<div class="post-meta clearfix">
<div class="post-date pull-left">
Posted on
<time datetime="2016-09-01T15:53:00&#43;03:00">
Sep 1, 2016
</time>
</div>
</div>
</header>
<div>
2016-09-01 Discuss helping CCAFS with some batch tagging of ORCID IDs for their authors Discuss how the migration of CGIAR&rsquo;s Active Directory to a flat structure will break our LDAP groups in DSpace We had been using DC=ILRI to determine whether a user was ILRI or not It looks like we might be able to use OUs now, instead of DCs: $ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot;
</div>
<footer>
<ul class="pager">
<li class="next"><a href="https://alanorth.github.io/cgspace-notes/2016-09/">Read more <span aria-hidden="true">&raquo;</span></a></li>
</ul>
</footer>
</article>
<hr/>
<article>
<header>
<h2><a href="https://alanorth.github.io/cgspace-notes/2016-08/">August, 2016</a></h2>
@ -307,39 +335,15 @@
</article>
<hr/>
<article>
<header>
<h2><a href="https://alanorth.github.io/cgspace-notes/2015-11/">November, 2015</a></h2>
<div class="post-meta clearfix">
<div class="post-date pull-left">
Posted on
<time datetime="2015-11-23T17:00:57&#43;03:00">
Nov 23, 2015
</time>
</div>
</div>
</header>
<div>
2015-11-22 CGSpace went down Looks like DSpace exhausted its PostgreSQL connection pool Last week I had increased the limit from 30 to 60, which seemed to help, but now there are many more idle connections: $ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace 78 For now I have increased the limit from 60 to 90, run updates, and rebooted the server 2015-11-24 CGSpace went down again Getting emails from uptimeRobot and uptimeButler that it&rsquo;s down, and Google Webmaster Tools is sending emails that there is an increase in crawl errors Looks like there are still a bunch of idle PostgreSQL connections: $ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace 96 For some reason the number of idle connections is very high since we upgraded to DSpace 5 2015-11-25 Troubleshoot the DSpace 5 OAI breakage caused by nginx routing config The OAI application requests stylesheets and javascript files with the path /oai/static/css, which gets matched here: # static assets we can load from the file system directly with nginx location ~ /(themes|static|aspects/ReportingSuite) { try_files $uri @tomcat; ...
</div>
<footer>
<ul class="pager">
<li class="next"><a href="https://alanorth.github.io/cgspace-notes/2015-11/">Read more <span aria-hidden="true">&raquo;</span></a></li>
</ul>
</footer>
</article>
</div>
<nav class="pagination" role="navigation">
<hr />
<span class="page-number">Page 1 of 1</span>
<span class="page-number">Page 1 of 2</span>
<a class="older-posts" href="/page/2/">Older Posts <span aria-hidden="true">&raquo;</span></a>
</nav>

View File

@ -6,9 +6,52 @@
<description>Recent content on CGSpace Notes</description>
<generator>Hugo -- gohugo.io</generator>
<language>en-us</language>
<lastBuildDate>Mon, 01 Aug 2016 15:53:00 +0300</lastBuildDate>
<lastBuildDate>Thu, 01 Sep 2016 15:53:00 +0300</lastBuildDate>
<atom:link href="https://alanorth.github.io/cgspace-notes/index.xml" rel="self" type="application/rss+xml" />
<item>
<title>September, 2016</title>
<link>https://alanorth.github.io/cgspace-notes/2016-09/</link>
<pubDate>Thu, 01 Sep 2016 15:53:00 +0300</pubDate>
<guid>https://alanorth.github.io/cgspace-notes/2016-09/</guid>
<description>
&lt;h2 id=&#34;2016-09-01&#34;&gt;2016-09-01&lt;/h2&gt;
&lt;ul&gt;
&lt;li&gt;Discuss helping CCAFS with some batch tagging of ORCID IDs for their authors&lt;/li&gt;
&lt;li&gt;Discuss how the migration of CGIAR&amp;rsquo;s Active Directory to a flat structure will break our LDAP groups in DSpace&lt;/li&gt;
&lt;li&gt;We had been using &lt;code&gt;DC=ILRI&lt;/code&gt; to determine whether a user was ILRI or not&lt;/li&gt;
&lt;li&gt;It looks like we might be able to use OUs now, instead of DCs:&lt;/li&gt;
&lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &amp;quot;dc=cgiarad,dc=org&amp;quot; -D &amp;quot;admigration1@cgiarad.org&amp;quot; -W &amp;quot;(sAMAccountName=admigration1)&amp;quot;
&lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt;
&lt;li&gt;User who has been migrated to the root vs user still in the hierarchical structure:&lt;/li&gt;
&lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;distinguishedName: CN=Last\, First (ILRI),OU=ILRI Kenya Employees,OU=ILRI Kenya,OU=ILRIHUB,DC=CGIARAD,DC=ORG
distinguishedName: CN=Last\, First (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG
&lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt;
&lt;li&gt;Notes for local PostgreSQL database recreation from production snapshot:&lt;/li&gt;
&lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ dropdb dspacetest
$ createdb -O dspacetest --encoding=UNICODE dspacetest
$ psql dspacetest -c &#39;alter user dspacetest createuser;&#39;
$ pg_restore -O -U dspacetest -d dspacetest ~/Downloads/cgspace_2016-09-01.backup
$ psql dspacetest -c &#39;alter user dspacetest nocreateuser;&#39;
$ psql -U dspacetest -f ~/src/git/DSpace/dspace/etc/postgres/update-sequences.sql dspacetest -h localhost
$ vacuumdb dspacetest
&lt;/code&gt;&lt;/pre&gt;
</description>
</item>
<item>
<title>August, 2016</title>
<link>https://alanorth.github.io/cgspace-notes/2016-08/</link>

126
public/page/2/index.html Normal file
View File

@ -0,0 +1,126 @@
<!DOCTYPE html>
<html lang="en-us">
<head prefix="og: http://ogp.me/ns#">
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0, maximum-scale=1" />
<meta property="og:title" content=" CGSpace Notes" />
<meta property="og:site_name" content="CGSpace Notes" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
<meta property="og:type" content="website" />
<title>
CGSpace Notes
</title>
<link rel="stylesheet" href="https://alanorth.github.io/cgspace-notes/css/bootstrap.min.css" />
<link rel="stylesheet" href="https://alanorth.github.io/cgspace-notes/css/main.css" />
<link rel="stylesheet" href="https://alanorth.github.io/cgspace-notes/css/font-awesome.min.css" />
<link rel="stylesheet" href="https://alanorth.github.io/cgspace-notes/css/github.css" />
<link rel="stylesheet" href="//fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400" type="text/css">
<link rel="shortcut icon" href="https://alanorth.github.io/cgspace-notes/images/favicon.ico" />
<link rel="apple-touch-icon" href="https://alanorth.github.io/cgspace-notes/images/apple-touch-icon.png" />
<link href="https://alanorth.github.io/cgspace-notes/index.xml" rel="alternate" type="application/rss+xml" title="CGSpace Notes" />
</head>
<body>
<header class="global-header" style="background-image:url( /images/bg.jpg )">
<section class="header-text">
<h1><a href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a></h1>
<div class="sns-links hidden-print">
</div>
<a href="https://alanorth.github.io/cgspace-notes/index.xml" class="btn-header btn-subscribe hidden-xs">
<i class="fa fa-rss" aria-hidden="true"></i>
&nbsp;Subscribe
</a>
</section>
</header>
<main class="container">
<div class="article-list">
<article>
<header>
<h2><a href="https://alanorth.github.io/cgspace-notes/2015-11/">November, 2015</a></h2>
<div class="post-meta clearfix">
<div class="post-date pull-left">
Posted on
<time datetime="2015-11-23T17:00:57&#43;03:00">
Nov 23, 2015
</time>
</div>
</div>
</header>
<div>
2015-11-22 CGSpace went down Looks like DSpace exhausted its PostgreSQL connection pool Last week I had increased the limit from 30 to 60, which seemed to help, but now there are many more idle connections: $ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace 78 For now I have increased the limit from 60 to 90, run updates, and rebooted the server 2015-11-24 CGSpace went down again Getting emails from uptimeRobot and uptimeButler that it&rsquo;s down, and Google Webmaster Tools is sending emails that there is an increase in crawl errors Looks like there are still a bunch of idle PostgreSQL connections: $ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspace 96 For some reason the number of idle connections is very high since we upgraded to DSpace 5 2015-11-25 Troubleshoot the DSpace 5 OAI breakage caused by nginx routing config The OAI application requests stylesheets and javascript files with the path /oai/static/css, which gets matched here: # static assets we can load from the file system directly with nginx location ~ /(themes|static|aspects/ReportingSuite) { try_files $uri @tomcat; ...
</div>
<footer>
<ul class="pager">
<li class="next"><a href="https://alanorth.github.io/cgspace-notes/2015-11/">Read more <span aria-hidden="true">&raquo;</span></a></li>
</ul>
</footer>
</article>
</div>
<nav class="pagination" role="navigation">
<hr />
<a class="newer-posts" href="/"><span aria-hidden="true">&laquo;</span> Newer Posts</a>
<span class="page-number">Page 2 of 2</span>
</nav>
</main>
<footer class="container global-footer">
<div class="copyright-note pull-left">
</div>
<div class="sns-links hidden-print">
</div>
</footer>
<script src="https://alanorth.github.io/cgspace-notes/js/highlight.pack.js"></script>
<script>
hljs.initHighlightingOnLoad();
</script>
</body>
</html>

View File

@ -3,7 +3,12 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/</loc>
<lastmod>2016-08-01T15:53:00+03:00</lastmod>
<lastmod>2016-09-01T15:53:00+03:00</lastmod>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/2016-09/</loc>
<lastmod>2016-09-01T15:53:00+03:00</lastmod>
</url>
<url>

View File

@ -64,7 +64,7 @@
<ul>
<li><a href="https://alanorth.github.io/cgspace-notes//tags/notes">notes</a> 10</li>
<li><a href="https://alanorth.github.io/cgspace-notes//tags/notes">notes</a> 11</li>
</ul>
</section>

View File

@ -61,6 +61,32 @@
<section class="article-list">
<h1>Notes</h1>
<hr/>
<article>
<header>
<h2><a href="https://alanorth.github.io/cgspace-notes/2016-09/">September, 2016</a></h2>
<div class="post-meta clearfix">
<div class="post-date pull-left">
Posted on
<time datetime="2016-09-01T15:53:00&#43;03:00">
Sep 1, 2016
</time>
</div>
</div>
</header>
<div>
2016-09-01 Discuss helping CCAFS with some batch tagging of ORCID IDs for their authors Discuss how the migration of CGIAR&rsquo;s Active Directory to a flat structure will break our LDAP groups in DSpace We had been using DC=ILRI to determine whether a user was ILRI or not It looks like we might be able to use OUs now, instead of DCs: $ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &quot;dc=cgiarad,dc=org&quot; -D &quot;admigration1@cgiarad.org&quot;
</div>
<footer>
<ul class="pager">
<li class="next"><a href="https://alanorth.github.io/cgspace-notes/2016-09/">Read more <span aria-hidden="true">&raquo;</span></a></li>
</ul>
</footer>
</article>
<hr/>
<article>
<header>

View File

@ -6,9 +6,52 @@
<description>Recent content in Notes on CGSpace Notes</description>
<generator>Hugo -- gohugo.io</generator>
<language>en-us</language>
<lastBuildDate>Mon, 01 Aug 2016 15:53:00 +0300</lastBuildDate>
<lastBuildDate>Thu, 01 Sep 2016 15:53:00 +0300</lastBuildDate>
<atom:link href="https://alanorth.github.io/cgspace-notes/tags/notes/index.xml" rel="self" type="application/rss+xml" />
<item>
<title>September, 2016</title>
<link>https://alanorth.github.io/cgspace-notes/2016-09/</link>
<pubDate>Thu, 01 Sep 2016 15:53:00 +0300</pubDate>
<guid>https://alanorth.github.io/cgspace-notes/2016-09/</guid>
<description>
&lt;h2 id=&#34;2016-09-01&#34;&gt;2016-09-01&lt;/h2&gt;
&lt;ul&gt;
&lt;li&gt;Discuss helping CCAFS with some batch tagging of ORCID IDs for their authors&lt;/li&gt;
&lt;li&gt;Discuss how the migration of CGIAR&amp;rsquo;s Active Directory to a flat structure will break our LDAP groups in DSpace&lt;/li&gt;
&lt;li&gt;We had been using &lt;code&gt;DC=ILRI&lt;/code&gt; to determine whether a user was ILRI or not&lt;/li&gt;
&lt;li&gt;It looks like we might be able to use OUs now, instead of DCs:&lt;/li&gt;
&lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b &amp;quot;dc=cgiarad,dc=org&amp;quot; -D &amp;quot;admigration1@cgiarad.org&amp;quot; -W &amp;quot;(sAMAccountName=admigration1)&amp;quot;
&lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt;
&lt;li&gt;User who has been migrated to the root vs user still in the hierarchical structure:&lt;/li&gt;
&lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;distinguishedName: CN=Last\, First (ILRI),OU=ILRI Kenya Employees,OU=ILRI Kenya,OU=ILRIHUB,DC=CGIARAD,DC=ORG
distinguishedName: CN=Last\, First (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG
&lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt;
&lt;li&gt;Notes for local PostgreSQL database recreation from production snapshot:&lt;/li&gt;
&lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ dropdb dspacetest
$ createdb -O dspacetest --encoding=UNICODE dspacetest
$ psql dspacetest -c &#39;alter user dspacetest createuser;&#39;
$ pg_restore -O -U dspacetest -d dspacetest ~/Downloads/cgspace_2016-09-01.backup
$ psql dspacetest -c &#39;alter user dspacetest nocreateuser;&#39;
$ psql -U dspacetest -f ~/src/git/DSpace/dspace/etc/postgres/update-sequences.sql dspacetest -h localhost
$ vacuumdb dspacetest
&lt;/code&gt;&lt;/pre&gt;
</description>
</item>
<item>
<title>August, 2016</title>
<link>https://alanorth.github.io/cgspace-notes/2016-08/</link>