Add notes for 2016-09-25

This commit is contained in:
Alan Orth 2016-09-25 14:50:37 +03:00
parent 2e6dcbcdf9
commit 16ccdfe0d1
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
5 changed files with 109 additions and 12 deletions

View File

@ -447,3 +447,20 @@ $ ./delete-metadata-values.py -i sponsors-delete-8.csv -f dc.description.sponsor
## 2016-09-22 ## 2016-09-22
- Update controlled vocabulary for sponsorship based on the latest corrected values from the database - Update controlled vocabulary for sponsorship based on the latest corrected values from the database
## 2016-09-25
- Merge accession date improvements for CUA module ([#275](https://github.com/ilri/DSpace/pull/275))
- Merge addition of accession date to Discovery search filters ([#276](https://github.com/ilri/DSpace/pull/276))
- Merge updates to sponsorship controlled vocabulary ([#277](https://github.com/ilri/DSpace/pull/277))
- I've been trying to add a search filter for `dc.description` so the IITA people can search for some tags they use there, but for some reason the filter never shows up in Atmire's CUA
- Not sure if it's something like we already have too many filters there (30), or the filter name is reserved, etc...
- Generate a list of ILRI subjects for Peter and Abenet to look through/fix:
```
dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where resource_type_id=2 and metadata_field_id=203 group by text_value order by count desc) to /tmp/ilrisubjects.csv with csv;
```
- Regenerate Discovery indexes a few times after playing with `discovery.xml` index definitions (syntax, parameters, etc).
- Merge changes to boolean logic in Solr search ([#274](https://github.com/ilri/DSpace/pull/274))
- Run all sponsorship and affiliation fixes on CGSpace, deploy latest `5_x-prod` branch, and re-index Discovery on CGSpace

View File

@ -531,7 +531,7 @@ Exception in thread "Thread-54216" org.apache.solr.client.solrj.impl.H
</ul> </ul>
<pre><code>$ ./fix-metadata-values.py -i affiliations_pb-322-corrections.csv -f cg.contributor.affiliation -t correct -m 211 -d dspace -u dspace -p fuuu <pre><code>$ ./fix-metadata-values.py -i affiliations_pb-322-corrections.csv -f cg.contributor.affiliation -t correct -m 211 -d dspace -u dspace -p fuuu
$ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2-deletions.csv -m 211 -u dspace-d dspace-p fuuu $ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2-deletions.csv -m 211 -u dspace -d dspace -p fuuu
</code></pre> </code></pre>
<ul> <ul>
@ -585,8 +585,8 @@ $ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2
<li>Start processing the fixes to <code>dc.description.sponsorship</code> from Peter Ballantyne:</li> <li>Start processing the fixes to <code>dc.description.sponsorship</code> from Peter Ballantyne:</li>
</ul> </ul>
<pre><code>$ ./fix-metadata-values.py -i sponsors-fix-23.csv -f dc.description.sponsorship -t correct -m 29 -d dspacetest -u dspacetest -p fuuu <pre><code>$ ./fix-metadata-values.py -i sponsors-fix-23.csv -f dc.description.sponsorship -t correct -m 29 -d dspace -u dspace -p fuuu
$ ./delete-metadata-values.py -i sponsors-delete-8.csv -f dc.description.sponsorship -m 29 -d dspacetest -u dspacetest -p fuuu $ ./delete-metadata-values.py -i sponsors-delete-8.csv -f dc.description.sponsorship -m 29 -d dspace -u dspace -p fuuu
</code></pre> </code></pre>
<ul> <ul>
@ -600,6 +600,26 @@ $ ./delete-metadata-values.py -i sponsors-delete-8.csv -f dc.description.sponsor
<li>Update controlled vocabulary for sponsorship based on the latest corrected values from the database</li> <li>Update controlled vocabulary for sponsorship based on the latest corrected values from the database</li>
</ul> </ul>
<h2 id="2016-09-25">2016-09-25</h2>
<ul>
<li>Merge accession date improvements for CUA module (<a href="https://github.com/ilri/DSpace/pull/275">#275</a>)</li>
<li>Merge addition of accession date to Discovery search filters (<a href="https://github.com/ilri/DSpace/pull/276">#276</a>)</li>
<li>Merge updates to sponsorship controlled vocabulary (<a href="https://github.com/ilri/DSpace/pull/277">#277</a>)</li>
<li>I&rsquo;ve been trying to add a search filter for <code>dc.description</code> so the IITA people can search for some tags they use there, but for some reason the filter never shows up in Atmire&rsquo;s CUA</li>
<li>Not sure if it&rsquo;s something like we already have too many filters there (30), or the filter name is reserved, etc&hellip;</li>
<li>Generate a list of ILRI subjects for Peter and Abenet to look through/fix:</li>
</ul>
<pre><code>dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where resource_type_id=2 and metadata_field_id=203 group by text_value order by count desc) to /tmp/ilrisubjects.csv with csv;
</code></pre>
<ul>
<li>Regenerate Discovery indexes a few times after playing with <code>discovery.xml</code> index definitions (syntax, parameters, etc).</li>
<li>Merge changes to boolean logic in Solr search (<a href="https://github.com/ilri/DSpace/pull/274">#274</a>)</li>
<li>Run all sponsorship and affiliation fixes on CGSpace, deploy latest <code>5_x-prod</code> branch, and re-index Discovery on CGSpace</li>
</ul>
</article> </article>

View File

@ -465,7 +465,7 @@ Exception in thread &amp;quot;Thread-54216&amp;quot; org.apache.solr.client.solr
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ ./fix-metadata-values.py -i affiliations_pb-322-corrections.csv -f cg.contributor.affiliation -t correct -m 211 -d dspace -u dspace -p fuuu &lt;pre&gt;&lt;code&gt;$ ./fix-metadata-values.py -i affiliations_pb-322-corrections.csv -f cg.contributor.affiliation -t correct -m 211 -d dspace -u dspace -p fuuu
$ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2-deletions.csv -m 211 -u dspace-d dspace-p fuuu $ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2-deletions.csv -m 211 -u dspace -d dspace -p fuuu
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt; &lt;ul&gt;
@ -519,8 +519,8 @@ $ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2
&lt;li&gt;Start processing the fixes to &lt;code&gt;dc.description.sponsorship&lt;/code&gt; from Peter Ballantyne:&lt;/li&gt; &lt;li&gt;Start processing the fixes to &lt;code&gt;dc.description.sponsorship&lt;/code&gt; from Peter Ballantyne:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ ./fix-metadata-values.py -i sponsors-fix-23.csv -f dc.description.sponsorship -t correct -m 29 -d dspacetest -u dspacetest -p fuuu &lt;pre&gt;&lt;code&gt;$ ./fix-metadata-values.py -i sponsors-fix-23.csv -f dc.description.sponsorship -t correct -m 29 -d dspace -u dspace -p fuuu
$ ./delete-metadata-values.py -i sponsors-delete-8.csv -f dc.description.sponsorship -m 29 -d dspacetest -u dspacetest -p fuuu $ ./delete-metadata-values.py -i sponsors-delete-8.csv -f dc.description.sponsorship -m 29 -d dspace -u dspace -p fuuu
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt; &lt;ul&gt;
@ -533,6 +533,26 @@ $ ./delete-metadata-values.py -i sponsors-delete-8.csv -f dc.description.sponsor
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Update controlled vocabulary for sponsorship based on the latest corrected values from the database&lt;/li&gt; &lt;li&gt;Update controlled vocabulary for sponsorship based on the latest corrected values from the database&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;
&lt;h2 id=&#34;2016-09-25&#34;&gt;2016-09-25&lt;/h2&gt;
&lt;ul&gt;
&lt;li&gt;Merge accession date improvements for CUA module (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/275&#34;&gt;#275&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Merge addition of accession date to Discovery search filters (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/276&#34;&gt;#276&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Merge updates to sponsorship controlled vocabulary (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/277&#34;&gt;#277&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;I&amp;rsquo;ve been trying to add a search filter for &lt;code&gt;dc.description&lt;/code&gt; so the IITA people can search for some tags they use there, but for some reason the filter never shows up in Atmire&amp;rsquo;s CUA&lt;/li&gt;
&lt;li&gt;Not sure if it&amp;rsquo;s something like we already have too many filters there (30), or the filter name is reserved, etc&amp;hellip;&lt;/li&gt;
&lt;li&gt;Generate a list of ILRI subjects for Peter and Abenet to look through/fix:&lt;/li&gt;
&lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where resource_type_id=2 and metadata_field_id=203 group by text_value order by count desc) to /tmp/ilrisubjects.csv with csv;
&lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt;
&lt;li&gt;Regenerate Discovery indexes a few times after playing with &lt;code&gt;discovery.xml&lt;/code&gt; index definitions (syntax, parameters, etc).&lt;/li&gt;
&lt;li&gt;Merge changes to boolean logic in Solr search (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/274&#34;&gt;#274&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Run all sponsorship and affiliation fixes on CGSpace, deploy latest &lt;code&gt;5_x-prod&lt;/code&gt; branch, and re-index Discovery on CGSpace&lt;/li&gt;
&lt;/ul&gt;
</description> </description>
</item> </item>

View File

@ -465,7 +465,7 @@ Exception in thread &amp;quot;Thread-54216&amp;quot; org.apache.solr.client.solr
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ ./fix-metadata-values.py -i affiliations_pb-322-corrections.csv -f cg.contributor.affiliation -t correct -m 211 -d dspace -u dspace -p fuuu &lt;pre&gt;&lt;code&gt;$ ./fix-metadata-values.py -i affiliations_pb-322-corrections.csv -f cg.contributor.affiliation -t correct -m 211 -d dspace -u dspace -p fuuu
$ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2-deletions.csv -m 211 -u dspace-d dspace-p fuuu $ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2-deletions.csv -m 211 -u dspace -d dspace -p fuuu
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt; &lt;ul&gt;
@ -519,8 +519,8 @@ $ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2
&lt;li&gt;Start processing the fixes to &lt;code&gt;dc.description.sponsorship&lt;/code&gt; from Peter Ballantyne:&lt;/li&gt; &lt;li&gt;Start processing the fixes to &lt;code&gt;dc.description.sponsorship&lt;/code&gt; from Peter Ballantyne:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ ./fix-metadata-values.py -i sponsors-fix-23.csv -f dc.description.sponsorship -t correct -m 29 -d dspacetest -u dspacetest -p fuuu &lt;pre&gt;&lt;code&gt;$ ./fix-metadata-values.py -i sponsors-fix-23.csv -f dc.description.sponsorship -t correct -m 29 -d dspace -u dspace -p fuuu
$ ./delete-metadata-values.py -i sponsors-delete-8.csv -f dc.description.sponsorship -m 29 -d dspacetest -u dspacetest -p fuuu $ ./delete-metadata-values.py -i sponsors-delete-8.csv -f dc.description.sponsorship -m 29 -d dspace -u dspace -p fuuu
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt; &lt;ul&gt;
@ -533,6 +533,26 @@ $ ./delete-metadata-values.py -i sponsors-delete-8.csv -f dc.description.sponsor
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Update controlled vocabulary for sponsorship based on the latest corrected values from the database&lt;/li&gt; &lt;li&gt;Update controlled vocabulary for sponsorship based on the latest corrected values from the database&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;
&lt;h2 id=&#34;2016-09-25&#34;&gt;2016-09-25&lt;/h2&gt;
&lt;ul&gt;
&lt;li&gt;Merge accession date improvements for CUA module (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/275&#34;&gt;#275&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Merge addition of accession date to Discovery search filters (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/276&#34;&gt;#276&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Merge updates to sponsorship controlled vocabulary (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/277&#34;&gt;#277&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;I&amp;rsquo;ve been trying to add a search filter for &lt;code&gt;dc.description&lt;/code&gt; so the IITA people can search for some tags they use there, but for some reason the filter never shows up in Atmire&amp;rsquo;s CUA&lt;/li&gt;
&lt;li&gt;Not sure if it&amp;rsquo;s something like we already have too many filters there (30), or the filter name is reserved, etc&amp;hellip;&lt;/li&gt;
&lt;li&gt;Generate a list of ILRI subjects for Peter and Abenet to look through/fix:&lt;/li&gt;
&lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where resource_type_id=2 and metadata_field_id=203 group by text_value order by count desc) to /tmp/ilrisubjects.csv with csv;
&lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt;
&lt;li&gt;Regenerate Discovery indexes a few times after playing with &lt;code&gt;discovery.xml&lt;/code&gt; index definitions (syntax, parameters, etc).&lt;/li&gt;
&lt;li&gt;Merge changes to boolean logic in Solr search (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/274&#34;&gt;#274&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Run all sponsorship and affiliation fixes on CGSpace, deploy latest &lt;code&gt;5_x-prod&lt;/code&gt; branch, and re-index Discovery on CGSpace&lt;/li&gt;
&lt;/ul&gt;
</description> </description>
</item> </item>

View File

@ -465,7 +465,7 @@ Exception in thread &amp;quot;Thread-54216&amp;quot; org.apache.solr.client.solr
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ ./fix-metadata-values.py -i affiliations_pb-322-corrections.csv -f cg.contributor.affiliation -t correct -m 211 -d dspace -u dspace -p fuuu &lt;pre&gt;&lt;code&gt;$ ./fix-metadata-values.py -i affiliations_pb-322-corrections.csv -f cg.contributor.affiliation -t correct -m 211 -d dspace -u dspace -p fuuu
$ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2-deletions.csv -m 211 -u dspace-d dspace-p fuuu $ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2-deletions.csv -m 211 -u dspace -d dspace -p fuuu
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt; &lt;ul&gt;
@ -519,8 +519,8 @@ $ ./delete-metadata-values.py -f cg.contributor.affiliation -i affiliations_pb-2
&lt;li&gt;Start processing the fixes to &lt;code&gt;dc.description.sponsorship&lt;/code&gt; from Peter Ballantyne:&lt;/li&gt; &lt;li&gt;Start processing the fixes to &lt;code&gt;dc.description.sponsorship&lt;/code&gt; from Peter Ballantyne:&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;$ ./fix-metadata-values.py -i sponsors-fix-23.csv -f dc.description.sponsorship -t correct -m 29 -d dspacetest -u dspacetest -p fuuu &lt;pre&gt;&lt;code&gt;$ ./fix-metadata-values.py -i sponsors-fix-23.csv -f dc.description.sponsorship -t correct -m 29 -d dspace -u dspace -p fuuu
$ ./delete-metadata-values.py -i sponsors-delete-8.csv -f dc.description.sponsorship -m 29 -d dspacetest -u dspacetest -p fuuu $ ./delete-metadata-values.py -i sponsors-delete-8.csv -f dc.description.sponsorship -m 29 -d dspace -u dspace -p fuuu
&lt;/code&gt;&lt;/pre&gt; &lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt; &lt;ul&gt;
@ -533,6 +533,26 @@ $ ./delete-metadata-values.py -i sponsors-delete-8.csv -f dc.description.sponsor
&lt;ul&gt; &lt;ul&gt;
&lt;li&gt;Update controlled vocabulary for sponsorship based on the latest corrected values from the database&lt;/li&gt; &lt;li&gt;Update controlled vocabulary for sponsorship based on the latest corrected values from the database&lt;/li&gt;
&lt;/ul&gt; &lt;/ul&gt;
&lt;h2 id=&#34;2016-09-25&#34;&gt;2016-09-25&lt;/h2&gt;
&lt;ul&gt;
&lt;li&gt;Merge accession date improvements for CUA module (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/275&#34;&gt;#275&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Merge addition of accession date to Discovery search filters (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/276&#34;&gt;#276&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Merge updates to sponsorship controlled vocabulary (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/277&#34;&gt;#277&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;I&amp;rsquo;ve been trying to add a search filter for &lt;code&gt;dc.description&lt;/code&gt; so the IITA people can search for some tags they use there, but for some reason the filter never shows up in Atmire&amp;rsquo;s CUA&lt;/li&gt;
&lt;li&gt;Not sure if it&amp;rsquo;s something like we already have too many filters there (30), or the filter name is reserved, etc&amp;hellip;&lt;/li&gt;
&lt;li&gt;Generate a list of ILRI subjects for Peter and Abenet to look through/fix:&lt;/li&gt;
&lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where resource_type_id=2 and metadata_field_id=203 group by text_value order by count desc) to /tmp/ilrisubjects.csv with csv;
&lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt;
&lt;li&gt;Regenerate Discovery indexes a few times after playing with &lt;code&gt;discovery.xml&lt;/code&gt; index definitions (syntax, parameters, etc).&lt;/li&gt;
&lt;li&gt;Merge changes to boolean logic in Solr search (&lt;a href=&#34;https://github.com/ilri/DSpace/pull/274&#34;&gt;#274&lt;/a&gt;)&lt;/li&gt;
&lt;li&gt;Run all sponsorship and affiliation fixes on CGSpace, deploy latest &lt;code&gt;5_x-prod&lt;/code&gt; branch, and re-index Discovery on CGSpace&lt;/li&gt;
&lt;/ul&gt;
</description> </description>
</item> </item>