Add notes for 2016-10-30

content/post/2016-10.md

@@ -209,3 +209,37 @@ UPDATE 0
 ![DSpace Test with Font Awesome icons](2016/10/dspacetest-fontawesome-icons.png)
 
 - Run the same replacements on CGSpace
+
+## 2016-10-30
+
+- Fix some messed up authors on CGSpace:
+
+```
+dspace=# update metadatavalue set authority='799da1d8-22f3-43f5-8233-3d2ef5ebf8a8', confidence=600 where metadata_field_id=3 and resource_type_id=2 and text_value like 'Charleston, B.%';
+UPDATE 10
+dspace=# update metadatavalue set authority='e936f5c5-343d-4c46-aa91-7a1fff6277ed', confidence=600 where metadata_field_id=3 and resource_type_id=2 and text_value like 'Knight-Jones%';
+UPDATE 36
+```
+
+- I updated the authority index but nothing seemed to change, so I'll wait and do it again after I update Discovery below
+- Skype chat with Tsega about the [IFPRI contentdm bridge](https://github.com/ilri/ckm-cgspace-contentdm-bridge)
+- We tested harvesting OAI in an example collection to see how it works
+- Talk to Carlos Quiros about CG Core metadata in CGSpace
+- Get a list of countries from CGSpace so I can do some batch corrections:
+
+```
+dspace=# \copy (select distinct text_value, count(*) from metadatavalue where metadata_field_id=228 group by text_value order by count desc) to /tmp/countries.csv with csv;
+```
+
+- Fix a bunch of countries in Open Refine and run the corrections on CGSpace:
+
+```
+$ ./fix-metadata-values.py -i countries-fix-18.csv -f dc.coverage.country -t 'correct' -m 228 -d dspace -u dspace -p fuuu
+$ ./delete-metadata-values.py -i countries-delete-2.csv -f dc.coverage.country -m 228 -d dspace -u dspace -p fuuu
+```
+
+- Run a shit ton of author fixes from Peter Ballantyne that we've been cleaning up for two months:
+
+```
+$ ./fix-metadata-values.py -i /tmp/authors-fix-pb2.csv -f dc.contributor.author -t correct -m 3 -u dspace -d dspace -p fuuu
+```

public/2016-10/index.html

@@ -349,6 +349,44 @@ UPDATE 0
 <li>Run the same replacements on CGSpace</li>
 </ul>
 
+<h2 id="2016-10-30">2016-10-30</h2>
+
+<ul>
+<li>Fix some messed up authors on CGSpace:</li>
+</ul>
+
+<pre><code>dspace=# update metadatavalue set authority='799da1d8-22f3-43f5-8233-3d2ef5ebf8a8', confidence=600 where metadata_field_id=3 and resource_type_id=2 and text_value like 'Charleston, B.%';
+UPDATE 10
+dspace=# update metadatavalue set authority='e936f5c5-343d-4c46-aa91-7a1fff6277ed', confidence=600 where metadata_field_id=3 and resource_type_id=2 and text_value like 'Knight-Jones%';
+UPDATE 36
+</code></pre>
+
+<ul>
+<li>I updated the authority index but nothing seemed to change, so I&rsquo;ll wait and do it again after I update Discovery below</li>
+<li>Skype chat with Tsega about the <a href="https://github.com/ilri/ckm-cgspace-contentdm-bridge">IFPRI contentdm bridge</a></li>
+<li>We tested harvesting OAI in an example collection to see how it works</li>
+<li>Talk to Carlos Quiros about CG Core metadata in CGSpace</li>
+<li>Get a list of countries from CGSpace so I can do some batch corrections:</li>
+</ul>
+
+<pre><code>dspace=# \copy (select distinct text_value, count(*) from metadatavalue where metadata_field_id=228 group by text_value order by count desc) to /tmp/countries.csv with csv;
+</code></pre>
+
+<ul>
+<li>Fix a bunch of countries in Open Refine and run the corrections on CGSpace:</li>
+</ul>
+
+<pre><code>$ ./fix-metadata-values.py -i countries-fix-18.csv -f dc.coverage.country -t 'correct' -m 228 -d dspace -u dspace -p fuuu
+$ ./delete-metadata-values.py -i countries-delete-2.csv -f dc.coverage.country -m 228 -d dspace -u dspace -p fuuu
+</code></pre>
+
+<ul>
+<li>Run a shit ton of author fixes from Peter Ballantyne that we&rsquo;ve been cleaning up for two months:</li>
+</ul>
+
+<pre><code>$ ./fix-metadata-values.py -i /tmp/authors-fix-pb2.csv -f dc.contributor.author -t correct -m 3 -u dspace -d dspace -p fuuu
+</code></pre>
+
 
         
         

public/index.xml

@@ -275,6 +275,44 @@ UPDATE 0
 <ul>
 <li>Run the same replacements on CGSpace</li>
 </ul>
+
+<h2 id="2016-10-30">2016-10-30</h2>
+
+<ul>
+<li>Fix some messed up authors on CGSpace:</li>
+</ul>
+
+<pre><code>dspace=# update metadatavalue set authority='799da1d8-22f3-43f5-8233-3d2ef5ebf8a8', confidence=600 where metadata_field_id=3 and resource_type_id=2 and text_value like 'Charleston, B.%';
+UPDATE 10
+dspace=# update metadatavalue set authority='e936f5c5-343d-4c46-aa91-7a1fff6277ed', confidence=600 where metadata_field_id=3 and resource_type_id=2 and text_value like 'Knight-Jones%';
+UPDATE 36
+</code></pre>
+
+<ul>
+<li>I updated the authority index but nothing seemed to change, so I’ll wait and do it again after I update Discovery below</li>
+<li>Skype chat with Tsega about the <a href="https://github.com/ilri/ckm-cgspace-contentdm-bridge">IFPRI contentdm bridge</a></li>
+<li>We tested harvesting OAI in an example collection to see how it works</li>
+<li>Talk to Carlos Quiros about CG Core metadata in CGSpace</li>
+<li>Get a list of countries from CGSpace so I can do some batch corrections:</li>
+</ul>
+
+<pre><code>dspace=# \copy (select distinct text_value, count(*) from metadatavalue where metadata_field_id=228 group by text_value order by count desc) to /tmp/countries.csv with csv;
+</code></pre>
+
+<ul>
+<li>Fix a bunch of countries in Open Refine and run the corrections on CGSpace:</li>
+</ul>
+
+<pre><code>$ ./fix-metadata-values.py -i countries-fix-18.csv -f dc.coverage.country -t 'correct' -m 228 -d dspace -u dspace -p fuuu
+$ ./delete-metadata-values.py -i countries-delete-2.csv -f dc.coverage.country -m 228 -d dspace -u dspace -p fuuu
+</code></pre>
+
+<ul>
+<li>Run a shit ton of author fixes from Peter Ballantyne that we’ve been cleaning up for two months:</li>
+</ul>
+
+<pre><code>$ ./fix-metadata-values.py -i /tmp/authors-fix-pb2.csv -f dc.contributor.author -t correct -m 3 -u dspace -d dspace -p fuuu
+</code></pre>
 </description>
     </item>
     

public/post/index.xml

@@ -275,6 +275,44 @@ UPDATE 0
 <ul>
 <li>Run the same replacements on CGSpace</li>
 </ul>
+
+<h2 id="2016-10-30">2016-10-30</h2>
+
+<ul>
+<li>Fix some messed up authors on CGSpace:</li>
+</ul>
+
+<pre><code>dspace=# update metadatavalue set authority='799da1d8-22f3-43f5-8233-3d2ef5ebf8a8', confidence=600 where metadata_field_id=3 and resource_type_id=2 and text_value like 'Charleston, B.%';
+UPDATE 10
+dspace=# update metadatavalue set authority='e936f5c5-343d-4c46-aa91-7a1fff6277ed', confidence=600 where metadata_field_id=3 and resource_type_id=2 and text_value like 'Knight-Jones%';
+UPDATE 36
+</code></pre>
+
+<ul>
+<li>I updated the authority index but nothing seemed to change, so I’ll wait and do it again after I update Discovery below</li>
+<li>Skype chat with Tsega about the <a href="https://github.com/ilri/ckm-cgspace-contentdm-bridge">IFPRI contentdm bridge</a></li>
+<li>We tested harvesting OAI in an example collection to see how it works</li>
+<li>Talk to Carlos Quiros about CG Core metadata in CGSpace</li>
+<li>Get a list of countries from CGSpace so I can do some batch corrections:</li>
+</ul>
+
+<pre><code>dspace=# \copy (select distinct text_value, count(*) from metadatavalue where metadata_field_id=228 group by text_value order by count desc) to /tmp/countries.csv with csv;
+</code></pre>
+
+<ul>
+<li>Fix a bunch of countries in Open Refine and run the corrections on CGSpace:</li>
+</ul>
+
+<pre><code>$ ./fix-metadata-values.py -i countries-fix-18.csv -f dc.coverage.country -t 'correct' -m 228 -d dspace -u dspace -p fuuu
+$ ./delete-metadata-values.py -i countries-delete-2.csv -f dc.coverage.country -m 228 -d dspace -u dspace -p fuuu
+</code></pre>
+
+<ul>
+<li>Run a shit ton of author fixes from Peter Ballantyne that we’ve been cleaning up for two months:</li>
+</ul>
+
+<pre><code>$ ./fix-metadata-values.py -i /tmp/authors-fix-pb2.csv -f dc.contributor.author -t correct -m 3 -u dspace -d dspace -p fuuu
+</code></pre>
 </description>
     </item>
     

public/tags/notes/index.xml

@@ -274,6 +274,44 @@ UPDATE 0
 <ul>
 <li>Run the same replacements on CGSpace</li>
 </ul>
+
+<h2 id="2016-10-30">2016-10-30</h2>
+
+<ul>
+<li>Fix some messed up authors on CGSpace:</li>
+</ul>
+
+<pre><code>dspace=# update metadatavalue set authority='799da1d8-22f3-43f5-8233-3d2ef5ebf8a8', confidence=600 where metadata_field_id=3 and resource_type_id=2 and text_value like 'Charleston, B.%';
+UPDATE 10
+dspace=# update metadatavalue set authority='e936f5c5-343d-4c46-aa91-7a1fff6277ed', confidence=600 where metadata_field_id=3 and resource_type_id=2 and text_value like 'Knight-Jones%';
+UPDATE 36
+</code></pre>
+
+<ul>
+<li>I updated the authority index but nothing seemed to change, so I’ll wait and do it again after I update Discovery below</li>
+<li>Skype chat with Tsega about the <a href="https://github.com/ilri/ckm-cgspace-contentdm-bridge">IFPRI contentdm bridge</a></li>
+<li>We tested harvesting OAI in an example collection to see how it works</li>
+<li>Talk to Carlos Quiros about CG Core metadata in CGSpace</li>
+<li>Get a list of countries from CGSpace so I can do some batch corrections:</li>
+</ul>
+
+<pre><code>dspace=# \copy (select distinct text_value, count(*) from metadatavalue where metadata_field_id=228 group by text_value order by count desc) to /tmp/countries.csv with csv;
+</code></pre>
+
+<ul>
+<li>Fix a bunch of countries in Open Refine and run the corrections on CGSpace:</li>
+</ul>
+
+<pre><code>$ ./fix-metadata-values.py -i countries-fix-18.csv -f dc.coverage.country -t 'correct' -m 228 -d dspace -u dspace -p fuuu
+$ ./delete-metadata-values.py -i countries-delete-2.csv -f dc.coverage.country -m 228 -d dspace -u dspace -p fuuu
+</code></pre>
+
+<ul>
+<li>Run a shit ton of author fixes from Peter Ballantyne that we’ve been cleaning up for two months:</li>
+</ul>
+
+<pre><code>$ ./fix-metadata-values.py -i /tmp/authors-fix-pb2.csv -f dc.contributor.author -t correct -m 3 -u dspace -d dspace -p fuuu
+</code></pre>
 </description>
     </item>