Add notes for 2016-05-18

This commit is contained in:
Alan Orth 2016-05-18 17:51:15 +03:00
parent fcdc3fdc0e
commit cbb7d63ef5
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
4 changed files with 65 additions and 0 deletions

View File

@ -129,3 +129,17 @@ fi
- dc.place → cg.place
- `dc.place` is our own field, so it's easy to move
- I've removed `dc.title.jtitle` from the list for now because there's no use moving it out of DC until we know where it will go (see discussion yesterday)
## 2016-05-18
- Work on 707 CCAFS records
- They have thumbnails on Flickr and elsewhere
- In OpenRefine I created a new `filename` column based on the `thumbnail` column with the following GREL:
```
if(cells['thumbnails'].value.contains('hqdefault'), cells['thumbnails'].value.split('/')[-2] + '.jpg', cells['thumbnails'].value.split('/')[-1])
```
- Because ~400 records had the same filename on Flickr (hqdefault.jpg) but different UUIDs in the URL
- So for the `hqdefault.jpg` ones I just take the UUID (-2) and use it as the filename
- Before importing with SAFBuilder I tested adding "__bundle:THUMBNAIL" to the `filename` column and it works fine

View File

@ -235,6 +235,23 @@ fi
</ul></li>
<li><code>dc.place</code> is our own field, so it&rsquo;s easy to move</li>
<li>I&rsquo;ve removed <code>dc.title.jtitle</code> from the list for now because there&rsquo;s no use moving it out of DC until we know where it will go (see discussion yesterday)</li>
</ul>
<h2 id="2016-05-18:b7bf1a0f8f2415a40e1e11e343b04c0d">2016-05-18</h2>
<ul>
<li>Work on 707 CCAFS records</li>
<li>They have thumbnails on Flickr and elsewhere</li>
<li>In OpenRefine I created a new <code>filename</code> column based on the <code>thumbnail</code> column with the following GREL:</li>
</ul>
<pre><code>if(cells['thumbnails'].value.contains('hqdefault'), cells['thumbnails'].value.split('/')[-2] + '.jpg', cells['thumbnails'].value.split('/')[-1])
</code></pre>
<ul>
<li>Because ~400 records had the same filename on Flickr (hqdefault.jpg) but different UUIDs in the URL</li>
<li>So for the <code>hqdefault.jpg</code> ones I just take the UUID (-2) and use it as the filename</li>
<li>Before importing with SAFBuilder I tested adding &ldquo;__bundle:THUMBNAIL&rdquo; to the <code>filename</code> column and it works fine</li>
</ul>
</section>

View File

@ -174,6 +174,23 @@ fi
&lt;li&gt;&lt;code&gt;dc.place&lt;/code&gt; is our own field, so it&amp;rsquo;s easy to move&lt;/li&gt;
&lt;li&gt;I&amp;rsquo;ve removed &lt;code&gt;dc.title.jtitle&lt;/code&gt; from the list for now because there&amp;rsquo;s no use moving it out of DC until we know where it will go (see discussion yesterday)&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id=&#34;2016-05-18:b7bf1a0f8f2415a40e1e11e343b04c0d&#34;&gt;2016-05-18&lt;/h2&gt;
&lt;ul&gt;
&lt;li&gt;Work on 707 CCAFS records&lt;/li&gt;
&lt;li&gt;They have thumbnails on Flickr and elsewhere&lt;/li&gt;
&lt;li&gt;In OpenRefine I created a new &lt;code&gt;filename&lt;/code&gt; column based on the &lt;code&gt;thumbnail&lt;/code&gt; column with the following GREL:&lt;/li&gt;
&lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;if(cells[&#39;thumbnails&#39;].value.contains(&#39;hqdefault&#39;), cells[&#39;thumbnails&#39;].value.split(&#39;/&#39;)[-2] + &#39;.jpg&#39;, cells[&#39;thumbnails&#39;].value.split(&#39;/&#39;)[-1])
&lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt;
&lt;li&gt;Because ~400 records had the same filename on Flickr (hqdefault.jpg) but different UUIDs in the URL&lt;/li&gt;
&lt;li&gt;So for the &lt;code&gt;hqdefault.jpg&lt;/code&gt; ones I just take the UUID (-2) and use it as the filename&lt;/li&gt;
&lt;li&gt;Before importing with SAFBuilder I tested adding &amp;ldquo;__bundle:THUMBNAIL&amp;rdquo; to the &lt;code&gt;filename&lt;/code&gt; column and it works fine&lt;/li&gt;
&lt;/ul&gt;
</description>
</item>

View File

@ -174,6 +174,23 @@ fi
&lt;li&gt;&lt;code&gt;dc.place&lt;/code&gt; is our own field, so it&amp;rsquo;s easy to move&lt;/li&gt;
&lt;li&gt;I&amp;rsquo;ve removed &lt;code&gt;dc.title.jtitle&lt;/code&gt; from the list for now because there&amp;rsquo;s no use moving it out of DC until we know where it will go (see discussion yesterday)&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id=&#34;2016-05-18:b7bf1a0f8f2415a40e1e11e343b04c0d&#34;&gt;2016-05-18&lt;/h2&gt;
&lt;ul&gt;
&lt;li&gt;Work on 707 CCAFS records&lt;/li&gt;
&lt;li&gt;They have thumbnails on Flickr and elsewhere&lt;/li&gt;
&lt;li&gt;In OpenRefine I created a new &lt;code&gt;filename&lt;/code&gt; column based on the &lt;code&gt;thumbnail&lt;/code&gt; column with the following GREL:&lt;/li&gt;
&lt;/ul&gt;
&lt;pre&gt;&lt;code&gt;if(cells[&#39;thumbnails&#39;].value.contains(&#39;hqdefault&#39;), cells[&#39;thumbnails&#39;].value.split(&#39;/&#39;)[-2] + &#39;.jpg&#39;, cells[&#39;thumbnails&#39;].value.split(&#39;/&#39;)[-1])
&lt;/code&gt;&lt;/pre&gt;
&lt;ul&gt;
&lt;li&gt;Because ~400 records had the same filename on Flickr (hqdefault.jpg) but different UUIDs in the URL&lt;/li&gt;
&lt;li&gt;So for the &lt;code&gt;hqdefault.jpg&lt;/code&gt; ones I just take the UUID (-2) and use it as the filename&lt;/li&gt;
&lt;li&gt;Before importing with SAFBuilder I tested adding &amp;ldquo;__bundle:THUMBNAIL&amp;rdquo; to the &lt;code&gt;filename&lt;/code&gt; column and it works fine&lt;/li&gt;
&lt;/ul&gt;
</description>
</item>