cgspace-notes/content/post/2017-11.md

---
title: "November, 2017"
date: 2017-11-02T09:37:54+02:00
author: "Alan Orth"
tags: ["Notes"]
---

## 2017-11-01

- The CORE developers responded to say they are looking into their bot not respecting our robots.txt

## 2017-11-02

- Today there have been no hits by CORE and no alerts from Linode (coincidence?)

```
# grep -c "CORE" /var/log/nginx/access.log
0
```

- Generate list of authors on CGSpace for Peter to go through and correct:

```
dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;
COPY 54701
```

<!--more-->

- Abenet asked if it would be possible to generate a report of items in Listing and Reports that had "International Fund for Agricultural Development" as the *only* investor
- I opened a ticket with Atmire to ask if this was possible: https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=540
- Work on making the thumbnails in the item view clickable
- Basically, once you read the METS XML for an item it becomes easy to trace the structure to find the bitstream link

```
//mets:fileSec/mets:fileGrp[@USE='CONTENT']/mets:file/mets:FLocat[@LOCTYPE='URL']/@xlink:href
```

- METS XML is available for all items with this pattern: /metadata/handle/10568/95947/mets.xml
- I whipped up a quick hack to print a clickable link with this URL on the thumbnail but it needs to check a few corner cases, like when there is a thumbnail but no content bitstream!
- Help proof fifty-three CIAT records for Sisay: https://dspacetest.cgiar.org/handle/10568/95895
- A handful of issues with `cg.place` using format like "Lima, PE" instead of "Lima, Peru"
- Also, some dates like with completely invalid format like "2010- 06" and "2011-3-28"
- I also collapsed some consecutive whitespace on a handful of fields

## 2017-11-03

- Atmire got back to us to say that they estimate it will take two days of labor to implement the change to Listings and Reports
- I said I'd ask Abenet if she wants that feature
Add notes for 2017-11-02 2017-11-02 08:37:59 +01:00			`---`
			`title: "November, 2017"`
			`date: 2017-11-02T09:37:54+02:00`
			`author: "Alan Orth"`
			`tags: ["Notes"]`
			`---`

			`## 2017-11-01`

			`- The CORE developers responded to say they are looking into their bot not respecting our robots.txt`

			`## 2017-11-02`

			`- Today there have been no hits by CORE and no alerts from Linode (coincidence?)`

			```
			`# grep -c "CORE" /var/log/nginx/access.log`
			`0`
			```

Add notes for 2017-11-02 2017-11-02 09:07:34 +01:00			`- Generate list of authors on CGSpace for Peter to go through and correct:`

			```
			`dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element = 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv;`
			`COPY 54701`
			```

Add notes for 2017-11-02 2017-11-02 08:37:59 +01:00			`<!--more-->`

Update notes for 2017-11-02 2017-11-02 16:05:37 +01:00			`- Abenet asked if it would be possible to generate a report of items in Listing and Reports that had "International Fund for Agricultural Development" as the only investor`
			`- I opened a ticket with Atmire to ask if this was possible: https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=540`
			`- Work on making the thumbnails in the item view clickable`
			`- Basically, once you read the METS XML for an item it becomes easy to trace the structure to find the bitstream link`

			```
			`//mets:fileSec/mets:fileGrp[@USE='CONTENT']/mets:file/mets:FLocat[@LOCTYPE='URL']/@xlink:href`
			```

			`- METS XML is available for all items with this pattern: /metadata/handle/10568/95947/mets.xml`
			`- I whipped up a quick hack to print a clickable link with this URL on the thumbnail but it needs to check a few corner cases, like when there is a thumbnail but no content bitstream!`
Update notes for 2017-11-02 2017-11-02 16:30:54 +01:00			`- Help proof fifty-three CIAT records for Sisay: https://dspacetest.cgiar.org/handle/10568/95895`
			- A handful of issues with `cg.place` using format like "Lima, PE" instead of "Lima, Peru"
			`- Also, some dates like with completely invalid format like "2010- 06" and "2011-3-28"`
			`- I also collapsed some consecutive whitespace on a handful of fields`
Add notes for 2017-11-03 2017-11-03 17:15:40 +01:00
			`## 2017-11-03`

			`- Atmire got back to us to say that they estimate it will take two days of labor to implement the change to Listings and Reports`
			`- I said I'd ask Abenet if she wants that feature`