Add notes for 2018-03-21

content/posts/2018-03.md

@@ -348,3 +348,25 @@ java.lang.IllegalArgumentException: No choices plugin was configured for  field
 ```
 
 - I have to figure that one out...
+
+## 2018-03-21
+
+- Looks like the indexing gets confused that there is still data in the `authority` column
+- Unfortunately this causes those items to simply not be indexed, which users noticed because item counts were cut in half and old items showed up in RSS!
+- Since we've migrated the ORCID identifiers associated with the authority data to the `cg.creator.id` field we can nullify the authorities remaining in the database:
+
+```sql
+dspace=# UPDATE metadatavalue SET authority=NULL WHERE resource_type_id=2 AND metadata_field_id=3 AND authority IS NOT NULL;
+UPDATE 195463
+```
+
+- After this the indexing works as usual and item counts and facets are back to normal
+- Send Peter a list of all authors to correct:
+
+```sql
+dspace=# \copy (select distinct text_value, count(*) as count from metadatavalue where metadata_field_id = (select metadata_field_id from metadatafieldregistry where element
+= 'contributor' and qualifier = 'author') AND resource_type_id = 2 group by text_value order by count desc) to /tmp/authors.csv with csv header;
+COPY 56156
+```
+
+- Afterwards we'll want to do some batch tagging of ORCID identifiers to these names