diff --git a/content/posts/2019-07.md b/content/posts/2019-07.md
index 66951b7a0..f1b0ea002 100644
--- a/content/posts/2019-07.md
+++ b/content/posts/2019-07.md
@@ -302,7 +302,7 @@ $ dspace user --add --givenname Lionelle --surname Samnick --email blah@blah.com
```
- I added her as a submitter to [CTA ISF Pro-Agro series](https://cgspace.cgiar.org/handle/10568/74536)
-- Start looking at 1492 records for the Bioversity batch import
+- Start looking at 1429 records for the Bioversity batch import
- Multiple authors should be specified with multi-value separatator (||) instead of ;
- We don't use "(eds)" as an author
- Same issue with dc.publisher using ";" for multiple values
@@ -334,4 +334,42 @@ $ dspace user --add --givenname Lionelle --surname Samnick --email blah@blah.com
- I left a note saying that DSpace is technically limited to a flat schema so we use `cg.coverage.country: Kenya`
- Do a little more work on CG Core v2 in the input forms
+## 2019-07-25
+
+- Generate a list of the ORCID identifiers that we added to CGSpace in 2019 for Sara Jani at ICARDA
+- Bioversity sent a new file for their migration to CGSpace
+ - There is always a blank row and blank column at the end
+ - One invalid type (Brie)
+ - 824 items with leading/trailing spaces in dc.identifier.citation
+ - 175 items with a trailing comma in dc.identifier.citation (using custom text facet with GREL `value.endsWith(',').toString()`)
+ - Fix them with GREL transform: `value.replace(/,$/, '')`
+ - A few strange publishers after splitting multi-value cells, like "(Belgium)"
+ - Deleted four ISSNs that are actually ISBNs and are already present in the ISBN field
+ - Eight invalid ISBNs
+ - Convert all DOIs to "https://doi.org" format and fix one invalid DOI
+ - Fix a handful of incorrect CRPs that seem to have been split on comma ","
+ - Lots of strange values in cg.link.reference, and I normalized all DOIs to https://doi.org format
+ - There are lots of invalid links here, like "36" and "recordlink:publications:2606" and "t3://record?identifier=publications&uid=2606"
+ - Also there are hundreds of items that use the same value for cg.link.reference AND cg.link.dataurl
+ - Use https:// for all Bioversity links (reference, data url, permalink)
+
+- I might be able to use [isbnlib](https://pypi.org/project/isbnlib/) to validate ISBNs in Python:
+
+```
+if isbnlib.is_isbn10('9966-955-07-0') or isbnlib.is_isbn13('9966-955-07-0'):
+ print("Yes")
+else:
+ print("No")
+```
+
+- Or with [python-stdnum](https://github.com/arthurdejong/python-stdnum):
+
+```
+from stdnum import isbn
+from stdnum import issn
+
+isbn.validate('978-92-9043-389-7')
+issn.validate('1020-3362')
+```
+
diff --git a/docs/2019-07/index.html b/docs/2019-07/index.html
index 9f08e8101..5e2ac849e 100644
--- a/docs/2019-07/index.html
+++ b/docs/2019-07/index.html
@@ -21,7 +21,7 @@ Abenet had another similar issue a few days ago when trying to find the stats fo
-
+
@@ -47,9 +47,9 @@ Abenet had another similar issue a few days ago when trying to find the stats fo
"@type": "BlogPosting",
"headline": "July, 2019",
"url": "https:\/\/alanorth.github.io\/cgspace-notes\/2019-07\/",
- "wordCount": "1906",
+ "wordCount": "2119",
"datePublished": "2019-07-01T12:13:51\x2b03:00",
- "dateModified": "2019-07-20T18:24:48\x2b03:00",
+ "dateModified": "2019-07-22T15:54:32\x2b03:00",
"author": {
"@type": "Person",
"name": "Alan Orth"
@@ -478,7 +478,7 @@ Please see the DSpace documentation for assistance.
I added her as a submitter to CTA ISF Pro-Agro series
-Start looking at 1492 records for the Bioversity batch import
+Start looking at 1429 records for the Bioversity batch import
+2019-07-25
+
+
+- Generate a list of the ORCID identifiers that we added to CGSpace in 2019 for Sara Jani at ICARDA
+
+Bioversity sent a new file for their migration to CGSpace
+
+
+- There is always a blank row and blank column at the end
+- One invalid type (Brie)
+- 824 items with leading/trailing spaces in dc.identifier.citation
+- 175 items with a trailing comma in dc.identifier.citation (using custom text facet with GREL
value.endsWith(',').toString())
+- Fix them with GREL transform:
value.replace(/,$/, '')
+- A few strange publishers after splitting multi-value cells, like “(Belgium)”
+- Deleted four ISSNs that are actually ISBNs and are already present in the ISBN field
+- Eight invalid ISBNs
+- Convert all DOIs to “https://doi.org" format and fix one invalid DOI
+- Fix a handful of incorrect CRPs that seem to have been split on comma “,”
+- Lots of strange values in cg.link.reference, and I normalized all DOIs to https://doi.org format
+- There are lots of invalid links here, like “36” and “recordlink:publications:2606” and “t3://record?identifier=publications&uid=2606”
+- Also there are hundreds of items that use the same value for cg.link.reference AND cg.link.dataurl
+- Use https:// for all Bioversity links (reference, data url, permalink)
+
I might be able to use isbnlib to validate ISBNs in Python:
+
+if isbnlib.is_isbn10('9966-955-07-0') or isbnlib.is_isbn13('9966-955-07-0'):
+print("Yes")
+else:
+print("No")
+
Or with python-stdnum:
+
+from stdnum import isbn
+from stdnum import issn
+
+isbn.validate('978-92-9043-389-7')
+issn.validate('1020-3362')
+
+
diff --git a/docs/sitemap.xml b/docs/sitemap.xml
index bec8bae30..4d7cb1def 100644
--- a/docs/sitemap.xml
+++ b/docs/sitemap.xml
@@ -4,30 +4,30 @@
https://alanorth.github.io/cgspace-notes/
- 2019-07-20T18:24:48+03:00
+ 2019-07-22T15:54:32+03:00
0
https://alanorth.github.io/cgspace-notes/2019-07/
- 2019-07-20T18:24:48+03:00
+ 2019-07-22T15:54:32+03:00
https://alanorth.github.io/cgspace-notes/tags/notes/
- 2019-07-20T18:24:48+03:00
+ 2019-07-22T15:54:32+03:00
0
https://alanorth.github.io/cgspace-notes/posts/
- 2019-07-20T18:24:48+03:00
+ 2019-07-22T15:54:32+03:00
0
https://alanorth.github.io/cgspace-notes/tags/
- 2019-07-20T18:24:48+03:00
+ 2019-07-22T15:54:32+03:00
0