2021-06-03 20:54:49 +02:00
<!DOCTYPE html>
< html lang = "en" >
< head >
< meta charset = "utf-8" >
< meta name = "viewport" content = "width=device-width, initial-scale=1, shrink-to-fit=no" >
< meta property = "og:title" content = "June, 2021" / >
< meta property = "og:description" content = "2021-06-01
IWMI notified me that AReS was down with an HTTP 502 error
Looking at UptimeRobot I see it has been down for 33 hours, but I never got a notification
I don’ t see anything in the Elasticsearch container logs, or the systemd journal on the host, but I notice that the angular_nginx container isn’ t running
I simply started it and AReS was running again:
" />
< meta property = "og:type" content = "article" / >
< meta property = "og:url" content = "https://alanorth.github.io/cgspace-notes/2021-06/" / >
< meta property = "article:published_time" content = "2021-06-01T10:51:07+03:00" / >
2021-06-14 14:09:07 +02:00
< meta property = "article:modified_time" content = "2021-06-10T21:41:44+03:00" / >
2021-06-03 20:54:49 +02:00
< meta name = "twitter:card" content = "summary" / >
< meta name = "twitter:title" content = "June, 2021" / >
< meta name = "twitter:description" content = "2021-06-01
IWMI notified me that AReS was down with an HTTP 502 error
Looking at UptimeRobot I see it has been down for 33 hours, but I never got a notification
I don’ t see anything in the Elasticsearch container logs, or the systemd journal on the host, but I notice that the angular_nginx container isn’ t running
I simply started it and AReS was running again:
"/>
< meta name = "generator" content = "Hugo 0.83.1" / >
< script type = "application/ld+json" >
{
"@context": "http://schema.org",
"@type": "BlogPosting",
"headline": "June, 2021",
"url": "https://alanorth.github.io/cgspace-notes/2021-06/",
2021-06-14 14:09:07 +02:00
"wordCount": "415",
2021-06-03 20:54:49 +02:00
"datePublished": "2021-06-01T10:51:07+03:00",
2021-06-14 14:09:07 +02:00
"dateModified": "2021-06-10T21:41:44+03:00",
2021-06-03 20:54:49 +02:00
"author": {
"@type": "Person",
"name": "Alan Orth"
},
"keywords": "Notes"
}
< / script >
< link rel = "canonical" href = "https://alanorth.github.io/cgspace-notes/2021-06/" >
< title > June, 2021 | CGSpace Notes< / title >
<!-- combined, minified CSS -->
< link href = "https://alanorth.github.io/cgspace-notes/css/style.beb8012edc08ba10be012f079d618dc243812267efe62e11f22fe49618f976a4.css" rel = "stylesheet" integrity = "sha256-vrgBLtwIuhC+AS8HnWGNwkOBImfv5i4R8i/klhj5dqQ=" crossorigin = "anonymous" >
<!-- minified Font Awesome for SVG icons -->
< script defer src = "https://alanorth.github.io/cgspace-notes/js/fontawesome.min.ffbfea088a9a1666ec65c3a8cb4906e2a0e4f92dc70dbbf400a125ad2422123a.js" integrity = "sha256-/7/qCIqaFmbsZcOoy0kG4qDk+S3HDbv0AKElrSQiEjo=" crossorigin = "anonymous" > < / script >
<!-- RSS 2.0 feed -->
< / head >
< body >
< div class = "blog-masthead" >
< div class = "container" >
< nav class = "nav blog-nav" >
< a class = "nav-link " href = "https://alanorth.github.io/cgspace-notes/" > Home< / a >
< / nav >
< / div >
< / div >
< header class = "blog-header" >
< div class = "container" >
< h1 class = "blog-title" dir = "auto" > < a href = "https://alanorth.github.io/cgspace-notes/" rel = "home" > CGSpace Notes< / a > < / h1 >
< p class = "lead blog-description" dir = "auto" > Documenting day-to-day work on the < a href = "https://cgspace.cgiar.org" > CGSpace< / a > repository.< / p >
< / div >
< / header >
< div class = "container" >
< div class = "row" >
< div class = "col-sm-8 blog-main" >
< article class = "blog-post" >
< header >
< h2 class = "blog-post-title" dir = "auto" > < a href = "https://alanorth.github.io/cgspace-notes/2021-06/" > June, 2021< / a > < / h2 >
< p class = "blog-post-meta" >
< time datetime = "2021-06-01T10:51:07+03:00" > Tue Jun 01, 2021< / time >
in
< span class = "fas fa-folder" aria-hidden = "true" > < / span > < a href = "/cgspace-notes/categories/notes/" rel = "category tag" > Notes< / a >
< / p >
< / header >
< h2 id = "2021-06-01" > 2021-06-01< / h2 >
< ul >
< li > IWMI notified me that AReS was down with an HTTP 502 error
< ul >
< li > Looking at UptimeRobot I see it has been down for 33 hours, but I never got a notification< / li >
< li > I don’ t see anything in the Elasticsearch container logs, or the systemd journal on the host, but I notice that the < code > angular_nginx< / code > container isn’ t running< / li >
< li > I simply started it and AReS was running again:< / li >
< / ul >
< / li >
< / ul >
< pre > < code class = "language-console" data-lang = "console" > $ docker-compose -f docker/docker-compose.yml start angular_nginx
< / code > < / pre > < ul >
< li > Margarita from CCAFS emailed me to say that workflow alerts haven’ t been working lately
< ul >
< li > I guess this is related to the SMTP issues last week< / li >
< li > I had fixed the config, but didn’ t restart Tomcat so DSpace didn’ t load the new variables< / li >
< li > I ran all system updates on CGSpace (linode18) and DSpace Test (linode26) and rebooted the servers< / li >
< / ul >
< / li >
< / ul >
< h2 id = "2021-06-03" > 2021-06-03< / h2 >
< ul >
< li > Meeting with AMCOW and IWMI to discuss AMCOW getting IWMI’ s content into the new AMCOW Knowledge Hub
< ul >
< li > At first we spent some time talking about DSpace communities/collections and the REST API, but then they said they actually prefer to send queries to sites on the fly and cache them in Redis for some time< / li >
< li > That’ s when I thought they could perhaps use the OpenSearch, but I can’ t remember if it’ s possible to limit by community, or only collection… < / li >
< li > Looking now, I see there is a “ scope” parameter that can be used for community or collection, for example:< / li >
< / ul >
< / li >
< / ul >
< pre > < code > https://cgspace.cgiar.org/open-search/discover?query=subject:water%20scarcity& scope=10568/16814& order=DESC& rpp=100& sort_by=2& start=1
< / code > < / pre > < ul >
< li > That will sort by date issued (see: < code > webui.itemlist.sort-option.2< / code > in dspace.cfg), give 100 results per page, and start on item 1< / li >
< li > Otherwise, another alternative would be to use the IWMI CSV that we are already exporting every week< / li >
< li > Fill out the < em > CGIAR-AGROVOC Task Group: Survey on the current CGIAR use of AGROVOC< / em > survey on behalf of CGSpace< / li >
< / ul >
2021-06-07 07:05:14 +02:00
< h2 id = "2021-06-06" > 2021-06-06< / h2 >
< ul >
< li > The Elasticsearch indexes are messed up so I dumped and re-created them correctly:< / li >
< / ul >
< pre > < code class = "language-console" data-lang = "console" > curl -XDELETE 'http://localhost:9200/openrxv-items-final'
curl -XDELETE 'http://localhost:9200/openrxv-items-temp'
curl -XPUT 'http://localhost:9200/openrxv-items-final'
curl -XPUT 'http://localhost:9200/openrxv-items-temp'
curl -s -X POST 'http://localhost:9200/_aliases' -H 'Content-Type: application/json' -d'{" actions" : [{" add" : { " index" : " openrxv-items-final" , " alias" : " openrxv-items" }}]}'
elasticdump --input=/home/aorth/openrxv-items_mapping.json --output=http://localhost:9200/openrxv-items-final --type=mapping
elasticdump --input=/home/aorth/openrxv-items_data.json --output=http://localhost:9200/openrxv-items-final --type=data --limit=1000
< / code > < / pre > < ul >
< li > Then I started a harvesting on AReS< / li >
< / ul >
< h2 id = "2021-06-07" > 2021-06-07< / h2 >
< ul >
< li > The harvesting on AReS completed successfully< / li >
2021-06-07 20:36:27 +02:00
< li > Provide feedback to FAO on how we use AGROVOC for their “ AGROVOC call for use cases” < / li >
2021-06-07 07:05:14 +02:00
< / ul >
2021-06-10 20:41:44 +02:00
< h2 id = "2021-06-10" > 2021-06-10< / h2 >
< ul >
< li > Skype with Moayad to discuss AReS harvesting improvements
< ul >
< li > He will work on a plugin that reads the XML sitemap to get all item IDs and checks whether we have them or not< / li >
< / ul >
< / li >
< / ul >
2021-06-14 14:09:07 +02:00
< h2 id = "2021-06-14" > 2021-06-14< / h2 >
< ul >
< li > Dump and re-create indexes on AReS (as above) so I can do a harvest< / li >
< / ul >
2021-06-03 20:54:49 +02:00
<!-- raw HTML omitted -->
< / article >
< / div > <!-- /.blog - main -->
< aside class = "col-sm-3 ml-auto blog-sidebar" >
< section class = "sidebar-module" >
< h4 > Recent Posts< / h4 >
< ol class = "list-unstyled" >
< li > < a href = "/cgspace-notes/2021-06/" > June, 2021< / a > < / li >
< li > < a href = "/cgspace-notes/2021-05/" > May, 2021< / a > < / li >
< li > < a href = "/cgspace-notes/2021-04/" > April, 2021< / a > < / li >
< li > < a href = "/cgspace-notes/2021-03/" > March, 2021< / a > < / li >
< li > < a href = "/cgspace-notes/cgspace-cgcorev2-migration/" > CGSpace CG Core v2 Migration< / a > < / li >
< / ol >
< / section >
< section class = "sidebar-module" >
< h4 > Links< / h4 >
< ol class = "list-unstyled" >
< li > < a href = "https://cgspace.cgiar.org" > CGSpace< / a > < / li >
< li > < a href = "https://dspacetest.cgiar.org" > DSpace Test< / a > < / li >
< li > < a href = "https://github.com/ilri/DSpace" > CGSpace @ GitHub< / a > < / li >
< / ol >
< / section >
< / aside >
< / div > <!-- /.row -->
< / div > <!-- /.container -->
< footer class = "blog-footer" >
< p dir = "auto" >
Blog template created by < a href = "https://twitter.com/mdo" > @mdo< / a > , ported to Hugo by < a href = 'https://twitter.com/mralanorth' > @mralanorth< / a > .
< / p >
< p >
< a href = "#" > Back to top< / a >
< / p >
< / footer >
< / body >
< / html >
