CHANGELOG.md: Move unreleased changes to version 0.3.0

I think it's more obvious if the "all items" route is plural. Also,
this will allow me to eventually put documentation at the root.

.travis.yml

@@ -0,0 +1,8 @@
+language: python
+python:
+  - "3.5"
+  - "3.6"
+install:
+  - pip install -r requirements.txt
+
+# vim: ts=2 sw=2 et

CHANGELOG.md

@@ -4,6 +4,20 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [0.3.0] - 2018-09-25
+### Added
+- requirements.txt for pip
+- Travis CI build configuration for Python 3.6 and 3.7
+- Documentation on using the API
+
+### Changed
+- The "all items" route from / to /items
+
+## [0.2.1] - 2018-09-24
+### Changed
+- Environment settings in example systemd unit files
+- Use psycopg2.extras.DictCursor for PostgreSQL connection
+
 ## [0.2.0] - 2018-09-24
 ### Changed
 - Use PostgreSQL instead of SQLite because UPSERT support needs a very new libsqlite3 whereas it's already in PostgreSQL 9.5+

README.md

@@ -1,22 +1,31 @@
 # DSpace Statistics API
 A quick and dirty REST API to expose Solr view and download statistics for items in a DSpace repository.
 
-Written and tested in Python 3.6. SolrClient (0.2.1) does not currently run in Python 3.7.0. Requires PostgreSQL version 9.5 or greater for [`UPSERT` support](https://wiki.postgresql.org/wiki/UPSERT).
+Written and tested in Python 3.5 and 3.6. SolrClient (0.2.1) does [not currently run in Python 3.7.0](https://github.com/moonlitesolutions/SolrClient/issues/79). Requires PostgreSQL version 9.5 or greater for [`UPSERT` support](https://wiki.postgresql.org/wiki/UPSERT).
 
 ## Installation
 Create a virtual environment and run it:
 
     $ virtualenv -p /usr/bin/python3.6 venv
     $ . venv/bin/activate
-    $ pip install falcon gunicorn SolrClient psycopg2-binary
+    $ pip install -r requirements.txt
     $ gunicorn app:api
 
+## Using the API
+The API exposes the following endpoints:
+
+  - GET `/items` — return views and downloads for all items that Solr knows about¹. Accepts `limit` and `page` query parameters for pagination of results.
+  - GET `/item/id` — return views and downloads for a single item (*id* must be a positive integer).
+
+¹ We are querying the Solr statistics core, which technically only knows about all items that have either views or downloads.
+
 ## Todo
 
 - Add API documentation
 - Close up DB connection when gunicorn shuts down gracefully
 - Better logging
 - Return HTTP 404 when item_id is nonexistent
+- Tests
 
 ## License
 This work is licensed under the [GPLv3](https://www.gnu.org/licenses/gpl-3.0.en.html).

app.py

@@ -1,7 +1,3 @@
-# Tested with Python 3.6
-# See DSpace Solr docs for tips about parameters
-# https://wiki.duraspace.org/display/DSPACE/Solr
-
 from database import database_connection
 import falcon
 from solr import solr_connection
@@ -25,7 +21,7 @@ class AllItemsResource:
         pages = round(cursor.fetchone()[0] / limit)
 
         # get statistics, ordered by id, and use limit and offset to page through results
-        cursor.execute('SELECT id, views, downloads FROM items ORDER BY id ASC LIMIT {0} OFFSET {1}'.format(limit, offset))
+        cursor.execute('SELECT id, views, downloads FROM items ORDER BY id ASC LIMIT {} OFFSET {}'.format(limit, offset))
         results = cursor.fetchmany(limit)
         cursor.close()
 
@@ -50,7 +46,7 @@ class ItemResource:
         """Handles GET requests"""
 
         cursor = db.cursor()
-        cursor.execute('SELECT views, downloads FROM items WHERE id={0}'.format(item_id))
+        cursor.execute('SELECT views, downloads FROM items WHERE id={}'.format(item_id))
         results = cursor.fetchone()
         cursor.close()
 
@@ -63,7 +59,7 @@ class ItemResource:
         resp.media = statistics
 
 api = falcon.API()
-api.add_route('/', AllItemsResource())
+api.add_route('/items', AllItemsResource())
 api.add_route('/item/{item_id:int}', ItemResource())
 
 # vim: set sw=4 ts=4 expandtab:

contrib/dspace-statistics-api.service

@@ -3,7 +3,10 @@ Description=DSpace Statistics API
 After=network.target
 
 [Service]
-Environment=SOLR_SERVER=http://localhost:8081/solr
+Environment=DATABASE_NAME=dspacestatistics
+Environment=DATABASE_USER=dspacestatistics
+Environment=DATABASE_PASS=dspacestatistics
+Environment=DATABASE_HOST=localhost
 User=nobody
 Group=nogroup
 WorkingDirectory=/opt/ilri/dspace-statistics-api

contrib/dspace-statistics-indexer.service

@@ -4,6 +4,10 @@ After=tomcat7.target
 
 [Service]
 Environment=SOLR_SERVER=http://localhost:8081/solr
+Environment=DATABASE_NAME=dspacestatistics
+Environment=DATABASE_USER=dspacestatistics
+Environment=DATABASE_PASS=dspacestatistics
+Environment=DATABASE_HOST=localhost
 User=nobody
 Group=nogroup
 WorkingDirectory=/opt/ilri/dspace-statistics-api

database.py

@@ -3,9 +3,10 @@ from config import DATABASE_USER
 from config import DATABASE_PASS
 from config import DATABASE_HOST
 import psycopg2
+import psycopg2.extras
 
 def database_connection():
-    connection = psycopg2.connect("dbname={} user={} password={} host='{}'".format(DATABASE_NAME, DATABASE_USER, DATABASE_PASS, DATABASE_HOST))
+    connection = psycopg2.connect("dbname={} user={} password={} host='{}'".format(DATABASE_NAME, DATABASE_USER, DATABASE_PASS, DATABASE_HOST), cursor_factory=psycopg2.extras.DictCursor)
 
     return connection
 

indexer.py

@@ -55,7 +55,7 @@ def index_views():
     cursor = db.cursor()
 
     while results_current_page <= results_num_pages:
-        print('Page {0} of {1}.'.format(results_current_page, results_num_pages))
+        print('Page {} of {}.'.format(results_current_page, results_num_pages))
 
         res = solr.query('statistics', {
             'q':'type:2',
@@ -102,7 +102,7 @@ def index_downloads():
     cursor = db.cursor()
 
     while results_current_page <= results_num_pages:
-        print('Page {0} of {1}.'.format(results_current_page, results_num_pages))
+        print('Page {} of {}.'.format(results_current_page, results_num_pages))
 
         res = solr.query('statistics', {
             'q':'type:0',

requirements.txt

@@ -0,0 +1,12 @@
+certifi==2018.8.24
+chardet==3.0.4
+falcon==1.4.1
+gunicorn==19.9.0
+idna==2.7
+kazoo==2.2.1
+psycopg2-binary==2.7.5
+python-mimeparse==1.6.0
+requests==2.19.1
+six==1.11.0
+SolrClient==0.2.1
+urllib3==1.23