Microsoft Office 2016 with Excel and Native JSON Processing
Microsoft Office and Excel is the de-facto reporting environment for many of us. One great advantage of Excel is its native JSON support and built-in programmable transformation engine. Excel can simply directly talk to Couchbase Server and report on the data. No ODBC or JDBC driver required! Lets see how you do that!
Reporting in Excel with Couchbase Server in 3 Steps
Lets walk through the 3 steps to get your Couchbase Server (version 4 or later) data visualized in Excel. I’ll be using Microsoft Office 2016 – Excel 2016 on Windows for the excercise.
Note to Mac/OSx Users: Unfortunately Office on Mac does not come with the capability to import JSON data.
#1 Get Some Sample Data:
I am using the travel-sample bucket that comes with Couchbase Server 4. Install this dataset using the “settings” tab in admin console or during installation. You will be able to follow along with the examples.
#2 Query through the N1QL REST API:
I will use a fairly simple query for the sample: This query returns full list of all airlines with their total flights to each destination airport.
SELECT a.name, r.destinationairport, count(a.name) as total_flights
FROM `travel-sample` r JOIN `travel-sample` a ON KEYS r.airlineid
WHERE r.type ="route" AND a.type="airline"
GROUP BY r.destinationairport, a.name
ORDER BY r.destinationairport
To connect Excel with N1QL. We will use the N1QL REST API to execute the query. Some may not know this but N1QL comes with a REST API that takes in an ad-hoc statement. N1QL REST API is documented here and you can use the JSON aware tool of your choice to directly hit this API. My tool of choice is Postman (available on the chrome marketplace as well). N1QL REST API combined with postman gives me the full visability to what’s travelling over the wire.
In the following figure, I am hitting a local cluster node on port 8093 with the above query with postman.
We will pass the encoded URL to Excel next and it looks like this:
#3 Submit & Transform Data in Excel:
Next, you need to fire up the desktop version of Excel 2016. To pass the REST call for N1QL to Excel, you need to go to the data tab, choose “New Query > From Other Sources > From Web” to get to import Couchbase Server JSON data into Excel.
- Enter in the URL above and wait for the data to show up and click OK.
- Now we will go through a set of transformations to prepare our data for visualization.
- Once the results are streamed into Excel, you will see the JSON attributes that come back from N1QL. Drill into “results” by clicking the “List” link in the screen.
- We will use the table transform to shape our JSON. Click on “To Table” menu at the top.
- Do not specify a delimiter and click OK.
- Next, you will click the little “split” icon at the top of column in the single column grid to split the attributes in JSON into seperate columns in the table.
- Once you click ok, this is what the completed data transformation should look like… Simply click “Close & Apply” at the top left corner
- You should now have your Couchbase Server data imported into Excel into a table. Now your Excel adventure begins…
Before I close, I want to mention that you can still use an ODBC/JDBC based experience with Couchbase Server v4. Here is the link to download free ODBC and JDBC Drivers for Couchbase Server.
However… What I am seeing in todays world is, majority of the new data that is generated and stored is in JSON. So existing and new reporting and data visualization platforms like Excel, PowerBI and others are adding powerful support around JSON. I expect this experience to get simpler over time.
cihan biyikoglu – director product management