Green Button Data is a Ruby gem that can consume Green Button APIs and parse the Green Button data XML schema very quickly. It uses an event-driven SAX parser which parses XML data without building an entire DOM in memory.
On a 2.3 GHz Core i7 processor, this gem is capable of parsing at a rate of ~1.7 MB/s which is fast enough to parse a 1 year 12-hour interval data in just over a second.
You may run the benchmarks by cloning this project and running rake benchmark.
Add the Green Button Data gem to your Gemfile:
gem 'green-button-data'Then run Bundler:
$ bundleUnless you have a project that auto loads all gems in the Gemfile (e.g. a Rails project), you will need to require it:
require 'green-button-data'This will expose the GreenButtonData module namespace.
GreenButtonData gem provides a familiar interface to consuming API endpoints. Method names are similar to Rails' ActiveRecord models and can be easily integrated into existing applications.
You can add configuration options like the following:
GreenButtonData.configure do |config|
config.base_url = "https://api.example.com/DataCustodian/espi/1_1/resource/"
config.application_information_path = "ApplicationInformation/"
config.authorization_path = "Authorization/"
config.subscription_path = "Subscription/"
config.usage_point_path = "UsagePoint/"
endNote that each path must end with a trailing slash.
IMPORTANT: Version 0.3.0 has a bug which causes Rails not to boot correctly. Please use 0.3.1 or higher when integrating into Rails by running
bundle update green-button-data.
If you are developing a Rails app, create a file at
config/initializers/green_button_data.rb from your Rails project root and
add the configuration there.
Green Button Data specification states that all API endpoints be secured with OAuth2 which means most fetch operations will require auth tokens.
Some endpoints are secured further by utilizing client SSL certificates (e.g.
Pacific Gas & Electric). You may pass in ssl options in addition to
the token option in this case.
DISCLAIMER: Green Button Data is NOT responsible for managing OAuth tokens to make authenticated requests. There are other gems that provide mature, production proven OAuth 2 functionalities such as OmniAuth.
With version 0.4.0, there are two ways to query data on a remote endpoint:
- Using a scoped client class
- Calling query methods directly on resource classes
This is the recommended method to query data from multiple Data Custodians.
Each instance of GreenButtonData::Client uses scoped configuration suitable
for each Data Custodians.
This allows you to make requests to different Data Custodians that have different URL path layouts.
The example below creates two clients: one for ESPI Green Button Data reference API and the other for Pacific Gas & Electric:
espi_base_url = "https://services.greenbuttondata.org/DataCustodian/espi/" +
"1_1/resource/"
pge_base_url = "https://api.pge.com/GreenButtonConnect/espi/1_1/resource/"
espi_client = GreenButtonData.connect base_url: "https://foo.com" do |client|
# Override base_url configuration
client.configuration.base_url = espi_base_url
# Equivalent to passing in as an argument hash in connect method:
# GreenButtonData.connect subscription_path: "Subscription/" do |client|
client.configuration.subscription_path = "Subscription/"
client.configuration.usage_point_path = "UsagePoint/"
client.configuration.usage_summary_path = "ElectricPowerUsageSummary/"
# Set OAuth 2.0 bearer token
client.token = "12345678-5672-abcd-567890abcdef"
end
pge_client = GreenButtonData.connect base_url: pge_base_url do |client|
client.configuration.subscription_path = "Subscription/"
client.configuration.usage_point_path = "UsagePoint/"
client.configuration.usage_summary_path = "UsageSummary/"
client.token = "098765432-abcd-ef00-12345678900"
endThe Client class provides query methods to query each resources:
-
GreenButtonData::Client#application_informationReturns a collection of
GreenButtonData::ApplicationInformationinstances if id is not specified. If id is specified, returns a single instance. -
GreenButtonData::Client#authorizationReturns a collection of
GreenButtonData::Authorizationinstances if id is not specified. If id is specified, returns a single instance. -
GreenButtonData::Client#interval_blockReturns a collection of
GreenButtonData::IntervalBlockinstances if id is not specified. If id is specified, returns a single instance. -
GreenButtonData::Client#local_time_parametersReturns a collection of
GreenButtonData::LocalTimeParametersinstances if id is not specified. If id is specified, returns a single instance. -
GreenButtonData::Client#meter_readingReturns a collection of
GreenButtonData::MeterReadinginstances if id is not specified. If id is specified, returns a single instance. -
GreenButtonData::Client#reading_typeReturns a collection of
GreenButtonData::ReadingTypeinstances if id is not specified. If id is specified, returns a single instance. -
GreenButtonData::Client#usage_pointReturns a collection of
GreenButtonData::UsagePointinstances if id is not specified. If id is specified, returns a single instance. -
GreenButtonData::Client#usage_summaryReturns a collection of
GreenButtonData::UsageSummaryinstances if id is not specified. If id is specified, returns a single instance.
Following the example from previous section, to retrieve all entries:
# Generally, Data Custodian access token is required to do this query which you
# can override with `token` keyword argument
# Makes a request to:
# https://services.greenbuttondata.org/DataCustodian/espi/1_1/resources/UsagePoint
espi_all_usage_points = espi_client.usage_pointTo retrieve a specific entry, specify the resource ID:
# Get a Usage Point 2
# Makes a request to:
# https://services.greenbuttondata.org/DataCustodian/espi/1_1/resources/UsagePoint/2
espi_usage_point = espi_client.usage_point 2, token: data_custodian_access_token
# Get a UsagePoint 1234 for subscription 3401
# Makes a request to:
# https://api.pge.com/GreenButtonConnect/espi/1_1/resources/Subscription/3401/UsagePoint/1234
pge_usage_point = pge_client.usage_point 1234, subscription_id: 3401You can query for related resources as well. There are couple ways you can do this:
# Gets all meter readings for this instance of UsagePoint
meter_readings_1 = pge_usage_point.meter_readings
# Same as above but requires knowledge of UsagePoint and Subscription ids
meter_readings_2 = pge_client.meter_reading usage_point_id: 1234, subscription_id: 3401This method allows you to query for data using the global configuration. This has limitations as you can only query data from one Data Custodian at a time unless you override the global configuration per method call.
The resource classes are as follows:
GreenButtonData::ApplicationInformationGreenButtonData::AuthorizationGreenButtonData::IntervalBlockGreenButtonData::LocalTimeParametersGreenButtonData::MeterReadingGreenButtonData::ReadingTypeGreenButtonData::UsagePointGreenButtonData::UsageSummary
By default, the .all method attempts to use the URL path set by configuration:
require 'green-button-data'
# Ideally obtained from OmniAuth gem
access_token = "12345678-1024-2048-abcdef001234"
# Return all usage points; URL is specified in GreenButtonData.configuration.usage_point_url
usage_points = UsagePoint.all token: access_tokenYou may override the global configuration by specifying the URL in the method:
usage_points = UsagePoint.all "https://someotherapi.org/espi/Authorization",
token: access_tokenIf you have URL defined in configuration, the .find method appends the ID to
the URL:
GreenButtonData.configure do |config|
config.base_url = "https://services.greenbuttondata.org/"
config.usage_point_path = "DataCustodian/espi/1_1/resource/UsagePoint/"
end
# GET request to https://services.greenbuttondata.org/DataCustodian/espi/1_1/resource/UsagePoint/2
usage_point = GreenButtonData::UsagePoint.find 2, token: access_tokenAs with .all method, URL can be overridden per request in .find:
usage_point = GreenButtonData::UsagePoint.find "https://someotherapi.org/espi/UsagePoint/1",
token: access_tokenAlmost all of the functionality for parsing data is wrapped in the
GreenButtonData::Feed class.
To parse a Green Button Atom feed, simply call the parse method and pass in
the entire XML document:
require 'green-button-data'
xml_text = File.read "#{File.dirname __FILE__}/gb_example_interval_block.xml"
data = GreenButtonData::Feed.parse xml_textYou can then access the data like this:
# Print all the interval readings from the feed
data.entries.each do |entry|
p "Entry: #{entry.title}"
entry.content.interval_block.interval_readings.each do |reading|
time_period = reading.time_period
p "[#{time_period.starts_at} - #{time_period.ends_at}]: #{reading.value}"
end
end- Fork this project
- Create a feature branch:
git checkout -b my-awesome-feature - Make changes and commit:
git commit -am "Add awesome feature" - Push the branch:
git push origin my-awesome-feature - Submit a pull request
Green Button Data gem follows Semantic Versioning 2.0. As such, you can specify a pessimistic version constraint on this gem with two digits of precision and be guaranteed latest features and bug fixes without backwards breaking changes:
gem 'green-button-data', '~> 0.1'Exception to this rule as per the SemVer specification is major version zero for initial development. This gem's API should NOT be considered stable until 1.0 release.
This software is distributed AS IS WITHOUT WARRANTY under Simplified BSD license.
Verdigris Technologies Inc. assumes NO RESPONSIBILITY OR LIABILITY UNDER ANY CIRCUMSTANCES for usage of this software. See the LICENSE.txt file for detailed legal information.
Do you have passion for solving challenging engineering problems? You may just be the right fit at Verdigris! We are hiring software engineers for our Mountain View, California, USA office.
For more information, check out our Careers page.
Copyright © 2015-2020, Verdigris Technologies Inc. All rights reserved.