Skip to content
This repository was archived by the owner on May 16, 2022. It is now read-only.
This repository was archived by the owner on May 16, 2022. It is now read-only.

CI:Add Automated Result Set Validation #17

@mrzzy

Description

@mrzzy

Motivation

Currently, the CI only runs the exercise SQL against the Sakila Database:

  • This only ensures that the SQL successfully executes, but not if the SQL produces the correct result set.
  • Need for correctness validation so that users can ensure the queries they executed are correct.

Requirements

  • Able to collect the result set for each SQL exercise query.
  • Perform data validation on the result query against expected result.
  • Data validation should be handle variations in row order, column names etc.

Proposal

  • Add test/%.sql Project Makefile target to test an Exercise SQL:
    • captures the result set of running the SQL query as CSV.
    • uses Great Expectations to validate the result.
  • Add test-exercises job to CI to automate SQL query testing.

Metadata

Metadata

Assignees

No one assigned

    Labels

    area: cicdArea of concern: Github Actions CI/CDarea: testingArea of concern: Data Validation / Testing

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions