Skip to content

Conversation

@qx-teo
Copy link
Contributor

@qx-teo qx-teo commented Dec 10, 2021

Description

7dav signals give NA values for the first 6 days a new geo_id is introduced, as there is not enough data for the smoother. We fix this by shifting the check to dynamic checks, and checking row by row (ignoring the first 6 rows of each geo_id in the checking window)

Changelog

Itemize code/test/documentation changes and files added/removed.

  • dynamic.py
  • test_dynamic.py
  • static.py
  • test_static.py

Moved check_val_missing to dynamic checks.
Increased granularity, now informs for each geo_id+date combination for missing values
Ignores first 6 days of the checking period since 7dav signals return NAs as part of smoothing
Move check_na_values to test_dynamic, changed test assertions to fit
@qx-teo qx-teo requested a review from nmdefries December 10, 2021 15:00
Keeping error_name as check_val_missing for easier processing, shifted relavant info to message
Added na value outside of checking range to test for filtering
Apply filter to df to only consider dates within the checking window
Test dataframe had time_value in the wrong type, should be datetime.date
@qx-teo
Copy link
Contributor Author

qx-teo commented Jan 20, 2022

@nmdefries this should be fixed now, failing test as a result of #1477

@krivard krivard merged commit dbea6ad into main Jan 31, 2022
@krivard krivard deleted the 7dav_new_geo_ids branch January 31, 2022 19:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants