2.0.169
Features
-
Data Quality
- Aggregation page form improvements
- Data Quality stats endpoint
- Added query predictions with global aggregates
- Data Quality variants are now controlled by backend
- Added endpoint to allow getting possible combinations
- Input from frontend is validated on endpoint level based on the JSON
- New endpoints: Get global aggregates: all, by db_id, by db_id and schema, by db_id, schema and table
-
New Data Quality Tests added:
- Detect if strings are truncated in the column
- Detect if given string column is used to store numbers
- Detect if column has unique values
- Database Metadata now stores the maximum length of columns from information schema
- Enabled Data Quality Tests:
- 'between' for string lengths
- 'in' and 'not in' for numeric
- 'between' for numeric
Fixes
- Robot test generation error handling
- DQ aggregation queries
Known issues
- Reconciliation tests may not be rerunnable
- Data Quality tests may not be rerunnable