Release/4.32.5

[aarthy-dk]

Features

• bigquery: Adding BigQuery to the connections pages (76ad544)
• bigquery: Support BigQuery for Profiling (b9ef2b4)
• bigquery: Support BigQuery for Test Generation (74a9569)
• add support for redshift spectrum (6fcca5e)
• pagination: paginate grid component (53bfb66)
• project-dashboard: display data point counts (1f58efb)
• schedules: support pausing/resuming job schedules (4b57cd7)
• hygiene-issues: add summary counts component (d060b0e)
• monitor: add data structure log (f07de29)
• data-type: track database data type for columns (a38046d)

Bug Fixes

• connection: save button not enabled correctly when switching flavors (cab8b61)
• sorting selector: selected items not sorted correctly (c60a840)
• sql: quote snowflake identifiers correctly (35ccbef)
• tests: don't quote columns in Timeframe Combo Match (cc50412)
• redshift: profiling error for timestamps with time zone (4d1e261)
• postgres: profiling bugs on money and time data types (32517ab)
• Applying sampling to the secondary profiling query (3c7f5ea)
• pagination: handle invalid page in query (2f86195)
• Updating services images to point to bitnamis legacy repo (56ec66d)
• source-data: fix lookup queries for Valid_US_Zip3 test (2c35f44)
• source-data: set max height for sql query (919eb3e)
• table freshness: arithmetic overflow in mssql (ca67e56)
• test-results: add details text to bottom section (b67008d)
• project-dashboard: improve css responsiveness (fc71112)
• connection-form: validation on file fields, clear db fields (8cd4849)
• test-validation: detect missing columns in Dupe_Rows test (2fe741a)
• logs: suppress noisy logs during setup and upgrade (62252a9)
• mssql: arithmetic overflow error in Incr_Avg_Shift test (a1500cd)
• add QUOTE to test and lookup queries to support non-standard identifiers (5edee1e)
• hygiene-issues: numeric value out of range error (d4076a1)
• test-validation: handle commas in column names (b5af463)
• miscellaneous qa fixes (af22198)
• sampling: trim quotes in estimate query (007a17a)
• profiling-results: make filters consistent with hygiene issues (8fd8cc8)
• grid: remove unpaginated filter and sort (5d0f4d0)
• connection: unnecessary rerender of file input (1f540de)
• hygiene-issues: include potential pii in possible count (7b4d688)
• clear cache on page refresh (d2e2246)

Refactors

• run-pages: move filters and pagination to vanjs (c83787d)

Miscellaneous

• Addressing code review feedback (730c1b6)

[github-actions]

Coverage Report •

File	Stmts	Miss	Cover	Missing
testgen
__main__.py	341	341	0%	1–704
testgen/commands
run_generate_tests.py	55	45	14%	15–93
run_launch_db_config.py	31	31	0%	1–102
run_profiling_bridge.py	271	271	0%	1–499
run_refresh_data_chars.py	30	22	24%	20–80
run_test_metadata_exporter.py	11	11	0%	1–19
run_test_parameter_validation.py	74	66	8%	22–119
run_upgrade_db_config.py	87	87	0%	1–162
testgen/commands/queries
execute_cat_tests_query.py	67	29	54%	34–41, 44–47, 50–79, 83, 87, 91, 95, 99, 103, 107, 111, 115, 119, 123
execute_tests_query.py	96	42	50%	56–62, 65–94, 99–142, 146–149, 152–155, 159, 163–173
generate_tests_query.py	65	33	44%	33–38, 41, 57–62, 66, 70, 74–102, 106, 110
profiling_query.py	225	134	31%	70–>83, 86–89, 92, 133–145, 148–168, 172, 176, 180, 184, 188, 192, 196, 200, 204, 208, 212, 216, 220, 224–244, 248–256, 260, 264, 268, 272, 280–379, 383, 387, 391, 395, 399
refresh_data_chars_query.py	55	6	89%	52, 86–91, 95, 99
test_parameter_validation_query.py	45	22	49%	21–24, 27–43, 47–50, 54–58, 62, 66, 70, 74, 78
testgen/common
clean_sql.py	31	26	12%	8–16, 21–47, 52–61
get_pipeline_parms.py	50	12	68%	48–54, 58–64, 68–74
read_yaml_metadata_records.py	108	108	0%	1–268
testgen/common/database
database_service.py	248	187	21%	51–65, 69–70, 75, 98–128, 139–166, 175–211, 217–226, 232–239, 243–263, 275–287, 297–299, 308–350, 354–386, 391–393, 396–420
testgen/common/database/flavor
bigquery_flavor_service.py	14	14	0%	1–22
databricks_flavor_service.py	10	10	0%	1–16
flavor_service.py	86	46	41%	39–66, 69, 72, 75, 78–83, 87, 91, 94–125
mssql_flavor_service.py	21	10	44%	14, 17–24, 27, 33–36
redshift_flavor_service.py	11	4	64%	11–13, 16, 20
redshift_spectrum_flavor_service.py	3	3	0%	1–6
snowflake_flavor_service.py	32	19	32%	17–33, 36–39, 46–66, 69
testgen/common/models
connection.py	99	33	61%	73–74, 79–83, 90–91, 95–98, 102–103, 107–110, 114–117, 120–132
custom_types.py	45	13	65%	18, 26–28, 31–33, 41, 49, 57, 60, 66, 69
profiling_run.py	132	132	0%	1–260
scheduler.py	57	23	60%	34–51, 55–62, 66–73, 77, 80–81, 85
table_group.py	153	57	57%	106–107, 114–115, 120–190, 194–211, 215–222, 226–262, 266–269, 277–323
testgen/ui
session.py	52	16	62%	49, 52, 55–57, 60–62, 66–76
testgen/ui/components/widgets
page.py	64	42	30%	20–33, 37–60, 80, 84, 88, 92, 96, 100, 104, 108, 112, 116–119
paginator.py	18	12	23%	28–47
summary.py	27	18	27%	31–53, 75–101
testgen/ui/navigation
router.py	79	59	21%	25–26, 29–71, 74, 81–83, 86, 89–117, 120–123, 126–132
testgen/ui/pdf
hygiene_issue_report.py	53	53	0%	1–203
testgen/ui/queries
profiling_queries.py	71	49	26%	73–119, 130–135, 145–150, 160–165, 176–259, 270–275, 288–298, 308–313, 323–328, 339–416, 421–470
scoring_queries.py	38	38	0%	1–215
source_data_queries.py	122	94	18%	20–69, 77–99, 103–143, 151–172, 178–186, 194–215, 229–250, 256–265
table_group_queries.py	60	60	0%	1–104
test_result_queries.py	20	12	40%	19–126, 131–169
testgen/ui/services
database_service.py	41	26	37%	23–30, 34–36, 42–46, 50–53, 57–68
form_service.py	145	123	10%	24–27, 31–32, 36–37, 41–42, 47–61, 65–80, 86–141, 164–414
testgen/ui/views
connections.py	243	243	0%	1–443
data_catalog.py	171	171	0%	1–551
hygiene_issues.py	221	221	0%	1–642
profiling_results.py	95	95	0%	1–290
profiling_runs.py	89	89	0%	1–183
test_definitions.py	538	472	9%	55–224, 228–263, 267–317, 323–345, 349–353, 371–817, 823, 829, 840–934, 937–940, 945–963, 969–989, 999–1003, 1013–1039, 1049–1073, 1084–1133, 1138–1142, 1151–1180, 1188–1199, 1203–1214, 1218–1251
test_results.py	334	271	15%	68–316, 322–333, 349–350, 355–362, 367–376, 381–431, 442–471, 514–609, 621–639, 649–655, 659–734, 738–780, 784–794, 800–839, 843–846, 850–858, 865–908
test_runs.py	92	44	45%	45–56, 103, 107, 118, 121, 124, 130, 134–138, 144–190
testgen/ui/views/dialogs
manage_schedules.py	104	79	23%	24, 27, 30, 33, 36, 40–42, 45–161
TOTAL	9897	7055	24%

Tests	Skipped	Failures	Errors	Time
37	0 💤	0 ❌	0 🔥	9.974s ⏱️