-
Notifications
You must be signed in to change notification settings - Fork 122
acc: Add EnvMatrixExclude config option #4178
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| Env.PYTHONUNBUFFERED = "1" | ||
| Env.PYTHONUTF8 = "1" | ||
|
|
||
| EnvMatrix.DATABRICKS_BUNDLE_ENGINE = ["terraform", "direct"] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should we combine these to completely enumerate all environments the test would run in? Something like:
EnvMatrix = [
{"DATABRICKS_BUNDLE_ENGINE":"terraform", "READPLAN":0},
{"DATABRICKS_BUNDLE_ENGINE":"direct", "READPLAN":0},
{"DATABRICKS_BUNDLE_ENGINE":"direct", "READPLAN":1},
]Much easier reason about.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
No, this does not allow composition. For example, we set today DATABRICKS_BUNDLE_ENGINE variants for all tests but READPLAN for some subset, they don't know about each other can be configured separately.
|
Commit: f798ebb
20 interesting tests: 14 KNOWN, 4 RECOVERED, 1 SKIP, 1 flaky
Top 29 slowest tests (at least 2 minutes):
|
|
Commit: 21129d6
37 interesting tests: 14 KNOWN, 14 FAIL, 4 flaky, 4 RECOVERED, 1 SKIP
Top 50 slowest tests (at least 2 minutes):
|
Why
In #4134 I added special case for engine/readplan vars directly into acceptance_test.go. This generalizes that, making this feature available to other env var combinations.