[draft][v1] Re-enable some randomized tests

[alancai98]

Relevant Issues

• [V1] Add support for randomized tests on 1.0 evaluator. #1601

Description

• Re-enables some randomized tests

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[github-actions]

CROSS-ENGINE-REPORT ❌

	BASE (LEGACY-V0.14.8)	TARGET (EVAL-FC89DB0)	+/-
% Passing	89.67%	94.56%	4.88% ✅
Passing	5287	5575	288 ✅
Failing	609	47	-562 ✅
Ignored	0	274	274 🔶
Total Tests	5896	5896	0 ✅

Testing Details

• Base Commit: v0.14.8
• Base Engine: LEGACY
• Target Commit: fc89db0
• Target Engine: EVAL

Result Details

• ❌ REGRESSION DETECTED. See Now Failing/Ignored Tests. ❌
• Passing in both: 2644
• Failing in both: 17
• Ignored in both: 0
• PASSING in BASE but now FAILING in TARGET: 2
• PASSING in BASE but now IGNORED in TARGET: 108
• FAILING in BASE but now PASSING in TARGET: 180
• IGNORED in BASE but now PASSING in TARGET: 0

Now FAILING Tests ❌

The following 2 test(s) were previously PASSING in BASE but are now FAILING in TARGET:

Click here to see

1. inPredicateWithTableConstructor, compileOption: PERMISSIVE
2. notInPredicateWithTableConstructor, compileOption: PERMISSIVE

Now IGNORED Tests ❌

The complete list can be found in GitHub CI summary, either from Step Summary or in the Artifact.

Now Passing Tests

180 test(s) were previously failing in BASE (LEGACY-V0.14.8) but now pass in TARGET (EVAL-FC89DB0). Before merging, confirm they are intended to pass.

The complete list can be found in GitHub CI summary, either from Step Summary or in the Artifact.

CROSS-COMMIT-REPORT ✅

	BASE (EVAL-71E9EE3)	TARGET (EVAL-FC89DB0)	+/-
% Passing	94.56%	94.56%	0.00% ✅
Passing	5575	5575	0 ✅
Failing	47	47	0 ✅
Ignored	274	274	0 ✅
Total Tests	5896	5896	0 ✅

Testing Details

• Base Commit: 71e9ee3
• Base Engine: EVAL
• Target Commit: fc89db0
• Target Engine: EVAL

Result Details

• Passing in both: 5575
• Failing in both: 47
• Ignored in both: 274
• PASSING in BASE but now FAILING in TARGET: 0
• PASSING in BASE but now IGNORED in TARGET: 0
• FAILING in BASE but now PASSING in TARGET: 0
• IGNORED in BASE but now PASSING in TARGET: 0

[alancai98]

(self-review) TimestampTemporalAccessor class was deleted in v1 branch so tests no longer relevant

[alancai98]

(self-review) these tests passed when re-enabled.

There is another file that has some datetime evaluation tests -- https://github.com/partiql/partiql-lang-kotlin/blob/enable-some-randomized-tests/test/partiql-randomized-tests/src/test/kotlin/org/partiql/lang/randomized/eval/EvaluatingCompilerDateTimeRandomizedTests.kt. Those tests depend on the old datetime modeling. Once that modeling is updated in #1691, we can try re-enabling those tests.

[alancai98]

(self-review) cut an issue to track -- #1697.

Will discuss w/ team on whether the evaluation behavior needs changed. If so, how to update the randomized tests.