TestBaseFileUpdatesExtractor.convertDiff is flaky

[ashvina]

Search before asking

• I had searched in the issues and found no similar issues.

Please describe the bug 🐞

The FilesDiff class does not guarantee the order of files it identifies in the add and remove sets. However, the test depends on the order and fails occasionally. Run the test suite multiple times to reproduce.

A recent build failure because of this bug is here

TestBaseFileUpdatesExtractor.convertDiff:138 expected: 
<{partition2=[file5.parquet], partition1=[file3.parquet, d1cf0980-445c-4c74-bdeb-b7e5d18779f5-0]}> 
but was: 
<{partition2=[file5.parquet], partition1=[d1cf0980-445c-4c74-bdeb-b7e5d18779f5-0, file3.parquet]}>

Are you willing to submit PR?

• I am willing to submit a PR!
• I am willing to submit a PR but need help getting started!

Code of Conduct

• I agree to follow this project's Code of Conduct