TestPerFieldDocValuesFormat > testSortedNumericsMultipleValuesVsStoredFields FAILED

[john-wagster]

Description

TestPerFieldDocValuesFormat > testSortedNumericsMultipleValuesVsStoredFields FAILED
    org.apache.lucene.index.IndexNotFoundException: no segments* file found in MockDirectoryWrapper(ByteBuffersDirectory@7ca1e911 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@e250219): files: [_0.cfe, _0.cfs, _0.si, _1.fdm, _1.fdt, _1_Lucene90FieldsIndex-doc_ids_2.tmp, _1_Lucene90FieldsIndexfile_pointers_3.tmp]
        at __randomizedtesting.SeedInfo.seed([EF80AAACDBCF0C78:8AABB83DBB194979]:0)
        at app//org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:804)
        at app//org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:105)
        at app//org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:67)
        at app//org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:60)
        at app//org.apache.lucene.tests.index.LegacyBaseDocValuesFormatTestCase.doTestSortedNumericsVsStoredFields(LegacyBaseDocValuesFormatTestCase.java:1547)
        at app//org.apache.lucene.tests.index.LegacyBaseDocValuesFormatTestCase.testSortedNumericsMultipleValuesVsStoredFields(LegacyBaseDocValuesFormatTestCase.java:2526)
        at java.base@24/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
        at java.base@24/java.lang.reflect.Method.invoke(Method.java:565)
        at app//com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1763)
        at app//com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
        at app//com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
        at app//com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
        at app//org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
        at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at app//org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
        at app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
        at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
        at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
        at app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
        at app//com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
        at app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
        at app//com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
        at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at app//org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at app//org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:51)
        at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at app//org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
        at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
        at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
        at java.base@24/java.lang.Thread.run(Thread.java:1447)

Gradle command to reproduce

./gradlew test --tests TestPerFieldDocValuesFormat.testSortedNumericsMultipleValuesVsStoredFields -Dtests.seed=EF80AAACDBCF0C78 -Dtests.locale=asa-Latn-TZ -Dtests.timezone=Asia/Ulaanbaatar -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[VivekKumarNeu]

Hi @john-wagster ,

The test failed because DirectoryReader.open() tried to read the index while there were still uncommitted changes in the writer.

The fix is to call writer.commit() after we have made all the changes and before opening the reader. That makes sure the reader can actually see a proper index.

I have opened a PR to fix the issue - #15233

Please take a look when you have some time.