HBASE-30382: Update zstd-jni to 1.5.7-15 (branch-2.5) by arvindKandpal-ksolves · Pull Request #8656 · apache/hbase

arvindKandpal-ksolves · 2026-09-16T06:02:54Z

What changes were proposed in this pull request?

Bumps zstd-jni from 1.5.7-2 to 1.5.7-15 in pom.xml (branch-2.5).

Why are the changes needed?

zstd-jni versions prior to 1.5.7-14 contain vulnerable code addressed by:

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Ran the full zstd-jni compression test suite before and after the bump:
TestWALCompressionZstd, TestZstdCodec, TestHFileCompressionZstd,
TestZstdDictionary, TestZstdDictionarySplitMerge, TestZstdByteBuffDecompressor.

Baseline (1.5.7-2): 15 tests run, 0 failures, 0 errors
After bump (1.5.7-15): 15 tests run, 0 failures, 0 errors

Verified via mvn dependency:tree that the resolved artifact is
com.github.luben:zstd-jni:jar:1.5.7-15.

Note: built with -Dhadoop.profile=3.0 (required for JDK11+).

arvindKandpal-ksolves · 2026-09-17T06:07:05Z

Verified locally on branch-2.5, JDK 17.0.20, Hadoop3 profile (-Dhadoop.profile=3.0), matching the "Yetus JDK17 Hadoop3 Unit Check / medium" failing job.

With zstd-jni 1.5.7-15 (this PR):

 mvn -Dhadoop.profile=3.0 -pl hbase-server -am clean install -DskipTests 2>&1 | tail -10
[INFO] Apache HBase - HTTP ................................ SUCCESS [  4.903 s]
[INFO] Apache HBase - Asynchronous FileSystem ............. SUCCESS [  4.376 s]
[INFO] Apache HBase - Procedure ........................... SUCCESS [  3.387 s]
[INFO] Apache HBase - Server .............................. SUCCESS [ 55.751 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  02:39 min
[INFO] Finished at: 2026-09-17T11:22:19+05:30
[INFO] ------------------------------------------------------------------------

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -Dhadoop.profile=3.0 -pl hbase-server test -Dtest=TestBasicWALEntryStreamAsyncFSWAL#testCleanClosedWALs,TestBasicWALEntryStreamFSHLog#testCleanClosedWALs,TestBufferedMutator#testMultiThread -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD"
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 14.00 s <<< FAILURE! -- in org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog
[ERROR] org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog.testCleanClosedWALs -- Time elapsed: 4.545 s <<< FAILURE!
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 14.24 s <<< FAILURE! -- in org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamAsyncFSWAL
[ERROR] org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamAsyncFSWAL.testCleanClosedWALs -- Time elapsed: 4.676 s <<< FAILURE!
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.35 s -- in org.apache.hadoop.hbase.client.TestBufferedMutator
[ERROR] Failures: 
[ERROR]   TestBasicWALEntryStreamAsyncFSWAL>TestBasicWALEntryStream.testCleanClosedWALs:727 expected: <0> but was: <1>
[ERROR]   TestBasicWALEntryStreamFSHLog>TestBasicWALEntryStream.testCleanClosedWALs:727 expected: <0> but was: <1>
[ERROR] Tests run: 3, Failures: 2, Errors: 0, Skipped: 0
[INFO] BUILD FAILURE
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.5.3:test (default-test) on project hbase-server: There are test failures.
[ERROR] 
[ERROR] See /home/arvindksi274/Opensource-works/hbase/hbase-server/target/surefire-reports for the individual test results.
[ERROR] See dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

With zstd-jni 1.5.7-2 (pristine upstream/branch-2.5, pom.xml reverted):

git checkout upstream/branch-2.5 -- pom.xml

arvindksi274@KLP2757:~/Opensource-works/hbase$ grep -n "zstd-jni.version" pom.xml
674:    <zstd-jni.version>1.5.7-2</zstd-jni.version>
1540:        <version>${zstd-jni.version}</version>

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -Dhadoop.profile=3.0 -pl hbase-server -am clean install -DskipTests 2>&1 | tail -5
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  02:41 min
[INFO] Finished at: 2026-09-17T11:29:38+05:30
[INFO] ------------------------------------------------------------------------

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -Dhadoop.profile=3.0 -pl hbase-server test -Dtest=TestBasicWALEntryStreamAsyncFSWAL#testCleanClosedWALs,TestBasicWALEntryStreamFSHLog#testCleanClosedWALs -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD"
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 10.03 s <<< FAILURE! -- in org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog
[ERROR] org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog.testCleanClosedWALs -- Time elapsed: 3.588 s <<< FAILURE!
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 10.32 s <<< FAILURE! -- in org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamAsyncFSWAL
[ERROR] org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamAsyncFSWAL.testCleanClosedWALs -- Time elapsed: 3.893 s <<< FAILURE!
[ERROR] Failures: 
[ERROR]   TestBasicWALEntryStreamAsyncFSWAL>TestBasicWALEntryStream.testCleanClosedWALs:727 expected: <0> but was: <1>
[ERROR]   TestBasicWALEntryStreamFSHLog>TestBasicWALEntryStream.testCleanClosedWALs:727 expected: <0> but was: <1>
[ERROR] Tests run: 2, Failures: 2, Errors: 0, Skipped: 0
[INFO] BUILD FAILURE
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.5.3:test (default-test) on project hbase-server: There are test failures.
[ERROR] 
[ERROR] See /home/arvindksi274/Opensource-works/hbase/hbase-server/target/surefire-reports for the individual test results.
[ERROR] See dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

Same failure, identical assertion, with and without the zstd-jni bump — confirms this is a pre-existing issue on branch-2.5, unrelated to this PR. Also confirmed no reference to zstd/compression in either test file or the shared test base class.

arvindKandpal-ksolves · 2026-09-17T06:37:45Z

Verified locally on branch-2.5, JDK 11.0.32, Hadoop3 profile (-Dhadoop.profile=3.0), matching "Yetus JDK11 Hadoop3 Unit Check / medium".

TestWALCompressionLzma passes. TestBufferedMutator#testMultiThread and TestBasicWALEntryStreamFSHLog#testCleanClosedWALs fail — confirmed pre-existing by reverting pom.xml to pristine zstd-jni 1.5.7-2 and reproducing the same failures.

With zstd-jni 1.5.7-15:

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -Dhadoop.profile=3.0 -pl hbase-server -am clean install -DskipTests 2>&1 | tail -10
[INFO] Apache HBase - HTTP ................................ SUCCESS [  4.903 s]
[INFO] Apache HBase - Asynchronous FileSystem ............. SUCCESS [  4.376 s]
[INFO] Apache HBase - Procedure ........................... SUCCESS [  3.387 s]
[INFO] Apache HBase - Server .............................. SUCCESS [ 55.751 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  02:39 min
[INFO] Finished at: 2026-09-17T11:22:19+05:30
[INFO] ------------------------------------------------------------------------

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -Dhadoop.profile=3.0 -pl hbase-server test -Dtest=TestBasicWALEntryStreamAsyncFSWAL#testCleanClosedWALs,TestBasicWALEntryStreamFSHLog#testCleanClosedWALs,TestBufferedMutator#testMultiThread -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD"
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 14.00 s <<< FAILURE! -- in org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog
[ERROR] org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog.testCleanClosedWALs -- Time elapsed: 4.545 s <<< FAILURE!
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 14.24 s <<< FAILURE! -- in org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamAsyncFSWAL
[ERROR] org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamAsyncFSWAL.testCleanClosedWALs -- Time elapsed: 4.676 s <<< FAILURE!
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.35 s -- in org.apache.hadoop.hbase.client.TestBufferedMutator
[ERROR] Failures: 
[ERROR]   TestBasicWALEntryStreamAsyncFSWAL>TestBasicWALEntryStream.testCleanClosedWALs:727 expected: <0> but was: <1>
[ERROR]   TestBasicWALEntryStreamFSHLog>TestBasicWALEntryStream.testCleanClosedWALs:727 expected: <0> but was: <1>
[ERROR] Tests run: 3, Failures: 2, Errors: 0, Skipped: 0
[INFO] BUILD FAILURE
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.5.3:test (default-test) on project hbase-server: There are test failures.
[ERROR] 
[ERROR] See /home/arvindksi274/Opensource-works/hbase/hbase-server/target/surefire-reports for the individual test results.
[ERROR] See dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

arvindksi274@KLP2757:~/Opensource-works/hbase$ export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64
export PATH=$JAVA_HOME/bin:$PATH
java -version
grep -rn "zstd" hbase-compression/hbase-compression-xz/pom.xml
openjdk version "11.0.32" 2026-07-21
OpenJDK Runtime Environment (build 11.0.32+9-post-1ubuntu1-24.04-Ubuntu)
OpenJDK 64-Bit Server VM (build 11.0.32+9-post-1ubuntu1-24.04-Ubuntu, mixed mode, sharing)

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -Dhadoop.profile=3.0 -pl hbase-compression/hbase-compression-xz -am clean install -DskipTests 2>&1 | tail -10
[INFO] Apache HBase - Server .............................. SUCCESS [ 54.323 s]
[INFO] Apache HBase - Testing Util ........................ SUCCESS [  6.245 s]
[INFO] Apache HBase - Compression ......................... SUCCESS [  0.068 s]
[INFO] Apache HBase - Compression - XZ .................... SUCCESS [  4.457 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  03:08 min
[INFO] Finished at: 2026-09-17T11:42:24+05:30
[INFO] ------------------------------------------------------------------------

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -Dhadoop.profile=3.0 -pl hbase-compression/hbase-compression-xz test -Dtest=TestWALCompressionLzma -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD"
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 174.8 s -- in org.apache.hadoop.hbase.io.compress.xz.TestWALCompressionLzma
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0
[INFO] BUILD SUCCESS
arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -Dhadoop.profile=3.0 -pl hbase-server -am clean install -DskipTests 2>&1 | tail -5
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  02:47 min
[INFO] Finished at: 2026-09-17T11:50:40+05:30
[INFO] ------------------------------------------------------------------------

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -Dhadoop.profile=3.0 -pl hbase-server test -Dtest=TestBufferedMutator#testMultiThread,TestBasicWALEntryStreamFSHLog#testCleanClosedWALs -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD"
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.78 s <<< FAILURE! -- in org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog
[ERROR] org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog.testCleanClosedWALs -- Time elapsed: 4.803 s <<< FAILURE!
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 39.56 s <<< FAILURE! -- in org.apache.hadoop.hbase.client.TestBufferedMutator
[ERROR] org.apache.hadoop.hbase.client.TestBufferedMutator.testMultiThread -- Time elapsed: 19.05 s <<< FAILURE!
[ERROR] Failures: 
[ERROR]   TestBufferedMutator.testMultiThread:125 expected: <true> but was: <false>
[ERROR]   TestBasicWALEntryStreamFSHLog>TestBasicWALEntryStream.testCleanClosedWALs:727 expected: <0> but was: <1>
[ERROR] Tests run: 2, Failures: 2, Errors: 0, Skipped: 0
[INFO] BUILD FAILURE
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.5.3:test (default-test) on project hbase-server: There are test failures.
[ERROR] 
[ERROR] See /home/arvindksi274/Opensource-works/hbase/hbase-server/target/surefire-reports for the individual test results.
[ERROR] See dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

With zstd-jni 1.5.7-2 (pristine):

arvindksi274@KLP2757:~/Opensource-works/hbase$ git checkout upstream/branch-2.5 -- pom.xml
grep -n "zstd-jni.version" pom.xml
mvn -Dhadoop.profile=3.0 -pl hbase-server -am clean install -DskipTests 2>&1 | tail -5
mvn -Dhadoop.profile=3.0 -pl hbase-server test -Dtest=TestBufferedMutator#testMultiThread -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD"
674:    <zstd-jni.version>1.5.7-2</zstd-jni.version>
1540:        <version>${zstd-jni.version}</version>
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  03:18 min
[INFO] Finished at: 2026-09-17T11:57:00+05:30
[INFO] ------------------------------------------------------------------------
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 38.80 s <<< FAILURE! -- in org.apache.hadoop.hbase.client.TestBufferedMutator
[ERROR] org.apache.hadoop.hbase.client.TestBufferedMutator.testMultiThread -- Time elapsed: 20.04 s <<< FAILURE!
[ERROR] Failures: 
[ERROR]   TestBufferedMutator.testMultiThread:125 expected: <true> but was: <false>
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
[INFO] BUILD FAILURE
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.5.3:test (default-test) on project hbase-server: There are test failures.
[ERROR] 
[ERROR] See /home/arvindksi274/Opensource-works/hbase/hbase-server/target/surefire-reports for the individual test results.
[ERROR] See dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

arvindKandpal-ksolves · 2026-09-17T15:21:13Z

Verified locally on branch-2.5, JDK 1.8.0_502, Hadoop2 (default profile), matching "Yetus JDK8 Hadoop2 Unit Check / medium".

TestWALCompressionLzma, TestMetaCache, TestMasterRegionFlush, TestBindExceptionHandling: all pass.

TestBasicWALEntryStreamAsyncFSWAL/FSHLog#testCleanClosedWALs: fail identically with and without the zstd-jni bump (reverted pom.xml to pristine 1.5.7-2 and reproduced) — pre-existing issue.

TestBufferedMutator#testMultiThread: failed once with the bump, passed on rerun without it and again passed with try — consistent with CI's own "Flakes" classification (timing-sensitive, not deterministic either way).

see here :

arvindksi274@KLP2757:~/Opensource-works/hbase$ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
export PATH=$JAVA_HOME/bin:$PATH
java -version
mvn -pl hbase-compression/hbase-compression-xz -am clean install -DskipTests 2>&1 | tail -5
openjdk version "1.8.0_502"
OpenJDK Runtime Environment (build 1.8.0_502-8u502-ga~us1-0ubuntu1~24.04-b07)
OpenJDK 64-Bit Server VM (build 25.502-b07, mixed mode)
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  02:09 min
[INFO] Finished at: 2026-09-17T20:17:28+05:30
[INFO] ------------------------------------------------------------------------

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -pl hbase-server -am clean install -DskipTests 2>&1 | tail -5
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  01:59 min
[INFO] Finished at: 2026-09-17T20:33:20+05:30
[INFO] ------------------------------------------------------------------------

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -pl hbase-compression/hbase-compression-xz test -Dtest=TestWALCompressionLzma -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD"
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 134.8 s -- in org.apache.hadoop.hbase.io.compress.xz.TestWALCompressionLzma
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0
[INFO] BUILD SUCCESS

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -pl hbase-server test -Dtest=TestBufferedMutator#testMultiThread,TestMetaCache#testAddToCacheReverse,TestMasterRegionFlush#testPeriodicalFlush,TestBasicWALEntryStreamAsyncFSWAL#testCleanClosedWALs,TestBasicWALEntryStreamFSHLog#testCleanClosedWALs -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD"
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.49 s <<< FAILURE! -- in org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog
[ERROR] org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog.testCleanClosedWALs -- Time elapsed: 4.838 s <<< FAILURE!
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.27 s -- in org.apache.hadoop.hbase.client.TestMetaCache
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 14.73 s <<< FAILURE! -- in org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamAsyncFSWAL
[ERROR] org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamAsyncFSWAL.testCleanClosedWALs -- Time elapsed: 5.838 s <<< FAILURE!
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.504 s -- in org.apache.hadoop.hbase.master.region.TestMasterRegionFlush
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 39.83 s <<< FAILURE! -- in org.apache.hadoop.hbase.client.TestBufferedMutator
[ERROR] org.apache.hadoop.hbase.client.TestBufferedMutator.testMultiThread -- Time elapsed: 18.66 s <<< FAILURE!
[ERROR] Failures: 
[ERROR]   TestBufferedMutator.testMultiThread:125 expected: <true> but was: <false>
[ERROR]   TestBasicWALEntryStreamAsyncFSWAL>TestBasicWALEntryStream.testCleanClosedWALs:727 expected: <0> but was: <1>
[ERROR]   TestBasicWALEntryStreamFSHLog>TestBasicWALEntryStream.testCleanClosedWALs:727 expected: <0> but was: <1>
[ERROR] Tests run: 5, Failures: 3, Errors: 0, Skipped: 0
[INFO] BUILD FAILURE
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.5.3:test (default-test) on project hbase-server: There are test failures.
[ERROR] 
[ERROR] See /home/arvindksi274/Opensource-works/hbase/hbase-server/target/surefire-reports for the individual test results.
[ERROR] See dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -pl hbase-thrift -am test -Dtest=TestBindExceptionHandling#testProtocolPortClash -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD"
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.612 s -- in org.apache.hadoop.hbase.thrift.TestBindExceptionHandling
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
[INFO] BUILD SUCCESS

arvindksi274@KLP2757:~/Opensource-works/hbase$ git checkout upstream/branch-2.5 -- pom.xml

arvindksi274@KLP2757:~/Opensource-works/hbase$ grep -n "zstd-jni.version" pom.xml
674:    <zstd-jni.version>1.5.7-2</zstd-jni.version>
1540:        <version>${zstd-jni.version}</version>

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -pl hbase-server -am clean install -DskipTests 2>&1 | tail -5
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  01:52 min
[INFO] Finished at: 2026-09-17T20:42:24+05:30
[INFO] ------------------------------------------------------------------------

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -pl hbase-server test -Dtest=TestBufferedMutator#testMultiThread,TestBasicWALEntryStreamAsyncFSWAL#testCleanClosedWALs,TestBasicWALEntryStreamFSHLog#testCleanClosedWALs -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD"
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.16 s <<< FAILURE! -- in org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog
[ERROR] org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog.testCleanClosedWALs -- Time elapsed: 4.807 s <<< FAILURE!
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.62 s <<< FAILURE! -- in org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamAsyncFSWAL
[ERROR] org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamAsyncFSWAL.testCleanClosedWALs -- Time elapsed: 5.408 s <<< FAILURE!
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.39 s -- in org.apache.hadoop.hbase.client.TestBufferedMutator
[ERROR] Failures: 
[ERROR]   TestBasicWALEntryStreamAsyncFSWAL>TestBasicWALEntryStream.testCleanClosedWALs:727 expected: <0> but was: <1>
[ERROR]   TestBasicWALEntryStreamFSHLog>TestBasicWALEntryStream.testCleanClosedWALs:727 expected: <0> but was: <1>
[ERROR] Tests run: 3, Failures: 2, Errors: 0, Skipped: 0
[INFO] BUILD FAILURE
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.5.3:test (default-test) on project hbase-server: There are test failures.
[ERROR] 
[ERROR] See /home/arvindksi274/Opensource-works/hbase/hbase-server/target/surefire-reports for the individual test results.
[ERROR] See dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

arvindksi274@KLP2757:~/Opensource-works/hbase$ git checkout HBASE-30382-branch-2.5 -- pom.xml
grep -n "zstd-jni.version" pom.xml
674:    <zstd-jni.version>1.5.7-15</zstd-jni.version>
1540:        <version>${zstd-jni.version}</version>

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -pl hbase-server -am clean install -DskipTests 2>&1 | tail -5
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  01:57 min
[INFO] Finished at: 2026-09-17T20:46:39+05:30
[INFO] ------------------------------------------------------------------------

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -pl hbase-server test -Dtest=TestBufferedMutator#testMultiThread,TestBasicWALEntryStreamAsyncFSWAL#testCleanClosedWALs,TestBasicWALEntryStreamFSHLog#testCleanClosedWALs -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD"
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.12 s <<< FAILURE! -- in org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog
[ERROR] org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog.testCleanClosedWALs -- Time elapsed: 4.868 s <<< FAILURE!
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.92 s <<< FAILURE! -- in org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamAsyncFSWAL
[ERROR] org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamAsyncFSWAL.testCleanClosedWALs -- Time elapsed: 5.520 s <<< FAILURE!
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.03 s -- in org.apache.hadoop.hbase.client.TestBufferedMutator
[ERROR] Failures: 
[ERROR]   TestBasicWALEntryStreamAsyncFSWAL>TestBasicWALEntryStream.testCleanClosedWALs:727 expected: <0> but was: <1>
[ERROR]   TestBasicWALEntryStreamFSHLog>TestBasicWALEntryStream.testCleanClosedWALs:727 expected: <0> but was: <1>
[ERROR] Tests run: 3, Failures: 2, Errors: 0, Skipped: 0
[INFO] BUILD FAILURE
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.5.3:test (default-test) on project hbase-server: There are test failures.
[ERROR] 
[ERROR] See /home/arvindksi274/Opensource-works/hbase/hbase-server/target/surefire-reports for the individual test results.
[ERROR] See dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

arvindKandpal-ksolves · 2026-09-24T13:20:49Z

JDK17 Hadoop3 (medium)

All failed test passed

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -Dhadoop.profile=3.0 -fae \
  -pl hbase-endpoint,hbase-server,hbase-compression/hbase-compression-xz test \
  -Dtest='TestCoprocessorEndpointTracing#traceSyncAdminEndpoint,TestRegionSplit#testSplitStoreFiles+testSplitTableRegion,TestWALCompressionLzma#test+testLarge' \
  -DfailIfNoTests=false -Dsurefire.failIfNoSpecifiedTests=false \
  2>&1 | tee /tmp/test-2.5-jdk17.log | grep -E "Tests run|FAIL|ERROR|BUILD"
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.13 s -- in org.apache.hadoop.hbase.master.assignment.TestRegionSplit
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.10 s -- in org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpointTracing
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 120.9 s -- in org.apache.hadoop.hbase.io.compress.xz.TestWALCompressionLzma
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0
[INFO] BUILD SUCCESS

JDK11 Hadoop3 (medium)

this is failed test in this branch that is passed

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -Dhadoop.profile=3.0 -pl hbase-compression/hbase-compression-xz test -Dtest=TestWALCompressionLzma -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD|==>"
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 146.4 s -- in org.apache.hadoop.hbase.io.compress.xz.TestWALCompressionLzma
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0
[INFO] BUILD SUCCESS

these marked as Flakes in failed report and again fail in local and it is not related to our changes.

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -Dhadoop.profile=3.0 -pl hbase-rsgroup test -Dtest='TestRegionMoverWithRSGroupEnable#testUnloadDefaultGroupServerWithRSGroupEnabled+testUnloadRegionsRespectsRSGroup' -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD|==>"
	[ERROR] Tests run: 2, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 31.98 s <<< FAILURE! -- in org.apache.hadoop.hbase.rsgroup.TestRegionMoverWithRSGroupEnable
[ERROR] org.apache.hadoop.hbase.rsgroup.TestRegionMoverWithRSGroupEnable.testUnloadRegionsRespectsRSGroup -- Time elapsed: 7.089 s <<< FAILURE!
org.opentest4j.AssertionFailedError: All 9 regions must be on the single remaining server in the test RSGroup ==> expected: <9> but was: <0>
[ERROR] org.apache.hadoop.hbase.rsgroup.TestRegionMoverWithRSGroupEnable.testUnloadDefaultGroupServerWithRSGroupEnabled -- Time elapsed: 5.142 s <<< FAILURE!
org.opentest4j.AssertionFailedError: Decommissioned default-group server must hold no regions after unload ==> expected: <0> but was: <2>
[ERROR] Failures: 
[ERROR]   TestRegionMoverWithRSGroupEnable.testUnloadDefaultGroupServerWithRSGroupEnabled:256 Decommissioned default-group server must hold no regions after unload ==> expected: <0> but was: <2>
[ERROR]   TestRegionMoverWithRSGroupEnable.testUnloadRegionsRespectsRSGroup:197 All 9 regions must be on the single remaining server in the test RSGroup ==> expected: <9> but was: <0>
[ERROR] Tests run: 2, Failures: 2, Errors: 0, Skipped: 0
[INFO] BUILD FAILURE
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.5.3:test (default-test) on project hbase-rsgroup: There are test failures.
[ERROR] 
[ERROR] See /home/arvindksi274/Opensource-works/hbase/hbase-rsgroup/target/surefire-reports for the individual test results.
[ERROR] See dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -Dhadoop.profile=3.0 -pl hbase-server test -Dtest=TestBufferedMutator#testMultiThread -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD|==>"
	[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 35.48 s <<< FAILURE! -- in org.apache.hadoop.hbase.client.TestBufferedMutator
[ERROR] org.apache.hadoop.hbase.client.TestBufferedMutator.testMultiThread -- Time elapsed: 18.44 s <<< FAILURE!
[ERROR] Failures: 
[ERROR]   TestBufferedMutator.testMultiThread:125 expected: <true> but was: <false>
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
[INFO] BUILD FAILURE
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.5.3:test (default-test) on project hbase-server: There are test failures.
[ERROR] 
[ERROR] See /home/arvindksi274/Opensource-works/hbase/hbase-server/target/surefire-reports for the individual test results.
[ERROR] See dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

JDK8 Hadoop2 (medium)

All failed test passed

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -pl hbase-compression/hbase-compression-xz test -Dtest=TestWALCompressionLzma -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD|==>"
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 141.1 s -- in org.apache.hadoop.hbase.io.compress.xz.TestWALCompressionLzma
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0
[INFO] BUILD SUCCESS

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -pl hbase-server test -Dtest='TestBufferedMutator#testMultiThread,TestMasterRegionFlush#testPeriodicalFlush' -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD|==>"
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.805 s -- in org.apache.hadoop.hbase.master.region.TestMasterRegionFlush
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.73 s -- in org.apache.hadoop.hbase.client.TestBufferedMutator
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0
[INFO] BUILD SUCCESS

arvindksi274@KLP2757:~/Opensource-works/hbase$ mvn -pl hbase-thrift test -Dtest=TestBindExceptionHandling#testProtocolPortClash -DfailIfNoTests=false 2>&1 | grep -E "Tests run|FAIL|ERROR|BUILD|==>"
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.761 s -- in org.apache.hadoop.hbase.thrift.TestBindExceptionHandling
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
[INFO] BUILD SUCCESS

petersomogyi · 2026-09-29T09:28:17Z

Closing. #8652 will be cherry-picked to this branch.

HBASE-30382 Update zstd-jni to 1.5.7-15

cd4910b

petersomogyi closed this Sep 29, 2026

Navigation Menu

HBASE-30382: Update zstd-jni to 1.5.7-15 (branch-2.5) - #8656

HBASE-30382: Update zstd-jni to 1.5.7-15 (branch-2.5)#8656
arvindKandpal-ksolves wants to merge 1 commit into
apache:branch-2.5from
arvindKandpal-ksolves:HBASE-30382-branch-2.5

arvindKandpal-ksolves commented Sep 16, 2026

Uh oh!

arvindKandpal-ksolves commented Sep 17, 2026

Uh oh!

arvindKandpal-ksolves commented Sep 17, 2026

Uh oh!

arvindKandpal-ksolves commented Sep 17, 2026

Uh oh!

arvindKandpal-ksolves commented Sep 24, 2026

Uh oh!

petersomogyi commented Sep 29, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

arvindKandpal-ksolves commented Sep 16, 2026

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

Uh oh!

arvindKandpal-ksolves commented Sep 17, 2026

Uh oh!

arvindKandpal-ksolves commented Sep 17, 2026

Uh oh!

arvindKandpal-ksolves commented Sep 17, 2026

Uh oh!

arvindKandpal-ksolves commented Sep 24, 2026

JDK17 Hadoop3 (medium)

JDK11 Hadoop3 (medium)

JDK8 Hadoop2 (medium)

Uh oh!

petersomogyi commented Sep 29, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants