HikariCP:从BoneCP迁移并分析基准数据

我正在测试从BoneCP到HikariCP的迁移.

基准(HikariCP Benchmark)的结果如下:

Benchmark                                 (maxPoolSize)  (pool)   Mode  Samples      Score  Score error   Units
c.z.h.b.ConnectionBench.cycleCnnection               32  hikari  thrpt       16   1033,071       38,893  ops/ms
c.z.h.b.ConnectionBench.cycleCnnection               32    bone  thrpt       16   1648,954       42,610  ops/ms
c.z.h.b.ConnectionBench.cycleCnnection               32  tomcat  thrpt       16    592,838       21,709  ops/ms
c.z.h.b.ConnectionBench.cycleCnnection               32    c3p0  thrpt       16    125,857        3,666  ops/ms
c.z.h.b.ConnectionBench.cycleCnnection               32   vibur  thrpt       16    831,693        9,299  ops/ms
c.z.h.b.StatementBench.cycleStatement                32  hikari  thrpt       16  49983,959     4796,385  ops/ms
c.z.h.b.StatementBench.cycleStatement                32    bone  thrpt        8   7022,146      526,111  ops/ms
c.z.h.b.StatementBench.cycleStatement                32  tomcat  thrpt       16  28777,731     1011,316  ops/ms
c.z.h.b.StatementBench.cycleStatement                32    c3p0  thrpt       16   3367,641      137,937  ops/ms
c.z.h.b.StatementBench.cycleStatement                32   vibur  thrpt       16   1739,060       45,451  ops/ms

我认为分数越高越好,所以:

为什么HikariCP中的cycleConnection比BoneCP低？

考虑到cycleConnection结果,cycleStatement结果是否足以更好地迁移到HikariCP？

分数错误列的含义是什么？

这些主题中的任何提示,建议等或相关的HikariCP迁移对我都非常有帮助.

非常感谢

第一次更新:

@brettw,谢谢你的建议,并祝贺你的出色工作.

我昨晚用nohup ./benchmark.sh做了一个完整的运行&得到了这些结果:

Benchmark                                 (maxPoolSize)  (pool)   Mode  Samples      Score  Score error   Units
c.z.h.b.ConnectionBench.cycleCnnection               32  hikari  thrpt      150    965,017       27,307  ops/ms
c.z.h.b.ConnectionBench.cycleCnnection               32    bone  thrpt      150   1528,097       26,963  ops/ms
c.z.h.b.ConnectionBench.cycleCnnection               32  tomcat  thrpt      150    473,702        8,068  ops/ms
c.z.h.b.ConnectionBench.cycleCnnection               32    c3p0  thrpt      150    108,527        1,591  ops/ms
c.z.h.b.ConnectionBench.cycleCnnection               32   vibur  thrpt      150    740,603       14,556  ops/ms
c.z.h.b.StatementBench.cycleStatement                32  hikari  thrpt       60  47998,292     3112,217  ops/ms
c.z.h.b.StatementBench.cycleStatement                32    bone  thrpt      120   6210,647      110,100  ops/ms
c.z.h.b.StatementBench.cycleStatement                32  tomcat  thrpt      150  25919,389      437,232  ops/ms
c.z.h.b.StatementBench.cycleStatement                32    c3p0  thrpt      150   3074,133       62,629  ops/ms
c.z.h.b.StatementBench.cycleStatement                32   vibur  thrpt      150   1517,554       25,027  ops/ms

查看扩展输出,我在日志中看到这个异常堆栈跟踪6次:

Iteration  15: [com.zaxxer.hikari.benchmark.StatementBench.cycleStatement-jmh-worker-7] INFO com.zaxxer.hikari.pool.HikariPool - HikariCP pool HikariPool-0 is shutting
down.


java.lang.IllegalStateException: Attempt to remove an object from the bag that was not borrowed or reserved
        at com.zaxxer.hikari.util.ConcurrentBag.remove(ConcurrentBag.java:207)
        at com.zaxxer.hikari.pool.HikariPool.closeConnection(HikariPool.java:394)
        at com.zaxxer.hikari.pool.HikariPool.releaseConnection(HikariPool.java:223)
        at com.zaxxer.hikari.proxy.ConnectionProxy.close(ConnectionProxy.java:216)
        at com.zaxxer.hikari.benchmark.StatementBench$ConnectionState.teardown(StatementBench.java:63)
        at com.zaxxer.hikari.benchmark.generated.StatementBench_cycleStatement.cycleStatement_Throughput(StatementBench_cycleStatement.java:100)
        at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.openjdk.jmh.runner.LoopBenchmarkHandler$BenchmarkTask.call(LoopBenchmarkHandler.java:204)
        at org.openjdk.jmh.runner.LoopBenchmarkHandler$BenchmarkTask.call(LoopBenchmarkHandler.java:186)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

最后,我回答你帖子中的其他主题:

pom.xml已更新为快速和完整执行.

干净启动后无法执行测试.

有一个带有Web应用程序的Tomcat服务器.在测试执行期间,计算机既没有高负载也没有运行繁重的过程.

JDK版本是jdk1.7.0_67

Linux是x86_64-redhat-linux-gnu

CPU型号是Intel(R)Xeon(R)CPU E5-2690 0 @ 2.90GHz

也许是一个重要问题:测试已经在虚拟机中运行,并与VMWare一起部署.

再次感谢

第二次更新:关于迁移的问题已经变为另一个关于虚拟化和基准测试的问题,这也是有趣且有用的.

到现在为止,我必须关注虚拟环境.当我有一点时间的时候,我将在真实和直接的环境中运行测试,我将把结果带到这里.我打赌这些测试会将HikariCP显示为最佳连接池.

@brettw,谢谢你的支持和你的态度.