couchbase
/
moss
/
83
/
1
83%
master: 83%
master: 83%
|
Ran
|
Files
17
|
Run time
1s
|
Badge
Embed ▾
README BADGES
|
coverage: 84.693% (-0.3%) from 84.97%
push
travis-ci
steveyenadded store related benchmarks There are multiple phases in each test... - open - opening a store - load - initial data load of items, at least to memory (all items are accessible through the API, but not necessarily persisted yet) - access - perform some accesses (e.g., mutations) - drain - wait for all dirty items to be persisted - close - close the store - reopen - reopen the store - iter - scan the entire store Both read and write stats are tracked. The default compaction setting at this time is aggressively "compact all the time", so final file size is after last compaction. Final file size "amplication" shows how large the file is compared to just the space the raw keys and vals would have taken. Some results from osx laptop, 16GB ram, ssd... $ go test -bench=BenchmarkStore PASS BenchmarkStore_numItems1M_keySize20_valSize100_batchSize100-8 spec: {numItems:1000000 keySize:20 valSize:100 batchSize:100 accesses:[]} open time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s load time: 1073 (ms), phase 931966 wop/s, 109214 wkb/s, 0 rop/s, 0 rkb/s, cum 931966 wop/s, 109214 wkb/s, 0 rop/s, 0 rkb/s drain time: 189 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 792393 wop/s, 92858 wkb/s, 0 rop/s, 0 rkb/s close time: 78 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 792393 wop/s, 92858 wkb/s, 0 rop/s, 0 rkb/s reopen time: 1 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 792393 wop/s, 92858 wkb/s, 0 rop/s, 0 rkb/s iter time: 170 (ms), phase 0 wop/s, 0 wkb/s, 5881770 rop/s, 689269 rkb/s, cum 792393 wop/s, 92858 wkb/s, 5881770 rop/s, 689269 rkb/s close time: 3 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 792393 wop/s, 92858 wkb/s, 5881770 rop/s, 689269 rkb/s total time: 1514 (ms) file size: 135 (mb), amplification: 1.133 1 1526601810 ns/op BenchmarkStore_numItems1M_keySize20_valSize100_batchSize100_ACCESSES_domain100K_ops200K_batchSize100-8 spec: {numItems:1000000 keySize:20 valSize:100 batchSize:100 accesses:[{domain:100000 ops:200000 batchSize:100}]} open time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s load time: 1051 (ms), phase 951474 wop/s, 111500 wkb/s, 0 rop/s, 0 rkb/s, cum 951474 wop/s, 111500 wkb/s, 0 rop/s, 0 rkb/s access time: 236 (ms), phase 847457 wop/s, 99311 wkb/s, 0 rop/s, 0 rkb/s, cum 932400 wop/s, 109265 wkb/s, 0 rop/s, 0 rkb/s drain time: 279 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 766283 wop/s, 89798 wkb/s, 0 rop/s, 0 rkb/s close time: 99 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 766283 wop/s, 89798 wkb/s, 0 rop/s, 0 rkb/s reopen time: 1 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 766283 wop/s, 89798 wkb/s, 0 rop/s, 0 rkb/s iter time: 182 (ms), phase 0 wop/s, 0 wkb/s, 5583983 rop/s, 654373 rkb/s, cum 766283 wop/s, 89798 wkb/s, 5583983 rop/s, 654373 rkb/s close time: 3 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 766283 wop/s, 89798 wkb/s, 5583983 rop/s, 654373 rkb/s total time: 1851 (ms) file size: 151 (mb), amplification: 1.263 1 1866549009 ns/op BenchmarkStore_numItems1M_keySize20_valSize100_batchSize10000-8 spec: {numItems:1000000 keySize:20 valSize:100 batchSize:10000 accesses:[]} open time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s load time: 463 (ms), phase 2159827 wop/s, 253104 wkb/s, 0 rop/s, 0 rkb/s, cum 2159827 wop/s, 253104 wkb/s, 0 rop/s, 0 rkb/s drain time: 114 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1733102 wop/s, 203097 wkb/s, 0 rop/s, 0 rkb/s close time: 95 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1733102 wop/s, 203097 wkb/s, 0 rop/s, 0 rkb/s reopen time: 1 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1733102 wop/s, 203097 wkb/s, 0 rop/s, 0 rkb/s iter time: 165 (ms), phase 0 wop/s, 0 wkb/s, 6000006 rop/s, 703125 rkb/s, cum 1733102 wop/s, 203097 wkb/s, 6000006 rop/s, 703125 rkb/s close time: 3 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1733102 wop/s, 203097 wkb/s, 6000006 rop/s, 703125 rkb/s total time: 841 (ms) file size: 134 (mb), amplification: 1.122 spec: {numItems:1000000 keySize:20 valSize:100 batchSize:10000 accesses:[]} open time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s load time: 457 (ms), phase 2188183 wop/s, 256427 wkb/s, 0 rop/s, 0 rkb/s, cum 2188183 wop/s, 256427 wkb/s, 0 rop/s, 0 rkb/s drain time: 326 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1277139 wop/s, 149664 wkb/s, 0 rop/s, 0 rkb/s close time: 173 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1277139 wop/s, 149664 wkb/s, 0 rop/s, 0 rkb/s reopen time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1277139 wop/s, 149664 wkb/s, 0 rop/s, 0 rkb/s iter time: 133 (ms), phase 0 wop/s, 0 wkb/s, 7443616 rop/s, 872298 rkb/s, cum 1277139 wop/s, 149664 wkb/s, 7443616 rop/s, 872298 rkb/s close time: 3 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1277139 wop/s, 149664 wkb/s, 7443616 rop/s, 872298 rkb/s total time: 1092 (ms) file size: 134 (mb), amplification: 1.122 spec: {numItems:1000000 keySize:20 valSize:100 batchSize:10000 accesses:[]} open time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s load time: 450 (ms), phase 2222222 wop/s, 260416 wkb/s, 0 rop/s, 0 rkb/s, cum 2222222 wop/s, 260416 wkb/s, 0 rop/s, 0 rkb/s drain time: 158 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1644736 wop/s, 192742 wkb/s, 0 rop/s, 0 rkb/s close time: 96 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1644736 wop/s, 192742 wkb/s, 0 rop/s, 0 rkb/s reopen time: 1 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1644736 wop/s, 192742 wkb/s, 0 rop/s, 0 rkb/s iter time: 164 (ms), phase 0 wop/s, 0 wkb/s, 6036591 rop/s, 707413 rkb/s, cum 1644736 wop/s, 192742 wkb/s, 6036591 rop/s, 707413 rkb/s close time: 3 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1644736 wop/s, 192742 wkb/s, 6036591 rop/s, 707413 rkb/s total time: 872 (ms) file size: 134 (mb), amplification: 1.122 2 994814701 ns/op BenchmarkStore_numItems10M_keySize20_valSize100_batchSize1000-8 spec: {numItems:10000000 keySize:20 valSize:100 batchSize:1000 accesses:[]} open time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s load time: 10482 (ms), phase 954016 wop/s, 111798 wkb/s, 0 rop/s, 0 rkb/s, cum 954016 wop/s, 111798 wkb/s, 0 rop/s, 0 rkb/s drain time: 1565 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 830082 wop/s, 97275 wkb/s, 0 rop/s, 0 rkb/s close time: 335 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 830082 wop/s, 97275 wkb/s, 0 rop/s, 0 rkb/s reopen time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 830082 wop/s, 97275 wkb/s, 0 rop/s, 0 rkb/s iter time: 1888 (ms), phase 0 wop/s, 0 wkb/s, 5296081 rop/s, 620634 rkb/s, cum 830082 wop/s, 97275 wkb/s, 5296081 rop/s, 620634 rkb/s close time: 28 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 830082 wop/s, 97275 wkb/s, 5296081 rop/s, 620634 rkb/s total time: 14298 (ms) file size: 1359 (mb), amplification: 1.133 1 14408308338 ns/op BenchmarkStore_numItems10M_keySize20_valSize100_batchSize10000-8 spec: {numItems:10000000 keySize:20 valSize:100 batchSize:10000 accesses:[]} open time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s load time: 7007 (ms), phase 1427144 wop/s, 167243 wkb/s, 0 rop/s, 0 rkb/s, cum 1427144 wop/s, 167243 wkb/s, 0 rop/s, 0 rkb/s drain time: 2881 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1011326 wop/s, 118514 wkb/s, 0 rop/s, 0 rkb/s close time: 320 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1011326 wop/s, 118514 wkb/s, 0 rop/s, 0 rkb/s reopen time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1011326 wop/s, 118514 wkb/s, 0 rop/s, 0 rkb/s iter time: 1791 (ms), phase 0 wop/s, 0 wkb/s, 5577890 rop/s, 653658 rkb/s, cum 1011326 wop/s, 118514 wkb/s, 5577890 rop/s, 653658 rkb/s close time: 29 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 1011326 wop/s, 118514 wkb/s, 5577890 rop/s, 653658 rkb/s total time: 12028 (ms) file size: 1358 (mb), amplification: 1.132 1 12138806651 ns/op BenchmarkStore_numItems50M_keySize20_valSize100_batchSize10000-8 spec: {numItems:50000000 keySize:20 valSize:100 batchSize:10000 accesses:[]} open time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s load time: 44601 (ms), phase 1121051 wop/s, 131373 wkb/s, 0 rop/s, 0 rkb/s, cum 1121051 wop/s, 131373 wkb/s, 0 rop/s, 0 rkb/s drain time: 19684 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 777786 wop/s, 91146 wkb/s, 0 rop/s, 0 rkb/s close time: 345 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 777786 wop/s, 91146 wkb/s, 0 rop/s, 0 rkb/s reopen time: 1 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 777786 wop/s, 91146 wkb/s, 0 rop/s, 0 rkb/s iter time: 17510 (ms), phase 0 wop/s, 0 wkb/s, 2854940 rop/s, 334563 rkb/s, cum 777786 wop/s, 91146 wkb/s, 2854940 rop/s, 334563 rkb/s close time: 153 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 777786 wop/s, 91146 wkb/s, 2854940 rop/s, 334563 rkb/s total time: 82294 (ms) file size: 6798 (mb), amplification: 1.133 1 82827836353 ns/op BenchmarkStore_numItems50M_keySize20_valSize100_batchSize10000_ACCESSES_domain100K_ops1M_batchSize10K-8 spec: {numItems:50000000 keySize:20 valSize:100 batchSize:10000 accesses:[{domain:100000 ops:1000000 batchSize:10000}]} open time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s load time: 45385 (ms), phase 1101685 wop/s, 129103 wkb/s, 0 rop/s, 0 rkb/s, cum 1101685 wop/s, 129103 wkb/s, 0 rop/s, 0 rkb/s access time: 475 (ms), phase 2105263 wop/s, 246710 wkb/s, 0 rop/s, 0 rkb/s, cum 1112080 wop/s, 130321 wkb/s, 0 rop/s, 0 rkb/s drain time: 19657 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 778423 wop/s, 91221 wkb/s, 0 rop/s, 0 rkb/s close time: 231 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 778423 wop/s, 91221 wkb/s, 0 rop/s, 0 rkb/s reopen time: 2 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 778423 wop/s, 91221 wkb/s, 0 rop/s, 0 rkb/s iter time: 18656 (ms), phase 0 wop/s, 0 wkb/s, 2685366 rop/s, 314691 rkb/s, cum 778423 wop/s, 91221 wkb/s, 2685366 rop/s, 314691 rkb/s close time: 159 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 778423 wop/s, 91221 wkb/s, 2685366 rop/s, 314691 rkb/s total time: 84565 (ms) file size: 6825 (mb), amplification: 1.138 1 85143346124 ns/op BenchmarkStore_numItems100M_keySize20_valSize100_batchSize10000-8 spec: {numItems:100000000 keySize:20 valSize:100 batchSize:10000 accesses:[]} open time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s load time: 115334 (ms), phase 867047 wop/s, 101607 wkb/s, 0 rop/s, 0 rkb/s, cum 867047 wop/s, 101607 wkb/s, 0 rop/s, 0 rkb/s drain time: 105121 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 453607 wop/s, 53157 wkb/s, 0 rop/s, 0 rkb/s close time: 1098 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 453607 wop/s, 53157 wkb/s, 0 rop/s, 0 rkb/s reopen time: 5 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 453607 wop/s, 53157 wkb/s, 0 rop/s, 0 rkb/s iter time: 40163 (ms), phase 0 wop/s, 0 wkb/s, 2489604 rop/s, 291750 rkb/s, cum 453607 wop/s, 53157 wkb/s, 2489604 rop/s, 291750 rkb/s close time: 260 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 453607 wop/s, 53157 wkb/s, 2489604 rop/s, 291750 rkb/s total time: 261981 (ms) file size: 13598 (mb), amplification: 1.133 1 263083885126 ns/op ok github.com/couchbase/moss 464.769s Change-Id: I92611eb73 Reviewed-on: http://review.couchbase.org/66135 Reviewed-by: Marty Schoch <marty.schoch@gmail.com> Tested-by: Steve Yen <steve.yen@gmail.com>
1837 of 2169 relevant lines covered (84.69%)
11466.75 hits per line
