broadinstitute / cromwell

70%

develop: 95%

LAST BUILD ON BRANCH jg_submit_performance_3

branch: jg_submit_performance_3

CHANGE BRANCH

x

Reset

• jg_submit_performance_3
• 0.19_hotfix
• 0.21
• 0.21_hotfix
• 0.22
• 0.22_hotfix
• 0.7
• 23
• 23_hotfix
• 24
• 24_FC_development
• 24_hotfix
• 25
• 25_hotfix
• 26_hotfix
• 26_hotfix_2
• 26_hotfix_io_retries
• 27_hotfix
• 28.2
• 28_changelog
• 28_hotfix
• 29
• 29_hotfix
• 403_auth_failure
• 910
• CromwellClientFailures
• FixGcrToken
• Papiv2
• PreWom
• PubSubBusinessLogging
• RT-fix
• RT-fix-dev
• acceptJSONAuth
• addSqlToChangelog
• aen_upgrade_import
• allowForDockerTagAndHash
• aws_backend
• batchRequest_29
• batch_limit
• bringChangeFrom24Hotfix
• c14e64d
• call-caching-docs
• call_actor_avoidance
• call_caching_jes_auth
• catchWEADeath
• ccc_testing
• centaur_restart
• cjl_#1097
• cjl_#1435
• cjl_#1463
• cjl_#1479
• cjl_#1587
• cjl_#1596
• cjl_#1597
• cjl_1463_changelog
• cjl_1594
• cjl_1615
• cjl_1802
• cjl_1971
• cjl_2438
• cjl_2438_hotfix
• cjl_2455
• cjl_CCA_strawman
• cjl_DEPRECATED
• cjl_akka_http_10.0.6
• cjl_array_construction_checks
• cjl_backend_retries
• cjl_batch_imports_develop
• cjl_better_validation_messages
• cjl_call_caching_hashing_rebased
• cjl_call_caching_timing_diagrams
• cjl_callcaching_hashing
• cjl_cat_bump
• cjl_cc_task_name_huh
• cjl_centaur_client_test
• cjl_client_publish-fixup
• cjl_coerce_map_to_pairs
• cjl_conditional_changelog
• cjl_conditionals
• cjl_consistent_failure
• cjl_consistent_failure_hotfix
• cjl_cromwell.server
• cjl_cromwell_api_client
• cjl_cromwell_api_client_crosspub
• cjl_decode_responses
• cjl_default_docker_submit_without_redirection
• cjl_default_runtime_attributes_bug
• cjl_define_defined
• cjl_diff_docs
• cjl_disadvertise_allowResultReuse
• cjl_ecs_placeholder
• cjl_ejea_crash_logging
• cjl_ejea_spec_redux
• cjl_empty_array_literals
• cjl_execution_events_for_everybody
• cjl_failure_metadata_migration
• cjl_fingers_in_ears
• cjl_fixup_examples.conf
• cjl_flaky_test_2193
• cjl_flatmapn
• cjl_flatten_causedBy_metadata
• cjl_give_FilePassingWorkflowSpec_more_time
• cjl_if_then_else
• cjl_ifthenelse_changelog
• cjl_ignore_bad_test
• cjl_imports
• cjl_invalidate_bad_cache_fix
• cjl_jes_6_day_limit
• cjl_jes_api_query_manager
• cjl_jes_glob_fix
• cjl_jes_polling_batches
• cjl_less_scary_logging
• cjl_metadata_in_memory
• cjl_more_clienty_bits
• cjl_optionalInputs
• cjl_optional_file_size
• cjl_optional_files
• cjl_optional_types
• cjl_optionals_and_defaults
• cjl_pairs
• cjl_pullapprove_fixup
• cjl_query_responses
• cjl_reformat_ccdiff
• cjl_remove_SubWorkflowStoreCompleteSuccess
• cjl_remove_semicolons
• cjl_remove_semicolons_develop
• cjl_runtime_attributes_in_backends
• cjl_safer_namespace_loading
• cjl_shhhhh_it_down
• cjl_simple_cache_hit_metadatum
• cjl_sneaky_test
• cjl_test
• cjl_test_centaur_cjl_optional_arrays
• cjl_test_upgrade
• cjl_the_globbit
• cjl_token_dispenser
• cjl_trim_md5_files
• cjl_wdl4s_bump
• cjl_womtool_inputs
• cjl_workflow_id_label
• cjl_workflow_labels
• cjl_workflow_name_limit
• cjl_write_lines_jes
• cleanUpDockerLookup
• compose
• cromwell-1079
• cromwell-1087
• cromwell-1187
• cromwell-1266
• cromwell-1270
• cromwell-1308
• cromwell-1325
• cromwell-1383
• cromwell-1386
• cromwell-1483
• cromwell-1501
• cromwell-1510
• cromwell-1523
• cromwell-1593
• cromwell-1617
• cromwell-1691
• cromwell-1754
• cromwell-1785
• cromwell-1817
• cromwell-1848
• cromwell-1886
• cromwell-1932
• cromwell-1938
• cromwell-1950
• cromwell-1978
• cromwell-1982
• cromwell-1990
• cromwell-1990v2
• cromwell-1999
• cromwell-2000
• cromwell-2033
• cromwell-2066
• cromwell-2079
• cromwell-2094
• cromwell-2145
• cromwell-2292
• cromwell-2309
• cromwell-2373
• cromwell-2453
• cromwell-2467
• cromwell-2475
• cromwell-2483
• cromwell-2525
• cromwell-2535
• cromwell-2570
• cromwell-3552
• cromwell-789
• cromwell-922
• cromwell-initialization-fix
• cromwomification
• db_wdl4s_symlink_update
• deb_add_pull_approve
• declaration_evaluation
• develop
• develop_test
• dockerCacheMode
• docker_mysql
• dont_override_events
• dont_override_events_23
• eventsFix
• eventsFixFor22
• eventually15s
• eventually2
• eventually3
• eventually30s
• executionStoreImp
• failHashIfFileNotFound
• firecloud
• fixCallCacheDiff
• fixCallCachingDiff28Hotix
• fixCentaurLocalLocalization
• fixContinueWhilePossible
• fixDockerDeadlocok
• fixRcErrorHandling
• fixRetry
• fixTimingDiagram26
• fixWorkflowName
• fmc-PBE-Interfaces
• fmc_HtCondorAsConfBackend
• fmc_cachingSL
• fmc_dockerBashCmdFix
• fmc_htCondorDockerConf
• fmc_htCondorNativeSpecs
• fmc_htCondorWorkingDir
• fmc_htCondor_dockerConf
• fmc_localizationLogging
• fmc_queryPostAPIFix
• full_uris_in_md
• gks-htcondor-abort
• google_auth
• hf_logback
• hf_logback_dev
• ioActor2
• ioActor2wgcsScope
• ioActorOnIoDispatcher
• jesExecutionEvents
• jg_1375
• jg_1770
• jg_1795
• jg_1811
• jg_1829
• jg_1835
• jg_1851
• jg_1870
• jg_1893
• jg_add_dispatchers
• jg_add_sentry
• jg_add_some_stats
• jg_add_travis_caching
• jg_akka_http
• jg_akka_http_2
• jg_bring_back_binding_default
• jg_broader_travis
• jg_bump_akka
• jg_centaur
• jg_centaur_2
• jg_centaur_3
• jg_coursier
• jg_cromwell_24_bump
• jg_flush_it_real_good
• jg_flush_it_real_good_2
• jg_flush_it_real_good_3
• jg_flush_it_real_good_4
• jg_for_jose
• jg_gzip_as_requested
• jg_jes_config_whitelist
• jg_local_centaur_travis
• jg_lots_o_cherry_picks
• jg_moar_dispatchers
• jg_more_testkit_removals
• jg_move_lenthall_spray_here
• jg_multiple_submit_workers
• jg_no_mainspec_travis
• jg_pre_restart
• jg_rc
• jg_readme_config
• jg_replace_runWdl
• jg_restrict_metadata
• jg_revert_swagger
• jg_rollback_2
• jg_scala_2_12_no_unused
• jg_services_use_dispatchers
• jg_status_endpoint
• jg_submit_performance
• jg_submit_performance_2
• jg_test_centaur
• jg_test_ec
• jg_test_ec_2
• jg_test_ec_30
• jg_test_new_centaur
• jg_test_some_stuff
• jg_testing_centaur_akka_http
• jg_things_that_make_you_go_hmmmm
• jg_tunable_batch_interval
• jg_unexpected_actor_death
• jg_update_logback
• jg_update_wdl4s_no_repeat_fqn
• jg_upgrade_akka
• jg_upgrade_scala
• jg_use_grpc_codes
• jg_workflow_name
• js_2178
• js_2178_fix_double_quotes
• js_crapola
• js_crude_validation
• js_green_inte
• js_green_integration
• js_interloper_pullapprove
• js_job_store_extra_quotation
• js_job_store_extra_quotation_develop
• js_test_develop
• js_test_test
• js_update_readme_paths
• js_wdlfile_validation
• jsonFormatForOptional
• jt_0.21
• jt_ref_comments
• kc_no_restart
• kc_sbt_docker
• kc_sbt_docker2
• kc_sbt_docker_compose
• kc_scale
• kc_svc_acct_1656
• ks_1965_harden
• ks_1980_patch
• ks_2017_edit
• ks_actor_singletons_to_system
• ks_allow_backends
• ks_allow_dotted_dirs
• ks_app_conf_diff
• ks_app_conf_readme
• ks_async_aws
• ks_bad_file_string
• ks_catch_runnable_scopes
• ks_causal_auth_failures
• ks_ci_refactor
• ks_client_pass_options
• ks_client_pass_options_take_2
• ks_client_pass_options_take_3
• ks_concurrent_jobs_for_all
• ks_conf_and_db_tests
• ks_config_tmpdir
• ks_debug_potpourri
• ks_dependency_patch
• ks_disable_type_annotation_inspections
• ks_doc_update
• ks_docker_push
• ks_docker_push_0.21_hotfix
• ks_docker_push_0.22_hotfix
• ks_docker_tag_caas
• ks_dockerize_paths
• ks_dont_hardcode_rest_workflow_type
• ks_encrypt_options
• ks_encrypt_options_0.22
• ks_encrypt_options_hotfix
• ks_exclude_scalacheck_again
• ks_fix_and_test_docs
• ks_glob_standard
• ks_handle_non_200
• ks_liquibase_then_bind
• ks_liquibase_updates
• ks_local_docker_hash
• ks_metadata_refresh_bug
• ks_metadata_service
• ks_move_version_endpoint
• ks_mysql_empty_lobs
• ks_patches
• ks_pin_centaur_0.21_hotfix
• ks_pin_centaur_0.22_hotfix
• ks_pin_centaur_develop
• ks_potpourri
• ks_println_pem_489f66b
• ks_publish_develop_docker
• ks_reduce_synchronization
• ks_reference_conf
• ks_remove_deprecated_code
• ks_rename_binding_timeout
• ks_report_bad_inputs
• ks_restore_backend_status
• ks_restore_backend_status_24
• ks_restore_external_tests
• ks_resync_slick_liquibase
• ks_rm_jes_copying
• ks_rm_jes_copying_2
• ks_rm_wf_inputs
• ks_runtime_attribute_edits
• ks_sfs_cache_copy_method_wip
• ks_sfs_copying
• ks_slick_3_2
• ks_snap
• ks_standard_async
• ks_standard_backend
• ks_standard_backend_w_jes
• ks_std_back_abort_patch
• ks_store_custom_labels_25_hotfix
• ks_store_custom_labels_develop
• ks_summary_status
• ks_swra_default_shutdown
• ks_tes_log_info
• ks_tes_patch
• ks_test_build_updates
• ks_test_bump_dependencies
• ks_test_docker_vault
• ks_timeout_changelog
• ks_warn_jes_aes
• ks_workflow_type_take_2
• ks_ya_examples_update
• kv_crom28_bug
• kv_crom29_relnotes
• kv_doc_con-job
• kv_readme
• kv_readme_cli
• lessHashing
• link_cromwell_branch_to_centaur
• master
• mc-rm_executionStore_query
• meow_mix
• metadata_htcondor_1454
• mlc_28_preemptible_Fix
• mlc_aws_io
• mlc_aws_one_task
• mlc_borked_abort
• mlc_burn_the_boats
• mlc_caching_batching
• mlc_call_caching_perf
• mlc_cold_hard_cache
• mlc_config_cwl_gull
• mlc_confirm_preemptible
• mlc_dekv
• mlc_develop_preemptible_fix
• mlc_docker_hashifact
• mlc_docker_library_27
• mlc_docker_library_develop
• mlc_docs
• mlc_ejea_abort_fixes
• mlc_embiggen_metadata_value
• mlc_expt
• mlc_ficus
• mlc_fix_prefix
• mlc_flags
• mlc_gcs_fail_on_underscores
• mlc_its_good_to_have_scoptions
• mlc_job_store_batching
• mlc_jobstore_tinyint
• mlc_jt_fixes
• mlc_kill_docker_stuff_for_realz
• mlc_length_nee_size
• mlc_log_it_just_in_case
• mlc_metric_shardload
• mlc_monad_xformers
• mlc_mwda_or_bust
• mlc_no_aws
• mlc_no_pipe_stripping
• mlc_nohash
• mlc_non_root
• mlc_notroot_legit
• mlc_nullable_job_store_simpleton_values
• mlc_nullable_job_store_simpleton_values_develop
• mlc_only_check_stderr_if_fail_on_stderr
• mlc_patvars
• mlc_post_post_mvp
• mlc_release_subprojected_wdl4s
• mlc_responsive_after_db_issue
• mlc_responsive_after_db_issue_develop
• mlc_ribbit
• mlc_sink_sync_develop
• mlc_sink_sync_hotfix
• mlc_son_of_sleepy_aws
• mlc_subworkflows_are_people_too
• mlc_test
• mlc_testing
• mlc_trailing_newlines_plz
• mlc_trusty_edge
• mlc_trusty_edge_deux
• mlc_undo_21
• mlc_unstick_abort_develop
• mlc_unstick_abort_hotfix
• mlc_usable_console
• mlc_users_other_than_root
• mlc_wdl_b_gone
• mlc_wdlsource_oopsie
• mlc_wom_it_up
• mlc_workflow_before_job
• mlc_workflow_failure_mode_fix
• mlc_workflow_name_embiggen_0.22
• mlc_workflow_name_embiggen_develop
• mlc_workflow_names_really_should_not_be_crazy_long_they_overflow_reasonably_sized_database_columns
• mlc_workflow_type
• moarRetries
• moreRetries
• more_failure_context
• nb_run_tests
• nio-actor
• null_rendering
• papi_staging
• quay
• release-0.22
• releaseCromwellOnGithub
• release_candidate_23
• renameWorkflowOptionsInMD
• rm_1737
• rm_1737Fix
• rm_1920
• rm_1958
• rm_2297
• rm_23
• rm_2597
• rm_2597_29h
• rm_25_labels_db_update
• rm_25docs
• rm_908
• rm_WEA
• rm_WEA_update
• rm_addLabels
• rm_add_inputs
• rm_auth_test
• rm_centaur
• rm_centaurTest
• rm_centaur_changes
• rm_centaur_testing
• rm_centaur_tests
• rm_collectorFix_develop
• rm_collectorKey_fix_0.21
• rm_collectorKey_fix_0.22
• rm_copyLogs
• rm_copyWfLogs
• rm_copyWfLogs2
• rm_cromwell_SWRM
• rm_detritus_bug
• rm_dev_labels_update
• rm_develop
• rm_fc_project
• rm_gcs_project
• rm_globbing
• rm_gotcBuild
• rm_gotc_build
• rm_idea_2
• rm_jesStaging
• rm_jes_copying
• rm_jes_staging
• rm_labelValidation
• rm_labels_cromwellClient
• rm_labels_fix
• rm_mlc_copyingJobOutputsRebase
• rm_monitoring
• rm_new
• rm_optionalRuntimeAttrs_develop
• rm_query-labels
• rm_release
• rm_releaseNotes_21
• rm_rerun_centaur
• rm_sleepBranchTest
• rm_stdout
• rm_temp
• rm_testTes
• rm_turnOnCaching
• rm_update_detritus_value
• rm_update_detritus_value_24
• rm_validateOptions
• rm_versioning
• rm_wf_inputs
• rollbackUnderscores
• sdf_backend_factory
• sdf_call_stdout
• sparkbackend_minorfixes
• speedTest
• ss_exclude_labels
• ss_scale_whitelist_bucket
• staging
• subWorkflowDocs
• subworkflow2
• syncFS
• tes_failure
• testCentaur
• tj-27_hotfix-docker-cache-mode
• tj-allowResultReuse
• tj-cc-changelog
• tj-cromwell-client-version
• tj-dependency-update
• tj-fix-27
• tj-fixAllowResultReuse
• tj-mem-leak
• tj-test-flakiness
• tj_dockerfix_v2_26_hotfix
• tj_dockerfix_v2_26_hotfix_2
• tj_local_docker_hash
• tj_release
• tn-credentials
• travis_updates
• try_tyranny_you_might_like_it
• type_syntax
• updateAllowResultReuse
• updateDockerLookup
• updateGoogleNio
• updateTravis
• update_release_wdl
• wdl4sUpdate
• wdl4s_rebase
• wfNameTest
• womification
• zoneb

Build # 11733

Build Type

push

travis-ci

Committed by geoffjentry

Commit Message

Rework structure of workflow store and metadata, provides roughly 5-fold performance increase under load prior to DB gumming up

Run Details

4892 of 7019 relevant lines covered (69.7%)

0.7 hits per line