projecthydra-labs / hyku

93%

master: 94%

LAST BUILD ON BRANCH job_chaining

branch: job_chaining

CHANGE BRANCH

x

Reset

• job_chaining
• 1023-index_metadata
• 247-user-list
• 421-group-management
• 467-group-breadcrumbs
• 483-rename-roles-and-permissions
• 522-my-works-visibility
• 532-duplicate_facet_chevron
• 574-content-blocks
• 611-repository-level-access-controls
• 634-move-review-page-under-tasks
• 725_invite_acct_admins
• 877-add_image_extent
• 982-admin-menu-submenu-items
• Cleanup_Admin_UsersController
• ability-cleanup
• about_page
• account_create_steps
• account_creation_validation
• accounts
• accounts_forms
• active-fedora-update
• activity
• add_chinese_translations_1060
• add_gh_templates
• add_load_workflows_button_to_admin_ui
• add_notion_of_versions
• add_spanish_translations
• add_tabbed_content_blocks
• add_workflow_roles_to_sidebar
• adding-i18n-debug
• admin_groups
• admin_host
• any_flavor_iiif
• apartment_initializer
• awful_monkeypatch_to_workaround_outdated_hyrax_assumption_for_chicago_workshop_tomorrow
• big_pool
• bump_version
• cache_headers
• canonical_image
• carrierwave_aws
• catch_404
• cbeer-patch-1
• cbeer-patch-2
• change_how_column_existence_is_checked
• cleanup_redis_on_tenant_deletion
• completely_revert
• compress_theme
• compress_uv
• controllers-hyrax-with-breadcrumbs
• create_default_admin_set_after_tenant_created
• create_default_admin_set_per_tenant_882
• default-superadmin
• default_host
• disable_redis_cluster_for_dev
• docker
• docker-redis
• dot_keep
• drop_account_title
• duplicate_review
• expand_section
• featured-researcher-displays-twice-555
• fits-1.1.0
• fix_assets
• fix_create_tenant
• fix_deprecation
• fix_group_add_users_form_837
• fix_mailbox
• fix_notifications
• fix_redis_config
• fix_sidebar
• fix_spanish_image_translation
• fix_system_status_display
• fix_tenant_cleanup_job
• fix_tenant_deletion
• fix_turbolinks
• fix_user_layout
• fix_view
• fog_provider
• fog_storage
• geonames_username
• groups_header
• gzip
• honeybadger_job
• hyrax
• hyrax-generate-collection
• hyrax-generate-models
• hyrax_update
• iiif_thumbnails
• import_from_purl
• ingore_pg
• inline_account_creation
• invalid_locale
• jcoyne-patch-1
• jcoyne-patch-2
• jquery3
• latest_json
• libraries
• link_to_dev_guide
• linked_data
• load_workflows
• logzio
• lucene
• master
• menu_presenter
• merge_appearance
• migrate
• missing_migration
• missing_migrations
• mjgiarlo-patch-1
• monkeypatch_for_workshop_tomorrow
• mount_qa
• multitenant-admin-accounts
• mutlitenancy_in_test
• navbar-height
• new-tabls
• nginx
• nil_connection
• no-quotes
• no_dupe_cname
• no_dupe_cname_db
• no_rescue
• no_settings
• no_tasks
• no_turbolinks_on_links_to_tinymce_views
• only_show_system_status_to_admins_967
• parse_error
• pass_account_to_admin_set_job
• per_should_not_be_0
• pick_up_fixed_file_set_labels_from_hyrax
• pin_tight
• postgres-hyku-namespace
• qa_migrations
• rails-5-0-3
• rails_s_bind
• redis
• reduce-height-brandbar
• redundant_filter
• referential_integrity
• released_flipflop
• remove-duplicate-include
• remove-unnecessary-space-below-header
• remove_config
• remove_deprecated_method
• remove_id_selector
• remove_noid
• remove_solr
• reorder_sidebar
• restore_cluster
• retry_conflict
• revert-970-monkeypatch_for_workshop_tomorrow
• revert_1090
• revert_970
• revert_callback_change
• revert_navbar_height
• revert_no_rescue
• revert_sentinel
• scss-lint
• search_for
• separate
• setup
• show_extent_on_show_page
• show_solr_doc
• sidebar_collapse
• sidebar_expand
• site_elements_banner_button
• smaller_default_thumbnail_size
• solr-dedup-configs
• solr-hyku-namespace
• solr_url
• spec_cleanup
• streamline_config
• superadmin_task
• switch_all_or_bust
• tests
• to_prepare
• todos
• trap_404
• travis-tweaks
• trim_comment_in_config
• trivial_comment
• tune_reporting
• tweak_gemfile
• undefined-method-bubbles
• update
• update-aej
• update-dependencies
• update-rails
• update_active_fedora
• update_copyright_override
• update_dependencies
• update_hyrax
• update_hyrax_20170510
• update_hyrax_20170512_take_two
• update_hyrax_add_blacklight_translations
• update_hyrax_and_workflow_json
• update_hyrax_apr25
• update_hyrax_dependency_for_workflow_task
• update_hyrax_march2nd
• update_hyrax_mayfifteen
• update_hyrax_to_fix_1040
• update_hyrax_to_latest
• update_importer
• update_rails
• update_riiif
• update_rsolr
• update_sidekiq
• update_solr_wrapper
• update_to_latest_hyrax_commit
• update_translations
• update_view_overrides
• update_workflow_json
• updating-contributing-guidelines-2017-01-26-15-01-15
• updating-hyku-migrations
• updating-rubocop
• updating-solr-wrapper
• upload_path
• use_database_backed_minter
• user-comment-fix
• uuid
• uv_2.0.1
• v1.0.0.beta1
• versioned_migrations
• workflow_elevator

Build # 2437

Build Type

push

travis-ci

Committed by atz

Commit Message

Basic example of job chaining

Built on top of the existing job.  So you could reasonably compose
different chains that used the same jobs in different sequences.

The main problem is that the two most costly jobs that benefit the most
from parallelization are solr and fedora creation, but those are the two
that we need to have logic about them both being complete.  So we either:
- sacrifice parallelism between solr and fedora creation to ensure logic
- allow the downstream job (e.g. AdminSet creation) to "spin" waiting for
  preconditions to arrive
- use a UX step/page with status polling that accomplishes the same thing

Spinning (check, sleep, check, sleep... eventually timeout) is
anti-pattern for queue mgmt.

Run Details

1548 of 1657 relevant lines covered (93.42%)

16.08 hits per line