projecthydra-labs / curation_concerns

80%

master: 90%

LAST BUILD ON BRANCH faster_indexing

branch: faster_indexing

CHANGE BRANCH

x

Reset

• faster_indexing
• 0.7.0_release_prep
• 1987_sufia_tech_debt
• 548-form-descriptive-fields
• 558-javascripts-typo
• 582-filename-error
• 766-actors-namespace
• 766-master-document-nouns
• 766-renderers-noun
• FileSetPresenter
• FileSetPresenter2
• ResolrizeJob
• SolrDocumentBehavior_mime_type
• access_denied
• active_fedora-10
• active_job
• actor_callbacks
• actor_class
• actor_pipeline
• add_collection_button
• add_doc
• add_fetch
• add_spec
• add_works
• additional-formats-for-works
• admin-group
• af_9_10
• affix_adjustment
• after-update-response
• after_create_content
• allow_file_to_be_missing
• allow_visibility
• app-bootstrap
• application_name
• attribute_renderer
• attribute_rows
• audit-job-refactor-mailboxer
• audit-job-specs-fix
• avoid_extra_lookups
• avoid_hydra_search_builder
• avoid_unnecessary_span
• batch_controller
• batch_operations_logging
• be_consistent_about_keywords
• belongs_to_representative
• better_errors
• blacklight_6
• bootstrap-nav
• bootstrap_icons
• brand-bar-style
• browse-everything
• bucket_derivatives
• build-form
• build_form_on_failure
• bump_dependencies
• bump_hh
• callbacks
• cancel_on_state
• capybara_wait
• cc-presenter
• ch12n-job
• characterization
• check_existing
• child_work_presenters
• class-attributes
• cleanup-user
• cleanup_derivatives
• cleanup_spec
• cleanup_user
• collection-keyword
• collection_create_errors
• collection_edit_errors
• collection_facet
• collection_form
• collection_metadata
• collection_next_page
• collection_partials_and_helpers
• collection_presenters_fix
• collection_result_partial
• collection_thumbnail
• collection_work_show
• collections
• collections_helper
• commented_model_specs
• concise
• config_default_type
• configure_thumbnail
• consistent_arguments
• content_length
• copy_embargos
• copy_visibility_to_files_on_ingest
• correct_description
• correct_doc
• correct_translations
• count-task
• cover_characterization
• css_icon
• curation_concerns_models
• date_created
• date_uploaded
• dc_elements
• dce_dev
• debug_error
• default_buttons
• default_image
• delete_file_set
• delete_models
• delete_unused
• dependencies
• derivatives_spec_review
• description
• dont_call_parents_twice
• download_options
• dump_unused_redis_config
• dup_include
• edit_form
• embargo_actor
• encapsulate_redirect
• engine_cart_0.8
• error_message
• exempt_coverage
• extract_download_behavior
• extract_file_presenter_class
• extract_form_class
• extract_fs_actions
• extract_permission_badge
• extract_presenter
• extract_show_actions
• facets
• faster_embargos
• faster_test
• feature/available_rights_service
• fedora-4.4
• fewer_overrides
• file_actor_class
• file_format
• file_presenters
• file_reordering_bug
• file_set_presenters
• file_type
• fits_spec
• fix-audit-job-event-signature
• fix-audit-specs
• fix-characterize-job-specs
• fix-import-url-event-signature
• fix-import-url-specs
• fix-ingest-local-specs
• fix_404
• fix_all_tab
• fix_copy_config
• fix_deprecation
• fix_download_route
• fix_flash
• fix_formatting
• fix_gemspec
• fix_keys
• fix_lineup
• fix_namespace
• fix_parameter
• fix_rspec_bug
• fix_rubocop
• fix_spec
• fix_styles
• fix_thumbnails
• fix_thumbs
• fix_type
• fix_visibility_worker
• fixes_bug_with_callbacks
• fixup_spec
• flyingzumwalt-patch-1
• forms_and_presenters
• forms_for_works
• full_text
• fulltext_derivative
• generate_catalog_controller
• generate_feature_spec
• generic_file_namespace
• generic_file_title
• gh_templates
• global_id
• hydra-collections
• hydra-collections-6
• hydra-collections-8
• hydra-editor-2
• hydra-works-dependency
• i18n_files
• improve_config
• improve_coverage
• improved_help_text
• improved_install_generator
• improving-instance-variable-isolation
• index_filename
• index_thumbnail
• indexer
• indexing_mime_type
• ingest
• ingest_queue_name
• init_forms
• initialize_edit_form
• integrate_config
• issue-491
• issue-492
• issue-493
• issue-496
• issue_#63
• issue_109
• issue_110
• issue_63
• issue_69
• jetty_tasks_fixes
• json_api
• kaminari_route_prefix
• latest_works
• lease_ui
• less_network
• link_to_facet
• link_to_lease_and_embargo
• local_views
• lock_file_attach
• lock_files_560
• log_in_collector
• log_warning
• longs_for_byte_size
• loosen_dependencies
• make_attribute_renderer_label_public
• make_download_link_optional
• master
• media_display
• media_display_args
• member-indexing
• member_partial
• method_visibility
• minter_state
• model_name
• more_override_types
• move_indexing_to_indexer
• move_job
• move_multiple_upload
• move_params
• multi_value_properties
• multivalue_title
• mutexing
• namespace_models
• namespace_renderer
• narrow-admin-abilities
• new_collections
• new_session_path
• no,_every_file_does_NOT_have_a_virus,_hydra-works
• no-custom-colors
• no_basic_containers
• no_change_files
• no_deprecations
• no_duplicates
• no_filters
• no_hardcode
• no_log
• no_menu
• no_require
• nuke_genericity
• null-logger
• null-members
• optimistic_dependencies
• optimize_delete
• ordered_file_sets_view
• parent_id_from_parent
• partial_path
• permit_file_set_form
• permit_rights
• port_figure
• post_params
• predicate_warning
• prefer-array-wrap-to-array
• presence_validator
• presenters
• prune
• prune_config
• prune_default_metadata
• queue_collapse
• radio_helpers
• rdf_vocab
• read_only_audit
• readme-dependencies
• readme-jetty
• readme_update
• redis-config
• redis_current
• refactor_ability
• refactor_actor_stack
• refactor_attributes
• refactor_form
• refactor_ingest_file_job
• refactor_job
• refactor_local_file_ingest
• refactor_local_ingest
• refactor_query
• refactor_routes
• refactor_search_builder
• refactor_single_use_links
• refactor_spec
• refactor_tests
• reindex_parent
• released_hydra_collections
• reload_object
• rely_on_hydra_editor
• remove-body-styling
• remove-duplicate-type-checking
• remove-multi_value_fields
• remove-self-check
• remove-unused-styles
• remove_accessor
• remove_batches
• remove_button_helpers
• remove_collection
• remove_collections_controller
• remove_constraint_url
• remove_copy_permissions
• remove_copy_vis
• remove_cruft
• remove_curatable
• remove_datastream_id
• remove_deprecated
• remove_deprecations
• remove_derivatives_ref
• remove_derivatives_spec
• remove_editor
• remove_engine_config
• remove_exception
• remove_files_variable
• remove_form_and_presenter
• remove_form_builder
• remove_from_collection
• remove_full_text
• remove_generic_file
• remove_generic_work
• remove_generic_work_metadata
• remove_github_dep
• remove_hash_rockets
• remove_human_readable_short_description
• remove_job_user
• remove_messages
• remove_methods
• remove_partial
• remove_queue
• remove_resque
• remove_resque_admin
• remove_sufia_virus_error
• remove_trailing_lines
• remove_unused
• remove_unused_assets
• remove_unused_partial
• remove_upload_set
• remove_vendored_jquery_ui
• rename_basic_metadata
• rename_presenter
• render_integers
• reorder_ui
• repair_audit_service
• representative_document
• representative_presenter
• require_title
• required_field
• required_fields
• required_metadata
• resource_types
• resque_pool
• restore_derivatives
• restore_export
• restore_human_readable_audit
• revert-382-ruby-2.2.3
• revert-507-issue-496
• review_test_coverage
• rights
• rights_qa
• rm_export
• rm_hyda-works_rake
• rm_methods
• rm_slop
• route_constraints
• route_with_block
• rubocop-0.36
• rubocop_034
• rubocop_autocorrect_rspec
• rubocopped
• rubocopped_21
• run_curation_concern_callbacks
• safe-create
• sans_datastreams
• scm785
• scm_172
• scm_181
• scm_181a
• scm_268
• scm_289
• scss_extension
• search-form-style
• search_form_partial
• send_rows
• separate-permissions-note
• separate_orders
• separate_services
• set_curation_concern
• set_form_on_failed_update
• set_indexers
• set_representative
• set_works_indexer
• settable_presenters
• show_file_set_title
• simplify_errors
• single_use_link_title
• skip_q
• solr_doc_test
• solrconf-models
• sort_edit_action
• sort_embargos
• specify_fits_version
• specify_module
• split_representative
• sprockets_shmockets
• sr_only
• standardize_dates
• store_derivatives_on_disk
• streaming
• sufia_dev
• sul
• template_actor
• test_member_ordering
• test_verbiage
• tests_for_services
• thumbnail
• thumbs_on_files
• tidying-up-rubocop-declarations
• timestamps_not_null
• toggle_popover
• translate
• trim_solr_doc
• unauthorized
• unauthorized_create
• unauthorized_path
• uncluttered_root_namespace
• unused_module
• update_fileupload
• update_gitignore
• update_hydra_head
• update_hydra_works
• update_on_delete
• update_to_af_98x
• upgrade_engine_cart
• upload_set
• upload_set_collects_works
• upload_set_form
• upload_sets
• upload_sets_orig
• upload_sets_rebase
• uploadset_depositor
• usage_info
• use_base_search
• use_feature_for_feature_specs
• use_form
• use_indexer
• use_inflections
• use_methods
• use_post
• v0.0.1
• v0.1.0
• v0.10.0
• v0.11.0
• v0.11.0.rc1
• v0.12.0
• v0.12.0.pre1
• v0.12.0.pre2
• v0.12.0.pre3
• v0.12.0.pre4
• v0.12.0.pre5
• v0.12.0.pre6
• v0.12.0.pre7
• v0.12.0.pre8
• v0.12.0.pre9
• v0.13.0
• v0.13.1
• v0.14.0
• v0.14.0.pre1
• v0.14.0.pre2
• v0.14.0.pre3
• v0.14.0.pre4
• v0.2.0
• v0.3.0
• v0.6.0
• v0.7.0
• v0.8.0
• v1.0.0.beta1
• v1.0.0.beta2
• virus_checking
• without-editors
• without_add_member
• without_cleaner
• without_fixtures
• without_search_config
• without_t
• work_generator
• work_generator_should_obey_the_cop
• works
• works_actor_collections_tests
• works_text_extraction

Build # 275

Build Type

push

travis-ci

Committed by jcoyne

Commit Message

Faster indexing not extending PCDM::ObjectIndexer
Hydra::PCDM::ObjectIndexer loads all the members in an aggregation and
sorts them by type. This is particularly slow. CurationConcerns makes
the assumption that all children of GenericWorks are GenericFiles, thus
we can take a shortcut, query solr and skip loading the whole
aggregation from Fedora.

Fixes #84

Run Details

1594 of 2002 relevant lines covered (79.62%)

7.67 hits per line