os-autoinst / openQA

62%

master: 100%

LAST BUILD ON BRANCH improve_performance_limit_assets

branch: improve_performance_limit_assets

CHANGE BRANCH

x

Reset

• improve_performance_limit_assets
• 4.0
• 4.1
• 4.2
• 4.3
• AdamWill-fixed-asset-download
• Martchus-parent_group_overview
• add_colour
• add_dummpy_emit
• add_fixed_to_apparmor
• add_job_comments
• add_modify_needle
• add_more_restart_buttons
• add_new_job_state
• add_result_time
• add_results_to_job_api
• add_screenshots_table
• allow_perl_sass
• allow_worker_pool
• anjas_colors
• apparmor_1217
• avoid_big_joins
• avoid_huge_scheduler_join
• avoid_md5_warning
• avoid_template_warning
• avoid_too_much_fixed
• avoid_undef_testresultdir
• be_perlcritic_gentle
• bootstrap_for_result
• bootstrap_sass_dashboard
• bootstrap_tests
• cache_apparmor
• carry_over
• carry_over_softfails
• catch-running
• change_backend_logic
• change_build_sorting
• change_result_display
• change_softfailed_colour
• cleanup_pool
• consider_last_fatal
• consider_machine
• consistent_qw_usage
• coolo_add_flavor_filter
• coolo_assign_group
• coolo_avoid_errors
• coolo_change_user
• coolo_delay_killing
• coolo_fix_apparmor
• coolo_fix_namespace
• coolo_fix_suffix
• coolo_import_result_json
• coolo_issue_6956
• coolo_match_version
• coolo_new_isodate_regexp
• coolo_parse_flags
• coolo_parse_flags2
• coolo_port_admin_routes
• coolo_port_jquery
• coolo_tmpdir
• document_openqa_config
• document_soft_failure
• dont_grab_twice
• dont_kill_backend
• dont_let_the_worker_write
• dont_rely_on_ipc
• drop_mysql
• expect_tagged_softfail
• expired_jobs
• export_tests
• extend_carry_over
• fix_369
• fix_apparmor
• fix_apps_home
• fix_back_button
• fix_calculate_status
• fix_cleanup
• fix_click
• fix_comments_order
• fix_complex_query
• fix_ev_installation
• fix_fetchneedles
• fix_geekotest_documentation
• fix_green_grey_difference
• fix_group_for_restarts
• fix_group_overview
• fix_gru_permissions
• fix_hotlinks
• fix_javascript_relation
• fix_jobs_scheduling
• fix_json_route
• fix_limit_assets
• fix_logging
• fix_make_test
• fix_migration
• fix_name_suggestion
• fix_nobody_comments
• fix_obsolete
• fix_overview_link
• fix_paginated_users
• fix_perl_return
• fix_postgresql_migration
• fix_reboot
• fix_reschedule_isos
• fix_result_dir
• fix_result_display
• fix_running_status
• fix_scheduled_pagination
• fix_schema_worker_properties
• fix_scripts
• fix_seen_error
• fix_source_in_running
• fix_sql_debug
• fix_str_compare
• fix_switch_back
• fix_test_show
• fix_thumbnails
• fix_tooltip
• fix_unicode
• fix_unobtrusive_scripting
• fix_uploading
• fix_utc
• fix_warn
• fixen_chosen_images
• fixen_token
• follow_restart
• format_error_as_json
• give_404_on_unknown_tests
• give_subapps_proper_home
• handle_generated_assets
• hardcode_demo_apikeys
• have_fun_with_bootstrap
• hdd_assets
• hide_obsoletes
• highlight_softfail_needles
• ignore_stale_qemu
• ignore_stale_qemu_pids
• improve_step_navigation
• issue_5428
• issue_6376
• issue_6404
• issue_6424
• issue_6442
• issue_6448
• issue_6450
• issue_6464
• issue_6496
• issue_6610
• issue_6618
• issue_6726
• issue_6764
• issue_6784
• less_border_for_thumbnails
• limit_assets_first
• limit_gru
• liveview_fixes
• make_fatal_important
• make_non_important_fails_softfails
• make_openqa_css_sass
• make_sense
• make_websockets_log
• map_unk
• mark_TX_time
• mark_active_tab
• mark_the_worker
• master
• merge_sort
• migrate_softfails
• migrate_templates
• more_admin_coverage
• more_apparmor_for_ipmi
• more_job_fixes
• more_query_params
• move_comments_to_sass
• move_modules
• needle_cleanup
• needle_editor
• needle_management
• new_navigation
• new_templates
• next_okurz_cleanup
• nicer_gru
• nilxam-dbix_profiling
• no_ack_on_websocket
• novell_to_suse
• one_worker_to_rule_them_all
• openid
• optimize_query_jobs
• pick_simple_ones
• play_with_needle_diff
• play_with_themes
• port_needlediff_to_jquery
• port_running_to_jquery
• prefer_bulk_for_settings
• reintegrate_iso_schedule
• reintegrate_job_duplicate
• remove_authorized_ip
• remove_dbus_deadlock
• remove_dead_file
• remove_dep
• remove_diskimage
• remove_invalid_english
• remove_old_assets
• remove_old_migrations
• remove_optipng_tasks
• remove_session_new
• remove_step_steps
• remove_timeout
• remove_unknown_backends
• remove_useless_catch
• remove_variable_get
• replaced_logo
• restart_mojo_workers
• return_job_state
• revert_broken_query
• rework_interactive_mode
• rework_needle_editor
• rework_tests_even_more
• rework_websocket
• rework_workers_routes
• run_optipng_on_upload
• running_preview
• s390_apparmor
• set_finished_time
• show_builds_on_group_overview
• show_interactive_mode
• showrepourl
• shutdown_properly
• simplify_upload
• snd2png_allowed
• sort_by_rmse
• sort_comments
• sort_finished_by_finished
• sort_scheduled_too
• sort_workers
• speedup_ajax
• speedup_list_jobs
• split_images
• take_favicon_from_assets
• test_coveralls
• test_db_profiler
• test_phantomjs
• testing_cpanfile
• tidy_overview_page
• tidy_perl
• translate_iso_path
• treat_uploading
• try_full_stack
• try_new_div
• update_asset_pack
• update_bootstrap
• update_jquery
• use_assetpack
• use_datetime_validator
• wait_for_ajax

GRU limit_assets: Only check assets once to avoid a CPU hog

We just have too many jobs with too many assets - so the join results
in a *huge* list that we went through in perl because a distinct is not
possible in that join. So now do it in 2 steps, first get the distinct
number of job_assets and then grab the asset information about them