openego / eDisGo

84%

dev: 84%

LAST BUILD ON BRANCH feat/pipeline-runner

branch: feat/pipeline-runner

CHANGE BRANCH

x

Reset

• feat/pipeline-runner
• #42-revise-logger
• 213-calculation-of-reactance
• 214
• 330-feature-flexibilize-charging-strategies
• 382-feature-add-check-in-topology-whether-grid-contains-mesh
• 383-custom-plot-colors-Feature
• 384-bug-voltage-drop-should-be-considered-when-selecting-cable-to-connect-new-components
• 399-bug-usage-of-correct-worst-case-simultaneity-factors
• 413--feature--improve-connection-of-charging-points
• 413-feature-improve-connection-of-charging-points
• 420-feature-implement-database-using-test-oep-environment
• 430-bug-error-in-heat_pump_import-due-to-invalid-database-query-or-multipolygon-handling
• 472-bug-generators-concetrated-in-one-lv-grid-after-generator-import
• 497-bug-plotly-is-not-zoomable-with-power-flow
• 514-feature-upgrade-to-python313
• 515-bug-future-warnings-in-multiple-files
• 516-bug-import-fails-after-update-in-the-toep
• 525-doc-improve-and-extend-the-julia-side-documentation
• 528-bug-replace-the-usage-of-mviews
• 600-feature-improve-github-testing
• 615-maintenance-add-tests-for-not-covered-lines-of-code
• 634-maintenance-resolve-pandasgeopandaspyproj-futurewarnings-and-userwarnings-spamming-run-output
• 663-feature-add-configurable-timestep-selection-for-individual-edisgo-grids-in-ego
• 663_timeseries_selection
• 671-epic-2-speed-up-edisgo-runtime-on-large-grids
• Backup/no_oep_implemented
• FNE_2026
• Maintenance-and-Future-Warnings
• add-concurrency-settings-to-prevent-overlapping-workflows
• bug/#450-bug-database-imports-not-working-ssh-tunnel-limitations
• bug/#599-importerror-pkg_resources-missing-with-setuptools82
• bug/#603-bugdocs-link-check-fails
• bug/450-bug-database-imports-not-working-ssh-tunnel-limitations
• bug/failing_windows_test
• bug/fix#348
• bug/fix-broken-links
• bug/fix_failing_plotly_tests
• bug/fix_logging_add_grid_id
• bug/import-error-due-to-binary-incompatibility-between-pandas-and-numpy
• bug/update_python_rtd_version_to_3_11
• bug/windows_tests_failing
• bugfix/#345_fixed_cosphi
• bugfix/contextily_provider
• bugfix/cts_timeseries
• bugfix/dash_plot
• bugfix/dingo-annual-demand-nans
• bugfix/documentation-updates
• bugfix/find_critical_time_intervals
• bugfix/fix-Doc-links
• bugfix/integrate_generators_by_power
• bugfix/matplotlib_attribute_error
• bugfix/optimisation_fixes
• bugfix/plotly_and_dash_plot
• bugfix/to_geopandas
• bugfix/update_demandlib
• debug/github-actions
• dependabot/github_actions/actions/checkout-4
• dependabot/github_actions/actions/checkout-5
• dependabot/github_actions/actions/checkout-6
• dependabot/github_actions/actions/checkout-7
• dependabot/github_actions/actions/setup-python-5
• dependabot/github_actions/actions/setup-python-6
• dependabot/github_actions/conda-incubator/setup-miniconda-3
• dependabot/github_actions/conda-incubator/setup-miniconda-4
• dependabot/github_actions/julia-actions/setup-julia-2
• dependabot/github_actions/julia-actions/setup-julia-3
• dependabot/pip/astroid-3.3.10
• dependabot/pip/astroid-3.3.9
• dependabot/pip/astroid-4.0.2
• dependabot/pip/astroid-4.0.3
• dependabot/pip/astroid-4.1.0
• dependabot/pip/black-lt-25.10.0
• dependabot/pip/black-lt-25.13.0
• dependabot/pip/black-lt-26.2.0
• dependabot/pip/black-lt-26.4.0
• dependabot/pip/contextily-lt-1.8.0
• dependabot/pip/dash-lt-3.1.0
• dependabot/pip/dash-lt-3.4.0
• dependabot/pip/dash-lt-3.5.0
• dependabot/pip/dash-lt-4.1.0
• dependabot/pip/dash-lt-4.2.0
• dependabot/pip/dash-lt-4.3.0
• dependabot/pip/dash-lt-4.4.0
• dependabot/pip/egoio-gte-0.4.8-and-lt-0.5.0
• dependabot/pip/flake8-lt-7.3.0
• dependabot/pip/flake8-lt-7.4.0
• dependabot/pip/geoalchemy2-lt-0.18.0
• dependabot/pip/geoalchemy2-lt-0.19.0
• dependabot/pip/geopandas-gte-0.12.0-and-lt-1.2.0
• dependabot/pip/geopy-gte-2.4.1-and-lt-2.5.0
• dependabot/pip/isort-lt-7.1.0
• dependabot/pip/isort-lt-8.1.0
• dependabot/pip/jupyterlab-lt-4.5.0
• dependabot/pip/jupyterlab-lt-4.6.0
• dependabot/pip/jupyterlab-lt-4.7.0
• dependabot/pip/networkx-gte-2.5.0-and-lt-3.7.0
• dependabot/pip/networkx-gte-3.6.1-and-lt-3.7.0
• dependabot/pip/pre-commit-lt-4.3.0
• dependabot/pip/pre-commit-lt-4.4.0
• dependabot/pip/pre-commit-lt-4.6.0
• dependabot/pip/pre-commit-lt-4.7.0
• dependabot/pip/pydot-lt-4.1.0
• dependabot/pip/pylint-lt-4.1.0
• dependabot/pip/pyproj-gte-3.7.2-and-lt-3.8.0
• dependabot/pip/pytest-lt-8.5.0
• dependabot/pip/pytest-lt-9.1.0
• dependabot/pip/pyupgrade-lt-3.21.0
• dependabot/pip/pyupgrade-lt-3.22.0
• dependabot/pip/shapely-gte-1.7.0-and-lt-2.2.0
• dependabot/pip/sphinx-autoapi-lt-3.5.0
• dependabot/pip/sphinx-autoapi-lt-3.6.0
• dependabot/pip/sphinx-autoapi-lt-3.7.0
• dependabot/pip/sphinx-autoapi-lt-3.8.0
• dependabot/pip/sphinx-autoapi-lt-3.9.0
• dependabot/pip/sphinx-autodoc-typehints-lt-3.10.0
• dependabot/pip/sphinx-autodoc-typehints-lt-3.11.0
• dependabot/pip/sphinx-autodoc-typehints-lt-3.12.0
• dependabot/pip/sphinx-autodoc-typehints-lt-3.13.0
• dependabot/pip/sphinx-autodoc-typehints-lt-3.2.0
• dependabot/pip/sphinx-autodoc-typehints-lt-3.7.0
• dependabot/pip/sphinx-lt-8.3.0
• dependabot/pip/sphinx-lt-9.1.0
• dependabot/pip/sphinx-lt-9.2.0
• dependabot/pip/sphinx-rtd-theme-gte-0.5.2-and-lt-3.2.0
• dependabot/pip/sphinx-rtd-theme-gte-3.1.0-and-lt-3.2.0
• dependabot/pip/urllib3-lt-2.5.0
• dependabot/pip/urllib3-lt-2.6.0
• dependabot/pip/urllib3-lt-2.7.0
• dependabot/pip/urllib3-lt-2.8.0
• dependabot/pip/urllib3-lt-3.0.0
• dependabot/pip/werkzeug-2.2.3
• dev
• docs/restructure-readthedocs
• edisgo_run_edisgo
• egon_dev
• failing_link_checks
• feat/565-voltage-over-distance
• featur/#382-add-check-in-topology-whether-grid-contains-mesh
• feature/#222-adding-pre-commit-hooks
• feature/#260-resample-time-series
• feature/#456-feature-set-default-timeindex-in-edisgoset_time_series_active_power_predefined
• feature/#56-add-header-to-all-files
• feature/446-feature-improve-apply_reference_operation-compatibility-with-egon-project-data
• feature/add_edisgo_consistency_check
• feature/add_feeder_methods
• feature/add_heat_pump
• feature/add_install_script
• feature/add_option_to_not_load_config
• feature/add_plotly_functionality_mapstyle_and_plot_storage
• feature/add_subs_at_half_feeder
• feature/adding_type_hinting
• feature/archive-edisgo-files
• feature/auto_sphinx_api
• feature/compatibility-python-3.11
• feature/coverage-coveralls
• feature/csv_import_ding0_no_changed_test_grids
• feature/egon_temporal_complexity_reduction
• feature/enable_dependabot
• feature/flake8
• feature/get_buses_downstream
• feature/include_HGV
• feature/issue-267-simultaneity-curves
• feature/log_grid_ids
• feature/lv_grid_property
• feature/ma_jonas
• feature/ma_maike
• feature/optimize_loc_cb
• feature/optional_engine_for_imports
• feature/plotting_with_map
• feature/power-flow-options
• feature/powermodels_interface
• feature/pre-commit-hooks
• feature/pre-commit-hooks-all-files
• feature/reinforcement-worst-cases
• feature/rename-peak-load
• feature/set-dtype-loading-from-files
• feature/temporal_complexiry_reduction_reinforcement
• feature/timeseries_reduction_reinforcement
• feature/to-geopandas-#224
• feature/update-pandas
• feature/update_requirements
• feature/upgrade_to_python3.12
• feature/use_TOEP_token
• feature/windows-installation-description
• feature_dependabot
• features/#201-check-links-github-action
• features/#218-simbev-map-function
• features/#261-emob-tests
• features/#276-improve-simple-example
• features/#307-missing-setter-charging_points_df
• features/#323-dsm-class
• features/#323-egon-data-link
• features/#377-grid-separation
• features/#903-desaggregate-heat-pumps
• features/LIS_siting
• features/adapt_plotting_example
• features/add-nbstripout
• features/add_pseudo_coordinates
• features/add_tox
• features/automated_windows_testing
• features/costs_calculation
• features/coveralls
• features/ding0_update
• features/disable-fail-fast
• features/edisgo_run_edisgo_ego_interface
• features/emob_integration
• features/flex_band_resampling
• features/flexibility_bands
• features/grid-reinforcement
• features/grid_reinforcement_Batuhan
• features/heat_pump_integration
• features/helper_functions_optimisation
• features/home_storage_operation
• features/improve_to_csv_functions
• features/integrate_lopf
• features/integrate_lopf_JE
• features/minor_adaptations
• features/minor_adaptions_overlying_grid
• features/minor_improvements
• features/n-minus-one-security
• features/no_removal_of_end_lines_in_ding0_import
• features/package_update
• features/path-to-zenodo-grids
• features/pre-commit-hooks
• features/refactor-new-loads-topology
• features/refactor_check_tech_constraints
• features/reinforcement_catch_convergence
• features/reinforcement_catch_convergence_bs
• features/remove_one_meter_lines
• features/resample-edisgo-simbev
• features/resample_helper_function
• features/restructure_time_series
• features/run_slow_tests
• features/save_flex_bands
• features/simbench_importer
• features/simbev-integration
• features/spatial_complexity_reduction
• features/tests_added
• features/update_documentation
• fix-doc-links-check
• fix/#342-BUG-PYOMO-Update
• fix/#342-BUG-PYOMO-update
• fix/#372-pandas2.0
• fix/allow_db_via_ssh
• fix/db-engine
• fix/ding0-import-topology-subfolder
• fix/electromobility_data_import
• fix/issue-661-replace-pytest-notebook
• fix/oedb-connection-issue-disable-tests
• fix/opf-suboptimal
• fix/persist-timeindex-worst-cases
• fix/predefined-timeindex-auto-set
• fix/readme_rendering
• fix/rtd_api_doc
• fix/snapshot-analysis
• fix/stable-sort-temporal-reduction
• fix/temporal-complexity-stable-sort
• fix/testgrid_with_integrated_charging_parks
• heikern-remotes/origin/features/emob_integration/simbench_import
• hotfix/#245
• hotfix/weather-cells-for-mv-grids
• maintanance/github-tests-for-python-3.10
• maintenance/#610-maintenance-update-the-whatsnewrst-for-030
• master
• oedb-connection-issue-disable-test
• project/411-LoMa
• project/R4MU
• project/open_bea
• refactor/update-database-from-toep-to-oep
• revert-239-214
• run_ding0/2023_04_06
• select_timeindex
• split_mv_lv
• test
• use_default_config_as_default
• v0.1.0
• v0.1.1
• v0.2.0
• v0.2.1
• vg250_download
• workshop/2022-08-04-mobis
• wp_flex
• wp_flex_changed_reinforcement
• wp_flex_changed_reinforcement_2
• wp_flex_pr

Build # 28952825336

Build Type

push

github

Committed by joda9

Commit Message

feat(run): add declarative pipeline runner

YAML/JSON-driven task pipelines with a single entry point
run_edisgo(config): registered tasks with requires/provides metadata,
a static pre-run validator, extends-based config merging, and three
bundled presets (worst_case, flex_opf, overlying_grid_opf).

- flexibilities: top-level carrier list drives both import_flex and
  the optimize task's flexible selection
- timestep selection split into set_timeindex (manual, early) and
  select_critical_timesteps (auto scoring, late)
- database source resolved via engine_from_settings (auto-detect,
  oep, egon-data)
- overlying-grid data via run_edisgo(..., overlying_grid_data=...)
  from eTraGo or CSVs, incl. new OverlyingGrid attributes
- ORM mapping fix for egon-data tables/views without primary key

Coverage Stats

446 of 618 new or added lines in 15 files covered. (72.17%)

9364 of 11188 relevant lines covered (83.7%)

0.84 hits per line