openego / eDisGo

87%

dev: 87%

LAST BUILD ON BRANCH perf/spatial-reduction-vectorize

branch: perf/spatial-reduction-vectorize

CHANGE BRANCH

x

Reset

• perf/spatial-reduction-vectorize
• #42-revise-logger
• 213-calculation-of-reactance
• 214
• 276-improve-simple-example
• 330-feature-flexibilize-charging-strategies
• 382-feature-add-check-in-topology-whether-grid-contains-mesh
• 383-custom-plot-colors-Feature
• 384-bug-voltage-drop-should-be-considered-when-selecting-cable-to-connect-new-components
• 399-bug-usage-of-correct-worst-case-simultaneity-factors
• 413--feature--improve-connection-of-charging-points
• 413-feature-improve-connection-of-charging-points
• 420-feature-implement-database-using-test-oep-environment
• 430-bug-error-in-heat_pump_import-due-to-invalid-database-query-or-multipolygon-handling
• 472-bug-generators-concetrated-in-one-lv-grid-after-generator-import
• 497-bug-plotly-is-not-zoomable-with-power-flow
• 514-feature-upgrade-to-python313
• 515-bug-future-warnings-in-multiple-files
• 516-bug-import-fails-after-update-in-the-toep
• 525-doc-improve-and-extend-the-julia-side-documentation
• 528-bug-replace-the-usage-of-mviews
• 600-feature-improve-github-testing
• 615-maintenance-add-tests-for-not-covered-lines-of-code
• 634-maintenance-resolve-pandasgeopandaspyproj-futurewarnings-and-userwarnings-spamming-run-output
• 654_pypsa_Line_bug
• 658-bug-wrong-p_k-value-for-the-1000-kva-lv-transformer-factor-of-10-too-low
• 663-feature-add-configurable-timestep-selection-for-individual-edisgo-grids-in-ego
• 663_timeseries_selection
• 671-epic-2-speed-up-edisgo-runtime-on-large-grids
• 679-bug-distribute_private_charging_demand
• 697-bug-heat-storage-standing-loss-uses-fixed-exponent-1-p_loss124-wrong-for-non-hourly-timesteps
• 705-Integrate-spatial-complexity-reduction-into-the-run-pipeline
• 705-feature-integrate-spatial-complexity-reduction-into-the-run-pipeline
• 706-feature-integrate-spatial-complexity-reduction-into-the-run-pipeline
• 739-task-decouple_regular_test_suite_from_live_OEP_access
• 741-feature-traceable-reinforcement-log
• Backup/no_oep_implemented
• FNE_2026
• Maintenance-and-Future-Warnings
• add-concurrency-settings-to-prevent-overlapping-workflows
• archive/edisgo_run_edisgo
• bug/#450-bug-database-imports-not-working-ssh-tunnel-limitations
• bug/#599-importerror-pkg_resources-missing-with-setuptools82
• bug/#603-bugdocs-link-check-fails
• bug/#650-monotonic-grid-connection-capacity
• bug/#700-plot_mv_grid_topology
• bug/450-bug-database-imports-not-working-ssh-tunnel-limitations
• bug/693-OPF_time_elapsed_computed_with_seconds_and_int
• bug/failing_windows_test
• bug/fix#348
• bug/fix-broken-links
• bug/fix_failing_plotly_tests
• bug/fix_logging_add_grid_id
• bug/import-error-due-to-binary-incompatibility-between-pandas-and-numpy
• bug/update_python_rtd_version_to_3_11
• bug/windows_tests_failing
• bugfix/#345_fixed_cosphi
• bugfix/contextily_provider
• bugfix/cts_timeseries
• bugfix/dash_plot
• bugfix/dingo-annual-demand-nans
• bugfix/documentation-updates
• bugfix/find_critical_time_intervals
• bugfix/fix-Doc-links
• bugfix/integrate_generators_by_power
• bugfix/matplotlib_attribute_error
• bugfix/optimisation_fixes
• bugfix/plotly_and_dash_plot
• bugfix/to_geopandas
• bugfix/update_demandlib
• chore/699-remove_dead_legacy_converter
• chore/remove-egoio-dependency
• ci/check-dependabot-version
• ci/oedb-test-reruns
• debug/github-actions
• dependabot/github_actions/actions/checkout-4
• dependabot/github_actions/actions/checkout-5
• dependabot/github_actions/actions/checkout-6
• dependabot/github_actions/actions/checkout-7
• dependabot/github_actions/actions/setup-python-5
• dependabot/github_actions/actions/setup-python-6
• dependabot/github_actions/actions/setup-python-7
• dependabot/github_actions/conda-incubator/setup-miniconda-3
• dependabot/github_actions/conda-incubator/setup-miniconda-4
• dependabot/github_actions/julia-actions/cache-3
• dependabot/github_actions/julia-actions/setup-julia-2
• dependabot/github_actions/julia-actions/setup-julia-3
• dependabot/pip/astroid-3.3.10
• dependabot/pip/astroid-3.3.9
• dependabot/pip/astroid-4.0.2
• dependabot/pip/astroid-4.0.3
• dependabot/pip/astroid-4.1.0
• dependabot/pip/astroid-4.3.4
• dependabot/pip/black-lt-25.10.0
• dependabot/pip/black-lt-25.13.0
• dependabot/pip/black-lt-26.2.0
• dependabot/pip/black-lt-26.4.0
• dependabot/pip/contextily-lt-1.8.0
• dependabot/pip/dash-lt-3.1.0
• dependabot/pip/dash-lt-3.4.0
• dependabot/pip/dash-lt-3.5.0
• dependabot/pip/dash-lt-4.1.0
• dependabot/pip/dash-lt-4.2.0
• dependabot/pip/dash-lt-4.3.0
• dependabot/pip/dash-lt-4.4.0
• dependabot/pip/dash-lt-4.5.0
• dependabot/pip/dash-lt-4.6.0
• dependabot/pip/egoio-gte-0.4.8-and-lt-0.5.0
• dependabot/pip/flake8-lt-7.3.0
• dependabot/pip/flake8-lt-7.4.0
• dependabot/pip/geoalchemy2-lt-0.18.0
• dependabot/pip/geoalchemy2-lt-0.19.0
• dependabot/pip/geoalchemy2-lt-0.21.0
• dependabot/pip/geopandas-gte-0.12.0-and-lt-1.2.0
• dependabot/pip/geopy-gte-2.4.1-and-lt-2.5.0
• dependabot/pip/geopy-gte-2.5.0-and-lt-2.6.0
• dependabot/pip/isort-lt-7.1.0
• dependabot/pip/isort-lt-8.1.0
• dependabot/pip/jupyterlab-lt-4.5.0
• dependabot/pip/jupyterlab-lt-4.6.0
• dependabot/pip/jupyterlab-lt-4.7.0
• dependabot/pip/networkx-gte-2.5.0-and-lt-3.7.0
• dependabot/pip/networkx-gte-3.6.1-and-lt-3.7.0
• dependabot/pip/paramiko-lt-6.0
• dependabot/pip/pre-commit-lt-4.3.0
• dependabot/pip/pre-commit-lt-4.4.0
• dependabot/pip/pre-commit-lt-4.6.0
• dependabot/pip/pre-commit-lt-4.7.0
• dependabot/pip/pydot-lt-4.1.0
• dependabot/pip/pylint-lt-4.1.0
• dependabot/pip/pylint-lt-4.2.0
• dependabot/pip/pyproj-gte-3.7.2-and-lt-3.8.0
• dependabot/pip/pytest-lt-8.5.0
• dependabot/pip/pytest-lt-9.1.0
• dependabot/pip/pytest-lt-9.3.0
• dependabot/pip/pyupgrade-lt-3.21.0
• dependabot/pip/pyupgrade-lt-3.22.0
• dependabot/pip/ruff-lt-0.18.0
• dependabot/pip/shapely-gte-1.7.0-and-lt-2.2.0
• dependabot/pip/sphinx-autoapi-lt-3.10.0
• dependabot/pip/sphinx-autoapi-lt-3.5.0
• dependabot/pip/sphinx-autoapi-lt-3.6.0
• dependabot/pip/sphinx-autoapi-lt-3.7.0
• dependabot/pip/sphinx-autoapi-lt-3.8.0
• dependabot/pip/sphinx-autoapi-lt-3.9.0
• dependabot/pip/sphinx-autodoc-typehints-lt-3.10.0
• dependabot/pip/sphinx-autodoc-typehints-lt-3.11.0
• dependabot/pip/sphinx-autodoc-typehints-lt-3.12.0
• dependabot/pip/sphinx-autodoc-typehints-lt-3.13.0
• dependabot/pip/sphinx-autodoc-typehints-lt-3.2.0
• dependabot/pip/sphinx-autodoc-typehints-lt-3.7.0
• dependabot/pip/sphinx-lt-8.3.0
• dependabot/pip/sphinx-lt-9.1.0
• dependabot/pip/sphinx-lt-9.2.0
• dependabot/pip/sphinx-rtd-theme-gte-0.5.2-and-lt-3.2.0
• dependabot/pip/sphinx-rtd-theme-gte-3.1.0-and-lt-3.2.0
• dependabot/pip/sshtunnel-lt-0.6.0
• dependabot/pip/urllib3-lt-2.5.0
• dependabot/pip/urllib3-lt-2.6.0
• dependabot/pip/urllib3-lt-2.7.0
• dependabot/pip/urllib3-lt-2.8.0
• dependabot/pip/urllib3-lt-2.9.0
• dependabot/pip/urllib3-lt-3.0.0
• dependabot/pip/werkzeug-2.2.3
• deps/pin-geoalchemy2-0.6.3
• dev
• docs/restructure-readthedocs
• docs/whatsnew-v0-3-1
• edisgo_run_edisgo
• egon_dev
• failing_link_checks
• feat/565-voltage-over-distance
• feat/pipeline-runner
• featur/#382-add-check-in-topology-whether-grid-contains-mesh
• feature/#222-adding-pre-commit-hooks
• feature/#260-resample-time-series
• feature/#446-reference-operation-egon
• feature/#456-feature-set-default-timeindex-in-edisgoset_time_series_active_power_predefined
• feature/#56-add-header-to-all-files
• feature/377-crosssection-escalation
• feature/377-ront
• feature/446-feature-improve-apply_reference_operation-compatibility-with-egon-project-data
• feature/781-cheaper-voltage-measure
• feature/830-14a-curtailment
• feature/add_edisgo_consistency_check
• feature/add_feeder_methods
• feature/add_heat_pump
• feature/add_install_script
• feature/add_option_to_not_load_config
• feature/add_plotly_functionality_mapstyle_and_plot_storage
• feature/add_subs_at_half_feeder
• feature/adding_type_hinting
• feature/archive-edisgo-files
• feature/auto_sphinx_api
• feature/compatibility-python-3.11
• feature/coverage-coveralls
• feature/csv_import_ding0_no_changed_test_grids
• feature/ego-212-overlying-grid-mapping-and-intervals
• feature/egon_temporal_complexity_reduction
• feature/enable_dependabot
• feature/expansion-path
• feature/flake8
• feature/get_buses_downstream
• feature/hosting-capacity
• feature/include_HGV
• feature/issue-267-simultaneity-curves
• feature/log_grid_ids
• feature/lv_grid_property
• feature/ma_jonas
• feature/ma_maike
• feature/optimize_loc_cb
• feature/optional_engine_for_imports
• feature/plotting_with_map
• feature/power-flow-options
• feature/powermodels_interface
• feature/pre-commit-hooks
• feature/pre-commit-hooks-all-files
• feature/reference-year-timeindex
• feature/reinforcement-worst-cases
• feature/rename-peak-load
• feature/set-dtype-loading-from-files
• feature/set-timeindex-ranges
• feature/temporal_complexiry_reduction_reinforcement
• feature/timeseries_reduction_reinforcement
• feature/to-geopandas-#224
• feature/update-pandas
• feature/update_requirements
• feature/upgrade_to_python3.12
• feature/use_TOEP_token
• feature/windows-installation-description
• feature_dependabot
• features/#201-check-links-github-action
• features/#218-simbev-map-function
• features/#261-emob-tests
• features/#276-improve-simple-example
• features/#307-missing-setter-charging_points_df
• features/#323-dsm-class
• features/#323-egon-data-link
• features/#377-grid-separation
• features/#764-set-edisgo-timeindex-dispatchable-gens
• features/#903-desaggregate-heat-pumps
• features/LIS_siting
• features/adapt_plotting_example
• features/add-nbstripout
• features/add_pseudo_coordinates
• features/add_tox
• features/automated_windows_testing
• features/costs_calculation
• features/coveralls
• features/ding0_update
• features/disable-fail-fast
• features/edisgo_run_edisgo_ego_interface
• features/emob_integration
• features/flex_band_resampling
• features/flexibility_bands
• features/grid-reinforcement
• features/grid_reinforcement_Batuhan
• features/heat_pump_integration
• features/helper_functions_optimisation
• features/home_storage_operation
• features/improve_to_csv_functions
• features/integrate_lopf
• features/integrate_lopf_JE
• features/minor_adaptations
• features/minor_adaptions_overlying_grid
• features/minor_improvements
• features/n-minus-one-security
• features/no_removal_of_end_lines_in_ding0_import
• features/package_update
• features/path-to-zenodo-grids
• features/pre-commit-hooks
• features/refactor-new-loads-topology
• features/refactor_check_tech_constraints
• features/reinforcement_catch_convergence
• features/reinforcement_catch_convergence_bs
• features/remove_one_meter_lines
• features/resample-edisgo-simbev
• features/resample_helper_function
• features/restructure_time_series
• features/run_slow_tests
• features/save_flex_bands
• features/simbench_importer
• features/simbev-integration
• features/spatial_complexity_reduction
• features/tests_added
• features/update_documentation
• fix-doc-links-check
• fix-dumb-reduced-flexbands-reduce-to-timeindex
• fix/#342-BUG-PYOMO-Update
• fix/#342-BUG-PYOMO-update
• fix/#372-pandas2.0
• fix/#742-reproducible-charging-points
• fix/695-hp-slack-penalty
• fix/703-timeindex-fixes
• fix/718-opf-positional-flexibility-bands
• fix/739-legacy-oep-token
• fix/760-spatial-restore-opf-results
• fix/762-multi-interval-og-requirements
• fix/767-reduction-breaks-reinforce
• fix/777-feeder-split-weaker-line
• fix/789-inflexible-charging
• fix/790-julia-failure-status
• fix/801-opf-v3-curtailment
• fix/allow_db_via_ssh
• fix/catch-convergence-keeps-mode
• fix/db-engine
• fix/ding0-import-topology-subfolder
• fix/ego-202-district-heating-feedin-runner
• fix/ego-213-pv-rooftop-building-id-duplicate-bus
• fix/ego-222-timeseries-selection-block
• fix/electromobility_data_import
• fix/issue-661-replace-pytest-notebook
• fix/julia-1.12-manifest-update
• fix/legacy-weather-test-oep-access
• fix/lv-grid-id-zero
• fix/lv-station-voltage-limits-fragmentation
• fix/oedb-connection-issue-disable-tests
• fix/oep-connection-limit
• fix/opf-julia-800-warm-start
• fix/opf-julia-803-debug-println
• fix/opf-julia-804-warm-start-values
• fix/opf-julia-805-ref-filter
• fix/opf-julia-808-line-loading-nw
• fix/opf-julia-809-cp-single-step
• fix/opf-multi-interval-overlying-grid
• fix/opf-solver-threads
• fix/opf-suboptimal
• fix/opf-version-presets
• fix/overlying-grid-dispatchable-timeindex
• fix/overlying-grid-import-key-mismatch
• fix/persist-timeindex-worst-cases
• fix/predefined-timeindex-auto-set
• fix/pseudo-coordinates-meshed-lv-grid
• fix/readme_rendering
• fix/reinforce-lines-voltage-issues-all-segments
• fix/rtd_api_doc
• fix/snapshot-analysis
• fix/stable-sort-temporal-reduction
• fix/temporal-complexity-stable-sort
• fix/testgrid_with_integrated_charging_parks
• heikern-remotes/origin/features/emob_integration/simbench_import
• hotfix/#245
• hotfix/weather-cells-for-mv-grids
• maintanance/github-tests-for-python-3.10
• maintenance/#610-maintenance-update-the-whatsnewrst-for-030
• maintenance/update-dependencies
• master
• oedb-connection-issue-disable-test
• project/411-LoMa
• project/R4MU
• project/open_bea
• refactor/update-database-from-toep-to-oep
• revert-239-214
• run_ding0/2023_04_06
• select_timeindex
• split_mv_lv
• test
• test/julia-opf-test-suite
• test/property-tests
• use_default_config_as_default
• v0.1.0
• v0.1.1
• v0.2.0
• v0.2.1
• v0.3.0
• vg250_download
• workshop/2022-08-04-mobis
• wp_flex
• wp_flex_changed_reinforcement
• wp_flex_changed_reinforcement_2
• wp_flex_pr

Build # 42037083244

Build Type

Pull #854

github

Committed by joda9

Commit Message

Replace the busmap reference test by a property test

The clusters k-means finds on the pseudo coordinates change with
rounding: shifting the coordinates by a factor of 1 + 1e-15 maps 4 to 8
of the 142 buses of test grid 1 to another cluster, and the Windows CI
job got other clusters than the references written on Linux.

The new test checks what holds whatever the clusters are: with mode
'kmeansdijkstra', every new bus takes the coordinates of one of its
buses, and every bus is mapped to the medoid it reaches on the shortest
path (within its feeder for cluster area 'feeder'). It fails if the
k-means labels are used instead of the shortest paths, and passes for
coordinates shifted by 1e-15 to 1e-11.

Pull Request Pull Request #854: Speed up the spatial complexity reduction and fix three bugs in it

Coverage Stats

212 of 220 new or added lines in 2 files covered. (96.36%)

10186 of 11737 relevant lines covered (86.79%)

0.87 hits per line