OCHA-DAP / hdx-scraper-ophi
94%
main: 97%

LAST BUILD BRANCH: airflow
DEFAULT BRANCH: main
Repo Added
Token DNq6dosjCrX2fWAOzuKblpDsqNbbBrDG2 regen
Build 73 Last
Files 6
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH airflow
branch: SELECT
CHANGE BRANCH
x
Sync Branches

coverage: 93.804% (+0.01%) from 93.793%
Relevant lines Covered
581 RELEVANT LINES 545 COVERED LINES
0.94 HITS PER LINE
Source Files on main

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
33719647968 airflow Restore per-line timestamps in inlined logs; add a per-country header Restores the original timestamp in _render_task_log()'s rendered lines (reverting the previous commit's removal): it's the real time each line was actually logged, unlike the o... push mcarans github
93.8
33719250601 airflow Drop the per-line timestamp from inlined failure log rendering _render_task_log()'s rendered lines each carried the original event's own timestamp, but Airflow's own JSON wrapper already timestamps the summarize_country_results log line each one ... push mcarans github
93.79
33718718487 airflow Simplify inlined failure logs in summarize_country_results Two fixes, both scoped to the summary step's failure inlining: - retriever_context() left delete_on_failure at temp_dir_batch()'s default of True, so any task failure deleted the share... push mcarans github
93.8
33717501098 airflow Fix false ERROR level and duplicate timestamp in task logs Airflow 3 wraps every captured line of a task's output as one JSON record per line (dag_id/run_id/task_id context plus the raw text under "event") - this is how the Task SDK ships logs to... push mcarans github
94.32
33716682202 airflow Reformat log output to read like conventional plain-text logs hdx.utilities.easy_logging.setup_logging() hardcodes its loguru stderr sink to colorize=True with no override parameter. Airflow 3 wraps every captured stderr line as a JSON {"event": ... push mcarans github
94.32
33713061739 dagster Add a country_results_summary_job, Dagster's equivalent of Airflow's end-of-run summary task Unlike Airflow, each country_mpi_dataset partition materializes as its own separate run (via ophi_country_fanout_sensor), not a step within one run - so ... push mcarans github
91.82
33709626546 airflow Add an end-of-run summary task for the country fan-out country_mpi_dataset now returns a small result dict ({countryiso3, status, folder}) instead of just the scratch folder. A new summarize_country_results task (trigger_rule=all_done, downstream... push mcarans github
94.28
33699766790 airflow Gate on dag_run.run_type, not logical_date is None Airflow's web UI trigger stamps a real logical_date (today) on a manual run, unlike a bare CLI `airflow dags trigger` which leaves it None - so checking "logical_date is None" only bypassed the a... push mcarans github
94.55
33698832413 airflow Log when a dataset write is skipped because read_only=True _maybe_create()'s read_only guard was silent on the skip branch, so a read-only run gave no indication either way of whether a dataset would have been written - indistinguishable from not... push mcarans github
94.54
33698820056 dagster Log when a dataset write is skipped because read_only=True The read_only guard around each create_in_hdx() call was silent on the skip branch, so a read-only run gave no indication either way of whether a dataset would have been written - indisti... push mcarans github
93.47
See All Builds (71)

Badge your Repo: hdx-scraper-ophi

We detected this repo isn’t badged! Grab the embed code to the right, add it to your repo to show off your code coverage, and when the badge is live hit the refresh button to remove this message.
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

Refresh