akvo / iwsims / #153

89%

main: 89%

push

coveralls-python

[#77] Seed Akvo Flow RWS surveys with caddisfly, label aliases and repeat index

- Finalise question mappings for Flow 535151018 (Rural Water Point Survey)
  and 540671011 (School Form) onto the Rural Water Project MIS forms
- Fan every caddisfly Flow question out to the CBT number, risk option and
  CBT-bag photo questions per child form (generic rule in af_forms_mapping)
- Data notebook: option label aliases from label_aliases.json, cascade
  names on non-administration questions, repeat index "<id>-<n>" columns,
  caddisfly split (MPN, health risk, image) with enumerator values winning
- Seeder: parse "<id>-<n>" columns into Answers.index, store on-the-fly
  photos as /images/<file>, keep data CSVs intact on --limit runs, resolve
  Flow forms through the shared storage/akvo-flow/flow_forms.json
- Add administration_csv_seeder: additive import of the official Fiji
  hierarchy (name, level and parent matched; existing ids untouched)
- Administration mapper: key lookups on parent, accept merged province
  names, skip non-administration cascades, apply _administration aliases
- Add af_export_to_raw.py to build raw CSVs from a Flow Excel export while
  the Flow data endpoint is unavailable
- Notebooks and seeder share flow_forms.json; README and plan document
  describe the workflow

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

Fix race condition in datapoint JSON file creation

Use tempfile.NamedTemporaryFile to create unique temporary files instead of using a fixed filename based on UUID. This prevents race conditions when multiple processes attempt to save the same datapoint simultaneously. The temporary file is properly cleaned up in a finally block after upload.

5822 of 6727 branches covered (86.55%)

Branch coverage included in aggregate %.

10713 of 11929 relevant lines covered (89.81%)

0.9 hits per line