rm-hull / metoffice-uk-weather-overlays

9%

LAST BUILD ON BRANCH main

branch: main

CHANGE BRANCH

x

Reset

Sync Branches

• main
• chore/docker-image-build
• chore/go-routine
• chore/update-deps
• chore/update-readme
• dependabot/github_actions/actions/cache-5
• dependabot/github_actions/actions/checkout-6
• dependabot/github_actions/actions/upload-artifact-5
• dependabot/github_actions/actions/upload-artifact-6
• dependabot/github_actions/golangci/golangci-lint-action-9
• dependabot/github_actions/mikepenz/action-junit-report-6
• dependabot/go_modules/github.com/Depado/ginprom-1.8.2
• dependabot/go_modules/github.com/rm-hull/godx-0.0.10
• dependabot/go_modules/github.com/rm-hull/godx-0.0.2
• dependabot/go_modules/github.com/rm-hull/godx-0.0.3
• dependabot/go_modules/github.com/rm-hull/godx-0.0.4
• dependabot/go_modules/github.com/rm-hull/godx-0.0.5
• dependabot/go_modules/github.com/rm-hull/godx-0.0.6
• dependabot/go_modules/github.com/rm-hull/godx-0.0.7
• dependabot/go_modules/github.com/rm-hull/godx-0.0.8
• dependabot/go_modules/github.com/rm-hull/godx-0.0.9
• dependabot/go_modules/github.com/spf13/cobra-1.10.2
• dependabot/go_modules/github.com/tavsec/gin-healthcheck-1.7.11
• dependabot/go_modules/github.com/tavsec/gin-healthcheck-1.7.12
• dependabot/go_modules/golang.org/x/image-0.32.0
• dependabot/go_modules/golang.org/x/image-0.33.0
• dependabot/go_modules/golang.org/x/image-0.34.0
• doc/update-readme
• feat/cobra-cmd
• feat/cron-schedule
• feat/dataSpec-1.1.0
• feat/debug-info
• feat/download-cmd
• feat/log-resp-info
• feat/prometheus
• feat/scheduler
• feat/simultaneous-fetch-pools
• feat/temporary-redirects
• fix/dpt-style
• test/datahub

Build # 20471331165

Build Type

push

github

Committed by web-flow

Commit Message

feat: add background cron job for data downloads (#42)

* feat: add background cron job for data downloads

Automate weather data retrieval by integrating a background cron job
within the API server. This ensures that the local data cache is
periodically updated without manual intervention.

To support this, the downloader logic has been refactored from the `cmd`
package into the `internal` package to allow shared access between the
CLI download command and the background task. Additionally, the API
server now validates required environment variables on startup and
propagates errors back to the root command.

*   Added `github.com/robfig/cron/v3` dependency.
*   Moved `Processor` and image pipeline logic to
`internal/downloader.go`.
*   Implemented `StartCron` in `internal/cron.go` with a pre-defined
    schedule.
*   Updated `ApiServer` to initialize the cron scheduler before starting
    the HTTP listener.

```mermaid
sequenceDiagram
    participant CLI as Main / CLI
    participant API as ApiServer
    participant Cron as Cron Scheduler
    participant DL as Downloader

    CLI->>API: ApiServer(root, port, debug)
    API->>API: Validate Environment Variables
    API->>Cron: StartCron(root, apiKey, orderId)
    activate Cron
    Cron-->>API: Return Cron Instance
    deactivate Cron
    API->>API: Start Gin Server (HTTP)

    Note over Cron: At 04:30, 05:30, 06:30
    Cron->>DL: NewDownloader(...)
    Cron->>DL: StartWorkers()
    Cron->>DL: DispatchJobs()
    Cron->>DL: Wait()
    DL-->>Cron: Log Results/Errors
```

* Update internal/cron.go

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

---------

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

Run Details

0 of 202 new or added lines in 5 files covered. (0.0%)

1 existing line in 1 file now uncovered.

47 of 508 relevant lines covered (9.25%)

0.1 hits per line