rm-hull / dot-block / 30498517512

67%

Build Type

push

github

Committed by web-flow

Commit Message

refactor: fetch blocklists asynchronously on startup (#258)

* refactor: fetch blocklists asynchronously on startup

- Run blocklist initial fetch in a background goroutine so the DNS
server starts immediately.
- Add `IsLoaded` and `AllLoaded` methods to track blocklist readiness.
- Add benchmark and unit tests for blocklist processing and update
states.
- Update integration tests with retry logic to handle asynchronous
blocklist loading.

* Optimize blocklist loader to reduce allocations and memory usage

* Remove unused IsLoaded and AllLoaded methods

* Refactor blocklist loader to use unified stream and count pattern

* refactor: optimize blocklist loader with streaming and buffering

- Replaced line counting with a fast `io.Reader` buffer scan to estimate
 bloom filter size.
- Refactored `stream` to accept `io.Reader`, decoupling file I/O from
parsing logic.
- Reduced memory overhead by processing blocklists in a single pass.

```mermaid
sequenceDiagram
    participant B as BlockList.processFile
    participant F as File (io.Reader)
    participant C as countNewlines
    participant S as stream

    B->>C: Read file to estimate size
    C->>B: Return line count
    B->>B: Seek(0, io.SeekStart)
    B->>S: Stream file with scanner
    S->>B: Return parsed metadata
    B->>B: Apply Bloom Filter
```

Coverage Stats

51 of 59 new or added lines in 3 files covered. (86.44%)

4 existing lines in 2 files now uncovered.

2141 of 3176 relevant lines covered (67.41%)

557.35 hits per line