DigitalTolk / ex / 39481021887

100%

push

github

History importer (pkg/importer) and user list pagination fix (#329)

* Fix user list pagination restarting at the first page

ListUsers built the continuation key with PK = USER#<GSI2 sort key>
instead of USER#<user id>, so DynamoDB could not position after the last
item and every follow-up page started over — a caller draining the list
(search reindex past one page of users) never terminated. Derive the
user id from the sort key's suffix; the regression test pages one user
at a time and asserts each user is visited exactly once.

* Add storage-layer helpers for writing history in bulk

- internal/limits: input ceilings and validators moved out of the service
  layer (service keeps the same names as re-exports) so every writer
  enforces identical rules; display-name cap included.
- store: DeriveGroupConversationID next to DeriveDMConversationID (the
  service now uses both), AddMessageSeq for channels and conversations,
  AddChannelLastRead / AddConversationLastRead, and SetReplyMetadata for
  recomputing a thread root from its full reply set.
- cache: DeleteUsers drops many cached user records in one round-trip.
- storage: PutChecksummedObject uploads a known object with its SHA-256 so
  S3 verifies it and stores the checksum attachment verification reads.
- search: IndexParentMessages bulk-indexes one parent's messages and files
  with the same documents the full reindex writes (shared builders).

* Add pkg/importer for importing chat history

A public package that writes users, channels, direct and group
conversations, memberships, messages, threads, reactions, pins and file
attachments straight through the storage layers. It never calls the
service layer, so imports publish no WebSocket events, send no
notifications or pushes and start no agent runs. Callers supply
deterministic IDs (message IDs are ULIDs carrying the original creation
time, so imported history interleaves with existing messages), which
makes every call idempotent and safe to ret... (continued)

11532 of 11532 branches covered (100.0%)

Branch coverage included in aggregate %.

1553 of 1553 new or added lines in 21 files covered. (100.0%)

49469 of 49470 relevant lines covered (100.0%)

1805.04 hits per line