enbility / spine-go / 17122433974

94%

push

github

✨ feat: implement smart list update filtering to prevent duplicate entries (#66)

This commit introduces intelligent filtering for SPINE list updates that
prevents duplicate and low-quality entries by distinguishing between
meaningful data updates and partial identifier-only messages.

Core feature:
- Smart filtering ignores incoming reply/notify data with only primary
identifiers
- Prevents merges that create multiple similar entries where one
contains useful data
- Maintains data quality by filtering out "crap" entries with just keys
- Uses primarykey tags to distinguish PRIMARY vs SUB identifiers per
SPINE spec

Implementation:
- Added comprehensive primarykey tag migration across all composite key
data types
- Enhanced UpdateList filtering with hasPrimaryKeyOnly() logic
- 82+ PRIMARY IDENTIFIER fields properly tagged across all feature areas
- Robust test coverage for edge cases and filtering behavior

Technical improvements:
- Added EEBusTagPrimaryKey support in eebus_tags.go
- Moved PRIMARYKEY_TAG_GUIDELINES.md to model/ folder for better
organization
- Maintains backward compatibility for single key types
- TDD approach with comprehensive test suite
- Removed obsolete Python analysis scripts

Result: Eliminates the common issue of having multiple entries for the
same entity where one contains meaningful data and another contains only
identifier information, significantly improving data quality in SPINE
message processing.

137 of 146 new or added lines in 1 file covered. (93.84%)

5501 of 5850 relevant lines covered (94.03%)

29410.71 hits per line