raystack / meteor / 23730456890
73%

DEFAULT BRANCH: main
Ran
Jobs 1
Files 100
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
coverage: 71.003% (+20.5%) from 50.458%
23730456890

push

github

web-flow 
feat: replace Asset model with native Entity+Edge model (#512)

* feat: replace Asset model with native Entity+Edge model

Replace v1beta2.Asset (rigid proto with typed Any data, separate Owners,
Lineage, Labels fields) with a native Entity+Edge model defined in
raystack/meteor/v1beta1.

Entity has flat properties (structpb.Struct) instead of typed Any wrappers.
All relationships (lineage, ownership) are now first-class Edge objects.
This aligns Meteor with Compass v2's entity-graph model and enables an
open type system where new entity types need no proto changes.

Key changes:
- New proto: raystack/meteor/v1beta1/record.proto (Entity + Edge)
- Record wraps Entity + []Edge instead of *Asset
- All 31 extractors migrated to produce Entity + Edges
- All 3 processors work with Entity.Properties directly
- Compass sink is now a thin Entity->UpsertEntity + Edge->UpsertEdge mapper
- All other sinks (kafka, file, http, stencil, frontier, gcs) updated
- Deleted all 14 typed data schemas (Table, Dashboard, Topic, etc.)
- Fixed structpb.NewStruct compatibility with map[string]string
- Fixed tengo script processor property loss during roundtrip

* chore: remove stale generated files and unused test helpers

- Delete duplicate models/models/raystack/ directory (buf generation artifact)
- Delete test/utils/any.go (BuildAny no longer needed without anypb)
- Delete test/utils/struct.go (BuildStruct no longer needed)

* chore: remove dead TryParseMapToProto and parseMapToProto functions

No production callers remain after the Entity migration.
Test helper replaced with local newStruct() using structpb.NewStruct directly.

* refactor: simplify codebase after Entity model migration

- Delete utils/custom_properties.go — inline AsMap/NewStruct in enrich processor
- Delete knownEntityTypes() whitelist in HTTP extractor — open type system
- Inline getSource() wrapper in stencil sink
- Simplify labels processor to use AsMap/NewStruct pattern (preserves all properties)
- Si... (continued)

952 of 1299 new or added lines in 48 files covered. (73.29%)

14 existing lines in 7 files now uncovered.

5889 of 8294 relevant lines covered (71.0%)

0.79 hits per line

New Missed Lines in Diff

Lines Coverage ∆ File
1
84.14
 -1.13% plugins/extractors/http/execute_script.go
1
63.27
 0.0% plugins/sinks/http/tengo_script.go
2
95.24
 -0.6% plugins/extractors/application_yaml/build_asset.go
2
72.73
 -1.74% plugins/extractors/clickhouse/clickhouse.go
2
79.66
 -0.67% plugins/extractors/mariadb/mariadb.go
2
79.83
 -0.66% plugins/extractors/mysql/mysql.go
2
76.92
 -0.85% plugins/extractors/presto/presto.go
2
78.57
 -4.76% plugins/processors/script/tengo_script.go
2
81.58
 -3.23% plugins/sinks/gcs/gcs.go
3
0.0
 0.0% plugins/sinks/console/sink.go
4
75.78
 -1.8% plugins/extractors/superset/superset.go
4
79.59
 2.93% plugins/extractors/tableau/builder.go
4
82.81
 -3.51% plugins/sinks/compass/sink.go
5
82.56
 -3.34% plugins/sinks/file/file.go
5
0.0
 0.0% plugins/sinks/kafka/sink.go
6
87.57
 -0.63% plugins/extractors/optimus/optimus.go
6
87.2
 -1.79% plugins/sinks/stencil/stencil.go
10
77.88
 -4.69% plugins/extractors/gcs/gcs.go
13
0.0
 0.0% plugins/extractors/github/github.go
14
0.0
 0.0% plugins/processors/enrich/processor.go
19
0.0
 0.0% plugins/processors/labels/labels.go
24
75.76
 -24.24% models/util.go
25
72.25
 -0.87% plugins/extractors/bigquery/bigquery.go
29
0.0
 0.0% plugins/extractors/oracle/oracle.go
160
0.0
 models/raystack/meteor/v1beta1/record.pb.go

Uncovered Existing Lines

Lines Coverage ∆ File
1
84.14
 -1.13% plugins/extractors/http/execute_script.go
1
88.66
 1.16% plugins/extractors/metabase/metabase.go
1
75.78
 -1.8% plugins/extractors/superset/superset.go
1
81.58
 -3.23% plugins/sinks/gcs/gcs.go
2
78.57
 -4.76% plugins/processors/script/tengo_script.go
4
72.25
 -0.87% plugins/extractors/bigquery/bigquery.go
4
87.2
 -1.79% plugins/sinks/stencil/stencil.go
Jobs
ID Job ID Ran Files Coverage
1 23730456890.1 100
71.0
 GitHub Action Run
Source Files on build 23730456890