supabase / realtime

89%

main: 89%

LAST BUILD ON BRANCH fix/region-aware-load-conflicts

branch: fix/region-aware-load-conflicts

CHANGE BRANCH

x

Reset

• fix/region-aware-load-conflicts
• basic-opentelemetry
• blacksmith-migration-8b621bd
• chore-review-actions
• chore/enhance-log-lack-of-connections
• chore/faster-tests-part-1
• chore/fix-flaky-rate-counter-test
• chore/fix-flaky-tenant-plugin-test
• chore/fix-flaky-test
• chore/fix-integration-rate-tests
• chore/fix-integration-test
• chore/flaky-test
• chore/flaky-test-part-4
• chore/flaky-tests
• chore/flaky-tests-part-3
• chore/mimic
• chore/misc-fixes
• chore/reduce-contetion
• chore/reuse-containers
• chore/speed-up-api-tests
• chore/speedup-authorization-tests
• chore/speedup-rate-counter-tests
• chore/speedup-tests
• chore/speedup-tests-2
• chore/split-distributed-tests
• chore/test-connection-teardown
• chore/test-flaky-speedup
• chore/update-e2e-tests
• chore/update-supabase-17
• chore/use-supabase-js-latest-on-integration-tests
• da/fix-shell
• da/gen-certs
• da/k8s-clustering
• da/remove-compromised-action
• dependabot/npm_and_yarn/demo/babel/runtime-7.27.0
• dependabot/npm_and_yarn/demo/next-14.2.25
• dependabot/npm_and_yarn/demo/next-14.2.26
• extract/dev-seeds
• feat/authorization-rate-limit-on-db-error
• feat/beacon
• feat/broadcast-payload-size
• feat/bump-up-elixir-and-otp
• feat/cluster-log-metadata
• feat/collect-payload-size-REAL-484
• feat/database-broadcast-enabled
• feat/disable-utf8-validation
• feat/erlang-dist-metrics
• feat/gen-rpc
• feat/gen-rpc-compression
• feat/gen-rpc-metrics
• feat/gen-rpc-pub-sub-adapter
• feat/handle-presence-enable-join-param
• feat/makefile-help
• feat/max-heap-size
• feat/measure-replay-latency
• feat/metric-cleaner-beacon
• feat/nodejs-integration-tests
• feat/opentelemetry-setup
• feat/peep
• feat/peep-partitions
• feat/pg-changes-poller-speed-up
• feat/phoenix-presence-dispatcher
• feat/postgres-changes-action-filter
• feat/postgres-changes-direct-broadcast
• feat/realtime-messages-avoid-encoding
• feat/realtime-v2-serializer
• feat/region-mapping
• feat/region-metrics-endpoint
• feat/regional-broadcasting
• feat/regional-master-write
• feat/regional-master-write-test-tweaks
• feat/replay
• feat/repo-master-region-aware
• feat/serializer-metrics
• feat/simplify-replica-config
• feat/speedup-db-event-json-encoding
• feat/track-presence-payload-size
• feat/use-beacon-on-tenant-metrics
• feat/v2-user-broadcast-push-metadata
• fix-liveview-stream-status
• fix/accept-ssl-options
• fix/add-back-migration-on-healthcheck
• fix/add-coverage
• fix/add-metadata-on-error
• fix/add-more-claims-to-jwt-error
• fix/add-private-to-inspector
• fix/add-region-to-connect-metadata
• fix/add-shutdown-endpoint
• fix/add-syn-resolution-testing
• fix/add-wal-error-back
• fix/app-js
• fix/auth-uid
• fix/authorization-write-check-improvements
• fix/auto-reconnect-replication-connection
• fix/better-replay-error-message
• fix/broadcast-fastlane
• fix/broadcast-handler-refactor
• fix/bump-max-heap-size
• fix/bump-up-realtime
• fix/bump-up-realtime-js
• fix/cdc-rls-rate-counter
• fix/cdc-rls-supervision-strategy
• fix/cdc-tenant-cache
• fix/change-default-gen_rpc
• fix/configurable-cache-ttl
• fix/configure-rebalance-interval
• fix/connect-backoff
• fix/connect-lookup-cold-start
• fix/connect-metric-from-connect-module
• fix/connect-rate-limit
• fix/connect-rebalance
• fix/create-partitions-on-health-check-REAL-500
• fix/db-events-limit
• fix/delete-after-suspend
• fix/delete-endpoint-reduce-impact
• fix/disable-channel-log-temporarly
• fix/disconnect-socket
• fix/disconnect-websocket-on-rate-limit-join
• fix/dispatcher-not-a-map
• fix/enable-presence-on-track
• fix/enhance-log-lack-of-connections
• fix/ensure-token-refresh-checks-write
• fix/erl-sys-mon
• fix/execute-migration
• fix/expose-authorization-metrics-per-tenant
• fix/expose-db-events-in-victoria-metrics
• fix/expose-metrics-rpc-timeout-config
• fix/flaky-test
• fix/flaky-tests
• fix/formatting-and-credo
• fix/further-decrease-presence-limit
• fix/gen-rpc-authorization
• fix/gen-rpc-bad-node
• fix/gen-rpc-broadcast
• fix/gen-rpc-broadcaster
• fix/gen-rpc-broadcaster-key
• fix/gen-rpc-call-tenant-id-tag
• fix/gen-rpc-dispatcher
• fix/gen-rpc-ipv6-only-config
• fix/gen-rpc-metrics
• fix/gen-rpc-postgres-changes
• fix/gen-rpc-pub-sub-distribution
• fix/gen-rpc-pub-sub-message-queue-off-heap
• fix/gen-rpc-pub-sub-shorter-fullsweep
• fix/gen-rpc-pub-sub-test
• fix/gen-rpc-subscriptions
• fix/genrpc-and-dist-metrics
• fix/global-metrics
• fix/handle-long-lived-conns
• fix/handle-match-error
• fix/handle-match-error-on-database-rpc
• fix/handle-max-wal-senders
• fix/handle-nil-tenant
• fix/handle-prefix-key-on-start
• fix/handle-tuple-errors
• fix/handle-unrecognized-events
• fix/handle_sb_keys
• fix/hardcode-presence-limit
• fix/healthcheck-logs
• fix/hs256-signature-verification
• fix/idempotent-migration
• fix/improve-auth-test
• fix/improve-backoff-logic
• fix/improve-ci-security-checks
• fix/improve-clustering-testing
• fix/improve-erlsysmon-logs
• fix/improve-failure-telemetry
• fix/improve-join-payload
• fix/improve-jwt-error-log
• fix/improve-metrics-handling
• fix/improve-runtime-boolean-parsing
• fix/improve-runtime-setup
• fix/improve-suspend-logic
• fix/improved-crud-remote-calls
• fix/increase-connect-error-rate-window
• fix/increase-coverage
• fix/increase-test-coverage
• fix/increase-timestamp-resolution
• fix/infer-boolean-strings-join-payload
• fix/invalid-jwt-error-case
• fix/invalid-jwt-error-log
• fix/invalidate-cache-on-any-tenant-change
• fix/janitor-cleans-disconnected-users
• fix/janitor-not-running
• fix/janitor-reduce-scope
• fix/join-payload-validation
• fix/jwt-secret-migration
• fix/jwt-verification-no-typ
• fix/libcluster-postgres-socket-options
• fix/load-aware-picker
• fix/local-registry
• fix/log-presence-events
• fix/log-stacktrace
• fix/log-warning-invalid-postgres-changes-config
• fix/logging
• fix/lower-presence-rate-limit
• fix/master-region-no-replica
• fix/match-error-on-connect
• fix/max-heap-size-part-2
• fix/measure-tenant-egress
• fix/measure-websocket-traffic
• fix/message-dispatcher-cache
• fix/message-per-second-error
• fix/messages-payload-id
• fix/metric-cleaner-beacon
• fix/metrics-cleaner
• fix/migrate-on-tenant-creation
• fix/migration-timeout
• fix/missing-logged-metadata
• fix/missing-match-on-token-validation
• fix/missing-unauthorized-match
• fix/more-gen_rpc
• fix/move-connect-rate-limit-to-socket
• fix/move-errors-to-warnings
• fix/move-invalid-jwt-log-to-warning
• fix/multicall-cache-invalidation
• fix/multiple-subscriptions
• fix/nodes-all-node-regions-dynamic
• fix/nullable-jwt-secret
• fix/optimise-gen-counter
• fix/optimise-postgres-changes-subscription-ids
• fix/oriole-compatability
• fix/oriole-db-compatability
• fix/partition-cdc-syn-scopes
• fix/peep-ets
• fix/pg-changes-pool-sizes
• fix/pg-changes-subscription-error
• fix/pg-changes-subscription-error-part-2
• fix/pg-output-fix
• fix/ping-gen-rpc
• fix/postgrex-replication-init-timeout
• fix/prefix-replication-slot-and-publication-names
• fix/presence-handler-ack
• fix/presence-handler-refactor
• fix/presence-handler-write-checks
• fix/prevent-join-on-bad-payload
• fix/private-only-change-disconnects-sockets
• fix/proper-exit-reason
• fix/properly-count-total-connections
• fix/properly-handle-pg-sub-timers
• fix/properly-handle-replication-connection-exit
• fix/pub-sub-config
• fix/rate-counter-db-event
• fix/rate-counter-default-shutdown
• fix/rate-counter-presence
• fix/rate-counters-limit-update
• fix/rate-limit-presence-events
• fix/rate-limit-tenants-lack-connections
• fix/ratelimit-log
• fix/realtime-channel-error-cases
• fix/realtime-channel-limit-update
• fix/realtime-connected-metric
• fix/realtime-logging
• fix/realtime-logging-error-code-metadata
• fix/realtime-presence-track-unchanged
• fix/realtime-send-sets-topic-config
• fix/recreate-publication-if-incorrect
• fix/region-broadcasting-node-selection
• fix/reject-connections-on-near-capacity-tenant-database
• fix/reload-endpoint-update
• fix/remote-telemetry-temporarly
• fix/remove-listen
• fix/remove-migrations-from-tenant-creation
• fix/remove-replication-teardown-from-replication-slot-disconnect
• fix/remove-repo-requirement
• fix/remove-unnecessary-publications
• fix/rename-settings
• fix/replace-syn-users
• fix/replica-master-region
• fix/replica-not-started-error
• fix/replication-empty-wal-record
• fix/replication-ignore-unknown-relations
• fix/replication-lag-metrics
• fix/replication-listen-sup-partitions
• fix/replication-poller-max-events
• fix/replication-slot-killing
• fix/restrict-phoenix-logs
• fix/revert-wal-sender-handling
• fix/rls-authorization-metrics
• fix/rpc-authorization
• fix/rpc-metric-fix
• fix/runtime-setup-error
• fix/sb-header-returns-informative-error
• fix/seeds
• fix/seeds-partitions
• fix/selective-migration-running
• fix/self-host-seeds
• fix/set-correct-env-var-name
• fix/set-max-websocket-messages
• fix/set-proper-presence-defaults
• fix/shard-user-scope-syn
• fix/shutdown
• fix/shutdown-connect-on-settings-change
• fix/simplify-logging-approach
• fix/socket-disconnect
• fix/socket-disconnect-on-no-channel
• fix/speedup-peep-export
• fix/speedup-tenant-connected-metrics
• fix/start-supervisor-on-seed
• fix/stop-sending-jwt-to-auth
• fix/stream-metrics-endpoint
• fix/sub-added-to-log-metadata
• fix/subscription-manager-rebalance
• fix/subscription-validation
• fix/subscriptions-rate-limit
• fix/suspend-tenant-socket
• fix/syn-conflict-resolution
• fix/syn-conflict-resolution-timestampless
• fix/tenant-cache-propagation
• fix/tenant-controller-tests-403
• fix/tenant-region-aware-migration
• fix/tenant-token-handling
• fix/test-billable-events
• fix/test-connect-resilience
• fix/testing-with-containers
• fix/unassign-db-conn-from-socket
• fix/unknown-errors-on-realtime-channel
• fix/update-gen-rpc-fullsweep-20
• fix/update-nodejs
• fix/update-peep
• fix/use-libcluster-postgres
• fix/use-syn-for-replication-connection-and-listen
• fix/use-tenant-broadcaster-everywhere
• fix/validate-track-size
• fix/wal-size-error-handling
• main
• realtime-prometheus-push
• refactor/authorization
• refactor/counters
• refactor/rate-counter
• releases/v2.40.12
• remove-rpc-metric
• remove/httpoison-hackney
• remove/unused-file
• revert/promex-phoenix-plugin
• revert/rate-counter-idle
• split/ci-workflow
• test-ci-larger-runner
• tls-all-the-things
• update/cowboy-REAL-517
• update/postgrex
• upgrade-github-actions-node24

Build # 449827faad71193aef2dd7bca37859326e2bb2db-PR-1694

Build Type

Pull #1694

github

Committed by edgurgel

Commit Message

fix: reduce conflicts on load aware node selection

The algorithm has been changed to use a time-bucketed seeded
random node selection. Also changed to the algorithm to always pick two
different nodes

If both nodes did not return a load to be used we just fallback to the
original algorithm to use phash2 on the tenant id for the index

Pull Request Pull Request #1694: fix: reduce conflicts on load aware node selection

Run Details

24 of 24 new or added lines in 2 files covered. (100.0%)

2633 of 2967 relevant lines covered (88.74%)

11049.51 hits per line