• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

grpc / grpc-java / #19987

18 Sep 2025 07:43PM UTC coverage: 88.545% (+0.006%) from 88.539%
#19987

push

github

web-flow
api: Avoid allocating empty array in LoadBalancer (#12337)

Use a singleton empty Object array to initialize the customOptions
default in LoadBalancer.Builder.

34667 of 39152 relevant lines covered (88.54%)

0.89 hits per line

Source File
Press 'n' to go to next uncovered line, 'b' for previous

79.46
/../api/src/main/java/io/grpc/LoadBalancer.java
1
/*
2
 * Copyright 2016 The gRPC Authors
3
 *
4
 * Licensed under the Apache License, Version 2.0 (the "License");
5
 * you may not use this file except in compliance with the License.
6
 * You may obtain a copy of the License at
7
 *
8
 *     http://www.apache.org/licenses/LICENSE-2.0
9
 *
10
 * Unless required by applicable law or agreed to in writing, software
11
 * distributed under the License is distributed on an "AS IS" BASIS,
12
 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
13
 * See the License for the specific language governing permissions and
14
 * limitations under the License.
15
 */
16

17
package io.grpc;
18

19
import static com.google.common.base.Preconditions.checkArgument;
20
import static com.google.common.base.Preconditions.checkNotNull;
21

22
import com.google.common.base.MoreObjects;
23
import com.google.common.base.Objects;
24
import com.google.common.base.Preconditions;
25
import java.util.ArrayList;
26
import java.util.Arrays;
27
import java.util.Collections;
28
import java.util.List;
29
import java.util.Map;
30
import java.util.concurrent.ScheduledExecutorService;
31
import javax.annotation.Nonnull;
32
import javax.annotation.Nullable;
33
import javax.annotation.concurrent.Immutable;
34
import javax.annotation.concurrent.NotThreadSafe;
35
import javax.annotation.concurrent.ThreadSafe;
36

37
/**
38
 * A pluggable component that receives resolved addresses from {@link NameResolver} and provides the
39
 * channel a usable subchannel when asked.
40
 *
41
 * <h3>Overview</h3>
42
 *
43
 * <p>A LoadBalancer typically implements three interfaces:
44
 * <ol>
45
 *   <li>{@link LoadBalancer} is the main interface.  All methods on it are invoked sequentially
46
 *       in the same <strong>synchronization context</strong> (see next section) as returned by
47
 *       {@link io.grpc.LoadBalancer.Helper#getSynchronizationContext}.  It receives the results
48
 *       from the {@link NameResolver}, updates of subchannels' connectivity states, and the
49
 *       channel's request for the LoadBalancer to shutdown.</li>
50
 *   <li>{@link SubchannelPicker SubchannelPicker} does the actual load-balancing work.  It selects
51
 *       a {@link Subchannel Subchannel} for each new RPC.</li>
52
 *   <li>{@link Factory Factory} creates a new {@link LoadBalancer} instance.
53
 * </ol>
54
 *
55
 * <p>{@link Helper Helper} is implemented by gRPC library and provided to {@link Factory
56
 * Factory}. It provides functionalities that a {@code LoadBalancer} implementation would typically
57
 * need.
58
 *
59
 * <h3>The Synchronization Context</h3>
60
 *
61
 * <p>All methods on the {@link LoadBalancer} interface are called from a Synchronization Context,
62
 * meaning they are serialized, thus the balancer implementation doesn't need to worry about
63
 * synchronization among them.  {@link io.grpc.LoadBalancer.Helper#getSynchronizationContext}
64
 * allows implementations to schedule tasks to be run in the same Synchronization Context, with or
65
 * without a delay, thus those tasks don't need to worry about synchronizing with the balancer
66
 * methods.
67
 * 
68
 * <p>However, the actual running thread may be the network thread, thus the following rules must be
69
 * followed to prevent blocking or even dead-locking in a network:
70
 *
71
 * <ol>
72
 *
73
 *   <li><strong>Never block in the Synchronization Context</strong>.  The callback methods must
74
 *   return quickly.  Examples or work that must be avoided: CPU-intensive calculation, waiting on
75
 *   synchronization primitives, blocking I/O, blocking RPCs, etc.</li>
76
 *
77
 *   <li><strong>Avoid calling into other components with lock held</strong>.  The Synchronization
78
 *   Context may be under a lock, e.g., the transport lock of OkHttp.  If your LoadBalancer holds a
79
 *   lock in a callback method (e.g., {@link #handleResolvedAddresses handleResolvedAddresses()})
80
 *   while calling into another method that also involves locks, be cautious of deadlock.  Generally
81
 *   you wouldn't need any locking in the LoadBalancer if you follow the canonical implementation
82
 *   pattern below.</li>
83
 *
84
 * </ol>
85
 *
86
 * <h3>The canonical implementation pattern</h3>
87
 *
88
 * <p>A {@link LoadBalancer} keeps states like the latest addresses from NameResolver, the
89
 * Subchannel(s) and their latest connectivity states.  These states are mutated within the
90
 * Synchronization Context,
91
 *
92
 * <p>A typical {@link SubchannelPicker SubchannelPicker} holds a snapshot of these states.  It may
93
 * have its own states, e.g., a picker from a round-robin load-balancer may keep a pointer to the
94
 * next Subchannel, which are typically mutated by multiple threads.  The picker should only mutate
95
 * its own state, and should not mutate or re-acquire the states of the LoadBalancer.  This way the
96
 * picker only needs to synchronize its own states, which is typically trivial to implement.
97
 *
98
 * <p>When the LoadBalancer states changes, e.g., Subchannels has become or stopped being READY, and
99
 * we want subsequent RPCs to use the latest list of READY Subchannels, LoadBalancer would create a
100
 * new picker, which holds a snapshot of the latest Subchannel list.  Refer to the javadoc of {@link
101
 * io.grpc.LoadBalancer.SubchannelStateListener#onSubchannelState onSubchannelState()} how to do
102
 * this properly.
103
 *
104
 * <p>No synchronization should be necessary between LoadBalancer and its pickers if you follow
105
 * the pattern above.  It may be possible to implement in a different way, but that would usually
106
 * result in more complicated threading.
107
 *
108
 * @since 1.2.0
109
 */
110
@ExperimentalApi("https://github.com/grpc/grpc-java/issues/1771")
111
@NotThreadSafe
112
public abstract class LoadBalancer {
1✔
113

114
  @Internal
115
  @NameResolver.ResolutionResultAttr
116
  public static final Attributes.Key<Map<String, ?>> ATTR_HEALTH_CHECKING_CONFIG =
1✔
117
      Attributes.Key.create("internal:health-checking-config");
1✔
118

119
  @Internal
120
  public static final LoadBalancer.CreateSubchannelArgs.Key<LoadBalancer.SubchannelStateListener>
121
      HEALTH_CONSUMER_LISTENER_ARG_KEY =
1✔
122
      LoadBalancer.CreateSubchannelArgs.Key.create("internal:health-check-consumer-listener");
1✔
123

124
  @Internal
125
  public static final LoadBalancer.CreateSubchannelArgs.Key<Boolean>
126
      DISABLE_SUBCHANNEL_RECONNECT_KEY =
1✔
127
      LoadBalancer.CreateSubchannelArgs.Key.createWithDefault(
1✔
128
          "internal:disable-subchannel-reconnect", Boolean.FALSE);
129

130
  @Internal
131
  public static final Attributes.Key<Boolean>
132
      HAS_HEALTH_PRODUCER_LISTENER_KEY =
1✔
133
      Attributes.Key.create("internal:has-health-check-producer-listener");
1✔
134

135
  public static final Attributes.Key<Boolean> IS_PETIOLE_POLICY =
1✔
136
      Attributes.Key.create("io.grpc.IS_PETIOLE_POLICY");
1✔
137

138
  /**
139
   * A picker that always returns an erring pick.
140
   *
141
   * @deprecated Use {@code new FixedResultPicker(PickResult.withNoResult())} instead.
142
   */
143
  @Deprecated
144
  public static final SubchannelPicker EMPTY_PICKER = new SubchannelPicker() {
1✔
145
    @Override
146
    public PickResult pickSubchannel(PickSubchannelArgs args) {
147
      return PickResult.withNoResult();
×
148
    }
149

150
    @Override
151
    public String toString() {
152
      return "EMPTY_PICKER";
×
153
    }
154
  };
155

156
  private int recursionCount;
157

158
  /**
159
   * Handles newly resolved server groups and metadata attributes from name resolution system.
160
   * {@code servers} contained in {@link EquivalentAddressGroup} should be considered equivalent
161
   * but may be flattened into a single list if needed.
162
   *
163
   * <p>Implementations should not modify the given {@code servers}.
164
   *
165
   * @param resolvedAddresses the resolved server addresses, attributes, and config.
166
   * @since 1.21.0
167
   */
168
  public void handleResolvedAddresses(ResolvedAddresses resolvedAddresses) {
169
    if (recursionCount++ == 0) {
1✔
170
      // Note that the information about the addresses actually being accepted will be lost
171
      // if you rely on this method for backward compatibility.
172
      acceptResolvedAddresses(resolvedAddresses);
1✔
173
    }
174
    recursionCount = 0;
1✔
175
  }
1✔
176

177
  /**
178
   * Accepts newly resolved addresses from the name resolution system. The {@link
179
   * EquivalentAddressGroup} addresses should be considered equivalent but may be flattened into a
180
   * single list if needed.
181
   *
182
   * <p>Implementations can choose to reject the given addresses by returning {@code false}.
183
   *
184
   * <p>Implementations should not modify the given {@code addresses}.
185
   *
186
   * @param resolvedAddresses the resolved server addresses, attributes, and config.
187
   * @return {@code true} if the resolved addresses were accepted. {@code false} if rejected.
188
   * @since 1.49.0
189
   */
190
  public Status acceptResolvedAddresses(ResolvedAddresses resolvedAddresses) {
191
    if (resolvedAddresses.getAddresses().isEmpty()
1✔
192
        && !canHandleEmptyAddressListFromNameResolution()) {
×
193
      Status unavailableStatus = Status.UNAVAILABLE.withDescription(
×
194
              "NameResolver returned no usable address. addrs=" + resolvedAddresses.getAddresses()
×
195
                      + ", attrs=" + resolvedAddresses.getAttributes());
×
196
      handleNameResolutionError(unavailableStatus);
×
197
      return unavailableStatus;
×
198
    } else {
199
      if (recursionCount++ == 0) {
1✔
200
        handleResolvedAddresses(resolvedAddresses);
×
201
      }
202
      recursionCount = 0;
1✔
203

204
      return Status.OK;
1✔
205
    }
206
  }
207

208
  /**
209
   * Represents a combination of the resolved server address, associated attributes and a load
210
   * balancing policy config.  The config is from the {@link
211
   * LoadBalancerProvider#parseLoadBalancingPolicyConfig(Map)}.
212
   *
213
   * @since 1.21.0
214
   */
215
  @ExperimentalApi("https://github.com/grpc/grpc-java/issues/11657")
216
  public static final class ResolvedAddresses {
217
    private final List<EquivalentAddressGroup> addresses;
218
    @NameResolver.ResolutionResultAttr
219
    private final Attributes attributes;
220
    @Nullable
221
    private final Object loadBalancingPolicyConfig;
222
    // Make sure to update toBuilder() below!
223

224
    private ResolvedAddresses(
225
        List<EquivalentAddressGroup> addresses,
226
        @NameResolver.ResolutionResultAttr Attributes attributes,
227
        Object loadBalancingPolicyConfig) {
1✔
228
      this.addresses =
1✔
229
          Collections.unmodifiableList(new ArrayList<>(checkNotNull(addresses, "addresses")));
1✔
230
      this.attributes = checkNotNull(attributes, "attributes");
1✔
231
      this.loadBalancingPolicyConfig = loadBalancingPolicyConfig;
1✔
232
    }
1✔
233

234
    /**
235
     * Factory for constructing a new Builder.
236
     *
237
     * @since 1.21.0
238
     */
239
    public static Builder newBuilder() {
240
      return new Builder();
1✔
241
    }
242

243
    /**
244
     * Converts this back to a builder.
245
     *
246
     * @since 1.21.0
247
     */
248
    public Builder toBuilder() {
249
      return newBuilder()
1✔
250
          .setAddresses(addresses)
1✔
251
          .setAttributes(attributes)
1✔
252
          .setLoadBalancingPolicyConfig(loadBalancingPolicyConfig);
1✔
253
    }
254

255
    /**
256
     * Gets the server addresses.
257
     *
258
     * @since 1.21.0
259
     */
260
    public List<EquivalentAddressGroup> getAddresses() {
261
      return addresses;
1✔
262
    }
263

264
    /**
265
     * Gets the attributes associated with these addresses.  If this was not previously set,
266
     * {@link Attributes#EMPTY} will be returned.
267
     *
268
     * @since 1.21.0
269
     */
270
    @NameResolver.ResolutionResultAttr
271
    public Attributes getAttributes() {
272
      return attributes;
1✔
273
    }
274

275
    /**
276
     * Gets the domain specific load balancing policy.  This is the config produced by
277
     * {@link LoadBalancerProvider#parseLoadBalancingPolicyConfig(Map)}.
278
     *
279
     * @since 1.21.0
280
     */
281
    @Nullable
282
    public Object getLoadBalancingPolicyConfig() {
283
      return loadBalancingPolicyConfig;
1✔
284
    }
285

286
    /**
287
     * Builder for {@link ResolvedAddresses}.
288
     */
289
    @ExperimentalApi("https://github.com/grpc/grpc-java/issues/1771")
290
    public static final class Builder {
291
      private List<EquivalentAddressGroup> addresses;
292
      @NameResolver.ResolutionResultAttr
1✔
293
      private Attributes attributes = Attributes.EMPTY;
294
      @Nullable
295
      private Object loadBalancingPolicyConfig;
296

297
      Builder() {}
1✔
298

299
      /**
300
       * Sets the addresses.  This field is required.
301
       *
302
       * @return this.
303
       */
304
      public Builder setAddresses(List<EquivalentAddressGroup> addresses) {
305
        this.addresses = addresses;
1✔
306
        return this;
1✔
307
      }
308

309
      /**
310
       * Sets the attributes.  This field is optional; if not called, {@link Attributes#EMPTY}
311
       * will be used.
312
       *
313
       * @return this.
314
       */
315
      public Builder setAttributes(@NameResolver.ResolutionResultAttr Attributes attributes) {
316
        this.attributes = attributes;
1✔
317
        return this;
1✔
318
      }
319

320
      /**
321
       * Sets the load balancing policy config. This field is optional.
322
       *
323
       * @return this.
324
       */
325
      public Builder setLoadBalancingPolicyConfig(@Nullable Object loadBalancingPolicyConfig) {
326
        this.loadBalancingPolicyConfig = loadBalancingPolicyConfig;
1✔
327
        return this;
1✔
328
      }
329

330
      /**
331
       * Constructs the {@link ResolvedAddresses}.
332
       */
333
      public ResolvedAddresses build() {
334
        return new ResolvedAddresses(addresses, attributes, loadBalancingPolicyConfig);
1✔
335
      }
336
    }
337

338
    @Override
339
    public String toString() {
340
      return MoreObjects.toStringHelper(this)
1✔
341
          .add("addresses", addresses)
1✔
342
          .add("attributes", attributes)
1✔
343
          .add("loadBalancingPolicyConfig", loadBalancingPolicyConfig)
1✔
344
          .toString();
1✔
345
    }
346

347
    @Override
348
    public int hashCode() {
349
      return Objects.hashCode(addresses, attributes, loadBalancingPolicyConfig);
×
350
    }
351

352
    @Override
353
    public boolean equals(Object obj) {
354
      if (!(obj instanceof ResolvedAddresses)) {
1✔
355
        return false;
×
356
      }
357
      ResolvedAddresses that = (ResolvedAddresses) obj;
1✔
358
      return Objects.equal(this.addresses, that.addresses)
1✔
359
          && Objects.equal(this.attributes, that.attributes)
1✔
360
          && Objects.equal(this.loadBalancingPolicyConfig, that.loadBalancingPolicyConfig);
1✔
361
    }
362
  }
363

364
  /**
365
   * Handles an error from the name resolution system.
366
   *
367
   * @param error a non-OK status
368
   * @since 1.2.0
369
   */
370
  public abstract void handleNameResolutionError(Status error);
371

372
  /**
373
   * Handles a state change on a Subchannel.
374
   *
375
   * <p>The initial state of a Subchannel is IDLE. You won't get a notification for the initial IDLE
376
   * state.
377
   *
378
   * <p>If the new state is not SHUTDOWN, this method should create a new picker and call {@link
379
   * Helper#updateBalancingState Helper.updateBalancingState()}.  Failing to do so may result in
380
   * unnecessary delays of RPCs. Please refer to {@link PickResult#withSubchannel
381
   * PickResult.withSubchannel()}'s javadoc for more information.
382
   *
383
   * <p>SHUTDOWN can only happen in two cases.  One is that LoadBalancer called {@link
384
   * Subchannel#shutdown} earlier, thus it should have already discarded this Subchannel.  The other
385
   * is that Channel is doing a {@link ManagedChannel#shutdownNow forced shutdown} or has already
386
   * terminated, thus there won't be further requests to LoadBalancer.  Therefore, the LoadBalancer
387
   * usually don't need to react to a SHUTDOWN state.
388
   *
389
   * @param subchannel the involved Subchannel
390
   * @param stateInfo the new state
391
   * @since 1.2.0
392
   * @deprecated This method will be removed.  Stop overriding it.  Instead, pass {@link
393
   *             SubchannelStateListener} to {@link Subchannel#start} to receive Subchannel state
394
   *             updates
395
   */
396
  @Deprecated
397
  public void handleSubchannelState(
398
      Subchannel subchannel, ConnectivityStateInfo stateInfo) {
399
    // Do nothing.  If the implementation doesn't implement this, it will get subchannel states from
400
    // the new API.  We don't throw because there may be forwarding LoadBalancers still plumb this.
401
  }
×
402

403
  /**
404
   * The channel asks the load-balancer to shutdown.  No more methods on this class will be called
405
   * after this method.  The implementation should shutdown all Subchannels and OOB channels, and do
406
   * any other cleanup as necessary.
407
   *
408
   * @since 1.2.0
409
   */
410
  public abstract void shutdown();
411

412
  /**
413
   * Whether this LoadBalancer can handle empty address group list to be passed to {@link
414
   * #handleResolvedAddresses(ResolvedAddresses)}.  The default implementation returns
415
   * {@code false}, meaning that if the NameResolver returns an empty list, the Channel will turn
416
   * that into an error and call {@link #handleNameResolutionError}.  LoadBalancers that want to
417
   * accept empty lists should override this method and return {@code true}.
418
   *
419
   * <p>This method should always return a constant value.  It's not specified when this will be
420
   * called.
421
   */
422
  public boolean canHandleEmptyAddressListFromNameResolution() {
423
    return false;
×
424
  }
425

426
  /**
427
   * The channel asks the LoadBalancer to establish connections now (if applicable) so that the
428
   * upcoming RPC may then just pick a ready connection without waiting for connections.  This
429
   * is triggered by {@link ManagedChannel#getState ManagedChannel.getState(true)}.
430
   *
431
   * <p>If LoadBalancer doesn't override it, this is no-op.  If it infeasible to create connections
432
   * given the current state, e.g. no Subchannel has been created yet, LoadBalancer can ignore this
433
   * request.
434
   *
435
   * @since 1.22.0
436
   */
437
  public void requestConnection() {}
1✔
438

439
  /**
440
   * The main balancing logic.  It <strong>must be thread-safe</strong>. Typically it should only
441
   * synchronize on its own state, and avoid synchronizing with the LoadBalancer's state.
442
   *
443
   * @since 1.2.0
444
   */
445
  @ThreadSafe
446
  @ExperimentalApi("https://github.com/grpc/grpc-java/issues/1771")
447
  public abstract static class SubchannelPicker {
1✔
448
    /**
449
     * Make a balancing decision for a new RPC.
450
     *
451
     * @param args the pick arguments
452
     * @since 1.3.0
453
     */
454
    public abstract PickResult pickSubchannel(PickSubchannelArgs args);
455
  }
456

457
  /**
458
   * Provides arguments for a {@link SubchannelPicker#pickSubchannel(
459
   * LoadBalancer.PickSubchannelArgs)}.
460
   *
461
   * @since 1.2.0
462
   */
463
  @ExperimentalApi("https://github.com/grpc/grpc-java/issues/1771")
464
  public abstract static class PickSubchannelArgs {
1✔
465

466
    /**
467
     * Call options.
468
     *
469
     * @since 1.2.0
470
     */
471
    public abstract CallOptions getCallOptions();
472

473
    /**
474
     * Headers of the call. {@link SubchannelPicker#pickSubchannel} may mutate it before before
475
     * returning.
476
     *
477
     * @since 1.2.0
478
     */
479
    public abstract Metadata getHeaders();
480

481
    /**
482
     * Call method.
483
     *
484
     * @since 1.2.0
485
     */
486
    public abstract MethodDescriptor<?, ?> getMethodDescriptor();
487

488
    /**
489
     * Gets an object that can be informed about what sort of pick was made.
490
     */
491
    @Internal
492
    public PickDetailsConsumer getPickDetailsConsumer() {
493
      return new PickDetailsConsumer() {};
×
494
    }
495
  }
496

497
  /** Receives information about the pick being chosen. */
498
  @Internal
499
  public interface PickDetailsConsumer {
500
    /**
501
     * Optional labels that provide context of how the pick was routed. Particularly helpful for
502
     * per-RPC metrics.
503
     *
504
     * @throws NullPointerException if key or value is {@code null}
505
     */
506
    default void addOptionalLabel(String key, String value) {
507
      checkNotNull(key, "key");
1✔
508
      checkNotNull(value, "value");
1✔
509
    }
1✔
510
  }
511

512
  /**
513
   * A balancing decision made by {@link SubchannelPicker SubchannelPicker} for an RPC.
514
   *
515
   * <p>The outcome of the decision will be one of the following:
516
   * <ul>
517
   *   <li>Proceed: if a Subchannel is provided via {@link #withSubchannel withSubchannel()}, and is
518
   *       in READY state when the RPC tries to start on it, the RPC will proceed on that
519
   *       Subchannel.</li>
520
   *   <li>Error: if an error is provided via {@link #withError withError()}, and the RPC is not
521
   *       wait-for-ready (i.e., {@link CallOptions#withWaitForReady} was not called), the RPC will
522
   *       fail immediately with the given error.</li>
523
   *   <li>Buffer: in all other cases, the RPC will be buffered in the Channel, until the next
524
   *       picker is provided via {@link Helper#updateBalancingState Helper.updateBalancingState()},
525
   *       when the RPC will go through the same picking process again.</li>
526
   * </ul>
527
   *
528
   * @since 1.2.0
529
   */
530
  @Immutable
531
  @ExperimentalApi("https://github.com/grpc/grpc-java/issues/1771")
532
  public static final class PickResult {
533
    private static final PickResult NO_RESULT = new PickResult(null, null, Status.OK, false);
1✔
534

535
    @Nullable private final Subchannel subchannel;
536
    @Nullable private final ClientStreamTracer.Factory streamTracerFactory;
537
    // An error to be propagated to the application if subchannel == null
538
    // Or OK if there is no error.
539
    // subchannel being null and error being OK means RPC needs to wait
540
    private final Status status;
541
    // True if the result is created by withDrop()
542
    private final boolean drop;
543
    @Nullable private final String authorityOverride;
544

545
    private PickResult(
546
        @Nullable Subchannel subchannel, @Nullable ClientStreamTracer.Factory streamTracerFactory,
547
        Status status, boolean drop) {
1✔
548
      this.subchannel = subchannel;
1✔
549
      this.streamTracerFactory = streamTracerFactory;
1✔
550
      this.status = checkNotNull(status, "status");
1✔
551
      this.drop = drop;
1✔
552
      this.authorityOverride = null;
1✔
553
    }
1✔
554

555
    private PickResult(
556
        @Nullable Subchannel subchannel, @Nullable ClientStreamTracer.Factory streamTracerFactory,
557
        Status status, boolean drop, @Nullable String authorityOverride) {
1✔
558
      this.subchannel = subchannel;
1✔
559
      this.streamTracerFactory = streamTracerFactory;
1✔
560
      this.status = checkNotNull(status, "status");
1✔
561
      this.drop = drop;
1✔
562
      this.authorityOverride = authorityOverride;
1✔
563
    }
1✔
564

565
    /**
566
     * A decision to proceed the RPC on a Subchannel.
567
     *
568
     * <p>The Subchannel should either be an original Subchannel returned by {@link
569
     * Helper#createSubchannel Helper.createSubchannel()}, or a wrapper of it preferably based on
570
     * {@code ForwardingSubchannel}.  At the very least its {@link Subchannel#getInternalSubchannel
571
     * getInternalSubchannel()} must return the same object as the one returned by the original.
572
     * Otherwise the Channel cannot use it for the RPC.
573
     *
574
     * <p>When the RPC tries to use the return Subchannel, which is briefly after this method
575
     * returns, the state of the Subchannel will decide where the RPC would go:
576
     *
577
     * <ul>
578
     *   <li>READY: the RPC will proceed on this Subchannel.</li>
579
     *   <li>IDLE: the RPC will be buffered.  Subchannel will attempt to create connection.</li>
580
     *   <li>All other states: the RPC will be buffered.</li>
581
     * </ul>
582
     *
583
     * <p><strong>All buffered RPCs will stay buffered</strong> until the next call of {@link
584
     * Helper#updateBalancingState Helper.updateBalancingState()}, which will trigger a new picking
585
     * process.
586
     *
587
     * <p>Note that Subchannel's state may change at the same time the picker is making the
588
     * decision, which means the decision may be made with (to-be) outdated information.  For
589
     * example, a picker may return a Subchannel known to be READY, but it has become IDLE when is
590
     * about to be used by the RPC, which makes the RPC to be buffered.  The LoadBalancer will soon
591
     * learn about the Subchannels' transition from READY to IDLE, create a new picker and allow the
592
     * RPC to use another READY transport if there is any.
593
     *
594
     * <p>You will want to avoid running into a situation where there are READY Subchannels out
595
     * there but some RPCs are still buffered for longer than a brief time.
596
     * <ul>
597
     *   <li>This can happen if you return Subchannels with states other than READY and IDLE.  For
598
     *       example, suppose you round-robin on 2 Subchannels, in READY and CONNECTING states
599
     *       respectively.  If the picker ignores the state and pick them equally, 50% of RPCs will
600
     *       be stuck in buffered state until both Subchannels are READY.</li>
601
     *   <li>This can also happen if you don't create a new picker at key state changes of
602
     *       Subchannels.  Take the above round-robin example again.  Suppose you do pick only READY
603
     *       and IDLE Subchannels, and initially both Subchannels are READY.  Now one becomes IDLE,
604
     *       then CONNECTING and stays CONNECTING for a long time.  If you don't create a new picker
605
     *       in response to the CONNECTING state to exclude that Subchannel, 50% of RPCs will hit it
606
     *       and be buffered even though the other Subchannel is READY.</li>
607
     * </ul>
608
     *
609
     * <p>In order to prevent unnecessary delay of RPCs, the rules of thumb are:
610
     * <ol>
611
     *   <li>The picker should only pick Subchannels that are known as READY or IDLE.  Whether to
612
     *       pick IDLE Subchannels depends on whether you want Subchannels to connect on-demand or
613
     *       actively:
614
     *       <ul>
615
     *         <li>If you want connect-on-demand, include IDLE Subchannels in your pick results,
616
     *             because when an RPC tries to use an IDLE Subchannel, the Subchannel will try to
617
     *             connect.</li>
618
     *         <li>If you want Subchannels to be always connected even when there is no RPC, you
619
     *             would call {@link Subchannel#requestConnection Subchannel.requestConnection()}
620
     *             whenever the Subchannel has transitioned to IDLE, then you don't need to include
621
     *             IDLE Subchannels in your pick results.</li>
622
     *       </ul></li>
623
     *   <li>Always create a new picker and call {@link Helper#updateBalancingState
624
     *       Helper.updateBalancingState()} whenever {@link #handleSubchannelState
625
     *       handleSubchannelState()} is called, unless the new state is SHUTDOWN. See
626
     *       {@code handleSubchannelState}'s javadoc for more details.</li>
627
     * </ol>
628
     *
629
     * @param subchannel the picked Subchannel.  It must have been {@link Subchannel#start started}
630
     * @param streamTracerFactory if not null, will be used to trace the activities of the stream
631
     *                            created as a result of this pick. Note it's possible that no
632
     *                            stream is created at all in some cases.
633
     * @since 1.3.0
634
     */
635
    public static PickResult withSubchannel(
636
        Subchannel subchannel, @Nullable ClientStreamTracer.Factory streamTracerFactory) {
637
      return new PickResult(
1✔
638
          checkNotNull(subchannel, "subchannel"), streamTracerFactory, Status.OK,
1✔
639
          false);
640
    }
641

642
    /**
643
     * Same as {@code withSubchannel(subchannel, streamTracerFactory)} but with an authority name
644
     * to override in the host header.
645
     */
646
    @ExperimentalApi("https://github.com/grpc/grpc-java/issues/11656")
647
    public static PickResult withSubchannel(
648
        Subchannel subchannel, @Nullable ClientStreamTracer.Factory streamTracerFactory,
649
        @Nullable String authorityOverride) {
650
      return new PickResult(
1✔
651
          checkNotNull(subchannel, "subchannel"), streamTracerFactory, Status.OK,
1✔
652
          false, authorityOverride);
653
    }
654

655
    /**
656
     * Equivalent to {@code withSubchannel(subchannel, null)}.
657
     *
658
     * @since 1.2.0
659
     */
660
    public static PickResult withSubchannel(Subchannel subchannel) {
661
      return withSubchannel(subchannel, null);
1✔
662
    }
663

664
    /**
665
     * A decision to report a connectivity error to the RPC.  If the RPC is {@link
666
     * CallOptions#withWaitForReady wait-for-ready}, it will stay buffered.  Otherwise, it will fail
667
     * with the given error.
668
     *
669
     * @param error the error status.  Must not be OK.
670
     * @since 1.2.0
671
     */
672
    public static PickResult withError(Status error) {
673
      Preconditions.checkArgument(!error.isOk(), "error status shouldn't be OK");
1✔
674
      return new PickResult(null, null, error, false);
1✔
675
    }
676

677
    /**
678
     * A decision to fail an RPC immediately.  This is a final decision and will ignore retry
679
     * policy.
680
     *
681
     * @param status the status with which the RPC will fail.  Must not be OK.
682
     * @since 1.8.0
683
     */
684
    public static PickResult withDrop(Status status) {
685
      Preconditions.checkArgument(!status.isOk(), "drop status shouldn't be OK");
1✔
686
      return new PickResult(null, null, status, true);
1✔
687
    }
688

689
    /**
690
     * No decision could be made.  The RPC will stay buffered.
691
     *
692
     * @since 1.2.0
693
     */
694
    public static PickResult withNoResult() {
695
      return NO_RESULT;
1✔
696
    }
697

698
    /** Returns the authority override if any. */
699
    @ExperimentalApi("https://github.com/grpc/grpc-java/issues/11656")
700
    @Nullable
701
    public String getAuthorityOverride() {
702
      return authorityOverride;
1✔
703
    }
704

705
    /**
706
     * The Subchannel if this result was created by {@link #withSubchannel withSubchannel()}, or
707
     * null otherwise.
708
     *
709
     * @since 1.2.0
710
     */
711
    @Nullable
712
    public Subchannel getSubchannel() {
713
      return subchannel;
1✔
714
    }
715

716
    /**
717
     * The stream tracer factory this result was created with.
718
     *
719
     * @since 1.3.0
720
     */
721
    @Nullable
722
    public ClientStreamTracer.Factory getStreamTracerFactory() {
723
      return streamTracerFactory;
1✔
724
    }
725

726
    /**
727
     * The status associated with this result.  Non-{@code OK} if created with {@link #withError
728
     * withError}, or {@code OK} otherwise.
729
     *
730
     * @since 1.2.0
731
     */
732
    public Status getStatus() {
733
      return status;
1✔
734
    }
735

736
    /**
737
     * Returns {@code true} if this result was created by {@link #withDrop withDrop()}.
738
     *
739
     * @since 1.8.0
740
     */
741
    public boolean isDrop() {
742
      return drop;
1✔
743
    }
744

745
    /**
746
     * Returns {@code true} if the pick was not created with {@link #withNoResult()}.
747
     */
748
    public boolean hasResult() {
749
      return !(subchannel == null && status.isOk());
1✔
750
    }
751

752
    @Override
753
    public String toString() {
754
      return MoreObjects.toStringHelper(this)
1✔
755
          .add("subchannel", subchannel)
1✔
756
          .add("streamTracerFactory", streamTracerFactory)
1✔
757
          .add("status", status)
1✔
758
          .add("drop", drop)
1✔
759
          .add("authority-override", authorityOverride)
1✔
760
          .toString();
1✔
761
    }
762

763
    @Override
764
    public int hashCode() {
765
      return Objects.hashCode(subchannel, status, streamTracerFactory, drop);
1✔
766
    }
767

768
    /**
769
     * Returns true if the {@link Subchannel}, {@link Status}, and
770
     * {@link ClientStreamTracer.Factory} all match.
771
     */
772
    @Override
773
    public boolean equals(Object other) {
774
      if (!(other instanceof PickResult)) {
1✔
775
        return false;
×
776
      }
777
      PickResult that = (PickResult) other;
1✔
778
      return Objects.equal(subchannel, that.subchannel) && Objects.equal(status, that.status)
1✔
779
          && Objects.equal(streamTracerFactory, that.streamTracerFactory)
1✔
780
          && drop == that.drop;
781
    }
782
  }
783

784
  /**
785
   * Arguments for creating a {@link Subchannel}.
786
   *
787
   * @since 1.22.0
788
   */
789
  @ExperimentalApi("https://github.com/grpc/grpc-java/issues/1771")
790
  public static final class CreateSubchannelArgs {
791
    private final List<EquivalentAddressGroup> addrs;
792
    private final Attributes attrs;
793
    private final Object[][] customOptions;
794

795
    private CreateSubchannelArgs(
796
        List<EquivalentAddressGroup> addrs, Attributes attrs, Object[][] customOptions) {
1✔
797
      this.addrs = checkNotNull(addrs, "addresses are not set");
1✔
798
      this.attrs = checkNotNull(attrs, "attrs");
1✔
799
      this.customOptions = checkNotNull(customOptions, "customOptions");
1✔
800
    }
1✔
801

802
    /**
803
     * Returns the addresses, which is an unmodifiable list.
804
     */
805
    public List<EquivalentAddressGroup> getAddresses() {
806
      return addrs;
1✔
807
    }
808

809
    /**
810
     * Returns the attributes.
811
     */
812
    public Attributes getAttributes() {
813
      return attrs;
1✔
814
    }
815

816
    /**
817
     * Get the value for a custom option or its inherent default.
818
     *
819
     * @param key Key identifying option
820
     */
821
    @SuppressWarnings("unchecked")
822
    public <T> T getOption(Key<T> key) {
823
      Preconditions.checkNotNull(key, "key");
1✔
824
      for (int i = 0; i < customOptions.length; i++) {
1✔
825
        if (key.equals(customOptions[i][0])) {
1✔
826
          return (T) customOptions[i][1];
1✔
827
        }
828
      }
829
      return key.defaultValue;
1✔
830
    }
831

832
    /**
833
     * Returns a builder with the same initial values as this object.
834
     */
835
    public Builder toBuilder() {
836
      return newBuilder().setAddresses(addrs).setAttributes(attrs).copyCustomOptions(customOptions);
1✔
837
    }
838

839
    /**
840
     * Creates a new builder.
841
     */
842
    public static Builder newBuilder() {
843
      return new Builder();
1✔
844
    }
845

846
    @Override
847
    public String toString() {
848
      return MoreObjects.toStringHelper(this)
1✔
849
          .add("addrs", addrs)
1✔
850
          .add("attrs", attrs)
1✔
851
          .add("customOptions", Arrays.deepToString(customOptions))
1✔
852
          .toString();
1✔
853
    }
854

855
    @ExperimentalApi("https://github.com/grpc/grpc-java/issues/1771")
856
    public static final class Builder {
857

858
      private static final Object[][] EMPTY_CUSTOM_OPTIONS = new Object[0][2];
1✔
859

860
      private List<EquivalentAddressGroup> addrs;
861
      private Attributes attrs = Attributes.EMPTY;
1✔
862
      private Object[][] customOptions = EMPTY_CUSTOM_OPTIONS;
1✔
863

864
      Builder() {
1✔
865
      }
1✔
866

867
      private Builder copyCustomOptions(Object[][] options) {
868
        customOptions = new Object[options.length][2];
1✔
869
        System.arraycopy(options, 0, customOptions, 0, options.length);
1✔
870
        return this;
1✔
871
      }
872

873
      /**
874
       * Add a custom option. Any existing value for the key is overwritten.
875
       *
876
       * <p>This is an <strong>optional</strong> property.
877
       *
878
       * @param key the option key
879
       * @param value the option value
880
       */
881
      public <T> Builder addOption(Key<T> key, T value) {
882
        Preconditions.checkNotNull(key, "key");
1✔
883
        Preconditions.checkNotNull(value, "value");
1✔
884

885
        int existingIdx = -1;
1✔
886
        for (int i = 0; i < customOptions.length; i++) {
1✔
887
          if (key.equals(customOptions[i][0])) {
1✔
888
            existingIdx = i;
1✔
889
            break;
1✔
890
          }
891
        }
892

893
        if (existingIdx == -1) {
1✔
894
          Object[][] newCustomOptions = new Object[customOptions.length + 1][2];
1✔
895
          System.arraycopy(customOptions, 0, newCustomOptions, 0, customOptions.length);
1✔
896
          customOptions = newCustomOptions;
1✔
897
          existingIdx = customOptions.length - 1;
1✔
898
        }
899
        customOptions[existingIdx] = new Object[]{key, value};
1✔
900
        return this;
1✔
901
      }
902

903
      /**
904
       * The addresses to connect to.  All addresses are considered equivalent and will be tried
905
       * in the order they are provided.
906
       */
907
      public Builder setAddresses(EquivalentAddressGroup addrs) {
908
        this.addrs = Collections.singletonList(addrs);
1✔
909
        return this;
1✔
910
      }
911

912
      /**
913
       * The addresses to connect to.  All addresses are considered equivalent and will
914
       * be tried in the order they are provided.
915
       *
916
       * <p>This is a <strong>required</strong> property.
917
       *
918
       * @throws IllegalArgumentException if {@code addrs} is empty
919
       */
920
      public Builder setAddresses(List<EquivalentAddressGroup> addrs) {
921
        checkArgument(!addrs.isEmpty(), "addrs is empty");
1✔
922
        this.addrs = Collections.unmodifiableList(new ArrayList<>(addrs));
1✔
923
        return this;
1✔
924
      }
925

926
      /**
927
       * Attributes provided here will be included in {@link Subchannel#getAttributes}.
928
       *
929
       * <p>This is an <strong>optional</strong> property.  Default is empty if not set.
930
       */
931
      public Builder setAttributes(Attributes attrs) {
932
        this.attrs = checkNotNull(attrs, "attrs");
1✔
933
        return this;
1✔
934
      }
935

936
      /**
937
       * Creates a new args object.
938
       */
939
      public CreateSubchannelArgs build() {
940
        return new CreateSubchannelArgs(addrs, attrs, customOptions);
1✔
941
      }
942
    }
943

944
    /**
945
     * Key for a key-value pair. Uses reference equality.
946
     */
947
    @ExperimentalApi("https://github.com/grpc/grpc-java/issues/1771")
948
    public static final class Key<T> {
949

950
      private final String debugString;
951
      private final T defaultValue;
952

953
      private Key(String debugString, T defaultValue) {
1✔
954
        this.debugString = debugString;
1✔
955
        this.defaultValue = defaultValue;
1✔
956
      }
1✔
957

958
      /**
959
       * Factory method for creating instances of {@link Key}. The default value of the key is
960
       * {@code null}.
961
       *
962
       * @param debugString a debug string that describes this key.
963
       * @param <T> Key type
964
       * @return Key object
965
       */
966
      public static <T> Key<T> create(String debugString) {
967
        Preconditions.checkNotNull(debugString, "debugString");
1✔
968
        return new Key<>(debugString, /*defaultValue=*/ null);
1✔
969
      }
970

971
      /**
972
       * Factory method for creating instances of {@link Key}.
973
       *
974
       * @param debugString a debug string that describes this key.
975
       * @param defaultValue default value to return when value for key not set
976
       * @param <T> Key type
977
       * @return Key object
978
       */
979
      public static <T> Key<T> createWithDefault(String debugString, T defaultValue) {
980
        Preconditions.checkNotNull(debugString, "debugString");
1✔
981
        return new Key<>(debugString, defaultValue);
1✔
982
      }
983

984
      /**
985
       * Returns the user supplied default value for this key.
986
       */
987
      public T getDefault() {
988
        return defaultValue;
×
989
      }
990

991
      @Override
992
      public String toString() {
993
        return debugString;
1✔
994
      }
995
    }
996
  }
997

998
  /**
999
   * Provides essentials for LoadBalancer implementations.
1000
   *
1001
   * @since 1.2.0
1002
   */
1003
  @ThreadSafe
1004
  @ExperimentalApi("https://github.com/grpc/grpc-java/issues/1771")
1005
  public abstract static class Helper {
1✔
1006
    /**
1007
     * Creates a Subchannel, which is a logical connection to the given group of addresses which are
1008
     * considered equivalent.  The {@code attrs} are custom attributes associated with this
1009
     * Subchannel, and can be accessed later through {@link Subchannel#getAttributes
1010
     * Subchannel.getAttributes()}.
1011
     *
1012
     * <p>The LoadBalancer is responsible for closing unused Subchannels, and closing all
1013
     * Subchannels within {@link #shutdown}.
1014
     *
1015
     * <p>It must be called from {@link #getSynchronizationContext the Synchronization Context}
1016
     *
1017
     * @return Must return a valid Subchannel object, may not return null.
1018
     *
1019
     * @since 1.22.0
1020
     */
1021
    public Subchannel createSubchannel(CreateSubchannelArgs args) {
1022
      throw new UnsupportedOperationException();
1✔
1023
    }
1024

1025
    /**
1026
     * Create an out-of-band channel for the LoadBalancer’s own RPC needs, e.g., talking to an
1027
     * external load-balancer service.
1028
     *
1029
     * <p>The LoadBalancer is responsible for closing unused OOB channels, and closing all OOB
1030
     * channels within {@link #shutdown}.
1031
     *
1032
     * @since 1.4.0
1033
     */
1034
    public abstract ManagedChannel createOobChannel(EquivalentAddressGroup eag, String authority);
1035

1036
    /**
1037
     * Create an out-of-band channel for the LoadBalancer's own RPC needs, e.g., talking to an
1038
     * external load-balancer service. This version of the method allows multiple EAGs, so different
1039
     * addresses can have different authorities.
1040
     *
1041
     * <p>The LoadBalancer is responsible for closing unused OOB channels, and closing all OOB
1042
     * channels within {@link #shutdown}.
1043
     * */
1044
    public ManagedChannel createOobChannel(List<EquivalentAddressGroup> eag,
1045
        String authority) {
1046
      throw new UnsupportedOperationException();
×
1047
    }
1048

1049
    /**
1050
     * Updates the addresses used for connections in the {@code Channel} that was created by {@link
1051
     * #createOobChannel(EquivalentAddressGroup, String)}. This is superior to {@link
1052
     * #createOobChannel(EquivalentAddressGroup, String)} when the old and new addresses overlap,
1053
     * since the channel can continue using an existing connection.
1054
     *
1055
     * @throws IllegalArgumentException if {@code channel} was not returned from {@link
1056
     *     #createOobChannel}
1057
     * @since 1.4.0
1058
     */
1059
    public void updateOobChannelAddresses(ManagedChannel channel, EquivalentAddressGroup eag) {
1060
      throw new UnsupportedOperationException();
×
1061
    }
1062

1063
    /**
1064
     * Updates the addresses with a new EAG list. Connection is continued when old and new addresses
1065
     * overlap.
1066
     * */
1067
    public void updateOobChannelAddresses(ManagedChannel channel,
1068
        List<EquivalentAddressGroup> eag) {
1069
      throw new UnsupportedOperationException();
×
1070
    }
1071

1072
    /**
1073
     * Creates an out-of-band channel for LoadBalancer's own RPC needs, e.g., talking to an external
1074
     * load-balancer service, that is specified by a target string.  See the documentation on
1075
     * {@link ManagedChannelBuilder#forTarget} for the format of a target string.
1076
     *
1077
     * <p>The target string will be resolved by a {@link NameResolver} created according to the
1078
     * target string.
1079
     *
1080
     * <p>The LoadBalancer is responsible for closing unused OOB channels, and closing all OOB
1081
     * channels within {@link #shutdown}.
1082
     *
1083
     * @since 1.20.0
1084
     */
1085
    public ManagedChannel createResolvingOobChannel(String target) {
1086
      return createResolvingOobChannelBuilder(target).build();
1✔
1087
    }
1088

1089
    /**
1090
     * Creates an out-of-band channel builder for LoadBalancer's own RPC needs, e.g., talking to an
1091
     * external load-balancer service, that is specified by a target string.  See the documentation
1092
     * on {@link ManagedChannelBuilder#forTarget} for the format of a target string.
1093
     *
1094
     * <p>The target string will be resolved by a {@link NameResolver} created according to the
1095
     * target string.
1096
     *
1097
     * <p>The returned oob-channel builder defaults to use the same authority and ChannelCredentials
1098
     * (without bearer tokens) as the parent channel's for authentication. This is different from
1099
     * {@link #createResolvingOobChannelBuilder(String, ChannelCredentials)}.
1100
     *
1101
     * <p>The LoadBalancer is responsible for closing unused OOB channels, and closing all OOB
1102
     * channels within {@link #shutdown}.
1103
     *
1104
     * @deprecated Use {@link #createResolvingOobChannelBuilder(String, ChannelCredentials)}
1105
     *     instead.
1106
     * @since 1.31.0
1107
     */
1108
    @Deprecated
1109
    public ManagedChannelBuilder<?> createResolvingOobChannelBuilder(String target) {
1110
      throw new UnsupportedOperationException("Not implemented");
×
1111
    }
1112

1113
    /**
1114
     * Creates an out-of-band channel builder for LoadBalancer's own RPC needs, e.g., talking to an
1115
     * external load-balancer service, that is specified by a target string and credentials.  See
1116
     * the documentation on {@link Grpc#newChannelBuilder} for the format of a target string.
1117
     *
1118
     * <p>The target string will be resolved by a {@link NameResolver} created according to the
1119
     * target string.
1120
     *
1121
     * <p>The LoadBalancer is responsible for closing unused OOB channels, and closing all OOB
1122
     * channels within {@link #shutdown}.
1123
     *
1124
     * @since 1.35.0
1125
     */
1126
    public ManagedChannelBuilder<?> createResolvingOobChannelBuilder(
1127
        String target, ChannelCredentials creds) {
1128
      throw new UnsupportedOperationException();
×
1129
    }
1130

1131
    /**
1132
     * Set a new state with a new picker to the channel.
1133
     *
1134
     * <p>When a new picker is provided via {@code updateBalancingState()}, the channel will apply
1135
     * the picker on all buffered RPCs, by calling {@link SubchannelPicker#pickSubchannel(
1136
     * LoadBalancer.PickSubchannelArgs)}.
1137
     *
1138
     * <p>The channel will hold the picker and use it for all RPCs, until {@code
1139
     * updateBalancingState()} is called again and a new picker replaces the old one.  If {@code
1140
     * updateBalancingState()} has never been called, the channel will buffer all RPCs until a
1141
     * picker is provided.
1142
     *
1143
     * <p>It should be called from the Synchronization Context.  Currently will log a warning if
1144
     * violated.  It will become an exception eventually.  See <a
1145
     * href="https://github.com/grpc/grpc-java/issues/5015">#5015</a> for the background.
1146
     *
1147
     * <p>The passed state will be the channel's new state. The SHUTDOWN state should not be passed
1148
     * and its behavior is undefined.
1149
     *
1150
     * @since 1.6.0
1151
     */
1152
    public abstract void updateBalancingState(
1153
        @Nonnull ConnectivityState newState, @Nonnull SubchannelPicker newPicker);
1154

1155
    /**
1156
     * Call {@link NameResolver#refresh} on the channel's resolver.
1157
     *
1158
     * <p>It should be called from the Synchronization Context.  Currently will log a warning if
1159
     * violated.  It will become an exception eventually.  See <a
1160
     * href="https://github.com/grpc/grpc-java/issues/5015">#5015</a> for the background.
1161
     *
1162
     * @since 1.18.0
1163
     */
1164
    public void refreshNameResolution() {
1165
      throw new UnsupportedOperationException();
×
1166
    }
1167

1168
    /**
1169
     * Historically the channel automatically refreshes name resolution if any subchannel
1170
     * connection is broken. It's transitioning to let load balancers make the decision. To
1171
     * avoid silent breakages, the channel checks if {@link #refreshNameResolution} is called
1172
     * by the load balancer. If not, it will do it and log a warning. This will be removed in
1173
     * the future and load balancers are completely responsible for triggering the refresh.
1174
     * See <a href="https://github.com/grpc/grpc-java/issues/8088">#8088</a> for the background.
1175
     *
1176
     * <p>This should rarely be used, but sometimes the address for the subchannel wasn't
1177
     * provided by the name resolver and a refresh needs to be directed somewhere else instead.
1178
     * Then you can call this method to disable the short-tem check for detecting LoadBalancers
1179
     * that need to be updated for the new expected behavior.
1180
     *
1181
     * @since 1.38.0
1182
     * @deprecated Warning has been removed
1183
     */
1184
    @ExperimentalApi("https://github.com/grpc/grpc-java/issues/8088")
1185
    @Deprecated
1186
    public void ignoreRefreshNameResolutionCheck() {
1187
      // no-op
1188
    }
×
1189

1190
    /**
1191
     * Returns a {@link SynchronizationContext} that runs tasks in the same Synchronization Context
1192
     * as that the callback methods on the {@link LoadBalancer} interface are run in.
1193
     *
1194
     * <p>Work added to the synchronization context might not run immediately, so LB implementations
1195
     * must be careful to ensure that any assumptions still hold when it is executed. In particular,
1196
     * the LB might have been shut down or subchannels might have changed state.
1197
     *
1198
     * <p>Pro-tip: in order to call {@link SynchronizationContext#schedule}, you need to provide a
1199
     * {@link ScheduledExecutorService}.  {@link #getScheduledExecutorService} is provided for your
1200
     * convenience.
1201
     *
1202
     * @since 1.17.0
1203
     */
1204
    public SynchronizationContext getSynchronizationContext() {
1205
      // TODO(zhangkun): make getSynchronizationContext() abstract after runSerialized() is deleted
1206
      throw new UnsupportedOperationException();
×
1207
    }
1208

1209
    /**
1210
     * Returns a {@link ScheduledExecutorService} for scheduling delayed tasks.
1211
     *
1212
     * <p>This service is a shared resource and is only meant for quick tasks.  DO NOT block or run
1213
     * time-consuming tasks.
1214
     *
1215
     * <p>The returned service doesn't support {@link ScheduledExecutorService#shutdown shutdown()}
1216
     * and {@link ScheduledExecutorService#shutdownNow shutdownNow()}.  They will throw if called.
1217
     *
1218
     * @since 1.17.0
1219
     */
1220
    public ScheduledExecutorService getScheduledExecutorService() {
1221
      throw new UnsupportedOperationException();
×
1222
    }
1223

1224
    /**
1225
     * Returns the authority string of the channel, which is derived from the DNS-style target name.
1226
     * If overridden by a load balancer, {@link #getUnsafeChannelCredentials} must also be
1227
     * overridden to call {@link #getChannelCredentials} or provide appropriate credentials.
1228
     *
1229
     * @since 1.2.0
1230
     */
1231
    public abstract String getAuthority();
1232

1233
    /**
1234
     * Returns the target string of the channel, guaranteed to include its scheme.
1235
     */
1236
    public String getChannelTarget() {
1237
      throw new UnsupportedOperationException();
×
1238
    }
1239

1240
    /**
1241
     * Returns the ChannelCredentials used to construct the channel, without bearer tokens.
1242
     *
1243
     * @since 1.35.0
1244
     */
1245
    public ChannelCredentials getChannelCredentials() {
1246
      return getUnsafeChannelCredentials().withoutBearerTokens();
×
1247
    }
1248

1249
    /**
1250
     * Returns the UNSAFE ChannelCredentials used to construct the channel,
1251
     * including bearer tokens. Load balancers should generally have no use for
1252
     * these credentials and use of them is heavily discouraged. These must be used
1253
     * <em>very</em> carefully to avoid sending bearer tokens to untrusted servers
1254
     * as the server could then impersonate the client. Generally it is only safe
1255
     * to use these credentials when communicating with the backend.
1256
     *
1257
     * @since 1.35.0
1258
     */
1259
    public ChannelCredentials getUnsafeChannelCredentials() {
1260
      throw new UnsupportedOperationException();
×
1261
    }
1262

1263
    /**
1264
     * Returns the {@link ChannelLogger} for the Channel served by this LoadBalancer.
1265
     *
1266
     * @since 1.17.0
1267
     */
1268
    public ChannelLogger getChannelLogger() {
1269
      throw new UnsupportedOperationException();
×
1270
    }
1271

1272
    /**
1273
     * Returns the {@link NameResolver.Args} that the Channel uses to create {@link NameResolver}s.
1274
     *
1275
     * @since 1.22.0
1276
     */
1277
    public NameResolver.Args getNameResolverArgs() {
1278
      throw new UnsupportedOperationException();
×
1279
    }
1280

1281
    /**
1282
     * Returns the {@link NameResolverRegistry} that the Channel uses to look for {@link
1283
     * NameResolver}s.
1284
     *
1285
     * @since 1.22.0
1286
     */
1287
    public NameResolverRegistry getNameResolverRegistry() {
1288
      throw new UnsupportedOperationException();
×
1289
    }
1290

1291
    /**
1292
     * Returns the {@link MetricRecorder} that the channel uses to record metrics.
1293
     *
1294
     * @since 1.64.0
1295
     */
1296
    @Internal
1297
    public MetricRecorder getMetricRecorder() {
1298
      return new MetricRecorder() {};
×
1299
    }
1300
  }
1301

1302
  /**
1303
   * A logical connection to a server, or a group of equivalent servers represented by an {@link 
1304
   * EquivalentAddressGroup}.
1305
   *
1306
   * <p>It maintains at most one physical connection (aka transport) for sending new RPCs, while
1307
   * also keeps track of previous transports that has been shut down but not terminated yet.
1308
   *
1309
   * <p>If there isn't an active transport yet, and an RPC is assigned to the Subchannel, it will
1310
   * create a new transport.  It won't actively create transports otherwise.  {@link
1311
   * #requestConnection requestConnection()} can be used to ask Subchannel to create a transport if
1312
   * there isn't any.
1313
   *
1314
   * <p>{@link #start} must be called prior to calling any other methods, with the exception of
1315
   * {@link #shutdown}, which can be called at any time.
1316
   *
1317
   * @since 1.2.0
1318
   */
1319
  @ExperimentalApi("https://github.com/grpc/grpc-java/issues/1771")
1320
  public abstract static class Subchannel {
1✔
1321
    /**
1322
     * Starts the Subchannel.  Can only be called once.
1323
     *
1324
     * <p>Must be called prior to any other method on this class, except for {@link #shutdown} which
1325
     * may be called at any time.
1326
     *
1327
     * <p>Must be called from the {@link Helper#getSynchronizationContext Synchronization Context},
1328
     * otherwise it may throw.  See <a href="https://github.com/grpc/grpc-java/issues/5015">
1329
     * #5015</a> for more discussions.
1330
     *
1331
     * @param listener receives state updates for this Subchannel.
1332
     */
1333
    public void start(SubchannelStateListener listener) {
1334
      throw new UnsupportedOperationException("Not implemented");
×
1335
    }
1336

1337
    /**
1338
     * Shuts down the Subchannel.  After this method is called, this Subchannel should no longer
1339
     * be returned by the latest {@link SubchannelPicker picker}, and can be safely discarded.
1340
     *
1341
     * <p>Calling it on an already shut-down Subchannel has no effect.
1342
     *
1343
     * <p>It should be called from the Synchronization Context.  Currently will log a warning if
1344
     * violated.  It will become an exception eventually.  See <a
1345
     * href="https://github.com/grpc/grpc-java/issues/5015">#5015</a> for the background.
1346
     *
1347
     * @since 1.2.0
1348
     */
1349
    public abstract void shutdown();
1350

1351
    /**
1352
     * Asks the Subchannel to create a connection (aka transport), if there isn't an active one.
1353
     *
1354
     * <p>It should be called from the Synchronization Context.  Currently will log a warning if
1355
     * violated.  It will become an exception eventually.  See <a
1356
     * href="https://github.com/grpc/grpc-java/issues/5015">#5015</a> for the background.
1357
     *
1358
     * @since 1.2.0
1359
     */
1360
    public abstract void requestConnection();
1361

1362
    /**
1363
     * Returns the addresses that this Subchannel is bound to.  This can be called only if
1364
     * the Subchannel has only one {@link EquivalentAddressGroup}.  Under the hood it calls
1365
     * {@link #getAllAddresses}.
1366
     *
1367
     * <p>It should be called from the Synchronization Context.  Currently will log a warning if
1368
     * violated.  It will become an exception eventually.  See <a
1369
     * href="https://github.com/grpc/grpc-java/issues/5015">#5015</a> for the background.
1370
     *
1371
     * @throws IllegalStateException if this subchannel has more than one EquivalentAddressGroup.
1372
     *         Use {@link #getAllAddresses} instead
1373
     * @since 1.2.0
1374
     */
1375
    public final EquivalentAddressGroup getAddresses() {
1376
      List<EquivalentAddressGroup> groups = getAllAddresses();
1✔
1377
      Preconditions.checkState(groups != null && groups.size() == 1,
1✔
1378
          "%s does not have exactly one group", groups);
1379
      return groups.get(0);
1✔
1380
    }
1381

1382
    /**
1383
     * Returns the addresses that this Subchannel is bound to. The returned list will not be empty.
1384
     *
1385
     * <p>It should be called from the Synchronization Context.  Currently will log a warning if
1386
     * violated.  It will become an exception eventually.  See <a
1387
     * href="https://github.com/grpc/grpc-java/issues/5015">#5015</a> for the background.
1388
     *
1389
     * @since 1.14.0
1390
     */
1391
    public List<EquivalentAddressGroup> getAllAddresses() {
1392
      throw new UnsupportedOperationException();
×
1393
    }
1394

1395
    /**
1396
     * The same attributes passed to {@link Helper#createSubchannel Helper.createSubchannel()}.
1397
     * LoadBalancer can use it to attach additional information here, e.g., the shard this
1398
     * Subchannel belongs to.
1399
     *
1400
     * @since 1.2.0
1401
     */
1402
    public abstract Attributes getAttributes();
1403

1404
    /**
1405
     * (Internal use only) returns a {@link Channel} that is backed by this Subchannel.  This allows
1406
     * a LoadBalancer to issue its own RPCs for auxiliary purposes, such as health-checking, on
1407
     * already-established connections.  This channel has certain restrictions:
1408
     * <ol>
1409
     *   <li>It can issue RPCs only if the Subchannel is {@code READY}. If {@link
1410
     *   Channel#newCall} is called when the Subchannel is not {@code READY}, the RPC will fail
1411
     *   immediately.</li>
1412
     *   <li>It doesn't support {@link CallOptions#withWaitForReady wait-for-ready} RPCs. Such RPCs
1413
     *   will fail immediately.</li>
1414
     * </ol>
1415
     *
1416
     * <p>RPCs made on this Channel is not counted when determining ManagedChannel's {@link
1417
     * ManagedChannelBuilder#idleTimeout idle mode}.  In other words, they won't prevent
1418
     * ManagedChannel from entering idle mode.
1419
     *
1420
     * <p>Warning: RPCs made on this channel will prevent a shut-down transport from terminating. If
1421
     * you make long-running RPCs, you need to make sure they will finish in time after the
1422
     * Subchannel has transitioned away from {@code READY} state
1423
     * (notified through {@link #handleSubchannelState}).
1424
     *
1425
     * <p>Warning: this is INTERNAL API, is not supposed to be used by external users, and may
1426
     * change without notice. If you think you must use it, please file an issue.
1427
     */
1428
    @Internal
1429
    public Channel asChannel() {
1430
      throw new UnsupportedOperationException();
×
1431
    }
1432

1433
    /**
1434
     * Returns a {@link ChannelLogger} for this Subchannel.
1435
     *
1436
     * @since 1.17.0
1437
     */
1438
    public ChannelLogger getChannelLogger() {
1439
      throw new UnsupportedOperationException();
×
1440
    }
1441

1442
    /**
1443
     * Replaces the existing addresses used with this {@code Subchannel}. If the new and old
1444
     * addresses overlap, the Subchannel can continue using an existing connection.
1445
     *
1446
     * <p>It must be called from the Synchronization Context or will throw.
1447
     *
1448
     * @throws IllegalArgumentException if {@code addrs} is empty
1449
     * @since 1.22.0
1450
     */
1451
    public void updateAddresses(List<EquivalentAddressGroup> addrs) {
1452
      throw new UnsupportedOperationException();
×
1453
    }
1454

1455
    /**
1456
     * (Internal use only) returns an object that represents the underlying subchannel that is used
1457
     * by the Channel for sending RPCs when this {@link Subchannel} is picked.  This is an opaque
1458
     * object that is both provided and consumed by the Channel.  Its type <strong>is not</strong>
1459
     * {@code Subchannel}.
1460
     *
1461
     * <p>Warning: this is INTERNAL API, is not supposed to be used by external users, and may
1462
     * change without notice. If you think you must use it, please file an issue and we can consider
1463
     * removing its "internal" status.
1464
     */
1465
    @Internal
1466
    public Object getInternalSubchannel() {
1467
      throw new UnsupportedOperationException();
×
1468
    }
1469

1470
    /**
1471
     * (Internal use only) returns attributes of the address subchannel is connected to.
1472
     *
1473
     * <p>Warning: this is INTERNAL API, is not supposed to be used by external users, and may
1474
     * change without notice. If you think you must use it, please file an issue and we can consider
1475
     * removing its "internal" status.
1476
     */
1477
    @Internal
1478
    public Attributes getConnectedAddressAttributes() {
1479
      throw new UnsupportedOperationException();
×
1480
    }
1481
  }
1482

1483
  /**
1484
   * Receives state changes for one {@link Subchannel}. All methods are run under {@link
1485
   * Helper#getSynchronizationContext}.
1486
   *
1487
   * @since 1.22.0
1488
   */
1489
  public interface SubchannelStateListener {
1490
    /**
1491
     * Handles a state change on a Subchannel.
1492
     *
1493
     * <p>The initial state of a Subchannel is IDLE. You won't get a notification for the initial
1494
     * IDLE state.
1495
     *
1496
     * <p>If the new state is not SHUTDOWN, this method should create a new picker and call {@link
1497
     * Helper#updateBalancingState Helper.updateBalancingState()}.  Failing to do so may result in
1498
     * unnecessary delays of RPCs. Please refer to {@link PickResult#withSubchannel
1499
     * PickResult.withSubchannel()}'s javadoc for more information.
1500
     *
1501
     * <p>When a subchannel's state is IDLE or TRANSIENT_FAILURE and the address for the subchannel
1502
     * was received in {@link LoadBalancer#handleResolvedAddresses}, load balancers should call
1503
     * {@link Helper#refreshNameResolution} to inform polling name resolvers that it is an
1504
     * appropriate time to refresh the addresses. Without the refresh, changes to the addresses may
1505
     * never be detected.
1506
     *
1507
     * <p>SHUTDOWN can only happen in two cases.  One is that LoadBalancer called {@link
1508
     * Subchannel#shutdown} earlier, thus it should have already discarded this Subchannel.  The
1509
     * other is that Channel is doing a {@link ManagedChannel#shutdownNow forced shutdown} or has
1510
     * already terminated, thus there won't be further requests to LoadBalancer.  Therefore, the
1511
     * LoadBalancer usually don't need to react to a SHUTDOWN state.
1512
     *
1513
     * @param newState the new state
1514
     * @since 1.22.0
1515
     */
1516
    void onSubchannelState(ConnectivityStateInfo newState);
1517
  }
1518

1519
  /**
1520
   * Factory to create {@link LoadBalancer} instance.
1521
   *
1522
   * @since 1.2.0
1523
   */
1524
  @ThreadSafe
1525
  @ExperimentalApi("https://github.com/grpc/grpc-java/issues/1771")
1526
  public abstract static class Factory {
1✔
1527
    /**
1528
     * Creates a {@link LoadBalancer} that will be used inside a channel.
1529
     *
1530
     * @since 1.2.0
1531
     */
1532
    public abstract LoadBalancer newLoadBalancer(Helper helper);
1533
  }
1534

1535
  /**
1536
   * A picker that always returns an erring pick.
1537
   *
1538
   * @deprecated Use {@code new FixedResultPicker(PickResult.withError(error))} instead.
1539
   */
1540
  @Deprecated
1541
  public static final class ErrorPicker extends SubchannelPicker {
1542

1543
    private final Status error;
1544

1545
    public ErrorPicker(Status error) {
×
1546
      this.error = checkNotNull(error, "error");
×
1547
    }
×
1548

1549
    @Override
1550
    public PickResult pickSubchannel(PickSubchannelArgs args) {
1551
      return PickResult.withError(error);
×
1552
    }
1553

1554
    @Override
1555
    public String toString() {
1556
      return MoreObjects.toStringHelper(this)
×
1557
          .add("error", error)
×
1558
          .toString();
×
1559
    }
1560
  }
1561

1562
  /** A picker that always returns the same result. */
1563
  public static final class FixedResultPicker extends SubchannelPicker {
1564
    private final PickResult result;
1565

1566
    public FixedResultPicker(PickResult result) {
1✔
1567
      this.result = Preconditions.checkNotNull(result, "result");
1✔
1568
    }
1✔
1569

1570
    @Override
1571
    public PickResult pickSubchannel(PickSubchannelArgs args) {
1572
      return result;
1✔
1573
    }
1574

1575
    @Override
1576
    public String toString() {
1577
      return "FixedResultPicker(" + result + ")";
1✔
1578
    }
1579

1580
    @Override
1581
    public int hashCode() {
1582
      return result.hashCode();
1✔
1583
    }
1584

1585
    @Override
1586
    public boolean equals(Object o) {
1587
      if (!(o instanceof FixedResultPicker)) {
1✔
1588
        return false;
1✔
1589
      }
1590
      FixedResultPicker that = (FixedResultPicker) o;
1✔
1591
      return this.result.equals(that.result);
1✔
1592
    }
1593
  }
1594
}
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2025 Coveralls, Inc