- 2.70.0 (latest)
- 2.69.0
- 2.68.2
- 2.67.0
- 2.66.0
- 2.65.0
- 2.63.1
- 2.62.0
- 2.61.0
- 2.60.0
- 2.59.1
- 2.58.0
- 2.57.0
- 2.55.0
- 2.54.1
- 2.53.0
- 2.52.0
- 2.51.0
- 2.50.0
- 2.49.0
- 2.48.1
- 2.47.0
- 2.46.1
- 2.45.0
- 2.43.0
- 2.42.0
- 2.41.0
- 2.39.0
- 2.38.0
- 2.37.0
- 2.36.0
- 2.35.0
- 2.34.1
- 2.33.0
- 2.32.1
- 2.31.1
- 2.30.1
- 2.24.0
- 2.23.3
- 2.22.0
- 2.21.0
- 2.20.1
- 2.19.6
- 2.18.7
- 2.17.0
- 2.16.0
- 2.15.0
- 2.14.0
- 2.13.0
- 2.12.2
- 2.11.0
- 2.10.0
- 2.9.0
- 2.8.1
- 2.7.1
public
abstract
class
ChannelPoolSettings
Settings to control ChannelPool behavior.
To facilitate low latency/high throughout applications, gax provides a ChannelPool . The pool is meant to facilitate high throughput/low latency clients. By splitting load across multiple gRPC channels the client can spread load across multiple frontends and overcome gRPC's limit of 100 concurrent RPCs per channel. However oversizing the ChannelPool can lead to underutilized channels which will lead to high tail latency due to GFEs disconnecting idle channels.
The ChannelPool is designed to adapt to varying traffic patterns by tracking outstanding RPCs and resizing the pool size. This class configures the behavior. In general clients should aim to have less than 50 concurrent RPCs per channel and at least 1 outstanding per channel per minute.
The settings in this class will be applied every minute.
Static Methods
builder()
public
static
ChannelPoolSettings
.
Builder
builder
()
staticallySized(int size)
public
static
ChannelPoolSettings
staticallySized
(
int
size
)
Constructors
ChannelPoolSettings()
public
ChannelPoolSettings
()
Methods
getInitialChannelCount()
public
abstract
int
getInitialChannelCount
()
The initial size of the channel pool.
During client construction the client open this many connections. This will be scaled up or down in the next period.
getMaxChannelCount()
public
abstract
int
getMaxChannelCount
()
The absolute maximum size of the channel pool.
Regardless of the current throughput, the number of channels will not exceed this limit
getMaxRpcsPerChannel()
public
abstract
int
getMaxRpcsPerChannel
()
Threshold to start scaling up the channel pool.
When the average of the maximum number of outstanding RPCs in a single minute surpass this threshold, channels will be added to the pool. For google services, gRPC channels will start locally queuing RPC when there are 100 concurrent RPCs.
getMinChannelCount()
public
abstract
int
getMinChannelCount
()
The absolute minimum size of the channel pool.
Regardless of the current throughput, the number of channels will not drop below this limit
getMinRpcsPerChannel()
public
abstract
int
getMinRpcsPerChannel
()
Threshold to start scaling down the channel pool.
When the average of the maximum number of outstanding RPCs in a single minute drop below this threshold, channels will be removed from the pool.
isPreemptiveRefreshEnabled()
public
abstract
boolean
isPreemptiveRefreshEnabled
()
If all of the channels should be replaced on an hourly basis.
The GFE will forcibly disconnect active channels after an hour. To minimize the cost of reconnects, this will create a new channel asynchronuously, prime it and then swap it with an old channel.
toBuilder()
public
abstract
ChannelPoolSettings
.
Builder
toBuilder
()
