We’re experimenting with Torchserve in k8s and would like to use cilent-side load-balancing for an auto-scaling deployment. To trigger re-resolution of DNS A-records, Need more intelligent re-resolution of names · Issue #12295 · grpc/grpc · GitHub suggests setting grpc.max_connection_age_ms and grpc.max_connection_age_grace_ms on the server. Does Torchserve support this level of configuration for gRPC?
Torchserve does not support configuration for rpc.max_connection_age_ms and grpc.max_connection_age_grace_ms. It uses the GRPC default values.