Mutually reduces multiple tensors of identical type and shape and scatters the result.
tf.raw_ops.CollectiveReduceScatterV2(
input,
group_size,
group_key,
instance_key,
ordering_token,
merge_op,
final_op,
communication_hint='auto',
timeout_seconds=0,
is_stateless=False,
max_subdivs_per_device=-1,
name=None
)
is_stateless means each op does not need control dependencies to other
collective ops. In this case, keys that are unique at runtime
(e.g. instance_key) should be used to distinguish collective groups.
Args |
|---|
input
Tensor. Must be one of the following types: bfloat16, float32, half, float64, int32, int64.
group_size
Tensor of type int32.
group_key
Tensor of type int32.
instance_key
Tensor of type int32.
ordering_token
Tensor objects with type resource.
merge_op
string from: "Min", "Max", "Mul", "Add".
final_op
string from: "Id", "Div".
communication_hint
string. Defaults to "auto".
timeout_seconds
float. Defaults to 0.
is_stateless
bool. Defaults to False.
max_subdivs_per_device
int. Defaults to -1.
name
Returns | |
|---|---|
A Tensor. Has the same type as input.
|