Load ADAM embedding parameters.
tf.raw_ops.LoadTPUEmbeddingADAMParameters(
parameters,
momenta,
velocities,
num_shards,
shard_id,
table_id=-1,
table_name='',
config='',
name=None
)
An op that loads optimization parameters into HBM for embedding. Must be preceded by a ConfigureTPUEmbeddingHost op that sets up the correct embedding table configuration. For example, this op is used to install parameters that are loaded from a checkpoint before a training loop is executed.
Args |
|---|
parameters
Tensor of type float32.
Value of parameters used in the ADAM optimization algorithm.
momenta
Tensor of type float32.
Value of momenta used in the ADAM optimization algorithm.
velocities
Tensor of type float32.
Value of velocities used in the ADAM optimization algorithm.
num_shards
int.
shard_id
int.
table_id
int. Defaults to -1.
table_name
string. Defaults to "".
config
string. Defaults to "".
name
Returns | |
|---|---|
| The created Operation. |