AdaptiveGradient - a.k.a Adagrad
AdaptiveGradientDelta - a.k.a AdaDelta
AdaptiveMomentEstimation - a.k.a Adam
AdaptiveMomentEstimationMaximum - a.k.a AdaMax
Gravity
Momentum
NesterovAcceleratedAdaptiveMomentEstimation - a.k.a NAdam
RootMeanSquarePropagation
LearningRateStepDecay
LearningRateTimeDecay
BaseOptimizer