Release Version 1.0.0

AutomaticDifferentiationTensors

• Added AutomaticDifferentiationTensors

WeightContainers

• Added WeightContainers

ActivationLayers

• Added:

  • LeakyRectifiedLinearUnit

  • RectifiedLinearUnit

  • ExponentialLinearUnit

  • SigmoidLinearUnit

  • Sigmoid

  • Mish

  • Tanh

  • Gaussian

  • BinaryStep

CostFunctions

• Added:

  • MeanSquaredError

  • MeanAbsoluteError

  • BinaryCrossEntropy

  • CategoricalCrossEntropy

  • FocalLoss

Optimizers

• Added:

  • RootMeanSquarePropagation

  • Momentum

  • AdaptiveGradient

  • AdaptiveGradientDelta

  • AdaptiveMomentEstimation

  • AdaptiveMomentEstimationMaximum

  • NesterovAcceleratedAdaptiveMomentEstimation

  • Gravity

  • LearningRateStepDecay

  • LearningRateTimeDecay

DropoutLayers

• Added:

  • Dropout

  • Dropout1D

  • Dropout2D

  • Dropout3D

  • DropoutND

ConvolutionLayers

• Added:

  • FastConvolution1D

  • FastConvolution2D

  • FastConvolution3D

PoolingLayers

• Added:

  • FastAveragePooling1D

  • FastAveragePooling2D

  • FastAveragePooling3D

  • FastMaximumPooling1D

  • FastMaximumPooling2D

  • FastMaximumPooling3D

  • FastMinimumPooling1D

  • FastMinimumPooling2D

  • FastMinimumPooling3D

  • FastMaximumUnpooling1D

  • FastMaximumUnpooling2D

  • FastMaximumUnpooling3D

PaddingLayers

• Added:

  • FastZeroPadding

  • FastConstantPadding

  • FastCircularPadding

  • FastReplicationPadding

  • FastReflectionPadding

  • ZeroPadding

  • ConstantPadding

  • CircularPadding

  • ReplicationPadding

  • ReflectionPadding

EncodingLayers

• Added:

  • OneHotEncoding

  • LabelEncoding

  • PositionalEncoding

ValueSchedulers

• Added:

  • StepDecay

  • TimeDecay