Initializaters

Initializers

Initializers provides a way to set the initial weights of Merlin functions.

f = Linear(Float32, 100, 100, init_W=Xavier(), init_b=Fill(0))
Merlin.Fill — Type.
Fill(x)

Fill initializer.

source
Merlin.Normal — Type.
Normal(mean, var)

Generator of ndarray with a normal distribution.

Arguments

  • mean: Mean of the random values.

  • var: Variance of the random values.

source
Merlin.Orthogonal — Type.
Orthogonal([gain=1.0])

References

source
Merlin.Uniform — Type.
Uniform(a, b)
Uniform(b)

Generator of ndarray with a uniform distribution.

Arguments

  • a: Lower bound of the range of random values.

  • b: Upper bound of the range of random values.

source
Merlin.Xavier — Type.
Xavier()

Xavier initialization.

source