Functions

Functions

Activation

BLAS

Merlin.gemm_batchMethod.
gemm_batch(tA::Char, tB::Char, alpha, A::Var, B::Var)
source
gemm(tA::Char, tB::Char, alpha, A::Var, B::Var)
gemm(A::Var, B::Var, [tA='N'], [tB='N'], [alpha=1])
  • tA, tB: 'T' (transpose) or 'N' (not transpose)

\[C = \alpha \times \textrm{tA}(A) \times \textrm{tB}(B)\]
T = Float32
A = Var(rand(T,10,5))
B = Var(rand(T,10,7))
C = BLAS.gemm('T', 'N', 1, A, B)
source
BLAS.gemv(tA::Char, alpha, A::Var, x::Var)
  • tA: 'T' (transpose) or 'N' (not transpose)

\[y = \alpha \times \textrm{tA}(A) \times x\]
T = Float32
A = Var(rand(T,10,5))
x = Var(rand(T,5))
B = BLAS.gemv('N', 1, A, x)
source

Convolution

Embeddings

Loss

Math

Base.:*Method.
*(A::Var, B::Var)
source
Base.:+Method.
+(x1::Var, x2::Var)
+(a::Number, x::Var)
+(x::Var, a::Number)
source
Base.:-Method.
-(x1, x2)
source
Base.:/Method.
/(x1::Var, a)
source
Base.:^Method.
^(x::Var, a::Number)
source
Base.broadcastMethod.
.*(x1::Var, x2::Var)
source
Base.broadcastMethod.
.+(x1::Var, x2::Var)
source
Base.broadcastMethod.
.-(x1::Var, x2::Var)
source
Base.expMethod.
exp(x)
source
Base.logMethod.
log(x)
source
Base.transposeMethod.
transpose(x)
source

Recurrent

Reduction

Misc

argmax
concat
dropout
getindex
Linear
lookup
reshape
softmax
logsoftmax
standardize