dm.cs.tu-dortmund.de/mlbits/neural-nlp-networks/
Deep Neural Network Embeddings – Lecture Notes
of neural networks:
\(X = (x_1, x_2, x_3, x_4)^T\)
\(h_1 = \sigma(\textcolor[RGB]{132,184,24}{W_1} \cdot X + b_1)\)
\(o = \textcolor[RGB]{0,155,170}{W_2} \cdot h_1 + b_2\)
\(y = \operatorname{softmax}(o)\) [...] Modeling
Matrix Factorization
Sequential Models
Neural Text Embeddings
Early Embeddings – Word2Vec
Beyond Word2Vec
Neural Networks Fundamentals
Basic Architectures for NLP
Transformer Architecture
Attention [...] (#trainable parameters) and data size.
continue to Basic Architectures for NLP »
« return to Beyond Word2Vec
Data Mining Group – TU Dortmund
Machine Learning Bits
Deep Neural Network Embeddings
Address
Return …
