Linear Algebra
Probability Theory
Basic Statistics
Causal Inference
- What is Causality?
- Measuring Causality
- Evaluating Assumptions
- Example of Causality
- Randomized Experiments
- Graphing Causal Models
- Illustrating Backdoor Paths
- Subclassification
- Exact Matching
- Approximate Matching
- Regression Discontinuity
- Instrumental Variables
- Panel Data
- Difference-in-Differences
- Synthetic Control
- Bayesian Structural Time-Series
- Causality Cheat Sheet
Parametric Regression
Nonparametric Regression
Classification
Unsupervised Learning
Bayesian Inference
Time Series Analysis
Deep Learning
- Linearity and Activation Functions
- Introducing Perceptrons
- Sigmoid Neurons
- Architecture of Neural Networks
- Feedforward Networks
- Learning XOR
- Gradient-Based Learning
- Cost Function
- Computing Derivatives
- Backpropagation
- Regularization
- Intuition behind Regularization
- Dropout Regularization
- Orthogonalization
- Normalizing Inputs
- Vanishing Gradient
- Dying ReLU
- Weight Initialization
- Gradient Checking
- Stochastic Gradient Descent
- Mini-Batch Gradient Descent
- Exponentially Weighted Averages
- Gradient Descent with Momentum
- RMSProp
- Adam Optimization
- Learning Rate Decay
- The Tuning Process
- Batch Normalization
- Softmax Regression
- Summary for Training Neural Networks
NLP
- Layers in Trax
- Data Pipelines using Trax
- Supervised Training using Trax
- Word Embeddings
- Recurrent Neural Networks
- Gated Recurrent Units
- Long Short-Term Memory
- Siamese Networks
- Attention Models
- Transformer Models
- Transfer Learning
- BERT
- The T5 Model
- Reformers
- TF-IDF
- Latent Dirichlet Allocation
- POS Tagging and NER
- Sentiment Analysis
- Duplicate Checking
- Neural Machine Translation
- Autocorrection
- Autocompletion
- Question Answering
- Designing a Chatbot
CNN
- Convolution Operation
- Convolutional Layer
- Pooling Layer
- LeNet-5 Implementation
- Benefits of Convolution
- Common Case Studies
- Residual Network
- Inception
- Transfer Learning
- Data Augmentation
- Object Localization
- Introducing Object Detection
- YOLO Algorithm
- Face Recognition
- Face Verification
- Visualizing a CNN
- Neural Style Transfer