Logistic Regression
A classification algorithm that uses the sigmoid function to predict the probability of a binary outcome. Despite its name containing 'regression,' it is used for classification tasks.
Why It Matters
Logistic regression is often the first model to try for binary classification — it is fast, interpretable, and surprisingly effective. It serves as a strong baseline.
Example
Predicting whether a customer will churn (yes/no) based on features like account age, usage frequency, and support ticket count.
Think of it like...
Like calculating odds in betting — you weigh various factors and come up with a probability that something will or will not happen.
Related Terms
Classification
A type of supervised learning task where the model predicts which category or class an input belongs to. The output is a discrete label rather than a continuous value.
Sigmoid
An activation function that squashes input values into a range between 0 and 1, creating an S-shaped curve. It is commonly used for binary classification outputs and in certain neural network architectures.
Linear Regression
The simplest regression algorithm that models the relationship between input features and a continuous output as a straight line (or hyperplane in multiple dimensions). It minimizes the sum of squared errors.