Support Vector Machine (SVM)

What is Support Vector Machine?

Support Vector Machine means sVM separates classes by finding the best boundary between data points.

In real programs, this topic helps in separating classes. Learn the idea first, then type the program yourself and compare the output.

Why should you learn this?

• It is useful for separating classes.
• It connects with classification with small datasets.
• It improves your ability to read, write and debug Python programs.

Important Terms

These terms are used directly in this lesson. Understand them before memorising the code.

Syntax / Basic Pattern

The simple pattern is: prepare data, apply the concept, then show the result.

from sklearn.svm import SVC
X = [[1, 2], [2, 3], [6, 7], [7, 8]]
y = [0, 0, 1, 1]
model = SVC(kernel="linear")
model.fit(X, y)
print(model.predict([[5, 6]])[0])

Complete Example Program

from sklearn.svm import SVC

X = [[1, 2], [2, 3], [6, 7], [7, 8]]
y = [0, 0, 1, 1]

model = SVC(kernel="linear")
model.fit(X, y)
print(model.predict([[5, 6]])[0])

Expected Output

Program Explanation

• from sklearn.svm import SVC imports ready-made features from a module/library.
• X = [[1, 2], [2, 3], [6, 7], [7, 8]] stores a value in X.
• y = [0, 0, 1, 1] stores a value in y.
• model = SVC(kernel="linear") stores a value in model.
• model.fit(X, y) performs the next step of the program logic.
• print(model.predict([[5, 6]])[0]) displays information or calculated result on the screen.

Where will you use it?

• Separating classes.
• Classification with small datasets.
• High-dimensional feature tasks.

Common Mistakes

• Training and testing the model on the same data.
• Using an algorithm without understanding the input features.
• Reporting only accuracy without checking actual mistakes and limitations.

Practice Tasks

1. Type the program in svm.py and run it.
2. Change input values or sample data and observe the new output.
3. Create one example related to separating classes.
4. Write 5 lines explaining the logic in your own words.

Summary

Support Vector Machine is not a theory-only topic. You should be able to explain the meaning, write the example, run it successfully, and use it in a small practical program.