BIZNIQUE / LINEAR ALGEBRA / 28
Connect an algorithm to its geometry
The distance, direction or objective you choose determines what an algorithm considers similar or useful.
BIZNIQUE / LINEAR ALGEBRA / 28
The distance, direction or objective you choose determines what an algorithm considers similar or useful.
THE IDEA
A nearest-neighbour comparison uses a distance in the chosen feature space. An SVM uses separating directions and margins. A kernel can supply inner products in an implicit representation. Each choice makes a different assumption about the data.
Distance depends on representation and metric
Do not choose an algorithm from its name alone. Define the task, acceptable errors, available information and evaluation procedure first.
TRY IT YOURSELF
If one numerical feature is measured in metres and another in millimetres, should their raw differences automatically receive equal weight?
No. Units and feature relevance need to be considered before interpreting a raw distance.
CONTINUE EXPLORING