k-NN
k-NN is a algorithm in the machine learning family. This learning algorithm turns examples/data into a rule, grouping or prediction based on a distance, objective or simple model.
先从这个心智模型开始
k-NN is a algorithm in the machine learning family. This learning algorithm turns examples/data into a rule, grouping or prediction based on a distance, objective or simple model.
它如何工作，不堆砌不必要的术语
k-NN should be understood through its invariant and the state it changes at each step.
The practical complexity in this reading is query O(n·d) naive; always connect that cost to the actual loops, recursion, data structure operations or input assumptions.
把算法读成一连串决策
Define features and scaling.
Run the model-specific update/search rule.
Evaluate with an appropriate metric and separate training from evaluation data.
Read a tiny input by hand and write down the state after every important operation. For k-NN, the goal is to make the invariant visible rather than to memorize code.
query O(n·d) naive
Do not quote this complexity mechanically. Ask which operation or input dimension it describes, then derive the cost from the loops, recursion depth, data-structure operations and any preprocessing assumptions.
适用场景
- Use it when the model assumptions match the data and evaluation objective.
通常哪里会出错
- Ignoring feature scaling.
- Evaluating on training data only.
- Treating a toy implementation as production ML infrastructure.
专业回答结构
A strong interview explanation of k-NN should cover the problem it solves, its invariant, the important data structure/state, its query O(n·d) naive cost, and the constraint that would make you choose a different approach.
What problem does k-NN solve?
k-NN is a algorithm in the machine learning family. This learning algorithm turns examples/data into a rule, grouping or prediction based on a distance, objective or simple model.
关于复杂度应该提到什么？
Its typical cost here is query O(n·d) naive, but a complete answer should connect that cost to the representation, input constraints and the dominant operations.
最常见的错误是什么？
Ignoring feature scaling.