LEC 5 Perceptron ：
Binary Classification Algorithm
8
感应器是 单个神经元的模型
突触连接的强度取决于接受外部刺激的反应
X input
W weights
a = x1*w1+x2*w2....... > / < threshold
Bias
MaxIter is a hyperparameter 超参数 which has to be chosen experimentally
• If we make many passes over the training data, then the algorithm is likely to overfit.
• If we make few passes might lead to underfitting
意思就是这个值，需要不断地手工修改枚举法，保证即不overfit，也不underfitting
LEC 6 Perceptron ：
Geometric Interpretation 几何解释
Hyperplane 超平面
Linear separability
1. When a dataset is linearly separable, there can exist more than one hyperplanes that separates the dataset into positive/negative groups.
当线性分离的时候，存在多个hyperplanes
not unique
2. 所以当不是线性分离的时候，就不会存在hyperplane
Take the average over all weight vectors during the training (Averaged Perceptron algorithm)
Multiclass Classification
Multiclass classifiers
• k-NN
• Naive Bayes
Binary classifiers
• Perceptron
• Logistic regression
How to turn a binary classifier to a multiclass classifier?
Given binary classification algorithm A we want to design a meta-algorithm that use A to make k-class predictions.
两种方法：
One-vs.-one approach
There might be ambiguity if some classes got the same number of votes (if the binary classifier A can produce a confidence score, it can be used to break ties)
One-vs.-rest approach
Drawbacks
1. the scale of the confidence scores may differ between the binary classifiers
2. the binary classifiers are trained on unbalanced datasets: usually the set ofnegative objects will be much larger than the set of positive objects
![正点原子[第二期]Linux之ARM（MX<span style='color:red;'>6</span>U）裸机篇学习笔记-<span style='color:red;'>6</span>.<span style='color:red;'>5</span>， 汇编 <span style='color:red;'>led</span>.s，第一次点亮<span style='color:red;'>LED</span>灯](https://img-blog.csdnimg.cn/direct/acb9a2e1d5a34e8b918e62c57d7c0262.png)
