Foundations of Machine LearningArtificial Neural NetworksArtificial Neural NetworksLesson 10 - 1Artificial Neural NetworksArtificial Neural Networks: IntroductionSingle Layer Neural NetworksMultiple Layer Neural NetworksSelf-Organizing Map (SOM)Other Neural Networkssklearn.neural_networkArtificial Neural NetworksLesson 10 - 2Artificial Neural Networks: IntroductionThe brain and the neurons （脑与神经元）Neurons are the building blocks of the brainTheir interconnectivity forms the programming that allows us to solve all our everyday tasksThey are able to perform parallel and fault tolerant computationTheoretical models of how the neurons in the brain work and how they learn have been developed from the beginning of Artificial IntelligenceMost of these models are really simple (but yet powerful) and have a slim resemblance to real brain neuronsArtificial Neural NetworksLesson 10 - 3Artificial Neural Networks: IntroductionA neuron model （神经元模型）1943 年， [McCulloch and Pitts, 1943] 抽象出“ M-P 神经元模型” , 在这个模型中， 神经元接收到来自 n 个其他神经元传递过来的输入信号，这些输入信号通过带权重的连接 ( connection) 进行传递，神经元接收到的总输入值将与神经元的阈值进行比较，然后通过“激活函数” (activation function) 处理以产生神经元的输出。Artificial Neural NetworksLesson 10 - 4Artificial Neural Networks: Introduction理想中的激活函数是阶跃函数，它将输入值映射为输出值“ 0” 或者“ 1” ，显然“ 1” 对应于神经元兴奋， “ 0” 对应于神经元抑制。然而，阶跃函数具有不连续、不光滑等不太好的性质，因此实际常用 Sigmoid 作为激活函数，它把可能在较大范围内变化的输入值挤压到 (0, 1) 输出值范围内，因此有时也称为 " 挤压函数 " (squashing function). Artificial Neural NetworksLesson 10 - 5Artificial Neural Networks: IntroductionOrganization of neurons/Networks ，神经元组织 / 网络Usually neurons are interc...
