
Parametric and non-parametric algorithms.
Objectives
1. To familiarize the student with the ideas and some of the most effective methods and in Data Science using two fundamental examples: Deep learning and decision trees.
2. That the student is able to understand the theoretical background of the chosen algorithms in order to offer autonomy to study and take advantage of their qualities.
3. Invite the student to the ideas and formalism of more elaborate techniques such as: pruning, stochastic gradient descent or back-propagation.
Syllabus
Module 1: Neural Networks
-
Linear perceptron
-
Gradient method
-
Stochastic Gradient Descent
-
Perceptron with more than one layer
-
Back-propagation
Module 2: Decision Trees
-
Overfitting vs fitting
-
Decision trees
-
Entropy, Gini and information measures (Shannon)
-
Random Forests
-
Pruning