Lugano, Switzerland

Introduction to Machine Learning

Workshop Contents and Objectives

Machine learning is of ever greater importance in data science applications in academia, government, and industry. It is not just another set of techniques; it is an entirely new way of thinking about data. The main objective of this course is to familiarize you with this way of thinking. What is it? What criteria are used to ensure its validity? How can social scientists take advantage of machine learning? What algorithms are available? We start by discussing the general machine learning workflow and by familiarizing you with the tidymodels package in R. In the following days, we delve into the most powerful machine learning algorithms currently available, focusing on both predictive performance and interpretability. By the end of the course, you should know how to use those algorithms in your own work. You should also know the logic and jargon of machine learning so that you can interact with computer and data scientists.



Workshop design

The course entails a mixture of lecture, individual, and group exercises. At the end of each day, there is time to discuss individual projects (clinic format).



Detailed lecture plan (daily schedule)

Day 1.
Morning: Objectives and workflows of machine learning (lecture); introductory example in R (lecture).
Afternoon: tidymodels in R (exercise); over-fitting, the lasso, and elastic nets (lecture); tuning models (lecture); R practice (exercise); clinic (one-on-one).

Day 2.
Morning: Classification and regression trees (lecture); variable importance (lecture); interpretation (lecture); R practice (exercise).
Afternoon: Bagging and random forests (lecture); R practice (exercise); how to read a machine learning paper (lecture); clinic (one-on-one).

Day 3.
Morning: Boosting with an emphasis on xgboost (lecture); R practice (exercise).
Afternoon: Stacking (lecture); R practice (exercise); presentation of machine learning papers (group work); clinic (one-on-one).

Day 4.
Morning: Feedforward neural networks (lecture).
Afternoon: R practice (exercise); interpretable machine learning (lecture); clinic (one-on-one).

Day 5.
Morning: R practice (exercise); advanced techniques in deep learning (demonstration).
Afternoon: Open—can be used to discuss topics requested by students (a survey will be sent ahead of the term), Q&A, or further clinics.

Prerequisites

Prior knowledge of regression and R is highly recommended.

Course leader

Marco Steenbergen is a professor of political methodology at the University of Zurich, Switzerland. His methodological interests span choice models, machine learning, measurement, and multilevel analysis.

Target group

graduate students, doctoral researchers, early career researchers, experienced researchers

Credits info

The Summer School cannot grant credits. We only deliver a Certificate of Participation, i.e. we certify your attendance.

If you consider using Summer School workshops to obtain credits (ECTS), you will have to investigate at your home institution (contact the person/institute responsible for your degree) to find out whether they recognise the Summer School, how many credits can be earned from a workshop/course with roughly 35 hours of teaching, no graded work, and no exams.

Make sure to investigate this matter before registering if this is important to you.

Fee info

CHF 700: Reduced fee: 700 Swiss Francs per weekly workshop for students (requires proof of student status).*

Reduced Fee

To qualify for the reduced fee, you are required to send a copy of an official document that certifies your current student status or a letter from your supervisor stating your actual position as a doctoral or postdoctoral researcher. Send this letter/document by e-mail to methodssummerschool@usi.ch.

*These fees also include participation in one of the preliminary workshops (a 2/3-day workshop preceding the Summer School). The registration fee for the Preliminary workshop booked on its own is 200 CHF.
CHF 1100: Normal fee: 1100 Swiss Francs per weekly workshop for all others.*

*These fees also include participation in one of the preliminary workshops (a 2/3-day workshop preceding the Summer School). The registration fee for the Preliminary workshop booked on its own is 200 CHF.