User Tools

Site Tools


SIKS Big Data course: Spark tutorial

Arjen de Vries (University of Nijmegen) (2016-12-06 13:30 - 14:30 in Drienerburght Conference Room A)

The Netherlands School for Information and Knowledge Systems (SIKS) and Statistics Netherlands (CBS) organize a two day tutorial on the management of Big Data, the Data Camp, hosted at the University of Twente.The tutorial will be given in English and is part of the Educational Program for SIKS PhD students.

The Data Camp's objective is to use big data sets to produce valuable and innovative answers to research questions with societal relevance. SIKS PhD students and CBS data analysts will learn about big data technologies and create, in small groups, feasibility studies for a research question of their choice.

Participants get access to predefined CBS research questions and massive datasets, including a large collection of Dutch Tweets, traffic data from Dutch high ways, and AIS data from ships. Participants will get access to the Twente Hadoop cluster, a 56 node cluster with almost 1 petabyte of storage space. The tutorial focuses on hands-on experience. The Data Camp participants will work in small, mixed teams in an informal setting, which stimulates intense contact with technologies and research questions. Experienced data scientists will support the teams by short lectures and hands-on support. Short lectures will introduce technologies to manage and visualize big data, that were first adopted by Google and are now used by many companies that manage large datasets. The tutorial teaches how to process terabytes of data on large clusters of commodity machines using new programming styles like MapReduce and Spark.

More info at:

colloquium/siks_big_data_course_spark.txt · Last modified: 2017/03/06 14:42 by Djoerd Hiemstra