CS 560: Large-Scale Data Management (HWS 2026)

Organization

  • Lecturer: Prof. Dr. Rainer Gemulla
  • Tutor: Simon Forbat
  • Type of course: Lecture, exercises (6 ECTS points)
  • Prerequisites: Database Systems I or equivalent, programming experience
  • Registration: Enroll in Portal 2

Lecture and tutorials will be held in presence, both starting in the first week.

Content

This course introduces the fundamental concepts and computational paradigms of large-scale data management and Big Data. This includes methods for storing, updating, querying, and analyzing large dataset as well as for data-intensive computing. The course covers concept, algorithms, and system issues; accompanying exercises provide hands-on experience. Topics include:

  • Parallel and distributed database systems (basics, architecture, scaling)
  • Parallel database design (fragmentation, allocation, transparency)
  • Parallel query execution (data localization, parallel algorithms)
  • Distributed storage (file-based, object-based, HDFS)
  • MapReduce (programming model, runtime)
  • Spark (programming model, runtime, streaming)
  • Distributed transactions (atomicity, isolation, replication)
  • NoSQL (CAP theorem, eventual consistency, consistent hashing, epidemic protocols)

Lecture Notes

In ILIAS. Last year's lecture videos and lecture slides can be found here.

Literature

  • H. Garcia-Molina, J. D. Ullman, J. Widom. Database Systems: The Complete Book. Prentice Hall, 2nd ed., 2008
  • T. Öszu, P. Valduriez. Principles of Distributed Database Systems. Springer, 4th ed., 2020
  • More in lecture notes