SM 445/ CS 707: Data and Web Science Seminar (HWS 2021)
The Data and Web Science seminar covers recent topics in data and web science. This term's topic is graph learning with a special (but not exclusive) focus on graph neural networks.
Organization
- This seminar is organized by Prof. Dr. Rainer Gemulla and Adrian Kochsiek.
- Available for Master students (2 SWS, 4 ECTS) and Bachelor students (2 SWS, 5 ECTS).
- Prerequisites for Master students: solid background in machine learning
- Maximum number of participants is 5 BSc and 10 MSc students
Goals
In this seminar, you will
- Read, understand, and explore scientific literature
- Summarize a current research topic in a concise report (10 single-column pages + references)
- Give two presentations about your topic (3 minutes flash presentation, 15 minutes final presentation)
- Moderate a scientific discussion about the topic of one of your fellow students
- Review a (draft of a) report of a fellow student
Schedule
- Register as described below.
- Attend the online kickoff meeting on Sep 14, 17:15 (tentative).
- Work individually throughout the semester according to the seminar schedule.
- Meet your advisor for guidance and feedback.
Registration
Register via Portal 2 until Sep 6.
If you are accepted into the seminar, provide at least 4 topics of your preference (your own and/
Topics
Each student works on a topic within the area of the seminar along with an accompanying reference paper. Your presentation and report should explore the topic with an emphasis on the reference paper, but not just the reference paper.
We provide example topics and reference papers below. If you want, you may suggest a different reference paper (let us know after the topic assignment) or a different topic within the graph learning area (talk to us before the topic assignments). A good starting point is recent research papers in top data mining and machine learning conferences (e.g., try NeurIPS, ICLR, ICML, KDD).
Introductory lecture videos on graph learning (part of IE 674) will be made available to all participants. The following review articles may serve as further starting points:
- Xia et al.
Graph Learning: A Survey
IEEE Transactions on Artificial Intelligence, 2021 - Zhang et al.
Deep Learning on Graphs: A Survey
IEEE Transactions on Knowledge and Data Engineering, 2020 - Wu et al.
A Comprehensive Survey on Graph Neural Networks
IEEE Transactions on Neural Networks and Learning Systems, 2021
Topic list
All topics marked as “BSc topics” can only be taken by BSc students. Unmarked topics are selected for MSc students, but can also be taken by BSc students with the appropriate background.
- Graph centrality (BSc topic)
Zaki and Meira Jr.
Ch. 4 of Data Mining and Analysis: Fundamental Concepts and Algorithms
Cambridge University Press, March 2020 - Graph models / generators (BSc topic)
Zaki and Meira Jr.
Ch. 4 of Data Mining and Analysis: Fundamental Concepts and Algorithms
Cambridge University Press, March 2020 - Graph pattern mining (BSc topic)
Zaki and Meira Jr.
Ch. 11 of Data Mining and Analysis: Fundamental Concepts and Algorithms
Cambridge University Press, March 2020 - Spectral clustering (BSc topic)
Zaki and Meira Jr.
Ch. 16 of Data Mining and Analysis: Fundamental Concepts and Algorithms
Cambridge University Press, March 2020o - Graph learning benchmarks (BSc topic)
Hu et al.
Open Graph Benchmark: Datasets for Machine Learning on Graphs
2020 - Message passing in graph neural networks
Hamilton et al.
Inductive Representation Learning on Large Graphs
NIPS 2017 - Spectral graph convolutional networks
Defferrard et al.
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
NIPS 2016 - Scaling graph neural networks
Zeng et al.
GraphSAINT: Graph Sampling Based Inductive Learning Method
ICLR 2020 - Graph kernels and graph similarity
Ok
A Graph Similarity for Deep Learning
NeurIPS 2020 - Expressivity of graph neural networks
Xu et al.
How Powerful Are Graph Neural Networks?
ICLR 2019 - Graph pooling
Mesquita et al.
Rethinking pooling in graph neural networks
NeurIPS 2020 - Pretraining graph neural nets
Hu et al.
Strategies for Pre-Training Graph Neural Networks
ICLR 2020 - Generative models for graphs
You et al.
GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models
ICML 2018 - Knowledge graph embeddings
Sun et al.
RotatE: Knowledge Graph Embedding By Relational Rotation In Complex Space
ICLR 2019 - Scene graph generation
Tang et al.
Unbiased Scene Graph Generation From Biased Training
CVPR 2020 - Graph to sequence learning
Xu et al.
Graph2Seq: Graph to Sequence Learning with Attention-based Neural Networks
2018 - Multi-relational graphs
Vashishth at al.
Composition-based Multi-Relational Graph Convolutional Networks
ICRL 2020
Supplementary materials and references
- “Giving Conference Talks”by Prof. Dr. Rainer Gemulla
- “Writing for Computer Science” by Justin Zobel, Springer, 2014