Seminar on Knowledge Graphs and Large Language Models (FSS 2026)
Large Language Models (LLMs) like ChatGPT have been among the most omnipresent advances in the field of Artificial Intelligence in the past years. Despite their potential and versatility, they have also exposed some drawbacks, such as hallucinations, intransparency, and non-factuality. Knowledge Graphs (KGs), on the hand, are a main driver of white box AI, which are known to be transparent and factual.
In this seminar, we will look at works at the cross-roads between knowledge graphs and large language models, which aim at combining the best of both worlds. Areas of interest include, but are not limited to:
- KGs for LLM training and tuning
- KG Enhanced LLM inference and explanations
- Prompt engineering with KGs
- Completing/
Refining KGs with LLMs - Question Answering/
Text Generation with KGs and LLMs - Joint Reasoning with KGs and LLMs
Goals
In this seminar, you will familiarize yourself with approaches to knowledge graph construction. You will read research papers, specifications, and tool descriptions, as well as conduct own experiments where applicable, and you will discuss the insights with the other participants of the seminar.
As a participant, you are supposed to introduce a particular technique for knowledge graph construction and present it to the seminar participants. Each seminar paper undergoes a peer review process in the seminar. Presentations are supposed to be about 25 minutes long.
Organization
This seminar is organized by Dr. Sven Hertling
Available for Master students (2 SWS, 4 ECTS)
Prerequisites: Basic prior knowledge in knowledge graphs (e.g., by attending IE650) and LLMs
Additional resources:
Schedule
Tentative schedule. In case these dates do not fit the participants, please contact Dr. Sven Hertling
- February 25th, 13:45–15:15: kick off meeting, room tba
- March 6th: topic assignment
- April 17th: paper draft due
- May 8th: peer review due
- May 20th, 27th: 13:45–17:00 presentations and discussions, schedule and room tba
- June 19th: final paper due
Registration
- Registration will be available in Portal2
- Note that this seminar is an in person event, so that you should only select it if you are planning to be in Mannheim in the spring term
- After the kick off session, please send a ranked list of three topics you would like to read and present in the seminar to Ezgi Yilmaz
- Final assignment of topics will be made after the kick off meeting
Recommended Reading
The following paper may serve as an entry point to the seminar topic:
- Pan et al., 2024: Unifying Large Language Models and Knowledge Graphs: A Roadmap
- Pan et al., 2024: Large Language Models and Knowledge Graphs: Opportunities and Challenges
Note that these are two different articles published in the same year by a different group of authors, where in both cases, the respective first author has the last name “Pan” (but they are two different persons).
To shape your topic, you may use the following list of papers: