News
Assignment 02Written on 24.04.25 by Luca Gretscher Dear students, we have just uploaded Assignment 02. The solutions will be published after the mini-test next week. Note that there is a practical exercise using a Jupyter notebook. We won't publish solutions for that exercise but you are welcome to ask and discuss in your tutorial. Kind… Read more Dear students, we have just uploaded Assignment 02. The solutions will be published after the mini-test next week. Note that there is a practical exercise using a Jupyter notebook. We won't publish solutions for that exercise but you are welcome to ask and discuss in your tutorial. Kind regards, |
Mini-Test 01 Results and InspectionWritten on 22.04.25 by Luca Gretscher Dear students, we have just published the results of Mini-Test 01. You can view your results on your personal status page. You may inspect your mini-test at the end of your regular tutorial tomorrow (if you were able to state the correct tutorial number on your mini-test). If you do not have a… Read more Dear students, we have just published the results of Mini-Test 01. You can view your results on your personal status page. You may inspect your mini-test at the end of your regular tutorial tomorrow (if you were able to state the correct tutorial number on your mini-test). If you do not have a tutorial assigned (or were not able to state the correct tutorial number on your mini-test), you are welcome to inspect your mini-test during the office hour next week. Remember to bring your student ID for inspection. Kind regards, |
Mini-Test InformationWritten on 21.04.25 by Luca Gretscher Dear students, the mini-test slot registration is now closed. The first mini-test will take place tomorrow, 12:15 - 12:45 in E2 2 - lecture hall 0.01 (Günter-Hotz). More information can be found in the Timetable. General Information and Procedure
Dear students, the mini-test slot registration is now closed. The first mini-test will take place tomorrow, 12:15 - 12:45 in E2 2 - lecture hall 0.01 (Günter-Hotz). More information can be found in the Timetable. General Information and Procedure
Kind regards, |
Tutorial AssignmentWritten on 21.04.25 by Luca Gretscher Dear students, we have now assigned you to your tutorial groups. You can find your assigned tutorial on your personal status page. The tutorials will start this week. More information can be found in the Timetable. If you were assigned to Tutorial 9 (Wednesday, 00:00 No Tutorial) but still want… Read more Dear students, we have now assigned you to your tutorial groups. You can find your assigned tutorial on your personal status page. The tutorials will start this week. More information can be found in the Timetable. If you were assigned to Tutorial 9 (Wednesday, 00:00 No Tutorial) but still want to attend a tutorial at some point, you are welcome to attend any other tutorial. We will upload the tutorial slides before each tutorial and the solutions afterwards. Kind regards, |
Office Hour on 22.04.Written on 21.04.25 by Luca Gretscher Dear students, due to the public holiday today, the office hour will take place tomorrow, 22.04., 09:15 - 10:45 in E1 1, 3.07.1. Kind regards, |
Reminder: Mini-Test Slot Registration + Tutorial PreferencesWritten on 20.04.25 by Luca Gretscher Dear students, You can still register for the mini-test slot as well as set your tutorial preferences until today, 23:59. For more details regarding mini-test slot registration and tutorial preferences see this and this news. Kind regards, |
Assignment 01Written on 17.04.25 by Luca Gretscher Dear students, we have just uploaded Assignment 01. The solutions will be published after the mini-test next week. Kind regards, |
Mini-Test Slot RegistrationWritten on 14.04.25 (last change on 20.04.25) by Luca Gretscher Dear students, we would like to remind you to register for a mini-test slot. Currently, we offer two mini-test slots at the following times: Registration is mandatory to attend the mini-tests and works on a… Read more Dear students, we would like to remind you to register for a mini-test slot. Currently, we offer two mini-test slots at the following times: Registration is mandatory to attend the mini-tests and works on a first-come-first-served basis. Depending on the number of students, we will add a third slot from 12:45 - 13:00 or in parallel to one of the other two slots, s.t. everyone who wants to attend the mini-tests will be able to register. More information about the mini-test procedure will follow after the registration has been closed. Please register for a mini-test slot on your personal status page by Sunday, 20.04.2025, 23:59! Kind regards, |
Tutorial PreferencesWritten on 14.04.25 (last change on 20.04.25) by Luca Gretscher Dear students, we would like to remind you to set your preferences for the tutorials starting next week. We offer eight regular tutorials at the following times: Dear students, we would like to remind you to set your preferences for the tutorials starting next week. We offer eight regular tutorials at the following times: In the tutorials, you have the opportunity to briefly discuss the solution of the previous assignment sheet and to inspect your mini-test. However, the main focus will be a recap of the lecture material by providing additional exercises. Please note, that both the solutions of the assignment sheets as well as the tutorial slides including solutions will be timely uploaded to our Materials. Because of this, experience has shown that some students will not attend the tutorials in person. Therefore, we also created an additional (pseudo) tutorial (Slot 1: Wednesday, 00:00). Please give preference to this tutorial if you do not plan to attend the tutorials in general and rule out the other tutorial choices. With this, we can allow students that plan to attend, to more likely get their preferred choice. Furthermore, we can better assess how many in-person tutorials we really need. Of course, you can always attend a tutorial if you change your mind. Please submit your tutorial preferences on your personal status page by Sunday, 20.04.2025, 23:59! Kind regards, |
DockerWritten on 14.04.25 by Luca Gretscher Dear students, in the course of this lecture, we will use Python and in particular Jupyter Notebooks to explain various concepts. For a few notebooks, we also require additional software (e.g. PostgreSQL). Therefore, we provide a Virtual Machine using Docker that has all the required software and… Read more Dear students, in the course of this lecture, we will use Python and in particular Jupyter Notebooks to explain various concepts. For a few notebooks, we also require additional software (e.g. PostgreSQL). Therefore, we provide a Virtual Machine using Docker that has all the required software and systems already installed. You can find detailed instructions at the following Github repository. The link is also available under Information > Docker. We spent a lot of time preparing the tools and the instructions. Please read them carefully before asking questions. Please note, that you are also able to run most of the notebooks by just having a Python installation with the required packages. For more information see Information > Manual Installation. If you still have problems with the installation, you can always ask a question in the forum (BDE25 > Technical). Additionally, there will be a special Docker support office hour on Tuesday, 15.04.2025, 12:15 - 14:00 in E2 2 - Lecture Hall 0.01 (Günter-Hotz). Kind regards, |
Big Data Engineering
This course covers the fundamentals of data management and query processing.
- Learn basic techniques in "Big Data Engineering" conceptually.
- Learn to apply basic techniques in "Big Data Engineering".
- Help you not to reinvent the wheel later.
- Learn to map new problems to existing problems and solve them using established techniques.
- Raise awareness for problems of important applications: Privacy, deanonymization, ethical issues.
- Raise awareness for solutions of important applications: Effort, performance, robustness, extensibility, maintainability.
Lecture
The lecture takes place every Thursday at 10:15 in building E2 2 - lecture hall 0.01 (Günter-Hotz-Hörsaal). The recording of the lecture will be uploaded to YouTube afterwards. The lecture was awarded with two busy beaver teaching awards (2011, 2021) and three busy beaver honorable mentions (2022, 2023, 2024).
Tutorials
On Wednesdays, there will be tutorials. In the tutorials there will be both exercises and the possibility to ask questions regarding the assignment sheets, the mini-tests, and the lectures. Please indicate your preferred tutorial timeslots on your personal status page by 23:59 on 20.04.2025. We will then assign you to your tutorial. If you are unable to attend on your assigned date at some point, you are welcome to attend another tutorial. The tutorials will start in the third week on 23.04.2025.
Office Hours
In addition to the tutorials, there will be an Office Hour on Mondays 10:15 - 11:45 in the seminar room E1.1, 3.06. In the Office Hour you can ask questions about the lectures and the assignment sheets, as well as get help with technical problems.
Assignment Sheets
During the day after each lecture we publish an assignment sheet with tasks related to the lecture under Materials. These usually consist of three written exercises and one programming exercise. Assignment sheets are voluntary and are intended as practice for the mini-tests and the exams.
Mini-Tests
On Tuesdays at 12:15 in building E2 2 - lecture hall 0.01 (Günter-Hotz-Hörsaal), there will be mandatory mini-tests with tasks related to the topics covered in the lecture the week before. Afterwards, your mini-test will be corrected by our team and you will receive points via CMS. Please register for a mini-test timeslots on your personal status page by 23:59 on 20.04.2025. This timeslot must not be changed during the semester. More information about the exact dates for the mini-tests can be found in the Timetable.
Project
Near the end of the lecture, there will be a small project for which you have to develop a toy backend server for a social network. The project is to be completed by you in groups of 3-4 students. Your points will be determined by functional tests and the quality of your code together with the outcome of a short code review. Note that all team members must know and understand all code. Team members who are not able to explain parts of the code do not get points for the project. More information about the exact dates for the release and the submission of the project and for the code reviews can be found in the Timetable.
Exam Admission
To be eligible for the written exam and/or re-exam, you must achieve at least 50% of the possible points in the mini-tests and at least 50% in the project separately. Additionally, no more than two mini-tests may be graded with 0 points.
Exam
At the end of the semester there will be both a written exam and a re-exam.
- Exam: 29.07.2025 12:00 - 14:00
- Re-Exam: 25.09.2025 14:00 - 16:00
Grade
The better result of the written exam and the re-exam determines 100% of the final grade. In order to pass the lecture, at least 50% of the points must be achieved in the written exam or the re-exam.