https://hub.imt-atlantique.fr/data-engineering-foundations/relational_dbms/index.html Presentation & objectives This part of the track is dedicated to a major data model, relational data. Even if it is not the most appropriate choice for very large datasets, the relational data model is still predominant to store the data of most dynamic web-based applications. Two topics are addressed and separated into two practical activities. The first one is dedicated to database servers administration. A focus is given to the Postgresql Relational DataBase Management System (RDBMS). More precisely, by the end of this first activity, you will be able to: Hugo en-us https://hub.imt-atlantique.fr/data-engineering-foundations/relational_dbms/db_indexes/index.html Mon, 01 Jan 0001 00:00:00 +0000 https://hub.imt-atlantique.fr/data-engineering-foundations/relational_dbms/db_indexes/index.html Indexes in DB are very important to speed up the retrieval of tuples and thus to make query execution more efficient. PostgreSQL supports a rich set of index types, each optimized for different kinds of queries and data structures. This document only covers the main types of indexes but more details can be found on the official documentation. An index speeds up read access but slows down write and update statements. https://hub.imt-atlantique.fr/data-engineering-foundations/relational_dbms/query_execution_plan/index.html Mon, 01 Jan 0001 00:00:00 +0000 https://hub.imt-atlantique.fr/data-engineering-foundations/relational_dbms/query_execution_plan/index.html What happens when an SQL query is submitted to a Relational DB Management System (RDBMS)? The goal of this document is to detail and analyse the different steps your query goes through to obtain its result. A focus is put on the way Postgresql executes a query but most of the existing RDBMS behave similarly. Query execution steps When an SQL query (e.g., SELECT * FROM users WHERE age > 30;) is submitted, the RDBMS has to analyse the query to determine the best way to access the data and to return the result. The execution pipeline typically involves the following steps: https://hub.imt-atlantique.fr/data-engineering-foundations/relational_dbms/practical_rdbms_administration/index.html Mon, 01 Jan 0001 00:00:00 +0000 https://hub.imt-atlantique.fr/data-engineering-foundations/relational_dbms/practical_rdbms_administration/index.html Duration1h15 AI Allowed Preparing the Docker environment To guide you in the identification of the key elements that compose a Postgresql server, you will first install and run the service from a base Linux system. Run an alpine Linux container taking care that you map its 5432 port to the 5433 port of the host, and execute in interactive mode a shell terminal in it. Port mapping will be necessary later on. Use the apk package manager to install the bash shell (more user-friendly than sh) and the last version of Postgresql (currently v17). Here is below an example of how to use apk: apk update apk search postgres apk add postgresql17 Running the Postgresql server For the moment, there is only one user registered in your Linux container, the root user. It is strongly recommended to run every service using a dedicated user to isolate the server’s process and data from other running services. https://hub.imt-atlantique.fr/data-engineering-foundations/relational_dbms/practical_query_execution/index.html Mon, 01 Jan 0001 00:00:00 +0000 https://hub.imt-atlantique.fr/data-engineering-foundations/relational_dbms/practical_query_execution/index.html Duration1h15 AI Allowed Deliverable You have to produce by pair a practice report detailing and discussing all the experiments you will conduct during this lesson. At the end of the session, upload your practice report on Moodle. Preparing the Docker environment You should have already acquired the basics of Docker container management and Postgresql administration.