Queste sono le differenze tra la revisione selezionata e la versione attuale della pagina.
Entrambe le parti precedenti la revisione Revisione precedente Prossima revisione | Revisione precedente | ||
mds:dsd:start [22/05/2019 alle 11:57 (5 anni fa)] Salvatore Ruggieri [Instructor] |
mds:dsd:start [27/03/2024 alle 13:18 (29 ore fa)] (versione attuale) Salvatore Ruggieri [Exams] |
||
---|---|---|---|
Linea 9: | Linea 9: | ||
ga(' | ga(' | ||
ga(' | ga(' | ||
- | ga(' | + | ga(' |
- | + | ||
ga(' | ga(' | ||
- | ga(' | + | ga(' |
setTimeout(" | setTimeout(" | ||
</ | </ | ||
<!-- End Google Analytics --> | <!-- End Google Analytics --> | ||
+ | <!-- Global site tag (gtag.js) - Google Analytics --> | ||
+ | <script async src=" | ||
+ | < | ||
+ | window.dataLayer = window.dataLayer || []; | ||
+ | function gtag(){dataLayer.push(arguments); | ||
+ | gtag(' | ||
+ | |||
+ | gtag(' | ||
+ | </ | ||
<!-- Capture clicks --> | <!-- Capture clicks --> | ||
< | < | ||
Linea 42: | Linea 51: | ||
</ | </ | ||
</ | </ | ||
- | ====== Decision Support Databases A.Y. 2018/19 ====== | + | ====== |
- | The course presents | + | This is the first module |
+ | The module presents the main approaches to the design and implementation of decision support databases, and the characteristics of business intelligence tools and computer based information systems used to produce summary information to facilitate appropriate decision-making processes and make them more quick and objectives. Specific attention will be paid to themes such as conceptual and logical Data Warehouses design, data analysis using analytic SQL, algorithms for selecting materialized views, data warehouse systems technology (indexes, star query optimization, | ||
+ | |||
+ | < | ||
=====Instructor===== | =====Instructor===== | ||
- | * **Salvatore Ruggieri** | + | * **Salvatore Ruggieri** |
* Università di Pisa | * Università di Pisa | ||
* [[http:// | * [[http:// | ||
- | * [[ruggieri@di.unipi.it]] | + | * [[salvatore.ruggieri@unipi.it]] |
- | * **Office hours:** Tuesdays h 14:00 - 17:00 or by appointment, | + | * **Office hours:** Tuesdays h 14:00 - 16:00 or by appointment, |
- | < | ||
- | < | ||
- | </ | ||
- | |||
- | =====Classes===== | + | =====Hours and rooms===== |
- | Lessons will be held at: Polo Didattico "L. Fibonacci", | + | ^ Day of Week ^ Hour ^ Room ^ |
+ | | Wednesday | ||
+ | | Thursday | ||
- | ^ Day of Week ^ Hour ^ Room ^ Type ^ | ||
- | | Thursday | 16:00 - 18:00 | Fib C1 | Lectures | ||
- | | Friday| | ||
+ | A [[https:// | ||
+ | =====Mandatory teaching material ===== | ||
- | =====Mandatory teaching material===== | + | |
- | + | * **[DB]** A. Albano. | |
- | | + | * Examples of {{ : |
- | * **[DWSol]** A. Albano, S. Ruggieri. Decision Support Databases | + | =====Software===== |
- | * **[DB]** A. Albano. [[http://apa.di.unipi.it/ | + | |
- | * Examples of [[http://apa.di.unipi.it/bsd/BSDsamples.pdf|written | + | |
+ | * [[http:// | ||
+ | * [[https:// | ||
+ | * [[https:// | ||
=====Preliminary program and calendar===== | =====Preliminary program and calendar===== | ||
- | * [[https:// | + | * [[https:// |
- | * [[https://www.di.unipi.it/ | + | * [[https://didattica.di.unipi.it/ |
=====Exams===== | =====Exams===== | ||
- | __//There are no mid-terms// | + | __//There are no mid-terms// |
- | Registration to exams is mandatory: | + | |
- | ^ Date ^ Hour ^ Room ^ | + | Registration to the written exam is mandatory (**pay attention at the deadline for registering!**): [[https://esami.unipi.it/esami2/|register here]]\\ |
- | | 18/ | + | |
- | | 2/7/2019 | 9:00 - 11:00 | Fib-L1 | + | |
- | | 24/7/2019 | 9:00 - 11:00 | Fib-L1 | + | |
- | =====Class calendar===== | + | |
- | Recordings are password protected. Ask the teacher | + | **Please indicate in the notes "Only Lab" |
+ | ^ Date ^ Hour ^ Room ^ Notes ^ | ||
+ | | 28/ | ||
+ | | 25/ | ||
+ | | 23/ | ||
+ | | 13/ | ||
- | **01.** //Monday 17 September 2018, 14-16// **[DW: 1.1-1.2]** | + | < |
+ | <!-- [[https://didattica.di.unipi.it/ | ||
+ | </ | ||
- | Course overview. Need for Strategic Information. Information Systems in Organizations: | + | =====Class calendar ===== |
- | | + | |
- | **02.** //Wednesday 19 September 2018, 9-11// **[DW: 1.3-1.7]** [[http:// | + | Lessons will be **NOT** be live-streamed, but recordings of past years are available here for non-attending students.\\ |
- | The data warehouse (DW) and DW architectures. What to model in a DW: Facts, measures, dimensions and dimensional hierarchies. Examples of data analysis. Exercises on data analysis in SQL. | + | Some of recordings |
- | **03.** //Thursday 27 September 2018, 16-18// **[DB: 1.1, 2.1-2.5]** [[http://apa.di.unipi.it/ | + | To watch the recordings online, you must be connected to the [[https:// |
- | Recalls: the Object Data Model. | + | **2023-01.** //Wednesday 20 September 2023, 11-13// **[DW: 1.1-1.2]** [[http:// |
- | **04.** //Friday 28 September 2018, 16-18// **[DW: 2.1]** [[http://apa.di.unipi.it/ | + | Course overview. Need for Strategic Information. Information Systems in Organizations: Operational and Decision support. Data driven Decision support systems and Business Intelligence applications. From data to information for decision making. Types of data synthesis: Reports, Multidimensional data analysis, Exploratory data analysis. |
- | DW modeling. A conceptual multidimensional data model. Representation of Fact, measures, dimensions, attributes and dimensional hierarchies. Key steps in conceptual design from business questions. How to identify Fact types and fact granularity and measure types. How to identify dimensions, dimensional attributes and hierarchies. Examples.\\ | + | **2023-02.** //Thursday 21 September 2023, 14-16// |
- | **Slides:** [[http://apa.di.unipi.it/bsd/UniversityCaseStudy.pdf|university requirements]]. | + | |
- | **05.** //Thursday 4 October 2018, 16-18// **[DW: 2.1, A.1]** [[http:// | + | The data warehouse (DW) and DW architectures. What to model in a DW: Facts, measures, dimensions and dimensional hierarchies. Examples of data analysis. Exercises on data analysis in SQL. |
- | The example of a data model for Master program exams. Presentation and discussion of the Hospital case study. | + | **2023-03.** //Wednesday 27 September 2023, 11-13// **[DB: 1.1, 2.1-2.5]** [[http:// |
- | **06.** //Friday 5 October 2018, 16-18// **[DB: 3.1-3.2]** | + | Recalls: the Object Data Model. [[http://131.114.72.230/dsd/dsd.03.assignments.pdf|Exercises at home (Assignments I and II) for the lesson 2023-05]]. |
- | Recalls: the relational model and relational algebra. Exercises. | + | **2023-04.** //Thursday 28 September 2023, 14-16// **[DW: 2.1]** |
- | **07.** //Thursday 11 October 2018, 16-18// **[DW: 2.1,2.2,A.1]** [[http://apa.di.unipi.it/bsd/video/ | + | DW modeling. A conceptual multidimensional data model. Representation of Fact, measures, dimensions, attributes and dimensional hierarchies. Key steps in conceptual design from business questions. How to identify fact types and fact granularity and measure types. How to identify dimensions, dimensional attributes and hierarchies. Examples. |
+ | [[http://131.114.72.230/dsd/dsd.04.assignments.pdf|Exercises at home (University exams) for the lesson 2023-05]]. | ||
- | More about data mart conceptual design, changing dimensions and advanced data model features. From Conceptual design to relational logical design. Star model, snowflake, and constellation. Logical schema of the Hospital case study. | ||
- | **XX** <del>//Friday 12 October | + | **2023-05.** //Wednesday 4 October |
- | Lesson canceled to allow students' | + | The example of a data model for Master program exams. Presentation and discussion of the Hospital case study. |
- | **08.** // | + | **2023-06.** // |
- | Recalls: the relational model and relational algebra. | + | Recalls: the relational model and relational algebra. |
+ | [[http:// | ||
- | **09.** //Friday 19 October | + | **2023-07.** //Wednesday 11 October |
- | Multidimensional Cube model: OLAP Operations. The extended cube and the lattice | + | More about data mart conceptual design, changing dimensions and advanced data model features. From Conceptual design to relational logical design. Star model, snowflake, |
- | **Additional learning material: | + | |
- | * G. Harvey. Excel 2013 All-in-One For Dummies, 2013. [[http://apa.di.unipi.it/bsd/PivotTable2013BookVIIchpt2.pdf|Chp. VII-2]] and [[http:// | + | |
- | * [[https:// | + | |
- | **XX** <del>// | + | **2023-08.** // |
- | Lesson canceled due to institutional duties of the teacher. It will be recovered in November. | + | Recalls: |
- | **XX** < | ||
- | Lesson canceled due to institutional duties of the teacher. It will be recovered in November. | + | **2023-09.** //Wednesday 18 October 2023, 11-13// **[DW: A.2, B.2]** [[http:// |
- | **10.** //Thursday 8 November 2018, 16-18// **[DW: A.2, | + | Discussion of students' |
- | Discussion of students' | + | **2023-10.** //Thursday 19 October 2023, 14-16// **[DW: 3.1-3.5]** [[http://131.114.72.230/ |
- | **11.** //Friday 9 November 2018, 16-18// **[DW: 3.1-3.5]** [[http:// | + | Data Warehouse design approaches. Data mart logical design. |
- | Data mart logical design. Slowly changing dimensions, fast changing dimensions, shared dimensions. Recursive hierarchies. Multivalued dimensions. Multivalued Dimensional Attributes. | + | **2023-11.** //**Tuesday 24 October 2022, 14-16, Room L1**// **[DW: 3.1-3.5]** [[http:// |
- | **12.** //Thursday 15 November 2018, 16-18// **[DB: 3.4], [DW: 4.1-4.8]** [[http://apa.di.unipi.it/bsd/video/ | + | Slowly changing dimensions, fast changing dimensions, shared dimensions. Recursive hierarchies. Multivalued dimensions. [[http://131.114.72.230/dsd/dsd.11.assignments.pdf|Exercises at home (Travel agency extended) for the lesson 2023-12]]. |
- | Recalls on: ODM-to-Relational Mapping. A DW to support Analytical CRM Analysis. | + | **2023-12.** //Thursday 2 November 2023, 14-16// |
- | **13.** //Friday 16 November 2018, 16-18// **[DB: 4.1-4.2, | + | A DW to support Analytical CRM Analysis. Wrap up on DW design. [[http://131.114.72.230/dsd/dsd.12.assignments.pdf|Exercises at home for the lesson 2023-14]]. |
- | Recalls on: DBMS, from SQL to extended relational algebra. Exercises.\\ | ||
- | **Software: | ||
- | **14.** //Thursday 22 November | + | **2023-13.** //**Tuesday 7 November |
- | OLAP systems. Data Analysis Using SQL. Simple reports. Examples. Moderately Difficult Reports. Examples of variance reports. Solutions | + | Multidimensional Cube model: |
+ | **Additional learning material:** G. Harvey. Excel 2013 All-in-One For Dummies, 2013. [[http:// | ||
- | **15.** //Friday 23 November | + | **2023-14.** //Wednesday 8 November |
- | Very Difficult Reports without Analytic | + | Recalls on: DBMS, from SQL to extended relational algebra. Exercises. |
- | **Software: | + | [[http://131.114.72.230/dsd/dsd.14.assignments.pdf|Exercises at home for the lesson 2023-15]]. |
- | |Azure Data Studio]]. | + | |
+ | **2023-15.** //Wednesday 15 November 2023, 11-36// | ||
- | **16.** //Monday 26 November 2018, 14-16 **(Recover lesson - Room M1)**// **[DB: 6.1-6.6, 6.8, 7.1-7.2]** [[http://apa.di.unipi.it/bsd/video/ | + | OLAP systems. Data Analysis Using SQL. Simple reports. Examples. Moderately Difficult Reports. Solutions in SQL. |
+ | [[http://131.114.72.230/dsd/dsd.15.foodmart.pdf|Foodmart datawarehouse schema]]. | ||
- | Recalls of relational DBMS internals: Storage, Indexing and Query Evaluation. Physical operators and physical plans for projection, selection, joins and grouping. Examples.\\ | + | **2023-16.** //Thursday 16 November 2023, 14-16// |
- | **Software:** [[http://apa.di.unipi.it/bsd/JRS2019.zip|JRS (Java Relational System) DBMS]] (updated on 9 Jan 2019). | + | |
- | **XX** <del>//Thursday 29 November 2018, 16-18//</ | + | Examples of variance reports. Very Difficult Reports without Analytic SQL. Example of reports with ranks. Analytic Functions with the use of partitions and running totals. Examples. |
- | Lesson canceled due to institutional duties of the teacher. | + | **2023-17.** //**Tuesday 21 November 2023, 14-16, Room L1**// |
- | **17.** //Friday 30 November 2018, 16-18// **[DW: 6.1-6.4]** [[http://apa.di.unipi.it/bsd/video/ | + | Analytic Functions with the use of moving windows. Examples. Exercises on Analytic SQL. [[http://131.114.72.230/dsd/dsd.17.assignments.pdf|Exercises during the lesson and at home]] and [[http://131.114.72.230/dsd/dsd.17.solutions.txt|solutions]]. |
- | Data Warehouse Systems: Special-Purpose Indexes and Star Query Plan. Bitmap indexes. Join indexes. Star queries optimization and query plans. Examples. Table partitioning. | + | **2023-18.** //Wednesday 22 November 2023, 11-13// |
- | **18.** //Monday 3 December 2018, 14-16 **(Recover lesson - Room M1)**// **[DW: 7.1-7.7]** [[http:// | + | Recalls of relational DBMS internals: Storage, Indexing and Query Evaluation. Physical operators and physical plans for projection, selection, joins and grouping. Examples. |
- | The problem of materialized views selection. The lattice of views and the greedy algorithm HRU for the selection of materialized views. Examples. Other algorithms for the choice of the views to materialize with a workload and dimensional hierarchies. | + | **2023-19.** //Wednesday 29 November 2023, 11-13// **[DW: 6.1-6.4]** [[http:// |
- | **19.** //Wednesday 5 December 2018, 14-16 **(Recover lesson - Room Seminari Ovest, Dept. Computer Science**)// | + | Data Warehouse Systems: Special-Purpose Indexes and Star Query Plan. Bitmap indexes. Join indexes. Star queries optimization and query plans. Examples. Table partitioning. |
- | Recalls of functional dependency properties and how they are used to reason about the properties of the result of a query. Properties of the group-by operator. | + | **2023-19 bis.** //Thursday 30 November 2023, 14-16, **Room Seminari Est at the Computer Science Dept.**// **[DW: 6.5-6.8]** |
- | **XX** <del>//Thursday 6 December 2018, 16-18//</del> | + | **For attending students:** Seminar (in Italian): |
- | Lesson canceled due to institutional duties of the teacher. | + | **For non-attending students:** Data Warehousing trends: column-oriented DW, main-memory DW, Big Data framework. (see recorded lesson from past years). |
- | **20.** //Friday 7 December 2018, 11-13 **(Recover lesson - Room N1**)// **[DW: 8.3-8.6]** [[http:// | ||
- | The problem of evaluating the group-by before the join operator. First case: Invariant grouping. Examples. Other cases: double grouping, grouping and counting. Examples with star queries. | + | **2023-20.** //Wednesday 6 December 2023, 11-13// **[DW: 7.1-7.7]**[[http://131.114.72.230/ |
- | **21.** //Friday 7 December 2018, 14-16 **(Anticipated lesson - Room C1**)/// **[DW: 9.1-9.4]** [[http://apa.di.unipi.it/bsd/video/ | + | The problem of materialized views selection. The lattice of views and the greedy algorithm HRU for the selection of materialized views. Examples. Other algorithms for the choice of the views to materialize with a workload and dimensional hierarchies. [[http://131.114.72.230/dsd/dsd.20.assignments.pdf|Exercises at home for the lesson 2023-21]]. |
- | The problem of query rewrite to use a materialized view. Hypothesis and two approaches: With a compensation on the logical view plan, and with a transformation of logical query plan. Examples. | + | **2023-21.** //Thursday 7 December 2023, 14-16// **[DW: 8.1-8.2, DB: 3.5.1-3.5.4]** [[http:// |
- | **22.** //Thursday 13 December 2018, 16-18// **[DW: 6.5-6.8]** [[http:// | + | Recalls of functional dependency properties and how they are used to reason about the properties of the result of a query. Properties of the group-by operator. |
- | Data Warehousing trends: column-oriented DW, main-memory DW, Big Data framework. | + | **2023-22.** //**Monday 11 December 2023, 14-16, Room M1**// **[DW: 8.3-8.6]** [[http:// |
- | **23.** //Friday 14 December 2018, 11-13 (**Recover lesson - Room N1**)// | + | The problem of evaluating the group-by before the join operator. First case: Invariant grouping. Examples. Other cases: double grouping, grouping and counting. Examples with star queries. |
- | Examples of written exams with solutions. Q. & A.\\ | + | **2023-23.** //Wednesday 13 December 2023, 11-13, ** Room M1**// **[DW: 9.1-9.4]** [[http://131.114.72.230/dsd/video/ |
- | **Slides:** [[http://apa.di.unipi.it/bsd/exercises.pdf|exercises]]. | + | |
+ | The problem of query rewrite to use a materialized view. Hypothesis and two approaches: With a compensation on the logical view plan, and with a transformation of logical query plan. Examples. | ||
- | **24.** //Friday 14 December 2018, 16-18// | ||
- | Examples of written exams with solutions. Q. & A. | + | =====Previous years===== |
+ | * [[mds: | ||
+ | * [[mds: | ||
+ | * [[mds: | ||