Strumenti Utente

Strumenti Sito


mds:dsd:start

Differenze

Queste sono le differenze tra la revisione selezionata e la versione attuale della pagina.

Link a questa pagina di confronto

Entrambe le parti precedenti la revisioneRevisione precedente
Prossima revisione
Revisione precedente
mds:dsd:start [20/09/2024 alle 19:29 (6 giorni fa)] Salvatore Ruggierimds:dsd:start [26/09/2024 alle 12:37 (15 ore fa)] (versione attuale) Salvatore Ruggieri
Linea 4: Linea 4:
  
 The module presents the main approaches to the design and implementation of decision support databases, and the characteristics of business intelligence tools and computer based information systems used to produce summary information to facilitate appropriate decision-making processes and make them more quick and objectives. Specific attention will be paid to themes such as conceptual and logical Data Warehouses design, data analysis using analytic SQL, algorithms for selecting materialized views, data warehouse systems technology (indexes, star query optimization, physical design, query rewrite methods to use materialized views). A part of the course will be dedicated to a collection of case studies. The module presents the main approaches to the design and implementation of decision support databases, and the characteristics of business intelligence tools and computer based information systems used to produce summary information to facilitate appropriate decision-making processes and make them more quick and objectives. Specific attention will be paid to themes such as conceptual and logical Data Warehouses design, data analysis using analytic SQL, algorithms for selecting materialized views, data warehouse systems technology (indexes, star query optimization, physical design, query rewrite methods to use materialized views). A part of the course will be dedicated to a collection of case studies.
- 
  
 =====Instructor===== =====Instructor=====
Linea 23: Linea 22:
 |  Wednesday  |  16:00 - 18:00  |  Fib H-Lab  | |  Wednesday  |  16:00 - 18:00  |  Fib H-Lab  |
 |  Thursday  |  11:00 - 13:00  |  Fib A1  | |  Thursday  |  11:00 - 13:00  |  Fib A1  |
-|  Friday  |  11:00 - 13:00  |  Fib L1  |+|  Friday  |  11:00 - 13:00  |  Fib C1  |
  
  
Linea 55: Linea 54:
  
 ^  Date  ^  Hour  ^  Room  ^  Notes  ^ ^  Date  ^  Hour  ^  Room  ^  Notes  ^
-|  6/11/2024  |  9:00 - 11:00  |  TBD  | [[https://didattica.di.unipi.it/en/appelli-straordinari/|Extra-ordinary exam]] |+|  6/11/2024  |  9:00 - 11:00  |  Riunioni Ovest, Dept. Computer Science  | [[https://didattica.di.unipi.it/en/appelli-straordinari/|Extra-ordinary exam]] |
  
 =====Class calendar ===== =====Class calendar =====
Linea 72: Linea 71:
 |04| 24/09 9-11 | Fib-C | DW modeling. Representation of facts, measures, dimensions, attributes and dimensional hierarchies. Key steps in conceptual design from business questions. How to identify facts, measures, dimensions, dimensional attributes and hierarchies. Examples. {{:mds:dsd:dsd04.assignments.pdf|Exercises at home (University exams) for the lesson 05}}.  [[http://131.114.72.230/dsd/video/dsd04_20170929.flv|rec04 (.flv)]] | **[DW: 2.1]**  {{:mds:dsd:dsd04.pdf|slides04 (.pdf)}} | |04| 24/09 9-11 | Fib-C | DW modeling. Representation of facts, measures, dimensions, attributes and dimensional hierarchies. Key steps in conceptual design from business questions. How to identify facts, measures, dimensions, dimensional attributes and hierarchies. Examples. {{:mds:dsd:dsd04.assignments.pdf|Exercises at home (University exams) for the lesson 05}}.  [[http://131.114.72.230/dsd/video/dsd04_20170929.flv|rec04 (.flv)]] | **[DW: 2.1]**  {{:mds:dsd:dsd04.pdf|slides04 (.pdf)}} |
 |05| 26/09 11-13 | Fib-A1 | The example of a data model for Master program exams. Presentation and discussion of the Hospital case study.  {{:mds:dsd:dsd05.assignments.pdf|Exercises at home (Assignment III) for the lesson 07}}.  [[http://131.114.72.230/dsd/video/dsd05_20210928.mp4|rec05 (.mp4)]] | **[DW: 2.1, A.1]**  {{:mds:dsd:dsd05.pdf|slides05 (.pdf)}} | |05| 26/09 11-13 | Fib-A1 | The example of a data model for Master program exams. Presentation and discussion of the Hospital case study.  {{:mds:dsd:dsd05.assignments.pdf|Exercises at home (Assignment III) for the lesson 07}}.  [[http://131.114.72.230/dsd/video/dsd05_20210928.mp4|rec05 (.mp4)]] | **[DW: 2.1, A.1]**  {{:mds:dsd:dsd05.pdf|slides05 (.pdf)}} |
-|06| 27/09 11-13 | Fib-L1 | Recalls: the relational model and relational algebra. Exercises. {{:mds:dsd:dsd06.assignments.pdf|Exercises at home (Assignment IV) for the lesson 08}}. [[http://131.114.72.230/dsd/video/dsd06_20211001.mp4|rec06 (.mp4)]] | **[DB: 3.1-3.2]**  {{:mds:dsd:dsd06.pdf|slides06 (.pdf)}} |+|06| 27/09 11-13 | Fib-C1 | Recalls: the relational model and relational algebra. Exercises. {{:mds:dsd:dsd06.assignments.pdf|Exercises at home (Assignment IV) for the lesson 08}}. [[http://131.114.72.230/dsd/video/dsd06_20211001.mp4|rec06 (.mp4)]] | **[DB: 3.1-3.2]**  {{:mds:dsd:dsd06.pdf|slides06 (.pdf)}} |
 |07| 01/10 9-11 | Fib-C | More about data mart conceptual design, changing dimensions and advanced data model features. From Conceptual design to relational logical design. Star model, snowflake, and constellation. Logical schema of the Hospital case study. {{:mds:dsd:dsd07.assignments.pdf|Exercises at home (Travel agency) for the lesson 09}}.  [[http://131.114.72.230/dsd/video/dsd07_20211005.mp4|rec07 (.mp4)]] | **[DW: 2.1, 2.2, A.1, B.1]**  {{:mds:dsd:dsd07.pdf|slides07 (.pdf)}} | |07| 01/10 9-11 | Fib-C | More about data mart conceptual design, changing dimensions and advanced data model features. From Conceptual design to relational logical design. Star model, snowflake, and constellation. Logical schema of the Hospital case study. {{:mds:dsd:dsd07.assignments.pdf|Exercises at home (Travel agency) for the lesson 09}}.  [[http://131.114.72.230/dsd/video/dsd07_20211005.mp4|rec07 (.mp4)]] | **[DW: 2.1, 2.2, A.1, B.1]**  {{:mds:dsd:dsd07.pdf|slides07 (.pdf)}} |
 |08| 03/10 11-13 | Fib-A1 | Recalls: the relational model and relational algebra. Logical trees. {{:mds:dsd:dsd08.jrsexercises.pdf|Exercises with JRS}}.  {{:mds:dsd:dsd08.assignments.pdf|Exercises at home (Airline companies) for the lesson 09}}. [[http://131.114.72.230/dsd/video/dsd08_20211008.mp4|rec08 (.mp4)]] | **[DB: 3.2-3.4]**  {{:mds:dsd:dsd08.pdf|slides08 (.pdf)}} | |08| 03/10 11-13 | Fib-A1 | Recalls: the relational model and relational algebra. Logical trees. {{:mds:dsd:dsd08.jrsexercises.pdf|Exercises with JRS}}.  {{:mds:dsd:dsd08.assignments.pdf|Exercises at home (Airline companies) for the lesson 09}}. [[http://131.114.72.230/dsd/video/dsd08_20211008.mp4|rec08 (.mp4)]] | **[DB: 3.2-3.4]**  {{:mds:dsd:dsd08.pdf|slides08 (.pdf)}} |
-|09| 04/10 11-13 | Fib-L1 | Discussion of students' solutions of conceptual and logical design case studies.   [[http://131.114.72.230/dsd/video/dsd09_20211012.mp4|rec09 (.mp4)]] | **[DW: A.2, B.2]**  {{:mds:dsd:dsd09.pdf|slides09 (.pdf)}} | +|09| 04/10 11-13 | Fib-C1 | Discussion of students' solutions of conceptual and logical design case studies.   [[http://131.114.72.230/dsd/video/dsd09_20211012.mp4|rec09 (.mp4)]] | **[DW: A.2, B.2]**  {{:mds:dsd:dsd09.pdf|slides09 (.pdf)}} | 
-|10| 8/10 11-13 | Fib-A1 | Data Warehouse design approaches. Data mart logical design.  [[http://131.114.72.230/dsd/video/dsd10_20211015.mp4|rec08 (.mp4)]] | **[DW: 3.1-3.5]**  {{:mds:dsd:dsd10.pdf|slides10 (.pdf)}} | +|10| 8/10 11-13 | Fib-| Data Warehouse design approaches. Data mart logical design.  [[http://131.114.72.230/dsd/video/dsd10_20211015.mp4|rec08 (.mp4)]] | **[DW: 3.1-3.5]**  {{:mds:dsd:dsd10.pdf|slides10 (.pdf)}} | 
-|11| 15/10 11-13 | Fib-A1 | Slowly changing dimensions, fast changing dimensions, shared dimensions. Recursive hierarchies. Multivalued dimensions. {{:mds:dsd:dsd11.assignments.pdf|Exercises at home (Travel agency extended) for the lesson 12}}.   [[http://131.114.72.230/dsd/video/dsd11_20221020.mp4|rec09 (.mp4)]] | **[DW: 3.1-3.5]**  {{:mds:dsd:dsd11.pdf|slides11 (.pdf)}} |+|11| 15/10 11-13 | Fib-| Slowly changing dimensions, fast changing dimensions, shared dimensions. Recursive hierarchies. Multivalued dimensions. {{:mds:dsd:dsd11.assignments.pdf|Exercises at home (Travel agency extended) for the lesson 12}}.   [[http://131.114.72.230/dsd/video/dsd11_20221020.mp4|rec09 (.mp4)]] | **[DW: 3.1-3.5]**  {{:mds:dsd:dsd11.pdf|slides11 (.pdf)}} |
 |12| 16/10 16-18 | Fib-H | A DW to support Analytical CRM Analysis. Wrap up on DW design.  {{:mds:dsd:dsd12.assignments.pdf|Exercises at home for the lesson 14}}. [[http://131.114.72.230/dsd/video/dsd12_20211022.mp4|rec12 (.mp4)]] | **[DW: 4.1-4.8]**  {{:mds:dsd:dsd12.pdf|slides12 (.pdf)}} | |12| 16/10 16-18 | Fib-H | A DW to support Analytical CRM Analysis. Wrap up on DW design.  {{:mds:dsd:dsd12.assignments.pdf|Exercises at home for the lesson 14}}. [[http://131.114.72.230/dsd/video/dsd12_20211022.mp4|rec12 (.mp4)]] | **[DW: 4.1-4.8]**  {{:mds:dsd:dsd12.pdf|slides12 (.pdf)}} |
 |13| 17/10 11-13 | Fib-A1 | Multidimensional Cube model: OLAP Operations. The extended cube and the lattice of cuboids. Pivot tables in Excel. [[http://131.114.72.230/dsd/video/dsd13a_20231107.mp4|rec13a (.mp4)]] and [[http://131.114.72.230/dsd/video/dsd13b_20211026.mp4|rec13b (.mp4)]] **Additional learning material:** G. Harvey. Excel 2013 All-in-One For Dummies, 2013. [[http://131.114.72.230/dsd/PivotTable2013BookVIIchpt2.pdf|Chp. VII-2]] and [[http://131.114.72.230/dsd/HerbalTeas.xlsx|example data for pivot table]]. | **[DW: 2.3, 2.4]**  {{:mds:dsd:dsd13.pdf|slides13 (.pdf)}} | |13| 17/10 11-13 | Fib-A1 | Multidimensional Cube model: OLAP Operations. The extended cube and the lattice of cuboids. Pivot tables in Excel. [[http://131.114.72.230/dsd/video/dsd13a_20231107.mp4|rec13a (.mp4)]] and [[http://131.114.72.230/dsd/video/dsd13b_20211026.mp4|rec13b (.mp4)]] **Additional learning material:** G. Harvey. Excel 2013 All-in-One For Dummies, 2013. [[http://131.114.72.230/dsd/PivotTable2013BookVIIchpt2.pdf|Chp. VII-2]] and [[http://131.114.72.230/dsd/HerbalTeas.xlsx|example data for pivot table]]. | **[DW: 2.3, 2.4]**  {{:mds:dsd:dsd13.pdf|slides13 (.pdf)}} |
-|14| 18/10 11-13 | Fib-L1 | Recalls on: DBMS, from SQL to extended relational algebra. Exercises. {{:mds:dsd:dsd14.assignments.pdf|Exercises at home for the lesson 15}}. [[http://131.114.72.230/dsd/video/dsd14_20221102.mp4|rec14 (.mp4)]] | **[DB: 4.1-4.2,5.1-5.11]**  {{:mds:dsd:dsd14.pdf|slides14 (.pdf)}} |+|14| 18/10 11-13 | Fib-C1 | Recalls on: DBMS, from SQL to extended relational algebra. Exercises. {{:mds:dsd:dsd14.assignments.pdf|Exercises at home for the lesson 15}}. [[http://131.114.72.230/dsd/video/dsd14_20221102.mp4|rec14 (.mp4)]] | **[DB: 4.1-4.2,5.1-5.11]**  {{:mds:dsd:dsd14.pdf|slides14 (.pdf)}} |
 |15| 24/10 11-13 | Fib-A1 | OLAP systems. Data Analysis Using SQL. Simple reports. Examples. Moderately Difficult Reports. Solutions in SQL. {{:mds:dsd:dsd15.foodmart.pdf|Foodmart datawarehouse schema}}. [[http://131.114.72.230/dsd/video/dsd15_20211102.mp4|rec15 (.mp4)]] | **[DW: 5.1-5.3]**  {{:mds:dsd:dsd15.pdf|slides15 (.pdf)}} | |15| 24/10 11-13 | Fib-A1 | OLAP systems. Data Analysis Using SQL. Simple reports. Examples. Moderately Difficult Reports. Solutions in SQL. {{:mds:dsd:dsd15.foodmart.pdf|Foodmart datawarehouse schema}}. [[http://131.114.72.230/dsd/video/dsd15_20211102.mp4|rec15 (.mp4)]] | **[DW: 5.1-5.3]**  {{:mds:dsd:dsd15.pdf|slides15 (.pdf)}} |
-|16| 25/10 11-13 | Fib-L1 | Examples of variance reports. Very Difficult Reports without Analytic SQL. Example of reports with ranks. Analytic Functions with the use of partitions and running totals. Examples.  {{:mds:dsd:dsd16.assignments.pdf|Exercises at home for the lesson 17}}. [[http://131.114.72.230/dsd/video/dsd16_20211105.mp4|rec16 (.mp4)]] | **[DW: 5.4-5.5]**  {{:mds:dsd:dsd16.pdf|slides16 (.pdf)}} |+|16| 25/10 11-13 | Fib-C1 | Examples of variance reports. Very Difficult Reports without Analytic SQL. Example of reports with ranks. Analytic Functions with the use of partitions and running totals. Examples.  {{:mds:dsd:dsd16.assignments.pdf|Exercises at home for the lesson 17}}. [[http://131.114.72.230/dsd/video/dsd16_20211105.mp4|rec16 (.mp4)]] | **[DW: 5.4-5.5]**  {{:mds:dsd:dsd16.pdf|slides16 (.pdf)}} |
 |17| 31/10 11-13 | Fib-A1 | Analytic Functions with the use of moving windows. Examples. Exercises on Analytic SQL. {{:mds:dsd:dsd17.assignments.pdf|Exercises during the lesson and at home}} and [[http://131.114.72.230/dsd/dsd.17.solutions.txt|solutions]]. [[http://131.114.72.230/dsd/video/dsd17_20211109.mp4|rec17 (.mp4)]] | **[DW: 5.5-5.6]**  {{:mds:dsd:dsd17.pdf|slides17 (.pdf)}} | |17| 31/10 11-13 | Fib-A1 | Analytic Functions with the use of moving windows. Examples. Exercises on Analytic SQL. {{:mds:dsd:dsd17.assignments.pdf|Exercises during the lesson and at home}} and [[http://131.114.72.230/dsd/dsd.17.solutions.txt|solutions]]. [[http://131.114.72.230/dsd/video/dsd17_20211109.mp4|rec17 (.mp4)]] | **[DW: 5.5-5.6]**  {{:mds:dsd:dsd17.pdf|slides17 (.pdf)}} |
 |18| 05/11 9-11 | Fib-C | Recalls of relational DBMS internals: Storage, Indexing and Query Evaluation. Physical operators and physical plans for projection, selection, joins and grouping. Examples. [[http://131.114.72.230/dsd/video/dsd18_20211112.mp4|rec18 (.mp4)]] | **[DB: 6.1-6.6, 6.8, 7.1-7.2]**  {{:mds:dsd:dsd18.pdf|slides18 (.pdf)}} | |18| 05/11 9-11 | Fib-C | Recalls of relational DBMS internals: Storage, Indexing and Query Evaluation. Physical operators and physical plans for projection, selection, joins and grouping. Examples. [[http://131.114.72.230/dsd/video/dsd18_20211112.mp4|rec18 (.mp4)]] | **[DB: 6.1-6.6, 6.8, 7.1-7.2]**  {{:mds:dsd:dsd18.pdf|slides18 (.pdf)}} |
 |19| 07/11 11-13 | Fib-A1 | Data Warehouse Systems: Special-Purpose Indexes and Star Query Plan. Bitmap indexes. Join indexes. Star queries optimization and query plans. Examples. Table partitioning. [[http://131.114.72.230/dsd/video/dsd19_20211116.mp4|rec19 (.mp4)]] | **[DW: 6.1-6.4]**  {{:mds:dsd:dsd19.pdf|slides19 (.pdf)}} | |19| 07/11 11-13 | Fib-A1 | Data Warehouse Systems: Special-Purpose Indexes and Star Query Plan. Bitmap indexes. Join indexes. Star queries optimization and query plans. Examples. Table partitioning. [[http://131.114.72.230/dsd/video/dsd19_20211116.mp4|rec19 (.mp4)]] | **[DW: 6.1-6.4]**  {{:mds:dsd:dsd19.pdf|slides19 (.pdf)}} |
-|20| 08/11 11-13 | Fib-L1 | The problem of materialized views selection. The lattice of views and the greedy algorithm HRU for the selection of materialized views. Examples. Other algorithms for the choice of the views to materialize with a workload and dimensional hierarchies.  {{:mds:dsd:dsd20.assignments.pdf|Exercises at home for the lesson 21}}. [[http://131.114.72.230/dsd/video/dsd20_20211119.mp4|rec20 (.mp4)]] | **[DW: 7.1-7.7]**  {{:mds:dsd:dsd20.pdf|slides20 (.pdf)}} | +|20| 08/11 11-13 | Fib-C1 | The problem of materialized views selection. The lattice of views and the greedy algorithm HRU for the selection of materialized views. Examples. Other algorithms for the choice of the views to materialize with a workload and dimensional hierarchies.  {{:mds:dsd:dsd20.assignments.pdf|Exercises at home for the lesson 21}}. [[http://131.114.72.230/dsd/video/dsd20_20211119.mp4|rec20 (.mp4)]] | **[DW: 7.1-7.7]**  {{:mds:dsd:dsd20.pdf|slides20 (.pdf)}} | 
-|21| 15/11 11-13 | Fib-L1 | Recalls of functional dependency properties and how they are used to reason about the properties of the result of a query. Properties of the group-by operator.   [[http://131.114.72.230/dsd/video/dsd21_20221130.mp4|rec21 (.mp4)]] | **[DW: 8.1-8.2, DB: 3.5.1-3.5.4]**  {{:mds:dsd:dsd21.pdf|slides21 (.pdf)}} | +|21| 15/11 11-13 | Fib-C1 | Recalls of functional dependency properties and how they are used to reason about the properties of the result of a query. Properties of the group-by operator.   [[http://131.114.72.230/dsd/video/dsd21_20221130.mp4|rec21 (.mp4)]] | **[DW: 8.1-8.2, DB: 3.5.1-3.5.4]**  {{:mds:dsd:dsd21.pdf|slides21 (.pdf)}} | 
-|22| 22/11 11-13 | Fib-L1 | The problem of evaluating the group-by before the join operator. First case: Invariant grouping. Examples. Other cases: double grouping, grouping and counting. Examples with star queries.  [[http://131.114.72.230/dsd/video/dsd22_20221201.mp4|rec22 (.mp4)]] | **[DW: 8.3-8.6]**  {{:mds:dsd:dsd22.pdf|slides22 (.pdf)}} | +|22| 22/11 11-13 | Fib-C1 | The problem of evaluating the group-by before the join operator. First case: Invariant grouping. Examples. Other cases: double grouping, grouping and counting. Examples with star queries.  [[http://131.114.72.230/dsd/video/dsd22_20221201.mp4|rec22 (.mp4)]] | **[DW: 8.3-8.6]**  {{:mds:dsd:dsd22.pdf|slides22 (.pdf)}} | 
-|23| 29/11 11-13 | Fib-L1 | The problem of query rewrite to use a materialized view. Hypothesis and two approaches: With a compensation on the logical view plan, and with a transformation of logical query plan. Examples. [[http://131.114.72.230/dsd/video/dsd23_20211130.mp4|rec23 (.mp4)]] | **[DW: 9.1-9.4]**  {{:mds:dsd:dsd23.pdf|slides23 (.pdf)}} | +|23| 29/11 11-13 | Fib-C1 | The problem of query rewrite to use a materialized view. Hypothesis and two approaches: With a compensation on the logical view plan, and with a transformation of logical query plan. Examples. [[http://131.114.72.230/dsd/video/dsd23_20211130.mp4|rec23 (.mp4)]] | **[DW: 9.1-9.4]**  {{:mds:dsd:dsd23.pdf|slides23 (.pdf)}} | 
-|24| 6/12 11-13 | Fib-L1 | Data Warehousing trends: column-oriented DW, main-memory DW, Big Data framework. [[http://131.114.72.230/dsd/video/dsd24_20211203.mp4|rec24 (.mp4)]] | **[DW: 6.5-6.8]**  {{:mds:dsd:dsd24.pdf|slides24 (.pdf)}} |+|24| 6/12 11-13 | Fib-C1 | Data Warehousing trends: column-oriented DW, main-memory DW, Big Data framework. [[http://131.114.72.230/dsd/video/dsd24_20211203.mp4|rec24 (.mp4)]] | **[DW: 6.5-6.8]**  {{:mds:dsd:dsd24.pdf|slides24 (.pdf)}} |
  
  
mds/dsd/start.1726860575.txt.gz · Ultima modifica: 20/09/2024 alle 19:29 (6 giorni fa) da Salvatore Ruggieri

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki