Big Data Systems (WT 2020/21) - tele-TASK

By Prof. Dr. Tilmann Rabl

Listen to a podcast, please open Podcast Republic app. Available on Google Play Store and Apple App Store.


Category: Courses

Open in Apple Podcasts


Open RSS feed


Open Website


Rate for this podcast

Subscribers: 1
Reviews: 0
Episodes: 47

Description

The amount of data that can be generated and stored in academic and industrial projects and applications is increasing rapidly. Big data analytics technologies have established themselves as a solution for big data challenges to the scalability problems of traditional database systems. The vast amounts of new data that is collected, however, usually is not as easily analyzed as curated, structured data in a data warehouse is. Typically, these data are noisy, of varying format and velocity, and need to be analyzed with techniques from statistics and machine learning rather than pure SQL-like aggregations and drill-downs. Moreover, the results of the analyses frequently are models that are used for decision making and prediction. The complete process of big data analysis is described as a pipeline, which includes data recording, cleaning, integration, modeling, and interpretation. In this lecture, we will discuss big data systems, i.e., infrastructures that are used to handle all steps in typical big data processing pipelines. We will learn about data center infrastructure and scale-out software systems. The software discussed will cover the full big data stack, i.e., distributed file systems, Map Reduce, key value stores, stream processing, graph processing, ML systems.

Episode Date
Fair Benchmarking
Feb 01, 2021
BigBench / TPCx-BB - Big Data Benchmark
Feb 01, 2021
Sort Benchmarks
Feb 01, 2021
Benchmarks
Feb 01, 2021
Some Statistics
Feb 01, 2021
Measurements & Metrics
Feb 01, 2021
Back of the Envelope Calculation
Feb 01, 2021
Introduction
Feb 01, 2021
A Brief Introduction to RDMAs
Jan 26, 2021
Intro to Persistent Memory II
Jan 26, 2021
Intro to Persistent Memory I
Jan 26, 2021
Data Processing on GPUs
Jan 26, 2021
Modern Hardware I
Jan 26, 2021
Data-Parallel Parameter Server
Jan 18, 2021
Execution Strategies
Jan 18, 2021
SystemML
Jan 18, 2021
Language Abstraction & System Architectures
Jan 18, 2021
ML System Stack
Jan 18, 2021
Machine Learning Models
Jan 18, 2021
Introduction
Jan 18, 2021
Federated Machine Learning
Jan 18, 2021
Graph Databases
Jan 07, 2021
Relational & Big-Data Processing in the Enterprise - Bridging the Gap
Jan 06, 2021
MapReduce II
Nov 30, 2020
(Big Data) File Format
Nov 25, 2020
Erasure Coding
Nov 25, 2020
Hadoop Distributed File System
Nov 25, 2020
Google File System
Nov 25, 2020
Network File System
Nov 25, 2020
Basics of File Systems
Nov 25, 2020
Cloud Applications
Nov 23, 2020
Cloud Computing
Nov 23, 2020
Scheduling
Nov 23, 2020
Virtualization
Nov 23, 2020
Introduction
Nov 23, 2020
MR Algorithms
Nov 16, 2020
MapReduce Architecture
Nov 16, 2020
Sorting in Detail
Nov 16, 2020
Map - Sort - Reduce
Nov 16, 2020
Introduction
Nov 16, 2020
Further Evolution
Nov 06, 2020
Open Source Big Data Stack
Nov 06, 2020
Google's Big Data Stack
Nov 06, 2020
The Big Data Stack
Nov 06, 2020
Introduction
Nov 06, 2020
Introduction
Nov 03, 2020
Welcome
Oct 02, 2020