MLOps.community

By Demetrios

Listen to a podcast, please open Podcast Republic app. Available on Google Play Store and Apple App Store.

Image by Demetrios

Category: Technology

Open in Apple Podcasts


Open RSS feed


Open Website


Rate for this podcast
    

Subscribers: 43
Reviews: 0
Episodes: 432

Description

Relaxed Conversations around getting AI into production, whatever shape that may come in (agentic, traditional ML, LLMs, Vibes, etc)

Episode Date
AI in M&A: Building, Buying, and the Future of Dealmaking // Kison Patel // #315
May 16, 2025
AI, Marketing, and Human Decision Making // Fausto Albers // #313
May 14, 2025
MLOps with Databricks // Maria Vechtomova // #314
May 13, 2025
Making AI Reliable is the Greatest Challenge of the 2020s // Alon Bochman // #312
May 06, 2025
Behavior Modeling, Secondary AI Effects, Bias Reduction & Synthetic Data // Devansh Devansh // #311
May 02, 2025
GraphBI: Expanding Analytics to All Data Through the Combination of GenAI, Graph, & Visual Analytics // Paco Nathan & Weidong Yang // #310
Apr 29, 2025
AI Data Engineers - Data Engineering After AI // Vikram Chennai // #309
Apr 25, 2025
I Am Once Again Asking "What is MLOps?" // Oleksandr Stasyk // #308
Apr 22, 2025
How Sama is Improving ML Models to Make AVs Safer // Duncan Curtis // #307
Apr 18, 2025
Agents of Innovation: AI-Powered Product Ideation with Synthetic Consumer Testing // Luca Fiaschi // #306
Apr 15, 2025
Real-Time Forecasting Faceoff: Time Series vs. DNNs // Josh Xi // #305
Apr 11, 2025
We're All Finetuning Incorrectly // Tanmay Chopra // #304
Apr 08, 2025
From Shiny to Strategic: The Maturation of AI Across Industries // David Cox // #303
Apr 07, 2025
Streaming Ecosystem Complexities and Cost Management // Rohit Agrawal // #302
Apr 04, 2025
Fraud Detection in the AI Era // Rafael Sandroni // #301
Apr 01, 2025
Beyond the Matrix: AI and the Future of Human Creativity
Mar 30, 2025
Efficient GPU infrastructure at LinkedIn // Animesh Singh // MLOps Podcast #299
Mar 28, 2025
Building Trust Through Technology: Responsible AI in Practice // Allegra Guinan // #298
Mar 25, 2025
Claude Plays Pokémon - A Conversation with the Creator // David Hershey // #294
Mar 21, 2025
From Rules to Reasoning Engines // George Mathew // #296
Mar 18, 2025
GenAI Traffic: Why API Infrastructure Must Evolve... Again // Erica Hughberg // #296
Mar 14, 2025
The Unbearable Lightness of Data // Rohit Krishnan // #295
Mar 11, 2025
Kubernetes, AI Gateways, and the Future of MLOps // Alexa Griffith // #294
Mar 07, 2025
Future of Software, Agents in the Enterprise, and Inception Stage Company Building // Eliot Durbin // #293
Mar 04, 2025
The Agent Exchange: Practitioner Insights
Mar 03, 2025
Talk to Your Data: The SQL Data Analyst
Feb 28, 2025
Getting to Grips with Web Agents
Feb 26, 2025
The Challenge with Voice Agents
Feb 22, 2025
The Agent Landscape - Lessons Learned Putting Agents Into Production
Feb 20, 2025
Evolving Workflow Orchestration // Alex Milowski // #291
Feb 14, 2025
Insights from Cleric: Building an Autonomous AI SRE // Willem Pienaar // #290
Feb 11, 2025
Robustness, Detectability, and Data Privacy in AI // Vinu Sankar Sadasivan // #289
Feb 07, 2025
AI & Aliens: New Eyes on Ancient Questions // Richard Cloete // #288
Feb 04, 2025
Real LLM Success Stories: How They Actually Work // Alex Strick van Linschoten // #287
Jan 31, 2025
Navigating Machine Learning Careers: Insights from Meta to Consulting // Ilya Reznik // #286
Jan 27, 2025
Collective Memory for AI on Decentralized Knowledge Graph // Tomaž Levak // #285
Jan 24, 2025
Efficient Deployment of Models at the Edge // Krishna Sridhar // #284
Jan 17, 2025
Real World AI Agent Stories // Zach Wallace // #283
Jan 15, 2025
Machine Learning, AI Agents, and Autonomy // Egor Kraev // #282
Jan 08, 2025
Re-Platforming Your Tech Stack // Michelle Marie Conway & Andrew Baker // #281
Jan 03, 2025
Holistic Evaluation of Generative AI Systems // Jineet Doshi // #280
Dec 23, 2024
Unleashing Unconstrained News Knowledge Graphs to Combat Misinformation // Robert Caulk // #279
Dec 20, 2024
LLM Distillation and Compression // Guanhua Wang // #278
Dec 17, 2024
AI's Next Frontier // Aditya Naganath // #277
Dec 11, 2024
PyTorch for Control Systems and Decision Making // Vincent Moens // #276
Dec 04, 2024
AI-Driven Code: Navigating Due Diligence & Transparency in MLOps // Matt van Itallie // #275
Nov 29, 2024
PyTorch's Combined Effort in Large Model Optimization // Michael Gschwind // #274
Nov 26, 2024
LLMs to agents: The Beauty & Perils of Investing in GenAI // VC Panel // Agents in Production
Nov 22, 2024
We Can All Be AI Engineers and We Can Do It with Open Source Models // Luke Marsden // #273
Nov 20, 2024
Exploring AI Agents: Voice, Visuals, and Versatility // Panel // Agents in Production
Nov 15, 2024
The Impact of UX Research in the AI Space // Lauren Kaplan // #272
Nov 13, 2024
EU AI Act - Navigating New Legislation // Petar Tsankov // MLOps Podcast #271
Nov 01, 2024
Boosting LLM/RAG Workflows & Scheduling w/ Composable Memory and Checkpointing // Bernie Wu // #270
Oct 22, 2024
How to Systematically Test and Evaluate Your LLMs Apps // Gideon Mendels // #269
Oct 18, 2024
Exploring the Impact of Agentic Workflows // Raj Rikhy // #268
Oct 15, 2024
The Only Constant is (Data) Change // Panel // DE4AI
Oct 11, 2024
The AI Dream Team: Strategies for ML Recruitment and Growth // Jelmer Borst and Daniela Solis // #267
Oct 09, 2024
Making Your Company LLM-native // Francisco Ingham // #266
Oct 06, 2024
Unpacking 3 Types of Feature Stores // Simba Khadder // #265
Oct 01, 2024
Reinvent Yourself and Be Curious // Stefano Bosisio // MLOps Podcast #264
Sep 27, 2024
Global Feature Store // Gottam Sai Bharath & Cole Bailey // #263
Sep 24, 2024
RAG Quality Starts with Data Quality // Adam Kamor // #262
Sep 20, 2024
Who's MLOps for Anyway? // Jonathan Rioux // #261
Sep 17, 2024
Alignment is Real // Shiva Bhattacharjee // #260
Sep 13, 2024
Ax a New Way to Build Complex Workflows with LLMs // Vikram Rangnekar // #259
Sep 11, 2024
Building in Production Human-centred GenAI Solutions // Mohamed Abusaid & Mara Pometti// #177
Sep 05, 2024
Visualize - Bringing Structure to Unstructured Data // Markus Stoll // #258
Sep 03, 2024
AI Testing Highlights // Special MLOps Podcast Episode
Sep 01, 2024
MLSecOps is Fundamental to Robust AISPM // Sean Morgan // #257
Aug 30, 2024
MLOps for GenAI Applications // Harcharan Kabbay // #256
Aug 27, 2024
BigQuery Feature Store // Nicolas Mauti // #255
Aug 23, 2024
Design and Development Principles for LLMOps // Andy McMahon // #254
Aug 20, 2024
Data Quality = Quality AI // AIQCON Panel
Aug 16, 2024
The Variational Book // Yuri Plotkin // #253
Aug 13, 2024
Vision and Strategies for Attracting & Driving AI Talents in High Growth // Panel // AIQCON
Aug 09, 2024
Red Teaming LLMs // Ron Heichman // #252
Aug 06, 2024
Balancing Speed and Safety // Panel // AIQCON
Aug 02, 2024
Reliable LLM Products, Fueled by Feedback // Chinar Movsisyan // #251
Jul 30, 2024
A Blueprint for Scalable & Reliable Enterprise AI/ML Systems // Panel // AIQCON
Jul 26, 2024
AI Operations Without Fundamental Engineering Discipline // Nikhil Suresh // #250
Jul 23, 2024
AI in Healthcare // Eric Landry // #249
Jul 19, 2024
Evaluating the Effectiveness of Large Language Models: Challenges and Insights // Aniket Singh // #248
Jul 16, 2024
Extending AI: From Industry to Innovation // Sophia Rowland & David Weik // #247
Jul 12, 2024
Detecting Harmful Content at Scale // Matar Haller // #246
Jul 09, 2024
All Data Scientists Should Learn Software Engineering Principles // Catherine Nelson // #245
Jul 05, 2024
Meta GenAI Infra Blog Review // Special MLOps Podcast
Jul 03, 2024
AI Agents for Consumers // Shaun Wei // #244
Jun 28, 2024
ML and AI as Distinct Control Systems in Heavy Industrial Settings // Richard Howes // #243
Jun 25, 2024
Accelerating Multimodal AI // Ethan Rosenthal // #242
Jun 21, 2024
Navigating the AI Frontier: The Power of Synthetic Data and Agent Evaluations in LLM Development // Boris Selitser // #241
Jun 18, 2024
How to Build Production-Ready AI Models for Manufacturing // [Exclusive] LatticeFlow Roundtable
Jun 14, 2024
From Robotics to Recommender Systems // Miguel Fierro // #240
Jun 11, 2024
Uber's Michelangelo: Strategic AI Overhaul and Impact // #239
Jun 07, 2024
AWS Tranium and Inferentia // Kamran Khan and Matthew McClean // #238
Jun 04, 2024
Build Reliable Systems with Chaos Engineering // Benjamin Wilms // #237
May 31, 2024
Managing Small Knowledge Graphs for Multi-agent Systems // Tom Smoker // #236
May 28, 2024
Just when we Started to Solve Software Docs, AI Blew Everything Up // Dave Nunez // #235
May 27, 2024
Open Standards Make MLOps Easier and Silos Harder // Cody Peterson // #234
May 21, 2024
Retrieval Augmented Generation
May 17, 2024
RecSys at Spotify // Sanket Gupta // #232
May 16, 2024
From A Coding Startup to AI Development in the Enterprise // Ryan Carson // #231
May 10, 2024
FedML Nexus AI: Your Generative AI Platform at Scale // Salman Avestimehr // #230
May 07, 2024
What is AI Quality? // Mohamed Elgendy // #228
May 03, 2024
Handling Multi-Terabyte LLM Checkpoints // Simon Karasik // #228
Apr 30, 2024
Leading Enterprise Data Teams // Sol Rashidi // #227
Apr 26, 2024
The Rise of Modern Data Management // Chad Sanderson // #226
Apr 23, 2024
Beyond AGI, Can AI Help Save the Planet? // Patrick Beukema // #225
Apr 19, 2024
GenAI in Production - Challenges and Trends // Verena Weber // #224
Apr 17, 2024
Introducing DBRX: The Future of Language Models // [Exclusive] Databricks Roundtable
Apr 12, 2024
From MVP to Production // AI in Production Conference
Apr 09, 2024
Data Engineering in the Federal Sector // Shane Morris // #223
Apr 05, 2024
What Business Stakeholders Want to See from the ML Teams // Peter Guagenti // #222
Apr 02, 2024
MLOps - Design Thinking to Build ML Infra for ML and LLM Use Cases // Amritha Arun Babu & Abhik Choudhury // #221
Mar 29, 2024
4 Years of the MLOps Community // Demetrios Brinkmann // #220
Mar 26, 2024
The Art and Science of Training LLMs // Bandish Shah and Davis Blalock // #219
Mar 22, 2024
Security and Privacy // Day 2 Panel 1 // AI in Production Conference
Mar 19, 2024
[Exclusive] Zilliz Roundtable // Why Purpose-built Vector Databases Matter for Your Use Case
Mar 15, 2024
A Decade of AI Safety and Trust // Petar Tsankov // MLOps Podcast #218
Mar 12, 2024
The Real E2E RAG Stack // Sam Bean, Rewind AI // #217
Mar 08, 2024
Managing Data for Effective GenAI Application // Anu Arora and Anass Bensrhir // #215
Mar 05, 2024
Becoming an AI Evangelist // Alex Volkov // #215
Mar 01, 2024
LLM Use Cases in Production // AI in Production Conference // Panel 1
Feb 28, 2024
Information Retrieval & Relevance // Daniel Svonava // #214
Feb 24, 2024
Evaluating and Integrating ML Models // Morgan McGuire and Anish Shah // #213
Feb 21, 2024
Data Governance and AI // Alexandra Diem // #212
Feb 16, 2024
Ads Ranking Evolution at Pinterest // Aayush Mudgal // #211
Feb 13, 2024
LLM Evaluation with Arize AI's Aparna Dhinakaran // #210
Feb 09, 2024
Powering MLOps: The Story of Tecton's Rift // Matt Bleifer & Mike Eastham // #209
Feb 06, 2024
[Exclusive] QuantumBlack Round-table // Gen AI Buy vs Build, Commercial vs Open Source
Feb 02, 2024
Micro Graph Transformer Powering Small Language Models // Jon Cooke // #208
Jan 30, 2024
How Data Platforms Affect ML & AI // Jake Watson // #207
Jan 26, 2024
RAG Has Been Oversimplified // Yujian Tang // #206
Jan 23, 2024
The Myth of AI Breakthroughs // Jonathan Frankle // #205
Jan 19, 2024
MLOps at the Crossroads // Patrick Barker & Farhood Etaati // #204
Jan 16, 2024
Pioneering AI Models for Regional Languages // Aleksa Gordić // #203
Jan 12, 2024
Small Data, Big Impact: The Story Behind DuckDB // Hannes Mühleisen & Jordan Tigani // #202
Jan 09, 2024
Language, Graphs, and AI in Industry // Paco Nathan // #201
Jan 05, 2024
Founding, Funding, and the Future of MLOps // Mihail Eric // #200
Jan 02, 2024
Challenges Operationalizing ML (And Some Solutions) // Nathan Ryan Frank // #199
Dec 29, 2023
Inferring Creativity // Nick Hasty // #198
Dec 26, 2023
The Role of Infrastructure in ML // Niels Bantilan // #197
Dec 22, 2023
LLMs in Focus: From One-Size Fits All to Verticalized Solutions // Venky Ganti & Laurel Orr // #196
Dec 19, 2023
[Exclusive] Weights & Biases Round-table // Model Management in a Regulated Environment
Dec 15, 2023
Building the Future of AI in Software Development // Varun Mohan // #195
Dec 12, 2023
AI in Education Fireside Chat // LLMs in Production Conference 3
Dec 08, 2023
[Exclusive] Tecton Round-table // Get your ML Application Into Production
Dec 07, 2023
DSPy: Transforming Language Model Calls into Smart Pipelines // Omar Khattab // #194
Dec 05, 2023
Fireside Chat with LLM Startups // LLMs in Production Conference 3
Dec 01, 2023
LLMs in Biomaterials Production // Pierre Salvy // #193
Nov 28, 2023
Product Engineering for LLMs // LLMs in Production Conference Part III // Panel 2
Nov 24, 2023
Enterprises Using MLOps, the Changing LLM Landscape, MLOps Pipelines // Chris Van Pelt // #192
Nov 21, 2023
Building Defensible AI Apps // Gregory Kamradt // #191
Nov 17, 2023
Guarding LLM and NLP APIs: A Trailblazing Odyssey for Enhanced Security // Ads Dawson // #190
Nov 14, 2023
Designing for Forward Compatibility in Gen AI // Rohit Agarwal // #189
Nov 10, 2023
Impact of LLMs on the Tech Stack and Product Development // Anand Das // #188
Nov 07, 2023
Building Effective Products with GenAI // Faizaan Charania // #187
Nov 03, 2023
The Future of Feature Stores and Platforms // Mike Del Balso & Josh Wills // # 186
Oct 31, 2023
Lessons on Data Science Leadership // Luigi Patruno // #185
Oct 27, 2023
Data Platforms in MLOps: Translating Business Goals into Product Decisions // Richa Sachdev // #184
Oct 24, 2023
MLOps vs ML Orchestration // Ketan Umare // #183
Oct 20, 2023
MLOps@GetYourGuide // Jean Machado, Meghana Satish, Olivia Houghton, Theodore Meynard// #182
Oct 20, 2023
The Centralization of Power in AI // Kyle Harrison // # 181
Oct 13, 2023
Adventures in Building CLIP & Other (Largeish) LMs // Sachin Abeywardana // #180
Oct 10, 2023
All About Evaluating LLM Applications // Shahul Es // #179
Oct 06, 2023
Building an ML Platform: Insights, Community, and Advocacy // Stephen Batifol // #178
Oct 03, 2023
Collaboration and Strategy // Vin Vashishta // #176
Sep 18, 2023
Ux of an LLM User Panel // LLMs in Production Conference Part II
Sep 15, 2023
From Virtualization to AI Integration // Lamia Youseff // # 175
Sep 12, 2023
LLM on K8s Panel // LLMs in Conference in Production Conference Part II
Sep 08, 2023
Harnessing MLOps in Finance // Michelle Marie Conway // MLOps Podcast Coffee #174
Sep 05, 2023
MLOps vs. LLMOps Panel // LLMs in Conference in Production Conference Part II
Sep 01, 2023
Building Cody, an Open Source AI Coding Assistant // Beyang Liu // MLOps Podcast #173
Aug 29, 2023
Evaluation Panel // Large Language Models in Production Conference Part II
Aug 25, 2023
FrugalGPT: Better Quality and Lower Cost for LLM Applications // Lingjiao Chen // MLOps Podcast #172
Aug 22, 2023
Building LLM Products Panel // LLMs in Production Conference Part II
Aug 18, 2023
Using Large Language Models at AngelList // Thibaut Labarre // MLOps Podcast #171
Aug 15, 2023
All the Hard Stuff with LLMs in Product Development // Phillip Carter // MLOps Podcast #170
Aug 11, 2023
MLOps at the Age of Generative AI // Barak Turovsky // MLOps Podcast #169
Aug 08, 2023
Experiment Tracking in the Age of LLMs // Piotr Niedźwiedź // MLOps Podcast #168
Aug 01, 2023
Treating Prompt Engineering More Like Code // Maxime Beauchemin // MLOps Podcast #167
Jul 25, 2023
Eliminating Garbage In/Garbage Out for Analytics and ML // Roy Hasson & Santona Tuli // MLOps Podcast #166
Jul 18, 2023
Python Power: How Daft Embeds Models and Revolutionizes Data Processing // Sammy Sidhu // MLOps Podcast #165
Jul 11, 2023
Open Source and Fast Decision Making // Rob Hirschfeld // MLOps Podcast #164
Jul 04, 2023
Democratizing AI // Yujian Tang // MLOps Podcast #163
Jun 27, 2023
From Arduinos to LLMs: Exploring the Spectrum of ML // Soham Chatterjee // MLOps Podcast #162
Jun 20, 2023
The Long Tail of ML Deployment // Tuhin Srivastava // MLOps Podcast #161
Jun 13, 2023
Clean Code for Data Scientists // Matt Sharp // MLOps Podcast # 160
Jun 07, 2023
Why is MLOps Hard in an Enterprise? // Maria Vechtomova & Basak Eskili // MLOps Podcast #159
May 30, 2023
Large Language Models at Cohere // Nils Reimers // MLOps Podcast #158
May 16, 2023
Data Privacy and Security // LLMs in Production Conference Panel Discussion
May 12, 2023
MLOps Build or Buy, Startup vs. Enterprise? // Aaron Maurer & Katrina Ni # 157
May 09, 2023
Cost/Performance Optimization with LLMs [Panel]
May 06, 2023
Machine Learning Education at Uber // Melissa Barr & Michael Mui // MLOps Podcast #156
May 02, 2023
The Birth and Growth of Spark: An Open Source Success Story // Matei Zaharia // MLOps Podcast #155
Apr 25, 2023
ML Scalability Challenges // Waleed Kadous // MLOps Podcast # 154
Apr 18, 2023
[EXCLUSIVE EPISODE!] LLM Key Results
Apr 13, 2023
Multilingual Programming and a Project Structure to Enable It // Rodolfo Núñez // MLOps Podcast #153
Apr 10, 2023
[Bonus Episode] Practical AI x MLOps // Demetrios Brinkmann, Mihail Eric, Daniel Whitenack and Chris Benson
Apr 07, 2023
How A Manager Became a Believer in DevOps for Machine Learning // Keith Trnka // MLOps Podcast #152
Apr 04, 2023
ML in Production: A DS from Ubisoft Perspective // Jean-Michel Daignan // MLOps Podcast #151
Mar 28, 2023
Large Language Models in Production Round-table Conversation
Mar 23, 2023
The Future of Search in the Era of Large Language Models // Saahil Jain // MLOps Podcast #150
Mar 21, 2023
The Challenges of Deploying (many!) ML Models // Jason McCampbell // MLOps Podcast #149
Mar 14, 2023
Intelligence & MLOps // Karl Fezer // MLOps Podcast # 148
Mar 07, 2023
The Rise of Serverless Databases // Alex DeBrie // MLOps Podcast #147
Feb 28, 2023
The Ops in MLOps - Process and People // Shalabh Chaudri // MLOps Podcast #146
Feb 21, 2023
Griffin, ML Platform at Instacart // Sahil Khanna // MLOps Podcast #145
Feb 14, 2023
Non-traditional Career Paths in MLOps // Matthew Dombrowski // MLOps Podcast #144
Feb 07, 2023
Investing in the Next Generation of AI & ML // Jill Chase & Manmeet Gujral // MLOps Podcast #143
Jan 31, 2023
Approaches to Fairness and XAI // Murtuza Shergadwala // MLOps Podcast #142
Jan 24, 2023
Airflow Sucks for MLOps // Stephen Bailey // MLOps Podcast #141
Jan 17, 2023
Updated The Evolution of ML Infrastructure // Sakib Dadi // MLOps Podcast #140
Jan 10, 2023
Foundational Models are the Future but... with Alex Ratner CEO of Snorkel AI // MLOps Podcast #139
Jan 03, 2023
Explainability in the MLOps Cycle // Dattaraj Rao // MLOps Podcast #138
Dec 27, 2022
Machine Learning Operations — What is it and Why Do We Need It? // Niklas Kühl // MLOps Podcast #137
Dec 20, 2022
Systems Engineer Navigating the World of ML // Andrew Dye // MLOps Podcast #136
Dec 13, 2022
"Real-Time" ML: Features and Inference // Sasha Ovsankin and Rupesh Gupta // MLOps Podcast #135
Dec 09, 2022
Building Threat Detection Systems: An MLE's Perspective // Jeremy Jordan // MLOps Podcast #134
Dec 06, 2022
Real-time Machine Learning with Chip Huyen // MLOps Coffee Sessions #133
Nov 22, 2022
What is Data / ML Like on League? // Ian Schweer // MLOps Coffee Sessions #132
Nov 15, 2022
Let's Continue Bundling into the Database // Ethan Rosenthal // MLOps Coffee Sessions #131
Nov 08, 2022
MLOps for Ad Platforms // Andrew Yates // MLOps Coffee Sessions #130
Oct 31, 2022
Voice and Language Tech // Catherin Breslin // Coffee Sessions #129
Oct 21, 2022
Managing Machine Learning Projects // Simon Thompson // MLOps Coffee Sessions #128
Oct 19, 2022
Reliable ML // Niall Murphy & Todd Underwood // Coffee Sessions #127
Oct 07, 2022
ML Unicorn Start-up Investor Tells-IT-All // George Mathew // MLOps Coffee Sessions #126
Oct 04, 2022
Databricks Model Serving V2 // Rafael Pierre // Coffee Sessions #125
Sep 30, 2022
Monitoring Unstructured Data // Aparna Dhinakaran & Jason Lopatecki // Lightning Sessions #2
Sep 27, 2022
Trustworthy Machine Learning // Kush Varshney // Coffee Sessions #124
Sep 21, 2022
RECOMMENDER SYSTEM: Why They Update Models 100 Times a Day // Gleb Abroskin // MLOps Coffee Sessions #123
Sep 16, 2022
Scaling Similarity Learning at Digits // Hannes Hapke // Coffee Sessions #122
Sep 09, 2022
Bringing DevOps Agility to ML// Luis Ceze // Coffee Sessions #121
Sep 06, 2022
Feathr: LinkedIn's High-performance Feature Store // David Stein // Coffee Sessions #120
Sep 02, 2022
MLOps at DoorDash // Hien Luu and DoorDash Leads // Coffee Sessions #119
Aug 30, 2022
ML Platforms, Where to Start? // Olalekan Elesin // Coffee Sessions #118
Aug 26, 2022
Data Engineering for ML // Chad Sanderson // Coffee Sessions #117
Aug 19, 2022
Scaling Machine Learning with Data Mesh // Shawn Kyzer // Coffee Sessions #116
Aug 17, 2022
How Hera is an Enabler of MLOps Integrations // Flaviu Vadan // Coffee Sessions #115
Aug 14, 2022
Product Enrichment and Recommender Systems // Marc Lindner and Amr Mashlah // Coffee Sessions #114
Aug 10, 2022
Building Better Data Teams // Leanne Fitzpatrick // Coffee Sessions #113
Aug 06, 2022
MLX: Opinionated ML Pipelines in MLflow // Xiangrui Meng // Coffee Sessions #112
Aug 03, 2022
More than a Cache: Turning Redis into a Composable, ML Data Platform // Samuel Partee // Coffee Sessions #111
Jul 30, 2022
Just Fetch the Data and then... // David Bayliss // Coffee Sessions #110
Jul 29, 2022
Why You Need More Than Airflow // Ketan Umare // Coffee Sessions #109
Jul 23, 2022
ML Flow vs Kubeflow 2022 // Byron Allen // Coffee Sessions #108
Jul 19, 2022
Why and When to Use Kubeflow for MLOps // Ryan Russon // Coffee Sessions #107
Jul 11, 2022
Building a Culture of Experimentation to Speed Up Data-Driven Value // Delina Ivanova // MLOps Coffee Sessions #106
Jul 05, 2022
Cleanlab: Labeled Datasets that Correct Themselves Automatically // Curtis Northcutt // MLOps Coffee Sessions #105
Jul 01, 2022
MLOps + BI? // Maxime Beauchemin // MLOps Coffee Sessions #104
Jun 24, 2022
Making MLFlow // Lead MLFlow Maintainer Corey Zumar // MLOps Coffee Sessions #103
Jun 17, 2022
Fixing Your ML Data Blind Spots // Yash Sheth // MLOps Coffee Sessions #102
Jun 10, 2022
Declarative Machine Learning Systems: Big Tech Level ML Without a Big Tech Team // Piero Molino // MLOps Coffee Sessions #101
Jun 03, 2022
Scaling Real-time Machine Learning at Chime // Peeyush Agarwal // Lightning Sessions #1
May 27, 2022
MLOps Critiques // Matthijs Brouns // MLOps Coffee Sessions #100
May 27, 2022
CPU vs GPU // Ronen Dar & Gijsbert Janssen van Doorn // MLOps Coffee Sessions #99
May 20, 2022
Racing the Playhead: Real-time Model Inference in a Video Streaming Environment // Brannon Dorsey // Coffee Sessions #98
May 12, 2022
Real-Time Exactly-Once Event Processing with Apache Flink, Kafka, and Pinot //Jacob Tsafatinos // MLOps Coffee Sessions #97
May 05, 2022
FastAPI for Machine Learning // Sebastián Ramírez // MLOps Coffee Sessions #96
May 02, 2022
MLOps as Tool to Shape Team and Culture // Ciro Greco // MLOps Coffee Sessions #95
Apr 25, 2022
Traversing the Data Maturity Spectrum: A Startup Perspective // Mark Freeman // Coffee Sessions #94
Apr 21, 2022
Model Monitoring in Practice: Top Trends // Krishnaram Kenthapadi // MLOps Coffee Sessions #93
Apr 14, 2022
Building the World's First Data Engineering Conference // Pete Soderling // MLOps Coffee Sessions #92
Apr 11, 2022
The Shipyard: Lessons Learned While Building an ML Platform / Automating Adherence // Joseph Haaga // Coffee Sessions #91
Apr 07, 2022
Bringing Audio ML Models into Production // Valerio Velardo // MLOps Coffee Sessions #90
Apr 04, 2022
A Journey in Scaling AI // Gabriel Straub // MLOps Coffee Sessions #89
Mar 31, 2022
ML Platform Tradeoffs and Wondering Why to Use Them // Javier Mansilla // MLOps Coffee Sessions #88
Mar 28, 2022
Don't Listen Unless You Are Going to Do ML in Production // Kyle Morris // MLOps Coffee Sessions #87
Mar 17, 2022
Building ML/Data Platform on Top of Kubernetes // Julien Bisconti // MLOps Coffee Sessions #86
Mar 12, 2022
Continuous Deployment of Critical ML Applications // Emmanuel Ameisen // MLOps Coffee Sessions #85
Mar 10, 2022
Lessons from Studying FAANG ML Systems // Ernest Chan // MLOps Coffee Sessions #84
Mar 02, 2022
Better Use cases for Text Embeddings // Vincent Warmerdam // MLOps Coffee Sessions #83
Feb 28, 2022
Feature Stores at Shopify and Skyscanner // Matt Delacour and Mike Moran // Reading Group #4
Feb 23, 2022
Trustworthy Data for Machine Learning // Chad Sanderson // MLOps Meetup #93
Feb 21, 2022
Practitioners Guide to MLOps // Donna Schut and Christos Aniftos // Coffee Sessions #82
Feb 15, 2022
Investing in MLOps // Leigh Marie Braswell and Davis Treybig // MLOps Coffee Sessions #81
Feb 14, 2022
The Journey from Data Scientist to MLOps Engineer // Ale Solano // MLOps Coffee Sessions #80
Feb 08, 2022
Platform Thinking: A Lemonade Case Study // Orr Shilon // MLOps Coffee Sessions #79
Feb 04, 2022
Calibration for ML at Etsy - apply() special // Erica Greene and Seoyoon Park // MLOps Coffee Sessions #78
Jan 31, 2022
Data Mesh - The Data Quality Control Mechanism for MLOps? // Scott Hirleman // MLOps Coffee Sessions #77
Jan 28, 2022
Build a Culture of ML Testing and Model Quality // Mohamed Elgendy // MLOps Coffee Sessions #76
Jan 25, 2022
Towards Observability for ML Pipelines // Shreya Shankar // MLOps Coffee Sessions #75
Jan 21, 2022
Scaling Biotech // Jesse Johnson // MLOps Coffee Sessions #74
Jan 19, 2022
On Structuring an ML Platform 1 Pizza Team //Breno Costa & Matheus Frata //MLOps Coffee Sessions #73
Jan 07, 2022
2021 MLOps Year in Review // Vishnu Rachakonda and Demetrios Brinkmann // MLOps Coffee Sessions #72
Jan 03, 2022
Setting up an ML Platform on GCP: Lessons Learned // Mefta Sadat // MLOps Coffee Sessions #71
Dec 28, 2021
2022 Predictions for MLOps and the Industry // Reah Miyara // MLOps Coffee Sessions #70
Dec 23, 2021
Building for Small Data Science Teams // James Lamb // MLOps Coffee Sessions #69
Dec 20, 2021
Wikimedia MLOps // Chris Albon // Coffee Sessions #68
Dec 13, 2021
ML Stepping Stones: Challenges & Opportunities for Companies // John Crousse // Coffee Sessions #67
Dec 09, 2021
Machine Learning at Reasonable Scale // Jacopo Tagliabue // MLOps Coffee Sessions #66
Dec 08, 2021
The Future of Data Science Platforms is Accessibility // Skylar Payne // Coffee Session #65
Nov 30, 2021
Impact of SWE in ML Projects // Laszlo Sragner and Tim Blazina // MLOps Reading Group
Nov 29, 2021
The Future of AI and ML in Process Automation // Slater Victoroff // MLOps Coffee Sessions #64
Nov 23, 2021
PyTorch: Bridging AI Research and Production // Dmytro Dzhulgakov // Coffee Sessions #63
Nov 16, 2021
I Don't Like Jupyter Notebooks // Joel Grus // Coffee Sessions #62
Nov 09, 2021
ML Tests // Svet Penkov // Coffee Sessions #61
Nov 02, 2021
Linkedin Job Recommendations // Alexandre Patry // Coffee Sessions #60
Oct 25, 2021
Data Selection for Data-Centric AI: Data Quality Over Quantity // Cody Coleman // Coffee Sessions #59
Oct 11, 2021
10 Types of Features your Location ML Model is Missing // Anne Cocos // Coffee Sessions #58
Oct 07, 2021
The Future of ML and Data Platforms // Michael Del Balso - Erik Bernhardsson // Coffee Sessions #57
Oct 01, 2021
A Few Learnings from Building a Bootstrapped MLOps Services Startup //Soumanta Das// Coffee Sessions #56
Sep 27, 2021
Learning and Teaching MLOps Applications // Salwa Muhammad // MLOps Coffee Sessions #55
Sep 21, 2021
Machine Learning SRE // Niall Murphy // MLOps Coffee Sessions #54
Sep 10, 2021
MLOps Insights // David Aponte-Demetrios Brinkmann-Vishnu Rachakonda // MLOps Coffee Sessions #53
Sep 07, 2021
Vector Similarity Search at Scale // Dave Bergstein // MLOps Coffee Sessions #52
Aug 31, 2021
ML Security: Why should you care? // Sahbi Chaieb // MLOps Coffee Sessions #51
Aug 17, 2021
Creating MLOps Standards // Alex Chung and Srivathsan Canchi // MLOps Coffee Sessions #50
Aug 12, 2021
Aggressively Helpful Platform Teams // Stefan Krawczyk // MLOps Coffee Sessions #49
Aug 10, 2021
Tour of Upcoming Features on the Hugging Face Model Hub // Julien Chaumond // MLOps Coffee Sessions #48
Jul 27, 2021
Fast.ai, AutoML, and Software Engineering for ML: Jeremy Howard // Coffee Session #47
Jul 15, 2021
Learning from 150 Successful ML-enabled Products at Booking.com // Pablo Estevez // Coffee Sessions #46
Jul 13, 2021
Machine Learning in Cyber Security // Monika Venckauskaite // MLOps Meetup #70
Jul 06, 2021
Enterprise Security and Governance MLOps // Diego Oppenheimer // MLOps Coffee Sessions #45
Jul 02, 2021
Autonomy vs. Alignment: Scaling AI teams to deliver value // Grant Wright // MLOps Coffee Sessions #44
Jun 30, 2021
How Pinterest Powers Image Similarity // Shaji Chennan Kunnummel // System Design Reviews #1
Jun 29, 2021
Engineering MLOps // Emmanuel Raj // MLOps Meetup #69
Jun 28, 2021
Project/Product Management for MLOps // Korri Jones - Simarpal Khaira - Veselina Staneva // MLOps Meetup #68
Jun 21, 2021
Maturing Machine Learning in Enterprise // Kyle Gallatin // MLOps Coffee Sessions #43
Jun 15, 2021
Practical MLOps Part 2 // Alfredo Deza // MLOps Meetup #66
Jun 05, 2021
Common Mistakes in the ML Development Lifecycle // Kseniia Melnikova // MLOps Meetup #65
Jun 01, 2021
Model Performance Monitoring and Why You Need it Yesterday // Amit Paka // MLOps Coffee Sessions #42
Jun 01, 2021
CI/CD in MLOPS // Monmayuri Ray // MLOps Coffee Sessions #41
May 27, 2021
Operationalizing Machine Learning at Scale // Christopher Bergh // MLOps Meetup #64
May 25, 2021
Scaling AI in production // Srivatsan Srinivasan // MLOps Coffee Sessions #40
May 21, 2021
MLOps: A leader's perspective // Stephen Galsworthy // MLOps Coffee Sessions #39
May 18, 2021
Learnings from Live Coding: An MLOps Project on Twitch // Felipe Campos Penha // MLOps Meetup #63
May 14, 2021
Law of Diminishing Returns for Running AI Proof-of-Concepts // Oguzhan Gencoglu // MLOps Meetup #62
May 10, 2021
Organisational Challenges of MLOps // Adam Sroka // MLOps Coffee Sessions #38
May 07, 2021
From Idea to Production ML // Lex Beattie - Michael Munn - Mike Moran // MLOps Meetup #61
May 03, 2021
MLOps Memes // Ariel Biller // MLOps Coffee Sessions #37
Apr 30, 2021
Luigi in Production Part 2 // Luigi Patruno // MLOps Coffee Sessions #36
Apr 23, 2021
War Stories Productionising ML // Nick Masca // Coffee Session #35
Apr 19, 2021
Deploying Machine Learning Models at Scale in Cloud // Vishnu Prathish // MLOps Meetup #60
Apr 16, 2021
Machine Learning at Atlassian // Geoff Sims // Coffee Session#34
Apr 12, 2021
MLOps Community 1 Year Anniversary! // Demetrios Brinkmann, David Aponte & Vishnu Rachakonda // MLOps Meetup #59
Apr 09, 2021
MLOps Investments // Sarah Catanzaro // Coffee Session #33
Apr 06, 2021
Model Watching: Keeping Your Project in Production // Ben Wilson // MLOps Meetup #58
Apr 04, 2021
A Missing Link in the ML Infrastructure Stack // Josh Tobin // MLOps Meetup #57
Mar 26, 2021
The Godfather Of MLOps // D. Sculley // MLOps Coffee Sessions #32
Mar 23, 2021
Operationalizing Machine Learning at a Large Financial Institution // Daniel Stahl // MLOps Meetup #56
Mar 19, 2021
How to Avoid Suffering in Mlops/Data Engineering Role // Igor Lushchyk // MLOps Meetup #55
Mar 12, 2021
Product Management in Machine Learning // Laszlo Sragner // MLOps Meetup #54
Mar 05, 2021
MLOps Engineering Labs Recap // Part 2 // MLOps Coffee Sessions #31
Mar 02, 2021
How Explainable AI is Critical to Building Responsible AI // Krishna Gade MLOps // Meetup #53
Mar 01, 2021
MLOps Engineering Labs Recap // Part 1 // MLOps Coffee Sessions #30
Feb 23, 2021
'Git for Data' - Who, What, How and Why? // Luke Feeney - Gavin Mendel-Gleason // MLOps Meetup #52
Feb 19, 2021
Agile AI Ethics: Balancing Short Term Value with Long Term Ethical Outcomes // Pamela Jasper // MLOps Meetup #51
Feb 12, 2021
Culture and Architecture in MLOps // Jet Basrawi // MLOps Coffee Sessions #29
Feb 08, 2021
2 tools to get you 90% operational // Michael Del Balso - Willem Pienaar - David Aronchick // MLOps Meetup #50
Feb 05, 2021
Machine Learning Design Patterns for MLOps // Valliappa Lakshmanan // MLOps Meetup #49
Feb 02, 2021
Lessons Learned From Hosting the Machine Learning Engineered Podcast // Charlie You // MLOps Coffee Sessions #28
Jan 29, 2021
Practical MLOps // Noah Gift // MLOps Coffee Sessions #27
Jan 26, 2021
Serving ML Models at a High Scale with Low Latency // Manoj Agarwal // MLOps Meetup #48
Jan 24, 2021
When Machine Learning meets privacy - Episode 9
Jan 21, 2021
Machine Learning Feature Store Panel Discussion // MLOps Coffee Sessions #26
Jan 19, 2021
ProductizeML: Assisting Your Team to Better Build ML Products // Adrià Romero // MLOps Meetup #47
Jan 18, 2021
When Machine Learning meets privacy - Episode 8
Jan 14, 2021
Most Underrated MLOps Topics // Marian Ignev MLOps // Coffee Sessions #25
Jan 12, 2021
Real-time Feature Pipelines, A Personal History // Hendrik Brackmann // MLOps Meetup #46
Jan 08, 2021
Machine Learning Design Patterns // Sara Robinson // MLOps Coffee Sessions #24
Dec 29, 2020
SRE for ML Infra // Todd Underwood // MLOps Coffee Sessions #23
Dec 22, 2020
How To Move From Barely Doing BI to Doing AI // Joe Reis // MLOps Meetup #45
Dec 20, 2020
Deep in the heart of data // Carl Steinbach // MLOps Coffee Sessions #22
Dec 18, 2020
When machine learning meets privacy - Episode 7
Dec 17, 2020
When Machine Learning meets privacy - Episode 6
Dec 14, 2020
Human-centric ML Infrastructure: A Netflix Original // Savin Goyal // MLOps Meetup #44
Dec 14, 2020
A Conversation with Seattle Data Guy // Benjamin Rogojan // MLOps Coffee Sessions #21
Dec 08, 2020
Monzo Bank - An MLOps Case Study // Neal Lathia // MLOps Coffee Sessions #20
Dec 07, 2020
When Machine Learning meets privacy - Episode 5
Dec 03, 2020
When Machine Learning meets privacy - Episode 4
Nov 26, 2020
Introducing Data Downtime: From Firefighting to Winning // Barr Moses // MLOps Coffee Sessions #19
Nov 24, 2020
The Current MLOps Landscape // Nathan Benaich & Timothy Chen // MLOps Meetup #43
Nov 23, 2020
When Machine Learning meets privacy - Episode 3 with Charles Radclyffe
Nov 19, 2020
UN Global Platform // Mark Craddock // Co-Founder & CTO, Global Certification and Training Ltd // MLOps Meetup #42
Nov 16, 2020
When Machine Learning meets Data Privacy - Episode 2 with Cat Coode
Nov 12, 2020
When You Say Data Scientist Do You Mean Data Engineer? Lessons Learned From Start Up Life // Elizabeth Chabot
Nov 10, 2020
Metaflow: Supercharging Our Data Scientist Productivity // Ravi Kiran Chirravuri // MLOps Meetup #41
Nov 10, 2020
Luigi in Production // MLOps Coffee Sessions #18 // Luigi Patruno ML in Production
Nov 09, 2020
When Machine Learning meets Data Privacy
Nov 05, 2020
Analyzing the Google Paper on Continuous Delivery in ML // Part 4 // MLOps Coffee Sessions #17
Nov 03, 2020
Hands-on serving models using KFserving // Theofilos Papapanagiotou // Data Science Architect at Prosus // MLOps Meetup #40
Oct 30, 2020
Operationalize Open Source Models with SAS Open Model Manager // Ivan Nardini // Customer Engineer at SAS // MLOps Meetup #39
Oct 27, 2020
Machine in Production = Data Engineering + ML + Software Engineering // Satish Chandra Gupta // MLOps Coffee Sessions #16
Oct 26, 2020
MLOps + Machine Learning // James Sutton // MLOps Coffee Sessions #15
Oct 20, 2020
Scalable Python for Everyone, Everywhere // Matthew Rocklin // MLOps Meetup #38
Oct 19, 2020
MLOps Coffee Sessions #13 How to Choose the Right Machine Learning Tool: A Conversation // Jose Navarro and Mariya Davydova
Oct 18, 2020
MLOps Coffee Sessions #14 Conversation with the Creators of Dask // Hugo Bowne-Anderson and Matthew Rocklin
Oct 12, 2020
MLOps Coffee Sessions #12: Journey of Flyte at Lyft and Through Open-source // Ketan Umare
Oct 10, 2020
MLOps Coffee Sessions #11: Analyzing “Continuous Delivery and Automation Pipelines in ML" // Part 3
Oct 04, 2020
MLOps Meetup #36: Moving Deep Learning from Research to Prod Using DeterminedAI and Kubeflow // David Hershey, DeterminedAI
Oct 04, 2020
MLOps Coffee Sessions #10 Analyzing the Article “Continuous Delivery and Automation Pipelines in Machine Learning" // Part 2
Sep 22, 2020
MLOps Meetup #34: Streaming Machine Learning with Apache Kafka and Tiered Storage // Kai Waehner, Confluent
Sep 17, 2020
MLOps Meetup #33 Owned By Statistics: How Kubeflow & MLOps Can Help Secure Your ML Workloads // David Aronchick - Head of Open Source ML Strategy at Azure
Sep 14, 2020
MLOps Coffee Sessions #9 Analyzing the Article “Continuous Delivery and Automation Pipelines in Machine Learning “ // Part 1
Sep 14, 2020
MLOps Meetup #32 Building Say Less: An AI-Powered Summarization App // Yoav Zimmerman - Founder of Model Zoo
Sep 08, 2020
MLOps Coffee Sessions #8 // MLOps from the Perspective of an SRE // Neeran Gul
Sep 08, 2020
MLOps Meetup #31 // Creating Beautiful Ambient Music with Google Brain’s Music Transformer // Daniel Jeffries - Chief Technology Evangelist at Pachyderm
Sep 05, 2020
MLOps Coffee Sessions #7 // MLOps and DevOps - Parallels and Deviations // Featuring Damian Brady
Aug 31, 2020
MLOps Meetup #30 // Path to Production and Monetizing Machine Learning // Vin Vashishta - Data Scientist | Strategist | Speaker & Author
Aug 20, 2020
MLOps Meetup #29 // Scaling Machine Learning Capabilities in Large Organizations // Bertjan Broeksema & Axel Goblet
Aug 10, 2020
MLOps Coffee Sessions #6 // Continuous Integration for ML // Featuring Elle O'Brien
Aug 08, 2020
MLOps Coffee Sessions #5 // Airflow in MLOps // Featuring Simon Darr and Byron Allen
Aug 04, 2020
MLOps #28 Continuous Evaluation & Model Experimentation // Danny Ma - Founder & CEO at Sydney Data Science
Jul 26, 2020
MLOps Coffee Sessions #4: A Conversation Around Feature Stores with Venkata Pingali and Jim Dowling
Jul 25, 2020
MLOps #27 ML Observability // Aparna Dhinakaran - Chief Product Officer at Arize AI
Jul 24, 2020
MLOps Meetup #26 // How to Leverage ML Tooling Ecosystem // Mariya Davydova - Head of Product at Neu.ro
Jul 20, 2020
MLOps Coffee Sessions #3 MLOps: Isn't That Just DevOps? // Featuring Ryan Dawson
Jul 16, 2020
MLOps Meetup #25 // Python and Dask: Scaling the DataFrame // Dan Gerlanc - Founder of Enplus Advisors
Jul 12, 2020
MLOps Meetup #23 // Monitoring the ML stack // Lina Weichbrodt
Jul 11, 2020
MLOps Meetup #24 // How to Become a Better Data Scientist: The Definite Guide // Alexey Grigorev
Jul 10, 2020
MLOps #22 Feature Stores: An Essential Part of the ML Stack to Build Great Data // Kevin Stumpf - Co-Founder & CTO at Tecton
Jul 04, 2020
MLOps Meetup #21 Deep Dive on Paperspace Tooling // Misha Kutsovsky - Senior ML Architect at Paperspace
Jun 28, 2020
MLOps Meetup #18 // Nubank - Running a Fintech on ML // Caique Lima and Cristiano Breuel
Jun 21, 2020
MLOps Meetup #19 // DataOps and Data Versioning in ML // Dmitry Petrov
Jun 19, 2020
MLOps Coffee Sessions #1: Serving Models with Kubeflow
Jun 13, 2020
MLOps Meetup #17 // The Challenges of ML Operations & How Hermione Helps Along the Way // Neylson Crepalde
Jun 11, 2020
MLOps Meetup #16 // Venture Capital and Machine Learning Startups with John Spindler
Jun 06, 2020
MLOps Meetup #15 Scaling Human-in-the-Loop Machine Learning with Robert Munro
Jun 04, 2020
MLOps #14 Kubeflow vs MLflow with Byron Allen
May 28, 2020
MLOps meetup #13 // Maximizing Job Opportunities as a Data Scientist on the Market With Anthony Kelly
May 27, 2020
MLOps meetup #12 // Why Data Scientists Should Know Data Engineering with Dan Sullivan
May 21, 2020
MLOps community meetup #11 // Machine Learning at Scale in Mercado Libre with Carlos de la Torre
May 16, 2020
MLOps.community meetup #9 with Charles Martin - 10 Years Deploying Machine Learning in the Enterprise: The Inside Scoop!
May 14, 2020
MLOps.community #10 - MLOps - The Blind Men and the Elephant with Saurav Chakravorty
May 08, 2020
MLOps.community meetup #8: Optimizing your ML workflow with Kubeflow 1.0 with Josh Bottom VP of Arrikto
May 01, 2020
MLOps meetup #7- Machine Learning and Open Banking with Alex Spanos of TrueLayer
Apr 24, 2020
MLOps.community #6 - Mid Scale Production Feature Engineering with Dr. Venkata Pingali
Apr 16, 2020
MLOps.community #5 - High Stakes ML: Latent Conditions and Active Failures with Flavio Clesio
Apr 15, 2020
MLOps.community #4 - Building an ML platform @SurveyMonkey with Shubhi Jain
Apr 10, 2020
Hierarchy of Machine Learning Needs // Phil Winder // MLOps Meetup #3
Apr 03, 2020
What Does Best in Class AI/ML Governance Look Like in Financial Services? // Charles Radclyffe // MLOps Meetup #2
Mar 26, 2020
Our 1st MLOps Meetup // Luke Marsden // MLOps Meetup #1
Mar 23, 2020