List: Data engineering patterns | Curated by Data Saint Consulting Inc | Medium

Data Saint Consulting Inc

Nov 19, 2023

10 stories

1 save

Data engineering patterns

In

TDS Archive

by

Naser Tamimi

Backfilling Mastery: Elevating Data Engineering Expertise

A go-to guide for data engineers wading through the backfilling maze

Nov 17, 2023

Backfilling Mastery: Elevating Data Engineering Expertise

Nov 17, 2023

In

Israeli Tech Radar

by

Chaim Turkel

Trying to make sense of the ETL Landscape

Having been assigned the task of delivering a lightning talk on Benthos, I decided to have a look around to see what else is in the ETL…

Jun 25, 2023

Trying to make sense of the ETL Landscape

Jun 25, 2023

Hugo Lu

Zero ELT could be the death of the Modern Data Stack

Zero-ELT is getting a fair bit of press at the moment despite the fact that, as data professionals, we probably don’t do a lot of it. In…

May 8, 2023

Zero ELT could be the death of the Modern Data Stack

May 8, 2023

Aditya Damle

Delta Live Tables : The Brahmastra for ETL solutions?

The world of data engineering has grown murkier over the years. Sources have become diverse. The very nature of data which systems have to…

Jun 24, 2023

Delta Live Tables : The Brahmastra for ETL solutions?

Jun 24, 2023

Deepa Vasanthkumar

Schema on read and Schema-on-write

In our traditional approach, we create a relational database with tables by specifiying the schema. Once we have configured the schemas…

Dec 7, 2021

Schema on read and Schema-on-write

Dec 7, 2021

In

CodeX

by

Paul Scalli

Designing Efficient Data Pipelines: Understanding the Components and Common Design Patterns

A data pipeline is a series of processes that move data from one system to another. These processes can include data ingestion, data…

Jan 18, 2023

Designing Efficient Data Pipelines: Understanding the Components and Common Design Patterns

Jan 18, 2023

This story is no longer available

In

TDS Archive

by

Kaya Kupferschmidt

Big Data Engineering —Declarative Data Flows

This is part 3 of a series on data engineering in a big data environment. It will reflect my personal journey of lessons learnt and…

Sep 30, 2020

Big Data Engineering —Declarative Data Flows

Sep 30, 2020

Collin Smith

Event-Driven Architecture with the Saga Pattern Approach in AWS

Event-Driven Architecture is a key concept when designing modern cloud applications with a microservices approach. The core concept is that…

Feb 15, 2023

Event-Driven Architecture with the Saga Pattern Approach in AWS

Feb 15, 2023

In

OmarElgabry's Blog

by

Omar Elgabry

Migration

The one-time yet critical task

Jun 22, 2020

Migration

Jun 22, 2020

Data Saint Consulting Inc

Data Saint Consulting Inc

For Consultation services regarding Data Engineering and Analytics: datasaintconsulting@ gmail.com

Following

See all (1,485)

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams