List: Metadata driven etl | Curated by Data Saint Consulting Inc | Medium

Data Saint Consulting Inc

Dec 27, 2024

6 stories

Metadata driven etl

Waliur Rahman

Unlocking Efficiency in Data Teams: The Case for Declarative Data Pipelines

In the vast, swirling seas of big data, the lighthouse guiding companies to actionable insights is a well-oiled data pipeline. Yet, as…

Jun 12, 2023

Unlocking Efficiency in Data Teams: The Case for Declarative Data Pipelines

Jun 12, 2023

Hanson Olatunde

How to Build Metadata Driven Pipelines in Microsoft Fabric

Over the past years, “traditional” ETL development has morphed into data engineering, which has a more disciplined software engineering…

Jun 9, 2024

How to Build Metadata Driven Pipelines in Microsoft Fabric

Jun 9, 2024

dlthub.com

Standardizing Ingestion and its metadata for compliant Data Platforms

💡 What if we had some magic documentation about our data sources, before even filling any tables? What if we could profile source data…

Sep 26, 2024

Standardizing Ingestion and its metadata for compliant Data Platforms

Sep 26, 2024

In

Towards Dev

by

Debi Prasad Mishra

How to capture Audit Logs/ Statistics Programmatically in Snowflake — II

If you are running ETL jobs in Snowflake database, below approach will help you to capture the metadata details of the ETL executions such…

Dec 23, 2021

How to capture Audit Logs/ Statistics Programmatically in Snowflake — II

Dec 23, 2021

Robert Caspari

Metadata-driven ETL Framework for Azure Synapse Analytics

Using Metadata to create and manage lakehouse database objects in Azure Synapse Analytics.

May 23, 2023

Metadata-driven ETL Framework for Azure Synapse Analytics

May 23, 2023

Jagadesh Jamjala

Key Points on Metadata-driven ETL

Metadata-driven ETL is an approach where the extract, transform, and load process is controlled by metadata stored in configuration tables…

Nov 18, 2024

Key Points on Metadata-driven ETL

Nov 18, 2024

Data Saint Consulting Inc

Data Saint Consulting Inc

For Consultation services regarding Data Engineering and Analytics: datasaintconsulting@ gmail.com

Following

See all (1,485)

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams