How to structure a data engineering pipeline in Microsoft Fabric?

posée a month ago300 vuesen

3

Starting a new project in Microsoft Fabric. Should I use a Lakehouse or a Warehouse for the silver layer? How do notebooks and pipelines fit together for orchestration?

🤖 Diagnostic IA

Généré par IA. Ce n'est pas une réponse — la communauté ci-dessous le confirme ou le corrige. Vérifiez toujours avant de vous y fier.

2 réponses

8

Lakehouse for the silver layer if you want Spark notebooks and Delta; Warehouse if your team is SQL-first. Pipelines orchestrate, notebooks transform. Keep bronze as raw files, silver as cleaned Delta tables, gold as a star schema.

Connectez-vous pour dire si ça a marché.

answered a month ago
1

Use interface for object shapes you might extend or that represent a public API; use type for unions, intersections, mapped and conditional types. Performance is identical for simple cases; interface error messages are sometimes cleaner.

Connectez-vous pour dire si ça a marché.

answered a month ago

Sign in and verify your email to post an answer.