Posted on:
August 7th, 2025
Tips and Tricks #156: Use dbt for Maintainable Data Transformations
Build modular, tested, documented data transformations with dbt.
Build modular, tested, documented data transformations with dbt.
Use table partitioning to dramatically speed up queries on large datasets.
Use MERGE (upsert) for safe, rerunnable data pipelines that handle duplicates gracefully.
Calculate running totals, rankings, and moving averages efficiently with SQL window functions.
Prevent excessive API calls by debouncing user input in search fields.
Bypass the GIL and utilize all CPU cores for compute-intensive tasks.