Tips and Tricks #221: Use Embeddings for Semantic Search
Implement semantic search using text embeddings for more relevant results than keyword matching.
Tips and Tricks #220: Use dbt for Maintainable Data Transformations
Build modular, tested, documented data transformations with dbt.
Tips and Tricks #219: Partition Large Tables for Query Performance
Use table partitioning to dramatically speed up queries on large datasets.
Tips and Tricks #218: Implement Idempotent ETL with Merge Statements
Use MERGE (upsert) for safe, rerunnable data pipelines that handle duplicates gracefully.
Spark Isn’t Magic: What Twenty Years of Data Engineering Taught Me About Distributed Processing
Every few years, a technology emerges that fundamentally changes how we think about data processing. MapReduce did it in 2004. Apache Spark did it in 2014. And after spending two…
Tips and Tricks #193: Use Span for Zero-Allocation String Parsing
Eliminate heap allocations when parsing strings by using Span for memory-efficient operations.