Posted on:
March 30th, 2025
Tips and Tricks #91: Partition Large Tables for Query Performance
Use table partitioning to dramatically speed up queries on large datasets.
Use table partitioning to dramatically speed up queries on large datasets.
Use MERGE (upsert) for safe, rerunnable data pipelines that handle duplicates gracefully.
Calculate running totals, rankings, and moving averages efficiently with SQL window functions.
Implement semantic caching to avoid redundant LLM calls and reduce API costs.
Use structured prompt templates to get reliable, formatted responses from LLMs.
Implement semantic search using text embeddings for more relevant results than keyword matching.