Data Engineering's Durable Skills: What AI Can't Automate
The data engineer who survives the next five years isn't the one who codes the fastest — it's the one who understands context. Here's what that means in practice.
Blog
AI & Agents
6 min read
Is Your RAG Pipeline Actually Secure? A 10-Question Gut Check
Ten quick questions on building retrieval-augmented systems that scale under load and don't leak data they shouldn't — access control, prompt injection, PII, evals, and caching. No reading required, just test yourself.
By Jeremy
Continue reading →
AI & Agents
5 min read
Your RAG Problem Might Be a Data Issue, Not Retrieval Issue
My chat bot confidently lied about my own writing. The bug wasn't retrieval - it was an ambiguous sentence in the source and a stale index. Why RAG is a data problem before it's a retrieval problem.
By Jeremy
Continue reading →
Technology
5 min read
Apache Beam Streaming Windowing: Quiz
Ten questions on Beam's windowing methods, watermarks, triggers, and late data — with sourced explanations for every answer.
By Jeremy
Continue reading →
Skills
11 min read
Data Management Pillar Overview
A short, high-level visual tour of the DAMA wheel: governance at the hub, the eleven knowledge areas around it, where data ethics fit, and my own attempt at slotting in AI.
By Jeremy
Continue reading →
Career
3 min read
What You Already Know (You Just Haven't Written It Down)
We badly underestimate what we already know, about our craft and about ourselves. A Father's Day reflection on my daughters, journaling, and why writing it down is how you find out what's in your head.
By Jeremy
Continue reading →
Career
5 min read
How to Actually Influence Change (When You Don't Have the Authority to Mandate It)
You see a better way to build something, but you don't own the budget, the roadmap, or the teams. Six things that have actually worked for me to win people over and enact change.
By Jeremy
Continue reading →
AI & Agents
5 min read
Let's Explain Explainability
Explainability has a fancy name, but it's built from things you already use - weighted scores, plain-English reasons, and an append-only audit trail. Here's a whole loan-approval workflow, walked through by persona.
By Jeremy
Continue reading →