Andrew Fairless, Ph.D.
/About/Bio
/Projects
/Reposts
/Tags
/Categories
Entries tagged :: pipeline
.
2025-03-12
What I Read: Incremental Jobs, Data Quality
2025-03-11
What I Read: Declarative Data Stack
2024-10-29
What I Read: Generative AI Platform
2024-10-17
What I Read: Data Flywheels, LLM
2024-09-10
What I Read: Command-line Tools, Faster
2024-08-13
What I Read: LLM Pipelines, DSPy
2024-02-07
What I Read: Multi-Modal Retrieval-Augmented Generation
2024-01-18
What I Read: Unify Batch and ML Systems
2024-01-11
What I Read: Enterprise AI, RAG + Fine Tuning
2023-11-28
What I Read: Data, The Land DevOps Forgot
2023-10-19
What I Read: Composable Data Systems
2023-09-04
Monitoring Data Pipelines: Airflow and Tcl/Tk
Airflow is terrific for scheduling and monitoring data pipeline components. But we also want to monitor in real-time what’s happening inside those components.
Read more ⟶
2023-07-29
How fast is Polars compared to Pandas?
Benchmarks are nice, but how fast are our favorite data tools on realistic data workflows?
Read more ⟶
2023-06-29
What I Read: Against LLM
2023-03-15
What I Read: Optimizing Machine Learning Training Pipelines
2023-03-14
What I Read: Feature Platforms
2023-03-08
What I Read: Data Pipeline Design Patterns
2023-03-01
What I Read: Build vs. Buy, Modern Data Stack
2023-02-20
What I Read: Data Engineering 2023 Predictions
2023-02-01
What I Read: Realtime ML Pipelines
2023-01-24
What I Learn: Simplest Data Pipeline
2023-01-04
What I Read: Data Pipeline Smoke Tests
2022-12-08
What I Read: How dbt fails
2022-12-01
What I Read: Data Engineers, What’s the profession about
2022-11-07
What I Read: end-to-end, infrastructure, recommendations
2022-11-01
What I Read: ML Engineering
2022-10-31
What I Read: deliberately create data
2022-09-21
What I Read: streaming for data scientists
2022-08-15
What I Read: Hidden Technical Debts
2022-07-25
What I Read: data replication in production
2022-07-18
What I Read: Death of Data Modeling
2022-06-28
What I Read: Deploying Deep Learning
2022-06-14
What I Read: Should Warehouse Be Immutable?
2022-06-13
What I Read: Modern Stack for ML Infrastructure
2022-04-04
What I Read: Scale Real-time Data Infrastructure
2022-03-09
What I Read: Real-time machine learning
2022-02-02
What I Read: MLOps Documentation
2021-12-20
What I Read: Lessons on ML Platforms
2021-11-22
What I Read: Is the data engineer still the “worst seat at the table?”
2021-11-10
What I Read: Data Orchestration w/ Nick Schrock (Elementl)
2021-11-03
What I Read: ETL Pipelines with Airflow
2021-11-02
What I Read: The Uselessness of Useful Knowledge
2021-09-09
What I Read: The dysfunctions of Data Engineering
2021-08-26
What I Read: The one data platform to rule them all
2021-08-12
What I Read: Building Data Platform
2021-07-06
What I Read: What is a Data Mesh?
2021-06-03
What I Read: Accelerating ML within CNN
2021-05-31
What I Read: Feature stores
2021-04-14
What I Read: Common Errors when Debugging Airflow DAGs
2021-03-30
What I Read: Kedro Pipelines with Airflow
2021-03-14
What I Read: MLOps for effective AI strategy
2021-03-03
What I Read: Machine learning is going real-time
2021-03-01
What I Watch: Future of Data Engineering
2021-03-01
What I Read: Long Live Data Discovery
2021-02-26
What I Read: MLOps Changing How Machine Learning Models Developed
2021-02-22
What I Read: How Build Production Workflow SQL
2021-02-14
What I Read: How DAGs grow
2021-02-04
What I Read: Architectures for Modern Data Infrastructure
2021-01-27
What I Read: data quality, ML Ops
2021-01-20
What I Read: why Switch from Jupyter Notebook to Scripts
2021-01-02
What I Read: Nitpicking ML Technical Debt
2020-12-23
What I Read: DevOps for ML Data
