Daniel B. Christensen

Full Stack Data Engineer specializing in scalable data pipelines, real-time analytics, and cloud-native solutions

Full stack data engineer with 7+ years of expertise in batch and streaming pipelines, real-time analytics, and building cloud-native solutions on AWS and Azure. Experienced in Python, Java, SQL, and modern data tools including Apache Flink, Snowflake, and Kubernetes. Currently optimizing enterprise-scale data infrastructure at The Walt Disney Company, achieving 30% performance improvements and significant cost reductions.

🏒 The Walt Disney Company πŸ“ Senior Data Engineer

About Me

I'm Daniel B. Christensen, a senior data engineer with over 7 years of experience designing and implementing mission-critical data pipelines and real-time data platforms. Currently working full-time with The Walt Disney Company, where I've improved event-based data query performance by 30% and significantly reduced Snowflake compute costs through advanced performance tuning and optimization strategies.

My expertise spans the entire data lifecycleβ€”from ingestion and transformation to modeling and visualization. I've built sub-2-minute latency streaming infrastructures using Apache Flink, managed ETL/ELT pipelines processing millions of records monthly, and architected FastAPI platforms handling 2M+ requests per month. I specialize in creating scalable, reliable systems using Python, Apache Airflow, Apache Flink, Snowflake, FastAPI, and cloud platforms like AWS and Azure.

Beyond technical implementation, I bring leadership and mentorship to teams, optimizing workflows and delivering data solutions that drive measurable business value. My approach combines robust engineering practices with a focus on cost optimization, performance tuning, and maintainability.

7+ Years Experience
2M+ Requests/Month
30% Cost Reduction
<2min Pipeline Latency

Core Expertise

πŸ”§

Data Pipeline Engineering

  • Real-time & Batch Processing: Built event-driven pipelines with <2-minute latency using Apache Flink
  • Scale: Architected systems handling 2M+ requests/month and 5M+ row syncs
  • Orchestration: Expert in Apache Airflow, Cron, and workflow automation
  • Cost Optimization: Reduced Snowflake compute costs by 30% through query optimization and warehouse management
  • Performance Tuning: Expert in Snowflake performance optimization, clustering strategies, and cost management
πŸ’»

Technical Stack

Languages

Python SQL JavaScript Bash R

Data Platforms

Snowflake BigQuery PostgreSQL SQL Server

Frameworks & Tools

Apache Flink Apache Airflow FastAPI Django dbt Docker Kubernetes

Cloud Platforms

AWS Azure GitHub Actions

Professional Experience

The Walt Disney Company

Senior Data Engineer

July 2024 – Present (Full-Time from May 2025)

  • Improve event-based data query performance by 30% through advanced Snowflake optimization techniques
  • Implement comprehensive Snowflake cost management strategies, reducing compute costs while maintaining performance SLAs
  • Design and deploy real-time data pipelines using Apache Flink for streaming analytics
  • Execute performance tuning initiatives including clustering strategies, query optimization, and warehouse sizing
  • Build and maintain data models for ML workflows, ensuring SLA adherence
  • Orchestrate data ingestion workflows using Apache Airflow with enhanced monitoring and visibility

SAVVBI

Senior Data Engineer

June 2023 – July 2024

  • Architected full-stack data solutions: ingestion, modeling, visualization
  • Built real-time event-driven reporting with <2-minute latency
  • Scaled batch/streaming pipelines handling thousands of daily events
  • Created comprehensive data-validation alerts and dashboards
  • Mentored engineers in scalable pipeline design and monitoring

VIVBI

Senior Data Engineer

January 2018 – June 2023

  • Built FastAPI ingestion platform on Azure handling 2M+ requests/month
  • Integrated with FB, Google Ads, AdRoll APIsβ€”saving 200+ hrs/month
  • Deployed services via Docker, GitHub Actions, AWS/Azure
  • Built MS Dynamics & POS integration pipelines syncing 5M+ rows/month
  • Developed client-facing iOS app using Retool, AWS, Postgres, Lambda
  • Managed SQL transformations across multiple platforms

Data Projects & Open Source

πŸ“¦

paged-list

Developed and published an open-source Python package for efficient pagination:

  • Streamlined static list pagination for large datasets
  • Published on PyPI with comprehensive documentation
  • Actively maintained with regular updates
View on PyPI β†’
πŸš€

Real-Time Analytics Pipeline

Designed and deployed enterprise streaming architecture:

  • Reduced event processing latency to under 2 minutes
  • Built custom Apache Flink operators for Snowflake integration
  • Achieved 30% query performance improvement
  • Processed millions of events daily with 99.9% uptime
View Public Projects β†’
πŸ”„

Multi-Source Data Platform

Architected and built FastAPI-based integration platform:

  • Handles 2M+ API requests per month
  • Integrated Facebook, Google Ads, and AdRoll APIs
  • Saved 200+ manual hours monthly through automation
  • Deployed on Azure with auto-scaling capabilities
View Case Study β†’
πŸ“

Technical Blog

Share insights on data engineering best practices:

  • Real-world implementation guides
  • Performance optimization techniques
  • Cloud cost reduction strategies
Read Blog β†’
πŸ’Ό

Enterprise Data Sync

Implemented robust ETL pipeline for retail systems:

  • Syncs 5M+ rows monthly between MS Dynamics and POS
  • Achieved 99.9% reliability with error handling
  • Built comprehensive monitoring and alerting
View Portfolio β†’
πŸ› οΈ

Technical Skills

Comprehensive overview of my technical expertise:

  • 40+ technologies and platforms
  • Cloud, streaming, and orchestration tools
  • Detailed proficiency levels and use cases
View Skills β†’

Education

πŸŽ“

Bachelor of Science in Economics

University of Utah

Graduated May 2017

Minor in Business

Relevant Coursework

Core Economics & Statistics
  • Econometrics and statistical analysis of economic data
  • Bayesian statistics and probability modeling
  • Linear and predictive modeling techniques
Applied Data Analysis
  • Statistical programming and data visualization in R
  • Multivariate regression analysis and time series modeling
  • Economic research methodology and data collection

Let's Connect

While I'm currently fully engaged at The Walt Disney Company and not available for hire, I highly recommend SAVVBI for your AI and data engineering needs. They excel at:

πŸ€– AI & Machine Learning Solutions
⚑ Scalable Data Pipelines
πŸ“Š Real-time Data Processing
πŸ”§ Data Infrastructure Optimization
πŸ’° Cloud Cost Optimization
πŸ“ˆ Advanced Analytics
πŸ”’ Data Security & Compliance
🎯 MLOps & Model Deployment

Looking for expert data engineering services?
I recommend reaching out to SAVVBI - they have an exceptional team capable of delivering enterprise-grade AI and data engineering solutions.

Feel free to connect with me on LinkedIn to discuss data engineering, technology trends, or potential open-source collaborations.