Data Engineer Job Profile in Worcester, MA

I’m a results-driven Senior Data Engineer with over 8 years of experience delivering scalable data solutions across the insurance, retail, and oil & gas industries. I specialize in building robust ETL pipelines using PySpark, Apache Spark, and Delta Lake on cloud platforms like Azure Databricks and AWS Glue. My expertise spans both batch and real-time processing, with a strong focus on migrating legacy systems to modern lakehouse architectures. I’ve developed curated data models to support analytics in domains such as claims, customer segmentation, and field operations. My work includes implementing CI/CD pipelines via Azure DevOps, enforcing data quality with PyDeequ, and orchestrating workflows using Apache Airflow. I bring a deep understanding of data observability, leveraging tools like Azure Monitor, Datadog, and CloudWatch to maintain SLA-driven operations. Passionate about translating complex business requirements into efficient, production-ready data solutions, I thrive in cross-functional environments where innovation meets impact.