Data Engineer - Washington D.C., DC Jobs in Washington, DC by Top Level Recruiter

Position Overview

We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have strong expertise in data integration, ETL processes, big data technologies, and cloud platforms, with the ability to ensure data reliability, scalability, and security.

Responsibilities

• Design, develop, and maintain data pipelines for ingesting, transforming, and delivering structured and unstructured data.

• Build and optimize ETL/ELT processes for analytics and reporting needs.

• Work with large datasets using SQL, Python, and big data frameworks.

• Collaborate with data scientists, analysts, and business teams to provide clean and reliable data.

• Manage and optimize data warehouses, data lakes, and cloud-based storage solutions.

• Implement best practices for data governance, quality, security, and compliance.

• Monitor and troubleshoot data workflows to ensure high availability and performance.

• Participate in Agile/Scrum development, sprint planning, and peer code reviews.

Required Skills & Qualifications

• Proven experience as a Data Engineer.

• Strong proficiency in SQL and relational databases (PostgreSQL, MySQL, Oracle, etc.).

• Hands-on experience with Python, PySpark, or Scala for data processing.

• Experience with big data tools (Hadoop, Spark, Kafka, Hive).

• Familiarity with cloud platforms (AWS, Azure, or GCP) and related data services (Redshift, BigQuery, Snowflake, Databricks).

• Knowledge of data warehousing concepts, ETL frameworks, and data modeling.

• Familiarity with version control (Git) and CI/CD pipelines.

• Strong problem-solving and communication skills.

Preferred Skills

• Experience with workflow orchestration tools (Airflow, Luigi).

• Knowledge of NoSQL databases (MongoDB, Cassandra, DynamoDB).

• Exposure to machine learning data pipelines.

• Understanding of data security and compliance standards (GDPR, HIPAA).