Data Operations Engineer - Manchester, NH - ST Jobs in Edison, NJ at Top Level Recruiter

Job Summary:

We are seeking a talented Data Engineer to join our team. The role involves designing, building, and maintaining scalable data pipelines and infrastructure to support data analytics, machine learning, and business intelligence initiatives. The ideal candidate will have strong technical skills in data architecture and a passion for working with large datasets.

Key Responsibilities:

·        Design, develop, and optimize scalable data pipelines for structured and unstructured data.

·        Build and manage data architectures including data warehouses, data lakes, and real-time streaming systems.

·        Work with ETL/ELT processes to integrate data from multiple sources.

·        Ensure data reliability, quality, governance, and security across platforms.

·        Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions.

·        Monitor, troubleshoot, and improve performance of data systems.

·        Document processes, workflows, and best practices for data engineering solutions.

Required Skills & Qualifications:

Proficiency in programming languages such as Python, Java, or Scala.

Strong SQL skills and experience with relational databases (e.g., PostgreSQL, MySQL, SQL Server).

Hands-on experience with data pipeline tools (e.g., Apache Airflow, NiFi, Luigi).

Knowledge of big data frameworks (e.g., Hadoop, Spark, Kafka).

Experience with cloud platforms (AWS, Azure, GCP) and cloud-native data services.

Understanding of data warehousing concepts and tools (e.g., Snowflake, Redshift, BigQuery).

Familiarity with CI/CD, version control (Git), and DevOps practices.

Good to Have:

Exposure to machine learning pipelines or MLOps.

Knowledge of NoSQL databases (MongoDB, Cassandra, DynamoDB).

Experience with containerization (Docker, Kubernetes).