Data Engineer - NJ (ST) Jobs in Edison, NJ at Top Level Recruiter

Summary:

We are seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines and systems that enable data-driven decision-making. The ideal candidate will have strong experience with ETL processes, big data technologies, and cloud platforms, along with expertise in SQL and programming languages like Python or Scala.

Responsibilities:

• Design, develop, and maintain data pipelines and ETL processes for structured and unstructured data.

• Work with large-scale datasets across multiple platforms and sources.

• Build and optimize data warehouses and data lakes.

• Collaborate with data scientists, analysts, and business teams to understand data requirements.

• Ensure data quality, integrity, and security throughout all processes.

• Implement data models, schemas, and workflows for scalable solutions.

• Develop real-time and batch processing pipelines using modern frameworks.

• Monitor, troubleshoot, and optimize performance of data systems.

Required Skills:

• Strong proficiency in SQL and database systems (MySQL, PostgreSQL, SQL Server, Oracle).

• Hands-on experience with ETL tools (Informatica, Talend, SSIS, AWS Glue, Azure Data Factory).

• Proficiency in Big Data technologies (Hadoop, Spark, Hive).

• Programming skills in Python, Scala, or Java.

• Experience with cloud platforms: AWS (Redshift, Glue, EMR), Azure (Data Factory, Synapse), GCP (BigQuery, Dataflow).

• Knowledge of workflow/orchestration tools (Airflow, Luigi, Kafka).

• Strong understanding of data warehousing concepts and modeling (Star schema, Snowflake schema).

Nice to Have:

• Experience with Snowflake, Databricks, or Teradata.

• Knowledge of Docker/Kubernetes for containerized data solutions.

• Exposure to machine learning pipelines.

• Familiarity with CI/CD pipelines for data engineering projects.