Big Data Engineer - Edison, NJ (ST) Jobs in Edison, NJ at Top Level Recruiter

Job Description:
We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and architectures that enable advanced analytics, reporting, and business insights. The ideal candidate will have strong experience with data integration, transformation, and storage solutions, as well as expertise in cloud-based platforms and modern data tools.

Responsibilities:

• Design, develop, and optimize data pipelines for structured and unstructured data.

• Implement ETL/ELT processes to extract data from multiple sources and transform it into usable formats.

• Build and manage scalable data warehouses, data lakes, and streaming platforms.

• Collaborate with data scientists, analysts, and software engineers to support analytics and machine learning initiatives.

• Ensure data quality, consistency, security, and compliance across all systems.

• Monitor and improve the performance of data infrastructure and workflows.

Required Skills:

• Strong proficiency in SQL and database technologies (Relational & NoSQL).

• Experience with Big Data technologies (Hadoop, Spark, Kafka, Hive, etc.).

• Hands-on with cloud platforms (AWS, Azure, GCP) and cloud-native data services.

• Proficiency in Python, Scala, or Java for data processing.

• Familiarity with workflow orchestration tools (Airflow, Luigi, Prefect, etc.).

• Experience with data warehousing solutions (Snowflake, Redshift, BigQuery, Synapse).

• Knowledge of data modeling, schema design, and data governance best practices.

• Understanding of CI/CD, version control (Git), and DevOps practices for data.

Preferred Skills:

• Exposure to machine learning pipelines and MLOps.

• Experience with real-time data streaming solutions.

• Knowledge of containerization (Docker, Kubernetes).