ETL Pipeline Specialist RM Jobs in New York, NY by Top Level Consultancy

The ETL Pipeline Specialist will be responsible for designing, developing, and maintaining efficient data pipelines that enable seamless data flow across multiple systems. The role involves working with large datasets, optimizing ETL performance, and ensuring data quality, accuracy, and security throughout the lifecycle.

• Design, build, and maintain ETL/ELT pipelines for data extraction, transformation, and loading from multiple sources.

• Collaborate with data engineers, analysts, and business teams to define data requirements.

• Optimize data workflows for performance and scalability.

• Manage and monitor data integration processes using tools like Informatica, Talend, SSIS, Apache Airflow, or AWS Glue.

• Implement data validation, cleansing, and transformation logic.

• Troubleshoot and resolve data pipeline failures or performance bottlenecks.

• Document ETL architecture, workflows, and processes.

• Ensure compliance with data governance and security standards.

• Bachelor’s degree in Computer Science, Information Systems, or related field.

• 3–7 years of experience in ETL design, development, and data integration.

• Strong knowledge of SQL and data warehousing concepts (Star/Snowflake schema).

• Hands-on experience with ETL tools (Informatica, Talend, SSIS, DataStage, etc.).

• Proficiency in Python, Shell scripting, or Spark for automation and data manipulation.

• Experience with cloud-based data platforms (AWS Redshift, Azure Synapse, Google BigQuery, or Snowflake).

• Familiarity with version control (Git), CI/CD, and Agile environments.

• Experience with data orchestration tools like Airflow or Prefect.

• Familiarity with API integrations and streaming data (Kafka, Kinesis).

• Knowledge of data governance and quality frameworks.

• ETL or Cloud certification (Informatica, AWS Data Engineer, etc.) is a plus.