Spark Developer NM Jobs in New York, NY at Top Level Consultancy

Job Summary:
We are looking for a talented Spark Developer to join our data engineering team. The ideal candidate will have experience in building scalable data pipelines and processing large datasets using Apache Spark. You’ll collaborate with cross-functional teams to deliver reliable, high-performance data solutions.

Key Responsibilities:

• Design, develop, and maintain data processing pipelines using Apache Spark.

• Write efficient Spark applications in Python (PySpark), Java, or Scala.

• Optimize and tune Spark jobs for performance and scalability.

• Integrate data from various sources (databases, APIs, flat files, etc.).

• Work with big data technologies such as Hadoop, Hive, and HDFS.

• Collaborate with data engineers, analysts, and business teams to meet project goals.

• Monitor and troubleshoot Spark jobs and data pipelines.

• Ensure data quality, consistency, and integrity across systems.

Job Overview

We are currently seeking a talented Spark Developer to join our innovative IT Software team, based in New York, NY. This is a fantastic opportunity to develop your career and work with some of the best minds in the industry. You will work on a variety of exciting and challenging projects, using the latest Ab Initio technologies. The position is available as either a W2-Permanent or a W2-Contract role, with a competitive salary range of $75,000 - $85,000 annually.

Job Roles & Responsibilities

• Design, develop and implement complex Ab Initio applications.
• Collaborate with cross-functional teams to define, design, and ship new features.
• Work on bug fixing and improving application performance.
• Continuously discover, evaluate, and implement new technologies to maximize development efficiency.

Salary

The salary for this position ranges from $75,000 to $85,000 annually, based on experience and qualifications. This is a full-time position with a comprehensive benefits package.

Qualifications

• A minimum of 1-3 years of experience in IT Software, specifically in Spark development and Ab Initio technologies.
• Applicants must be US citizens, Green Card holders, or H4 visa holders.
• A Bachelor's degree in Computer Science or a related field is required.

Skills

• Proficiency in Ab Initio technologies with the ability to design and optimize applications.
• Strong problem-solving skills and ability to think algorithmically.
• Excellent communication and teamwork skills, with a keen eye for detail.

Salary

For this full-time position, the salary range is $75,000 - $85,000 per year, dependent upon experience and qualifications. We believe in rewarding our employees for their hard work and offer a competitive benefits package.