Job Description

We are seeking an experienced Senior Data Engineer with a strong background in Databricks, Apache Spark, Azure, and ETL processes . The ideal candidate will have hands-on experience with large-scale data platforms, financial datasets, and compliance-driven environments. This role requires advanced technical expertise, problem-solving skills, and the ability to work in a fast-paced, collaborative setting.

REQUIREMENTS

Key Responsibilities

• Design, develop, and optimize ETL pipelines for large-scale data processing
• Build and maintain data models to support business reporting and analytics
• Develop and manage workflows in Databricks and Apache Spark
• Implement and maintain data integration solutions using Azure Data Factory and Synapse Analytics
• Write and optimize complex SQL/HiveQL queries for large datasets
• Automate workflows and processes using Unix Shell scripting
• Ensure data quality, governance, and compliance with financial industry regulations
• Collaborate with cross-functional teams including Data Scientists, Analysts, and Business Stakeholders

Required Skills & Qualifications

• 5+ years in Data Engineering or Software Engineering
• Proven hands-on expertise with:
• Apache Spark
• Hive
• Databricks
• Strong ETL development and data modeling skills
• Proficiency in Microsoft Azure (Azure Data Factory, Synapse Analytics)
• Advanced SQL and/or HiveQL skills for large datasets
• Proficiency in Unix Shell scripting for automation
• Experience working with financial data and compliance-driven projects

Work Arrangement

• Onsite only – Must be able to work from Weehawken, NJ office 5 days per week

Job Tags

Similar Jobs