Senior Azure Data Engineer – Python/PySpark & Databricks
Axiom Path Jersey City, New Jersey, United States
IT Services and IT Consulting · 51-200 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Design, develop, and enhance scalable data pipelines and integration solutions within an enterprise Azure cloud environment. Build and maintain ETL/ELT workflows using Python, PySpark, and Azure data technologies to support capital markets operations.
What they look for
Requirements
Requires 10+ years of experience in software development and data engineering with strong proficiency in Python, PySpark, and Azure cloud services. Candidates should have expertise in building enterprise-scale data solutions and familiarity with financial services or capital markets data.
Full description
Be Part Of A High-Performing Team
Join a leading global financial services organization investing in the modernization of its enterprise data infrastructure. The technology team supports sophisticated capital markets operations, including securities trading, financial instruments, and market data management.
As part of a broader digital transformation initiative, the Data Strategy team is developing a cloud-based data platform that will improve how critical financial information is collected, processed, integrated, and distributed across the organization. This opportunity involves collaborating with engineering teams across the United States and internationally to build scalable data solutions using modern Azure technologies.
What's In Store For You
- Hybrid work arrangement based in Jersey City, NJ.
- Engagement: W2 only (no C2C/1099).
- Long-term contract opportunity supporting a strategic enterprise data modernization initiative.
- Opportunity to work with Azure Databricks, Python, PySpark, Azure Data Factory, and cloud-native integration technologies.
- Exposure to complex capital markets data environments, including securities reference data and pricing information.
- Collaboration with geographically distributed engineering teams on enterprise-scale data platform development.
How You Will Make An Impact
- Design, develop, and enhance scalable data pipelines and integration solutions within an enterprise Azure cloud environment.
- Build and maintain ETL/ELT workflows using Python, PySpark, Azure Data Factory, and Azure Databricks.
- Contribute to the development of a centralized data platform, initially focusing on securities reference data and pricing information before expanding into additional data domains.
- Develop Python-based APIs and serverless services to enable data exchange between enterprise applications and cloud data platforms.
- Implement data ingestion, transformation, storage, and processing solutions using Azure Data Lake Storage Gen2 and Azure database technologies.
- Write and optimize SQL queries to support data processing, validation, and integration across relational and NoSQL databases.
- Participate in CI/CD processes, version control, code reviews, testing, and production deployments.
- Partner with cross-functional engineering teams to deliver reliable, maintainable, and scalable data services.
- Follow enterprise development standards while helping improve the performance, quality, and reliability of the data platform.
Requirements
Do You Bring Proven Success in Azure Data Engineering and Python-Based Data Integration?
- 10+ years of relevant software development and data engineering experience preferred, with substantial hands-on experience building enterprise data solutions.
- Strong proficiency in Python and PySpark, including developing production-grade data processing and integration applications.
- Proven experience developing data solutions within Microsoft Azure.
- Hands-on expertise with Azure Databricks, Azure Data Factory, and Azure Data Lake Storage Gen2.
- Experience working with Azure databases, Azure Functions, and API management technologies.
- Strong SQL development skills, including experience with relational and/or NoSQL databases.
- Practical experience developing RESTful APIs using FastAPI or comparable Python frameworks.
- Strong understanding of ETL/ELT architecture, data ingestion, transformation, and integration patterns.
- Familiarity with Git, Jenkins or similar tools, automated deployment pipelines, and DevOps practices.
- Experience with Microsoft Fabric or comparable Azure data platform technologies is beneficial.
- Financial services experience, particularly involving capital markets, securities, financial instruments, asset classes, or market data, is advantageous.
- Strong troubleshooting, analytical, and communication skills, with the ability to collaborate effectively across distributed technical teams.
Similar roles
-
Senior Data Engineer II
Oscar Health New York, New York, United States · $181K–$237K/yr
-
Data Engineer
AcuityMD $113K–$159K/yr
-
Staff Data Engineer, Analytics
Afresh San Francisco, California, United States · $168K–$250K/yr
-
Data Engineer - Agentic AI
Defense Unicorns Springfield, Virginia, United States · $149K–$201K/yr
-
Senior Data Engineer
Southend Pharmacy Houston, Texas, United States · €45K–€65K/yr
-
Senior Data Engineer (Talent Pool)
ioet San José de Alluriquín, Santo Domingo de los Tsáchilas, Ecuador