Senior Data Engineer - Python
Cleartelligence · New York, New York, United States · $110K–$160K/yr
IT Services and IT Consulting · 11-50 employees
About the role
Design, develop, and maintain Python-based data ingestion and ETL pipelines to support large-scale data migration. Collaborate with stakeholders to extract, transform, and load data from legacy and enterprise systems into SQL databases.
What they look for
Requirements
Requires 7+ years of experience in data engineering and expert-level Python programming skills. Candidates must have strong experience with ETL pipelines, SQL, and working with various database and API technologies.
Full description
We are seeking a highly experienced Senior Data Engineer with strong Python development skills to support a large-scale data migration initiative. This individual will build and maintain data ingestion pipelines that extract data from legacy and enterprise systems, transform it, and load it into SQL databases for downstream reporting and analytics.
The ideal candidate is a self-sufficient engineer who is comfortable working across APIs, databases, and ETL pipelines, with the ability to independently deliver high-quality solutions in a fast-paced environment.
Location is commutable to New York City with some onsite work in New York
Responsibilities
- Design, develop, and maintain Python-based data ingestion and ETL pipelines.
- Extract data from legacy/homegrown securities platforms, REST APIs, MySQL, PostgreSQL, Microsoft System Center, MDM tools, and similar enterprise systems.
- Develop Python scripts to transform, validate, and load data into MySQL and PostgreSQL databases.
- Support migration of existing data feeds into a new environment while ensuring data quality and reliability.
- Maintain source code in GitHub and support deployment through Bloomberg's internal scheduling platform.
- Monitor, troubleshoot, and optimize data pipelines.
- Collaborate with engineering and business stakeholders to implement scalable data solutions.
- Document data flows, processes, and technical solutions.
Required Qualifications
- 7+ years of Data Engineering and Python development experience.
- Expert-level Python programming.
- Strong ETL/data ingestion pipeline experience.
- Experience with APIs, MySQL, and PostgreSQL.
- Strong SQL skills.
- Experience using Git/GitHub.
- Ability to work independently with minimal oversight.
- Strong analytical and troubleshooting skills.
Preferred Qualifications
- Data modeling or data warehouse experience.
- Financial services or securities data experience.
- Experience with enterprise infrastructure management systems.
- Experience supporting large-scale data migration initiatives.
- Exposure to enterprise scheduling/orchestration tools.
What We're Looking For
- Senior-level engineer capable of owning data ingestion pipelines end-to-end, from extracting data from legacy systems through transforming and loading it into modern SQL environments with minimal supervision.
Nice-to-Have Skills
- Data modeling and dimensional modeling
- Data warehouse architecture
- Financial services experience
The anticipated hourly rate for this role is up to $100 per hour or between $110,000 - $160,000 annually. Final pay rate will be determined based on experience, qualifications and geographic location
It is our policy to provide and promote equal employment opportunity to all employees and applicants for employment following all local, state, and federal laws and regulations governing personnel activities. Under federal guidelines we are committed to a program of affirmative action for work sites in the United States.
.
