Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Manage and improve pipelines for cleansing, filtering, and structuring raw datasets for analysis. Implement QA procedures, build new products, and collaborate with stakeholders on infrastructure and documentation.
What they look for
Requirements
Requires 3-7 years of data engineering experience with expertise in cloud environments and tools like Python, Databricks, and SQL. Candidates should hold a bachelor's degree or higher in a quantitative discipline and possess strong communication and project management skills.
Benefits
Full description
M Science is a data-driven research and analytics firm, uncovering new insights for leading financial institutions and corporations. We come to work every day to create actionable insights from alternative data. M Science is revolutionizing research, discovering new data sets and pioneering methodologies to provide actionable intelligence. Our research teams have decades of experience working with massive amounts of unstructured data in near real-time to discern critical insights that help clients make smarter, more informed decisions. We combine the best of finance, data and technology to create a truly unique value proposition for both financial services firms and major corporations.
We’re looking for exceptional data engineers who will work with petabytes of data daily using diverse technologies like Databricks, SQL, Python, Airflow, and others. You will be expected to effectively partner with upstream engineering teams and downstream consumers, including analysts and product engineers. In this role, you will build datasets to support analytics, experimentation, and machine learning. Specifically, you will build out standards for pipelining at scale, including establishing common operators, workflows/DAGs, and optimizing existing products.
NOTE: This role requires flexible working hours to ensure at least 2 hours of overlap with colleagues based on both the US East Coast and West Coast. Expected working schedule: 12:00–20:00 CET.
Responsibilities:• Manage and improve pipeline for cleansing, filtering, and structuring raw datasets for the purposes of company and customer analysis.
- Implement QA procedures to proactively identify data anomalies and issues.
- Implement new products and features created by analyst teams using best practices.
- Work with other team members and internal stakeholders on infrastructure projects, documentation, QA and code reviews.
- Build and manage Repos.
- Continuously seek opportunities to standardize code and automate production pipelines.
- Create and contribute to frameworks that improve the efficacy of logging data, while working with infrastructure to triage issues and resolve.
- Mentor team members by giving/receiving actionable feedback.
Requirements:• 3-7 years of experience as a data engineer.
- Preference given to those that have worked in a similar type role within a data intelligence company or within our desired verticals including consumer retail & brands, digital media and technology.
- Expertise in data engineering in a cloud environment (Python, Databricks, AWS, Airflow, Snowflake, SQL).
- SQL & Python required.
- Working knowledge of PySpark and distributed computing.
- Strong people and management skills to interact with product managers and data analysts.
- Familiarity with software development methods such as Scrum and TDD.
- General project management skills.
- Ability to clearly articulate project plans, technical requirements, methodologies, and takeaways to both technical and non-technical stakeholders.
- Bachelor’s or higher degree, or significant experience in Statistics, Mathematics, Computer Science, or a similar quantitative discipline.
- Ability to thrive in a culture of quality and personal accountability.
What we offer:• 20 days of vacation.
- Public holidays.
- Mobilization reservation available upon successful completion of the probation period (for Ukrainian colleagues).
- The exchange of experience and work with talented colleagues.
- Last but not least - valuable compensation for your efforts.
Similar roles
-
Senior Data Engineer II
Oscar Health New York, New York, United States · $181K–$237K/yr
-
Data Engineer
AcuityMD $113K–$159K/yr
-
Staff Data Engineer, Analytics
Afresh San Francisco, California, United States · $168K–$250K/yr
-
Data Engineer - Agentic AI
Defense Unicorns Springfield, Virginia, United States · $149K–$201K/yr
-
Senior Data Engineer
Southend Pharmacy Houston, Texas, United States · €45K–€65K/yr
-
Senior Data Engineer (Talent Pool)
ioet San José de Alluriquín, Santo Domingo de los Tsáchilas, Ecuador