Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
The Data Engineer will design, construct, and maintain scalable data management systems and enterprise ETL processes. They are also responsible for building high-performance algorithms, predictive models, and ensuring data quality through rigorous testing and documentation.
What they look for
Requirements
Candidates must hold a bachelor's degree in a technical field and possess at least 5 years of experience building production data pipelines. Strong proficiency in SQL, Python, and distributed query engines like Spark or Presto is required.
Benefits
Full description
Our client is looking for a Data Engineer to join their team.
Duration - 4 months
Location - Hybrid (3 days onsite)
Responsibilities :
The main function of the Data Engineer is to develop, evaluate, test and maintain architectures and data solutions within our organization. The typical Data Engineer executes plans, policies, and practices that control, protect, deliver, and enhance the value of the organization’s data assets.
Job Responsibilities:
- Design, construct, install, test and maintain highly scalable data management systems.
- Ensure systems meet business requirements and industry practices.
- Design, implement, automate and maintain large scale enterprise data ETL processes.
- Build high-performance algorithms, prototypes, predictive models and proof of concepts.
- Build, test and maintain batch ETL pipelines for assigned datasets, following existing team
patterns and standards.
- Implement changes to existing pipelines and tables in response to defined requirements,
including backfills and schema updates.
- Write and optimise SQL for large-scale datasets; investigate and fix data quality issues raised
through monitoring or stakeholder reports.
- Add and maintain data quality checks, tests and documentation for the pipelines in scope.
- Produce prototypes and exploratory analyses where requested, with direction from the FTE
owner on scope and success criteria.
- Participate in code review and follow team conventions for version control, deployment and
change management
Requirements
- Bachelor's degree in computer science, engineering, or a related technical field, or equivalent
practical experience.
- 5+ years building production data pipelines.
- Strong SQL, including performance tuning on large tables.
- Python for data transformation and pipeline orchestration.
- Experience with a distributed query engine (Presto, Spark, Hive or similar) and a workflow
scheduler (Airflow or similar).
- Comfortable working in a code review based workflow with Git.
- Ability to work as part of a team, as well as work independently or with minimal direction.
- Excellent written, presentation, and verbal communication skills.
- Collaborate with data architects, modelers and IT team members on project goals.
- Strong PC skills including knowledge of Microsoft SharePoint.
Nice to have:
- Experience with data modelling for analytics (dimensional or wide-table patterns).
- Experience building dashboards or working with BI tooling.
- Experience with data quality frameworks and pipeline observability.
Education/Experience:
- Bachelor's degree in a technical field such as computer science, computer engineering or related field required.
- Process certification, such as, Six Sigma, CBPP, BPM, ISO 20000, ITIL, CMMI."
Benefits
- Competitive salary
- Healthcare contribution and inclusion in company pension scheme
- Work laptop and phone
- 25 days annual leave (pro-rata) plus paid bank holidays
- Expanding workforce with potential for career progression for top performers.
Similar roles
-
Senior Data Engineer
Kula Example San Francisco, California, United States
-
Data Engineer (Supply Chain) - Clearance Required
LMI United States · $108K–$161K/yr
-
Cloud Data Engineer (Azure)
General Dynamics Information Technology Maryland, United States · $85K–$115K/yr
-
Staff Data Engineer
Commonwealth Bank Sydney, New South Wales, Australia
-
Data Engineer Sr. Consultant level
Visa Bengaluru, Karnataka, India
-
Senior Data Engineer
Shell Singapore, Singapore