Lou Test 25 TEMPLATE - Data Engineer 1, Level F
Skyscanner · London, England, United Kingdom
Internet Publishing · 1,001-5,000 employees
About the role
The Data Engineer will maintain and optimize data platforms while developing and deploying data pipelines using PySpark. They will also collaborate with cross-functional teams to ensure data quality, integrity, and security standards are met.
What they look for
Requirements
Candidates must hold a bachelor's degree in Computer Science or a related field. Proven experience with PySpark and strong skills in maintaining data platforms are required.
Benefits
Full description
Job Title: Data Engineer
Location: London (Onsite/Hybrid)
About the Role
We are seeking a skilled Data Engineer to join our team in London. In this role, you will be responsible for maintaining and enhancing our data platforms, ensuring robust data processing and seamless operations. You will leverage your expertise in PySpark to support our pipelines and deliver high-quality data solutions.
Key Responsibilities
- Maintain and optimize data platforms to ensure reliable performance
- Develop, test, and deploy data pipelines using PySpark
- Collaborate with data analysts, scientists, and cross-functional teams to meet business requirements
- Monitor data workflows and troubleshoot issues as they arise
- Ensure data quality, integrity, and security standards are upheld
Requirements
- Bachelor’s degree in Computer Science or related field
- Proven experience working with PySpark
- Strong understanding of maintaining and optimizing data platforms
- Excellent problem-solving skills
- Effective communicator and team player
Benefits
- Competitive compensation
- Opportunities for professional growth
- Collaborative and innovative work environment
If you are passionate about data engineering and have experience with PySpark, we encourage you to apply!
