Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Support the design, development, and maintenance of data infrastructure, including building data pipelines and developing PySpark notebooks to process and analyze large datasets. Integrate data from multiple sources, improve workflow efficiency and data quality, monitor and troubleshoot processing systems, and document data processes.
What they look for
Requirements
The role prefers a bachelor's degree in Computer Science, Information Technology, or a related field, along with 1–2 years of experience. Candidates should have proficiency in PySpark and Python, familiarity with Microsoft Fabric, SQL, databases, data warehouses, and data gateways, as well as strong problem-solving, attention to detail, communication, and teamwork skills.
Full description
As a Junior Data Engineer, you will be responsible for supporting the design, development, and maintenance of our data infrastructure. You will work closely with key users to identify efficient data processing and analysis of large datasets.
Key Responsibilities:
- Assist in the design and implementation of data pipelines.
- Develop and maintain PySpark notebooks for data processing and analysis.
- Support the integration and management of data from various sources, including dataflows and data lakes.
- Work with both structured and unstructured data to ensure comprehensive data coverage.
- Collaborate with team members to optimize data workflows and improve data quality.
- Monitor and troubleshoot data processing systems to ensure reliability and performance.
- Document data processes and workflows for future reference.
- Stay updated with the latest industry trends and technologies in data engineering.
Preferred Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field from1 to 2 years' experience
- Proficiency in PySpark and Python programming.
- Knowledge of Microsoft Fabric components and their application in data engineering.
- Familiarity with SQL and database management systems, including data warehouses.
- Familiarity with data gateways for secure data transfer.
- Strong problem-solving skills and attention to detail.
- Excellent communication and teamwork abilities.
Similar roles
-
AI & Synthetic Data Engineer
Lenovo Beijing, China
-
Senior Data Engineer
Fictiv Schaumburg, Illinois, United States · $167K–$202K/yr
-
Data Engineer_Red shift
XPT Software Australia Pty Ltd Victoria, Australia
-
Data Engineer
XPT Software Australia Pty Ltd Greater Brisbane, Queensland, Australia
-
Senior Data Engineer
NZ Transport Agency Waka Kotahi Auckland, Auckland, New Zealand · NZ$134K–NZ$163K/yr
-
Data Engineer (temporary)
Applaudo Studios Lima, Lima, Peru