Python Pyspark Developer
Unison Group Singapore, Singapore
Business Consulting and Services · 11-50 employees
About the role
Design, develop, and maintain scalable ETL and data pipelines using Python, PySpark, and SQL. Analyze business requirements to translate them into robust technical solutions within a banking environment.
What they look for
Requirements
Requires strong hands-on experience in Python and PySpark for large-scale data processing and Big Data technologies. Candidates must possess knowledge of SQL, data modeling, and performance tuning, with experience in Agile environments.
Full description
Job Description:
- Strong hands-on experience in Python and PySpark development for large-scale data processing.
- Design, develop and maintain ETL/data pipelines using PySpark, Python and SQL.
- Experience working with Big Data technologies, data transformation and batch processing.
- Strong knowledge of SQL, data modelling, performance tuning and optimization.
- Experience with cloud/data platforms such as AWS, Azure, Databricks or equivalent is preferred.
- Good understanding of data quality, reconciliation, validation and error handling.
- Ability to analyse business requirements and translate them into scalable technical solutions.
- Experience working in Agile/Scrum environments with strong communication and stakeholder-management skills.
- Candidates should be available to work in a Singapore-based banking environment.
Similar roles
-
Python Developer - Digital Forensics
The Mitre Corporation McLean, Virginia, United States · $159K–$238K/yr
-
Software Engineer Python Sr
Softtek Madrid, Community of Madrid, Spain
-
Full-stack Engineer 4 (Java, Python, AWS) (Enterprise Platforms Technology)
Capital One McLean, Virginia, United States · $197K–$225K/yr
-
Data & AI Engineer — AWS, Java & Python
Incentivio Mansfield, Pennsylvania, United States
-
Full-stack Engineer 4 (Java, Python, AWS, Spark)
Capital One Richmond, Virginia, United States · $179K–$205K/yr
-
Full-Stack Engineer 4 (Java, Python, AWS, Spark)
Capital One San Francisco, California, United States · $215K–$246K/yr