Senior Python Developer
Sales Consulting · Bucureşti, Bucharest, Romania
Human Resources Services · 51-200 employees
About the role
The role involves processing large data volumes using Python, PySpark, and Scala within a Big Data ecosystem. Responsibilities include managing ETL processes and utilizing Google Cloud Platform tools like DataProc and AirFlow.
What they look for
Requirements
Candidates need over 5 years of experience with Python and Big Data technologies, including Spark and various SQL databases. Proficiency in DevOps practices and strong English communication skills are also required.
Full description
Responsibilities
- 5+ years of experience utilizing Python, PySpark/Scala for processing large data volumes
- Good knowledge of working with Databases (e.g., SQL, Oracle, Hive, Impala)
- Relevant experience with Pandas, NumPy, Scikit-learn, and other relevant Python libraries
- Google Cloud Platform (DataProc, AirFlow, Google Cloud Storage)
- Good knowledge of Unix/Linux environments
- Familiarity with Big Data and Hadoop Ecosystem: Spark (Spark SQL, Dataframes, PySpark, HUE, parquet files)
- Awareness about DevOps practices like CI/CD
- Proficient communication and English language skills (written/verbal)
Skills
- PySpark (Python, PySpark or Scala)
- Spark DataFrames
- ETL concepts
- Database and SQL knowledge (Hive/Impala)