NucleusTeq

GCP Data Engineer

NucleusTeq · Phoenix, Arizona, United States

IT Services and IT Consulting · 201-500 employees

Yesterday
Senior (5-10 yrs) Contractor United States
Log in to apply, save this posting, or score it against your profile with AI.

About the role

Design and implement large-scale enterprise-level big data platforms using GCP services. Perform analysis on large data sets and deliver business intelligence solutions within an agile team environment.

What they look for

GCP GCS DataProc BigQuery Composer Airflow PySpark Spark Python Scala Hive Pig MapReduce SQL Spanner DB Graph DB

Requirements

Requires 6+ years of experience as a big data engineer and a degree in a technology-related field. Must demonstrate proficiency in PySpark, Spark, Python, SQL, and GCP cloud technologies.

Full description

Role – GCP Data Engineer

Location – Phoenix, AZ

Duration: 12+ Months

Skills:

  • Years of experience : 5-7 years
  • GCP Cloud : GCS, DataProc, BigQuery, Composer/Airflow
  • Big Data: PySpark
  • Spark, Python, GCP is must have
  • Strong experience with Spark , Data Frames
  • Big Query background with data processing for large volumes
  • Another NO Sql DB is big plus - Spanner DB & Graph DB

Qualifications:

  • Degree in Computer Science, Applied Mathematics, Engineering, or any other technology related field (or equivalent work experience)
  • 6+ years of experience working as a big data engineer (Required) must be able to articulate use cases supported and outcomes driven.
  • knowledge of the following (expectation is to demonstrate these skills live during the interview): PySpark, Spark, Python, Scala, Hive, Pig, and MapReduce.
  • Experience in GCP.
  • Experience in SQL.
  • Large scale data engineering and business intelligence delivery experience
  • Design of large-scale enterprise level big data platforms
  • Experience working with and performing analysis using large data sets
  • Proven and Demonstrated experience working with or on a mature, self-organized agile team