JobCubby JobCubby
Sign up
NTT Data Singapore

Data Engineer

NTT Data Singapore Singapore, Singapore

IT Services and IT Consulting · 10,001+ employees

8 h ago
data-engineer Senior (5-10 yrs) Full-time Singapore
Log in to apply, save this posting, or score it against your profile with AI.

About the role

The role involves building and maintaining stream-processing systems and integrating data from multiple sources. You will be responsible for utilizing Big Data tools and ETL techniques to manage complex data pipelines.

What they look for

Hadoop Spark Iceberg Spring Boot Spark-Streaming Pig Hive Impala HBase Cassandra MongoDB Kafka RabbitMQ Mahout SparkML H2O

Requirements

Candidates must have a bachelor's degree in Computer Science and at least 7 years of IT experience, including 5 years in a similar Big Data role. Proficiency in distributed computing, Hadoop, Spark, and NoSQL databases is required.

Full description

Requirements Bachelor's degree in Computer Science or a related field. 

At least 7 years of IT experience of which at least 5 years' experience in similar role, ideally in a Big Data tools Proficient understanding of distributed computing principles Strong experience of Hadoop, Spark, Iceberg and Spring Boot Experience with building stream-processing systems, using solutions such as Spark-Streaming Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala Experience with integration of data from multiple data sources Experience with NoSQL databases, such as HBase, Cassandra, MongoDB Knowledge of various ETL techniques and frameworks Experience with various messaging systems, such as Kafka or RabbitMQ Knowlege with Big Data ML toolkits, such as Mahout, SparkML, or H2O Good understanding of Lambda Architecture, along with its advantages and drawbacks

Similar roles