Bristlecone

Big Data Engineer

Bristlecone Bangalore, Karnataka, India

IT Services and IT Consulting · 1,001-5,000 employees

22 h ago
data-engineer Senior (5-10 yrs) Full-time India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Collaborate with teams to design, develop, and deploy data tools while performing analysis on large datasets using AWS. You will own product features from development through production and evaluate big data technologies to improve processing architecture.

What they look for

Java Spark Scala Python AWS MapReduce Hive Kafka Airflow Agile Data Ingestion Data Transformation Object-oriented Design Automated QA AI Technologies Data Modeling

Requirements

Requires 4-7 years of experience in enterprise software solutions with proficiency in Java, Spark, Scala, and Python. Candidates must have strong object-oriented design skills and knowledge of AWS cloud technologies.

Full description

  • 4-7 years of experience delivering enterprise software solutions
  • Proficient with Java, Spark, Scala, Python, AWS Cloud technologies
  • 2+ years of experience across multiple Spark technologies such as MapReduce, Hive, Kafka, Scala
  • Flair for data, schema, data model, how to bring efficiency in big data related life cycle.
  • Experience with Agile Development methodologies.
  • Experience with data ingestion and transformation
  • Have understanding for secure application development methodologies.
  • Experience in with Airflow and Python will be preferred.
  • Understanding of automated QA needs related to Big data technology.
  • Strong object-oriented design and analysis skills
  • Excellent written and verbal communication skills

Responsibilities

  • Utilize your software engineering skills including Spark, Python, Scala to Analyze disparate, complex systems and collaboratively design new products and services
  • Integrate new data sources and tools
  • Implement scalable and reliable distributed data replication strategies

Responsibilities

Collaborate with other teams to design and develop and deploy data tools that support both operations and product use cases

  • Perform analysis of large data sets using components in AWS Cloud
  • Own product features from the development, testing through to production deployment
  • Evaluate big data technologies and prototype solutions to improve our data processing architecture
  • Automate different pipelines

Qualifications

Knowledge and hands-on experience of using AI technologies for development, Testing and automation.

  • Knowledge of Cloud Technologies is a must such as AWS and its services

ABOUT US:

Bristlecone is the leading provider of AI-powered application transformation services for the connected supply chain. We empower our customers with speed, visibility, automation, and resiliency – to thrive on change.

Our transformative solutions in Digital Logistics, Cognitive Manufacturing, Autonomous Planning, Smart Procurement and Digitalization are positioned around key industry pillars and delivered through a comprehensive portfolio of services spanning digital strategy, design and build, and implementation across a range of technology platforms.

Bristlecone is ranked among the top ten leaders in supply chain services by Gartner. We are headquartered in San Jose, California, with locations across North America, Europe and Asia, and over 2,500 consultants. Bristlecone is part of the $19.4 billion Mahindra Group.

EQUAL OPPORTUNITY EMPLOYER:

Bristlecone is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

INFORMATION SECURITY RESPONSIBILITIES:

  • Understand and adhere to Information Security policies, guidelines and procedure, practice them for protection of organizational data and Information System.
  • Take part in information security training and act while handling information.
  • Report all suspected security and policy breach to InfoSec team or appropriate authority (CISO).
  • Understand and adhere to the additional information security responsibilities as part of the assigned job role.

Similar roles