Big Data Engineer
Bristlecone Bangalore, Karnataka, India
IT Services and IT Consulting · 1,001-5,000 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Collaborate with teams to design, develop, and deploy data tools while performing analysis on large datasets using AWS. You will own product features from development through production and evaluate big data technologies to improve processing architecture.
What they look for
Requirements
Requires 4-7 years of experience in enterprise software solutions with proficiency in Java, Spark, Scala, and Python. Candidates must have strong object-oriented design skills and knowledge of AWS cloud technologies.
Full description
- 4-7 years of experience delivering enterprise software solutions
- Proficient with Java, Spark, Scala, Python, AWS Cloud technologies
- 2+ years of experience across multiple Spark technologies such as MapReduce, Hive, Kafka, Scala
- Flair for data, schema, data model, how to bring efficiency in big data related life cycle.
- Experience with Agile Development methodologies.
- Experience with data ingestion and transformation
- Have understanding for secure application development methodologies.
- Experience in with Airflow and Python will be preferred.
- Understanding of automated QA needs related to Big data technology.
- Strong object-oriented design and analysis skills
- Excellent written and verbal communication skills
Responsibilities
- Utilize your software engineering skills including Spark, Python, Scala to Analyze disparate, complex systems and collaboratively design new products and services
- Integrate new data sources and tools
- Implement scalable and reliable distributed data replication strategies
Responsibilities
Collaborate with other teams to design and develop and deploy data tools that support both operations and product use cases
- Perform analysis of large data sets using components in AWS Cloud
- Own product features from the development, testing through to production deployment
- Evaluate big data technologies and prototype solutions to improve our data processing architecture
- Automate different pipelines
Qualifications
Knowledge and hands-on experience of using AI technologies for development, Testing and automation.
- Knowledge of Cloud Technologies is a must such as AWS and its services
ABOUT US:
Bristlecone is the leading provider of AI-powered application transformation services for the connected supply chain. We empower our customers with speed, visibility, automation, and resiliency – to thrive on change.
Our transformative solutions in Digital Logistics, Cognitive Manufacturing, Autonomous Planning, Smart Procurement and Digitalization are positioned around key industry pillars and delivered through a comprehensive portfolio of services spanning digital strategy, design and build, and implementation across a range of technology platforms.
Bristlecone is ranked among the top ten leaders in supply chain services by Gartner. We are headquartered in San Jose, California, with locations across North America, Europe and Asia, and over 2,500 consultants. Bristlecone is part of the $19.4 billion Mahindra Group.
EQUAL OPPORTUNITY EMPLOYER:
Bristlecone is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
INFORMATION SECURITY RESPONSIBILITIES:
- Understand and adhere to Information Security policies, guidelines and procedure, practice them for protection of organizational data and Information System.
- Take part in information security training and act while handling information.
- Report all suspected security and policy breach to InfoSec team or appropriate authority (CISO).
- Understand and adhere to the additional information security responsibilities as part of the assigned job role.
Similar roles
-
Senior Data Engineer II
Oscar Health New York, New York, United States · $181K–$237K/yr
-
Data Engineer
AcuityMD $113K–$159K/yr
-
Staff Data Engineer, Analytics
Afresh San Francisco, California, United States · $168K–$250K/yr
-
Data Engineer - Agentic AI
Defense Unicorns Springfield, Virginia, United States · $149K–$201K/yr
-
Senior Data Engineer
Southend Pharmacy Houston, Texas, United States · €45K–€65K/yr
-
Senior Data Engineer (Talent Pool)
ioet San José de Alluriquín, Santo Domingo de los Tsáchilas, Ecuador