AuxoAI

Data Engineer - AWS/Databricks

AuxoAI Bengaluru, Karnataka, India

Software Development · 201-500 employees

6 d ago
data-engineer Mid (2-5 yrs) Full-time India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design, build, maintain, and optimize scalable data pipelines and ETL processes using AWS services and Databricks. Collaborate with data scientists and analysts to support analytics and machine learning, while ensuring data performance, security, governance, and reliability.

What they look for

Data Engineering AWS Databricks Data Pipelines ETL Python Java Scala SQL NoSQL Data Warehousing Big Data Data Governance Data Security Docker Apache Airflow

Requirements

Requires a bachelor's or master's degree in Computer Science, Engineering, or a related field, and at least three years of data engineering experience. Candidates should be proficient in Databricks, AWS services, programming with Python, Java, or Scala, SQL and NoSQL databases, data warehousing, and big data technologies; Docker, Kubernetes, and Apache Airflow are a plus.

Full description

AuxoAI is seeking a skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have

3+ years of prior experience in data engineering, with a strong background in AWS (Amazon Web Services) and

Databricks technologies. This role offers an exciting opportunity to work on diverse projects, collaborating with

cross-functional teams to design, build, and optimize data pipelines and infrastructure.

Responsibilities:

  • Design, develop, and maintain scalable data pipelines and ETL processes leveraging AWS services such as S3,

Glue, EMR, Lambda, and Databricks.

  • Collaborate with data scientists and analysts to understand data requirements and implement solutions that

support analytics and machine learning initiatives.

  • Optimize data storage and retrieval mechanisms to ensure performance, reliability, and cost-effectiveness.
  • Implement data governance and security best practices to ensure compliance and data integrity.
  • Troubleshoot and debug data pipeline issues, providing timely resolution and proactive monitoring.
  • Stay abreast of emerging technologies and industry trends, recommending innovative solutions to enhance

data engineering capabilities.

Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 3+ years of prior experience in data engineering, with a focus on designing and building data pipelines.
  • Proficiency in Databricks, AWS services, particularly S3, Glue, EMR, Lambda, and Redshift.
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Experience with SQL and NoSQL databases, data warehousing concepts, and big data technologies.
  • Familiarity with containerization technologies (e.g., Docker, Kubernetes) and orchestration tools (e.g.,

Apache Airflow) is a plus.

Similar roles