Agentic AI Data Engineer

Agentic AI Data Engineer

Role Overview

Total Experience required : 5-10 Years

We are seeking a highly skilled Agentic AI Data Engineer to design, build, and optimize intelligent, autonomous data systems that power next-generation AI applications. This role blends data engineering, machine learning infrastructure, and emerging agent-based AI frameworks to enable scalable, self-orchestrating pipelines and decision-making systems.

You will work at the intersection of data platforms, large language models (LLMs), and cloud-native architectures—building systems that can reason, act, and adapt autonomously.

Key Responsibilities

• Design and implement agentic AI systems that autonomously orchestrate data workflows and decision pipelines

• Build scalable data pipelines for structured and unstructured data (batch + real-time)

• Develop and manage LLM-powered applications using retrieval-augmented generation (RAG), tool use, and multi-agent frameworks

• Integrate AWS AI/ML services into production-grade architectures

• Develop and optimize data lakes, warehouses, and lakehouse architectures

• Build APIs and microservices to expose AI/ML capabilities

• Ensure data quality, governance, and security across pipelines

• Collaborate with data scientists, ML engineers, and product teams to deploy AI solutions

• Implement monitoring, logging, and observability for AI agents and pipelines

• Optimize cost and performance of cloud-based AI workloads

Required Technical Skills

Cloud & AWS Ecosystem

• Strong experience with AWS services, including:

• Amazon S3, Glue, Lambda, Step Functions

• Amazon Redshift / Athena

• Amazon SageMaker (training, deployment, pipelines)

• Amazon Bedrock (foundation models, agents, knowledge bases)

AI/ML & Agentic Systems

• Experience with LLMs and generative AI systems

• Hands-on with agent frameworks (e.g., multi-agent orchestration, tool calling, planning systems)

• Familiarity with AgentCore / agent orchestration platforms

• Understanding of RAG architectures, embeddings, and vector databases

• Experience with model deployment, inference optimization, and prompt engineering

Data Engineering

• Strong proficiency in Python and SQL

• Experience with ETL/ELT tools and frameworks

• Distributed data processing (Spark, PySpark, or similar)

• Streaming technologies (Kafka, Kinesis, or similar)

• Data modeling and schema design

Data & AI Infrastructure

• Experience with vector databases (e.g., Pinecone, FAISS, OpenSearch)

• Knowledge of data lakehouse architectures (Delta Lake, Iceberg, Hudi)

• Containerization (Docker) and orchestration (Kubernetes)

• CI/CD for ML and data pipelines

Preferred Qualifications

• Experience building autonomous AI agents for enterprise use cases

• Knowledge of multi-agent collaboration systems and planning algorithms

• Familiarity with LangChain, LlamaIndex, or similar frameworks

• Experience with MLOps and LLMOps practices

• Understanding of graph-based workflows and knowledge graphs

• Exposure to real-time AI systems and event-driven architectures

Soft Skills

• Strong problem-solving and system design skills

• Ability to work in fast-paced, evolving AI environments

• Effective communication and cross-functional collaboration

• Curiosity and adaptability to emerging AI technologies

Education & Experience

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field

• 4+ years of experience in data engineering or ML engineering

• Hands-on experience with production-grade AI/ML systems

Nice-to-Have

• Experience with reinforcement learning or planning systems

• Background in distributed systems design

• Contributions to open-source AI/data projects

• Certifications in AWS (e.g., Solutions Architect, Machine Learning Specialty)

What You’ll Build

• Autonomous data pipelines that self-heal and optimize

• AI agents capable of reasoning over enterprise data

• Scalable LLM-powered applications integrated with business workflows

• Intelligent systems that move beyond automation into decision-making