JobCubby JobCubby
Sign up
techcarrot FZ LLC

Data Engineer

techcarrot FZ LLC Hyderabad, Telangana, India

IT Services and IT Consulting · 201-500 employees

14 h ago
data-engineer Senior (5-10 yrs) Full-time India
Log in to apply, save this posting, or score it against your profile with AI.

About the role

The role involves designing, architecting, and implementing robust data pipelines using the Microsoft and Databricks stack. You will collaborate with engineering teams to integrate prototypes into core intelligence products while ensuring data quality and business value.

What they look for

Azure Data Factory Databricks Python PySpark Azure Synapse SQL Azure DevOps Data Pipelines Relational Databases Non-relational Databases Eventhub Data Architecture Data Engineering Cloud Computing

Requirements

Candidates must have at least 4-6 years of experience with Azure data platforms, including Databricks and Azure Data Factory. A bachelor's degree and strong proficiency in Python, PySpark, and SQL are required.

Full description

  • Detailed reviewing and analyzing structured, semi-structured and

unstructured data sources for quality, completeness and business value.

  • Design, architect, implement and test rapid prototypes that demonstrate value

of the data and present them to diverse audiences.

  • Participate in early state design and feature definition activities.
  • Responsible

for implementing robust data pipeline using Microsoft, Databricks Stack

  • Responsible

for creating reusable and scalable data pipelines

  • You

are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.

Requirements

  • Advanced

working knowledge and experience with relational and non-relational databases

  • Experience

building and optimizing Azure Data data pipelines, architectures and data sets

  • Strong

analytic skills related to working with unstructured datasets

  • Strong

experience in Azure Data factory, Databricks, Eventhub, Python, PySpark , Azure Synapse and SQL, Azure DevOps

  • Azure

DevOps experience to deploy the ADF pipelines.

  • Create

end to end Azure databricks

  • Minimum

4-6 years of experience

  • Bachelor’s

degree

  • Knowledge/Experience

with Azure cloud stack.

  • Azure

Data Platform & Databricks exp should be more than 4 years

Similar roles