Lead Data Engineer (Power BI, AWS, Data Pipeline)
Principal Global Services Hyderabad, Telangana, India
Financial Services · 10,001+ employees
About the role
The Lead Data Engineer will design, develop, and maintain robust data pipelines using AWS and Snowflake technologies. They will also lead a team, provide technical mentorship, and collaborate with Enterprise Architects to deliver scalable data solutions.
What they look for
Requirements
Candidates must have 7-9 years of experience in data engineering, with proficiency in Python or TypeScript, SQL, Power BI, and AWS services. A bachelor's or master's degree in a technical field is required, along with strong leadership and communication skills.
Full description
Responsibilities
Lead Data Engineer Position
Are you ready to lead a dynamic team and drive impactful data engineering solutions? At Principal, we offer an outstanding opportunity for an ambitious Lead Data Engineer to join our Enterprise Architecture engineering team. Here, you will work on groundbreaking projects, using automation, CI/CD, and Agile delivery approaches to deliver detailed results.
Key Responsibilities
As a Lead Data Engineer (data pipelines, Python or Typescript, PowerBI and AWS), your responsibilities will include:
- Support data management, LeanIX platform configurations and integrations, and application development.
- Build, develop, and maintain data pipelines through AWS cloud offerings alongside Snowflake.
- Maintain data using Snowflake data products.
- Coordinate and refine database updates using SQL, Snowflake technologies, and version control techniques.
- Apply AWS services including Lambda, S3, SNS, SQS, IAM, EventBridge, DynamoDB, KMS, and CloudWatch.
- Quickly grasp and adjust to new AWS services and developing cloud technologies.
- Create complex SQL queries and lead Power BI reports, dashboards, and visualizations.
- Develop programming solutions using Python and/or TypeScript.
- Perform automated testing, pipeline automation, and apply CI/CD tools.
- Work within Agile methodologies to ensure efficient project delivery.
- Exhibit leadership capabilities, leading the work for a small team.
- Mentor team members, providing technical guidance and support.
- Evaluate build options, making sound technical decisions and trade-offs.
- Collaborate effectively with collaborators and Enterprise Architects.
- Potentially handle LeanIX platform administration, maintenance, and integrations.
Required Skills and Experience
To be successful in this role, you should have:
- Experience in building data pipelines, Python or Typescript, PowerBI and AWS is mandatory
- Practical experience working with AWS services or Snowflake.
- Skilled in Snowflake, SQL, and handling database changes.
- Advanced SQL query development skills.
- Experience building and supporting Power BI reports and dashboards.
- Proficiency in programming with Python and/or TypeScript.
- Experience with automated testing, continuous integration and delivery tools, and Agile methodologies.
- Demonstrated ability to lead, mentor, and develop a team.
- Excellent collaboration and communication skills.
Qualifications
Qualifications
- 7-9 years of relevant experience.
- Bachelor’s degree or Master’s degree or equivalent experience in Computer Science, Technology, Engineering, Mathematics, or a related field (B.E. / B.Tech / M.S. / M.Tech / MCA).
Additional Information
Why Principal?
At Principal, we believe in encouraging a collaborative and welcoming environment where everyone's input is appreciated. We are committed to your professional development and assist our team members in reaching their personal and career ambitions. Join us and become part of a world-class team that is making an impact!
Similar roles
-
Data Engineer 4 (Manager, IC)
Capital One McLean, Virginia, United States · $179K–$225K/yr
-
Senior Data Engineer, Vice President
State Street Boston, Massachusetts, United States · $110K–$208K/yr
-
AI Data Engineer II (Business Data Analyst II)
UKG Bengaluru, Karnataka, India
-
Senior Data Engineer (Spark)
SSC HR Solutions Cairo, Cairo, Egypt
-
Databricks Data Engineer
Elevate Government Solutions Washington, District of Columbia, United States
-
Senior Data Engineer
Iris Software Noida, Uttar Pradesh, India