IBM

Management Consultant - Data Engineer

IBM Louisiana, United States

IT Services and IT Consulting · 10,001+ employees

6 d ago
Remote data-engineer Senior (5-10 yrs) Full-time United States
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

You will design, develop, and deploy data and AI solutions on the Databricks platform to drive business value for clients. Additionally, you will lead solution delivery and collaborate with stakeholders to enhance platform performance and scalability.

What they look for

Databricks Data Engineering Cloud Computing Data Warehousing ETL Data Governance Machine Learning Deep Learning Natural Language Processing Cloud Migration Data Pipelines Solution Delivery Data Architecture Scalability Performance Optimization

Requirements

Candidates must have deep expertise in Databricks, data engineering principles, and cloud-based infrastructure management. A proven track record in leading solution delivery and relevant certifications in data or AI are also required.

Full description

As a Data Engineer specializing in Data Platforms-Databricks, you will play a critical role in building and enhancing the Databricks platform for client's Data and AI use cases. This position is responsible for implementing Data and AI use cases on the Databricks platform.

Your primary responsibilities will include:

  • Implement Data and AI Use Cases: Design, develop, and deploy data and AI solutions on the Databricks platform to meet client needs, driving business value through data-driven insights.
  • Enhance Databricks Platform: Collaborate with stakeholders to identify areas for improvement and implement enhancements to the Databricks platform, ensuring optimal performance and scalability.
  • Drive Solution Delivery: Lead the delivery of data and AI solutions, working closely with clients to understand their requirements and ensure successful project outcomes.

 *This job can be performed from anywhere in the US.

  • Deep Expertise in Databricks: Proven experience with designing, developing, and deploying data and AI solutions on the Databricks platform, with a strong understanding of its architecture and capabilities.
  • Experience with Data Engineering: Skilled in data engineering principles, including data processing, storage, and retrieval, with the ability to apply this knowledge to build scalable and efficient data pipelines.
  • Cloud Computing Knowledge: Experience with cloud-based technologies and infrastructure, including migration, deployment, and management of cloud-based data platforms.
  • Certification in Data and AI: Possession of relevant certifications in data engineering, data science, or AI, demonstrating expertise in implementing data and AI use cases on cloud-based platforms.
  • Experience with Solution Delivery: Proven track record of leading the delivery of data and AI solutions, working closely with clients to understand their requirements and ensure successful project outcomes.
  • Cloud Migration Expertise: Experience with migrating data platforms to cloud-based infrastructure, including planning, execution, and post-migration optimization. Ability to assess existing infrastructure and develop strategies for seamless migration to cloud-based environments.
  • Advanced Data Engineering: Deep understanding of data engineering principles, including data warehousing, ETL, and data governance. Ability to design and implement scalable and efficient data pipelines, leveraging expertise in data processing, storage, and retrieval.
  • AI Solution Development: Experience with developing and deploying AI solutions on cloud-based platforms, including natural language processing, machine learning, and deep learning. Ability to collaborate with stakeholders to identify business opportunities and develop AI-powered solutions to drive business value.

Similar roles