Senior Data Engineer
Bitful Consulting Wadsworth, Ohio, United States
IT Services and IT Consulting · 11-50 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
You will build and maintain scalable data pipelines and datasets within a Databricks lakehouse environment to support various business functions. Additionally, you will collaborate with stakeholders to deliver data solutions while ensuring pipeline reliability, data quality, and performance.
What they look for
Requirements
The role requires 7+ years of experience in data engineering with strong proficiency in Python, PySpark, and SQL. Candidates must have hands-on experience with Databricks, Apache Spark, and cloud data platforms, along with a solid understanding of data modeling and CI/CD practices.
Full description
- You’ll build and maintain data pipelines and datasets that support reporting, visualization, machine learning and data-driven decision making across finance, sales, supply chain, marketing and other business functions.
- Your responsibilities will include:
- Developing and maintaining scalable data pipelines and reusable datasets within a Databricks lakehouse environment
- Ingesting, validating, cleaning and transforming structured and unstructured data from multiple sources using Python, PySpark and SQL
- Building data models and reporting datasets that support Tableau and established analytics tools such as Spotfire
- Integrating established data warehouse and reporting systems with modern cloud analytics platforms
- Improving pipeline reliability, data quality and processing performance
- Implementing automated testing, monitoring, documentation and CI/CD practices
- Partnering with analysts, architects, developers and business stakeholders to deliver practical data solutions
- Providing technical guidance, reviewing code and mentoring other data engineer
- 7+ years of experience in data engineering, including building and supporting production data pipelines
- Strong SQL skills and a solid understanding of data modeling, database design and data warehousing
- Hands-on experience with Databricks, Apache Spark and cloud data platforms
- Strong proficiency in Python and PySpark
- Experience developing ETL/ELT pipelines and integrating data from multiple source systems
- Experience preparing reliable datasets for Tableau or comparable business intelligence tools
- Familiarity with source control, automated testing and CI/CD practices
- Ability to troubleshoot complex data issues and optimize pipeline performance
- Strong communication skills and experience collaborating with technical teams and business stakeholders
- Experience with Spotfire, Oracle, Informatica, R or data virtualization preferred
- Databricks certification preferred
Similar roles
-
Data Engineer
TAL Sydney, New South Wales, Australia
-
Staff Data Engineer
Meeru AI Inc Pleasanton, California, United States
-
Platform & Data Engineer
Apple Cupertino, California, United States
-
Senior Data Engineer
Xometry Waltham, Massachusetts, United States · $119K–$155K/yr
- Forward Deployed Data Engineer
-
Data Engineer (Data Products - Apple Ads)
Apple Cupertino, California, United States