Manager, Data Engineering
BLDG SVC 32 B-J New York, New York, United States · $140K–$150K/yr
Education Administration Programs · 201-500 employees
About the role
The Manager, Data Engineering provides technical leadership and oversight for the data engineering team, managing the enterprise data warehouse, system integrations, and data pipelines. This role drives the delivery of high-quality data products while establishing best practices for data management, governance, and cross-functional collaboration.
What they look for
Requirements
Candidates must have at least 8 years of experience in data engineering and 3 years of management experience leading technical teams. Proficiency in SQL, Python, and data warehouse design is required, along with a bachelor's degree in a related field.
Full description
Job Code 911
Department Name Health Fund Admin
Reports To Assistant Director, Health Analytics & Engineering
FLSA Status Exempt
Union Code N/A
Management Yes
About Us:
Building Services 32BJ Benefit Funds (“the Funds”) is the umbrella organization responsible for administering Health, Pension, Retirement Savings, Training, and Legal Services benefits to over 185,000 SEIU 32BJ members. Our mission is to make significant contributions to the lives of our members by providing high quality benefits and services. Through our commitment, we embody five core values: Flexibility, Initiative, Respect, Sustainability, and Teamwork (FIRST). By following our core values, employees are open to different and new ways of doing things, take active steps to improve the organization, create an environment of trust and respect, approach their work with the intent of a positive outcome, and work collaboratively with colleagues.
The Funds oversees and manages $11 billion of dollars in assets, which are made up of many, varied and complex funds. The dollars come from a number of sources, including the property owners who pay into the funds on behalf of their employees, and as such, requires those who oversee and manage the money to be highly skilled financial management people.
32BJ Benefit Funds will continue to drive innovation, equity, and technology insights to further help the lives of our hard-working members and their families. We use cutting edge technology such as: M365, Dynamics 365 CRM, Dynamics 365 F&O, Azure, AWS, SQL, Snowflake, QlikView, and more.
Please take a moment to watch our video to learn more about our culture and contributions to our members: youtu.be/hYNdMGLn19A
Job Summary:
Under the direction of the Assistant Director, Health Analytics & Engineering, the Manager, Data Engineering provides technical leadership and oversight for the Health Fund's Data Engineering Team, including the enterprise data warehouse, system integrations, data pipelines, and data governance frameworks. The role leads a team of data engineering professionals responsible for delivering scalable, secure, and high-quality data solutions that support reporting, analytics, operational processes, and strategic initiatives.
The Manager, Data Engineering oversee numerous projects and initiatives across the full data lifecycle, including data governance, ETL processes, data validation, standardization and normalization, data integrity and quality assurance/control (QA/QC), data integration, and reporting and dashboard solutions. This position operates at both a technical and business level, helping to delineate roles and responsibilities across the Data Engineering Team while minimizing operational friction and delivering high-quality, reliable technical products in line with business needs and expectations. Working closely with internal teams, including Data Engineering, Analytics, IT, and other stakeholders, as well as external data vendors and content providers, this position drives the delivery of high-quality data products, establishes best practices for data management and governance, and ensures data platforms meet evolving business, regulatory, privacy, and security requirements.
Essential Duties and Responsibilities:
- Oversee the Data Engineering Team through leadership and supervision. Staff may include Data Engineers, ETL Specialists, and other relevant technical staff.
- Provide leadership, coaching, performance management, and professional development to Data Engineering staff, fostering a collaborative, accountable, and high-performing team environment.
- Technical ownership of the data warehouse, including system architecture, data architecture, data engineering, and data pipelines
- Lead collaboration for the deployment and implementation of tools necessary to integrate data within and across information systems and support data-driven decision­ making.
- Understand business requirements and translate them into technical solutions and application features.
- Develop and implement methods to improve data reliability, quality, and accessibility.
- Maintain data governance and documentation practices for a variety of data inputs from multiple sources, including flat files and spreadsheet-based files transmitted through SFTP, as well as JSON/XML style objects from API interfaces and other data exchange mechanisms.
- Participate in the evaluation and pilot of new technologies and provide recommendations regarding their alignment with business needs and strategic objectives.
- Manage communication and relationships with data platform stakeholders, balancing business requirements with technology capabilities.
- Partner with business and technology leadership to develop and execute the Health Fund's data strategy, roadmap, and priorities, ensuring alignment with organizational goals and business objectives.
- Develop testing protocols to ensure processes are robust and bugs are identified, documented, and resolved.
- Conduct functional and non-functional testing.
- Evaluate existing data models, architectures, and pipelines.
- Develop and maintain technical documentation to accurately represent data models, architectures, integrations, and workflows.
- Ensure that integration processes are fully tested and any issues, limitations, integrations, or dependencies are well defined and documented.
- Work with cross-functional technology and business partners to lead the technical delivery of integration solutions approved within the portfolio and contribute to the ongoing development of the Funds' data strategy
- Collaborate with business partners and internal teams to understand, document, prioritize and implement new datasets, integrations, and features within the data warehouse environment.
- Align closely with agency IT teams to support the deployment of integration systems.
- Partner with the QA and Infrastructure teams to ensure compliance with regulatory and security requirements.
- Establish, maintain, and enforce data engineering standards, policies, procedures, and best practices to ensure data quality, scalability, security, reliability, and operational efficiency.
- Monitor and optimize the performance, availability, and reliability of data platforms, data pipelines, data warehouse environments, and integration processes to support business continuity and operational effectiveness.
- Collaborate with Data Warehouse Architect in the design for the overall architecture of the data platforms and provide guidance and oversight.
- Ensure that guiding principles, technology standards, data governance requirements, and privacy policies are consistently followed.
Qualifications (Competencies):
- Minimum 8 years of experience in data engineering, data warehousing, ETL/ELT development, data integration, or related technical disciplines.
- Minimum 3 years of management or supervisory experience leading technical teams and complex data initiatives.
- Experience managing projects across the full data lifecycle, including data governance, data quality, integration, testing, documentation, and production support.
- Knowledge of healthcare regulatory requirements and data governance standards affecting health benefits organizations preferred.
- Familiarity of HIPAA privacy and security requirements and their application to healthcare data environments preferred.
- Advanced knowledge of data warehouse design, data modeling, and ETL/ELT methodologies preferred.
- Proficiency in SQL and Python, with hands-on industry experience is a must.
- Knowledge of API integrations, JSON, XML, SFTP, and file-based data exchanges.
- Experience in conducting code review a must; familiarity with unit, integration, and functional testing best practices and procedures preferred.
- Strong project management skills a must; familiarity with Agile methodology preferred.
- Experience with GitHub is a must; experience with Azure DevOps preferred.
- Experience building, maintaining enterprise data pipelines and data stores.
- Experience in extracting maximum value from low quality and/or error ridden input data preferred.
Soft Skills (Interpersonal Skills):
- Strong communication and client-facing skills with the ability to work in a centralized technology environment.
- Proven ability to lead, coach, mentor, and develop technical staff in a collaborative environment.
- Ability to build collaborative relationships across business and technology teams.
- Ability to lead organizational change and drive continuous process improvement initiatives.
- Strong analytical, problem-solving, and critical-thinking skills.
- Strong organizational skills with exceptional attention to detail and follow-through.
- Ability to communicate technical concepts to non-technical audiences.
Education:
Bachelor's degree in Computer Science, Information Systems, or related field required.
Master's degree preferred.
Reasoning Ability:
High
Physical Demands: The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals to perform the essential functions.
The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals to perform the essential functions.
- Under 1/3 of the time: Standing, Walking, Climbing or Balancing, Stooping, Kneeling, Crouching, or Crawling
- Over 2/3 of the time: Talking or Hearing
- 100% of the time: Using Hands
Work Environment:
The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.
- 1/3 to 2/3 of the time: Work near moving or mechanical parts, exposure to radiation, moderate noise.