Data Engineer, Senior

Purpose: Senior Data Engineers develop custom end-to-end integration solutions for large data sets of diverse and complex healthcare data. Implementations include test driven development, SDLC standards and scrum principles. The team has set a high standard for quality. Deliveries require accuracy, performance stability, security, robust monitoring, alerting and pipeline uptime requirements. They will work closely with various business, technical and possibly clinical professionals daily. Additional responsibilities may include product support and ongoing data maintenance responsibilities. This position will be required to manage multiple projects and to prioritize work and have excellent written and verbal communication skills.

Please note that this position is in-office three days per week.

Must be legally authorized to work in the United States, without requiring, now or in the future, sponsorship for employment visa status. UPMC does not offer any type of sponsorship (H-1B, permanent residence, etc. ) UPMC does not participate in STEM OPT.

Responsibilities:

• Deliver complex end-to-end integration solutions that follow Data Engineering best practices and leverage test driven development and standard SDLC best practices.
• Execute solutions using the appropriate Data Engineering Design, Development and Delivery processes.
• Perform as a role model for other team members following integration policies and procedures.
• Create infrastructure diagrams for project specific integrations.
• Create appropriate monitoring, alerting and error messaging to integrate with various tools in accordance with Data Engineering standard practices.
• Work independently on complex projects managing multiple user stories and own and work on stories through each of the scrum stage gates effectively.
• Represent Data Engineering team in vendor and client discussions to refine requirements, discover data sources, drive design decisions, adhere to standards, and obtain necessary accesses to achieve accurate data representation.
• Work cooperatively and constructively with many teams and roles within the organizations, while independently representing the Data team as an SME.
• Write and maintain technical implementation and support documentation for integrations.
• Document, troubleshoot, and appropriately address production issues with the customer and effectively communicate with the team and other stakeholders.
• Manage tasks and timelines related to assigned work. Escalate risks and delays timely and effectively to the team Lead.
• Demonstrate the ability to create and deliver clear, concise, and effective written and oral communications.
• Complete projects, tasks, and initiatives by embracing a “team-first” approach. Work in collaboration with team and offer feedback, where appropriate, to support individual and group efforts. Show the ability to adjust and be flexible to change by adapting approaches when necessary.
• Responsible for continuous self-study, training, and/or seek opportunities to broaden scope and to stay up to date with industry and organizational trends. Seek feedback from team members for development and effectively incorporate feedback into work and behaviors.
• Build relationships across the One-Enterprises organization, developing awareness of big picture business drivers and customers’ needs to help align work and accelerate value delivery.
• Assist in the education and coaching of members both within the Data Engineering team and across the broader UPMC Enterprises team.
• Objectively assess and sign-off on teammates work according to team standards and processes.

• Bachelor’s degree in a field like mathematics, statistics, economics, finance, computer science, or another relevant field preferred.
• Typically has 7+ years of relevant experience or equivalent combination of education and experience.
• Technical writing skills
• Demonstrate proficiency in integration tools, ETL concepts, Java, Python, Spark, Kubernetes, OMOP CDM, Microsoft Fabric, AWS tools such as Lambda Functions, S3, AWS Glue
• Advanced analytical and problem-solving skills
• Ability to set and meet deadlines for complex projects
• Ability to work in high-pressure situations
• Reporting and data visualization skills
• Excellent attention to detail
• Proficiency in healthcare IT data or systems is required
• Experience with modern, scalable big-data architecture is preferred
• Experience with modern AI development workflows and accelerators are preferred
• Experience with clinical data formats and exchange protocols such as HL7, CDA, CCDA and FHIR are strongly preferred

Licensure, Certifications, and Clearances:

UPMC is an Equal Opportunity Employer/Disability/Veteran