Senior Network Observability Engineer
St. Jude Children's Research Hospital Memphis, Tennessee, United States · $95K–$170K/yr
Non-profit Organizations · 1,001-5,000 employees
About the role
The role involves designing and maintaining observability pipelines to ensure network health, performance, and availability across a multi-site environment. You will correlate telemetry data, manage alerting systems, and lead root cause analysis for major network incidents.
What they look for
Requirements
Candidates must have at least four years of IT experience in infrastructure operations and engineering environments. A bachelor's degree is required, and proficiency with network monitoring tools and Cisco routing/switching architectures is preferred.
Full description
The Enterprise Network Team is building out proactive observability across a large, multi-site network. This role owns visibility into network health, performance, and availability, turning raw telemetry into actionable insight before problems hit patients, staff, or research systems.
Job Responsibilities:
- Design and maintain observability pipelines across StatSeeker, ThousandEyes, Cisco Catalyst Center, and NDFC.
- Build dashboards and alerting that surface SLA breaches, capacity trends, and anomalies across the network.
- Correlate telemetry across the network stack (Catalyst, Nexus, F5, ISE, BlueCat) into a single operational picture.
- Integrate monitoring data into ServiceNow for auto-ticketing and queue visibility.
- Route and process telemetry events using Azure Event Grid to support real-time alerting and downstream integrations.
- Develop synthetic monitoring and active testing for key network paths and services.
- Lead root cause analysis on major incidents using historical telemetry and trend data.
- Establish baselines and thresholds for network performance across sites and platforms.
- Document observability standards and mentor the team on interpreting and acting on data.
- Perform other duties as assigned to meet the goals and objectives of the department and institution.
- Maintains regular and predictable attendance.
Minimum Education and/or Training:
- Bachelor's degree in Computer Science, Engineering, Business or related field of study required.
- Master's degree preferred.
Minimum Experience:
- Minimum experience: Four (4) years of IT experience with experience in infrastructure operations and engineering environments.
- Experience in infrastructure design, systems analysis, and security management.
- Some experience working with commercial models around infrastructure capacity procurement.
- Experience in customer service and vendor management.
- Some experience in business stakeholder engagement and management.
- Hands-on experience with at least one of StatSeeker, ThousandEyes, SolarWinds, LogicMonitor, or similar preferred.
- Strong understanding of SNMP, NetFlow/IPFIX, streaming telemetry, and syslog architectures preferred.
- Experience with Azure Event Grid or similar event routing/messaging services preferred.
- Deep understanding of Cisco routing/switching, with comfort working across Catalyst, Nexus, and NDFC environments preferred.
- Experience integrating network systems with ITSM platforms like ServiceNow preferred.
- Familiarity with healthcare or other high-availability environments preferred.
- CCNP or equivalent certification preferred.
- Proven performance in earlier role/comparable role.
Compensation
In recognition of certain U.S. state and municipal pay transparency laws, St. Jude is including a reasonable estimate of the compensation range for this role. This is an estimate offered in good faith and a specific salary offer takes into account factors that are considered in making compensation decisions including but not limited to skill sets, experience and training, licensure and certifications, and other business and organizational needs. It is not typical for an individual to be hired at or near the top of the salary range and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current salary range is $94,640 - $169,520 per year for the role of Senior Network Observability Engineer.
Explore our exceptional benefits!
St. Jude is an Equal Opportunity Employer
No Search Firms
St. Jude Children's Research Hospital does not accept unsolicited assistance from search firms for employment opportunities. Please do not call or email. All resumes submitted by search firms to any employee or other representative at St. Jude via email, the internet or in any form and/or method without a valid written search agreement in place and approved by HR will result in no fee being paid in the event the candidate is hired by St. Jude.
