OpticoreIT

Site Reliability Engineer

OpticoreIT London, England, United Kingdom

IT Services and IT Consulting · 51-200 employees

5 h ago
Remote sre Senior (5-10 yrs) Contractor United Kingdom
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Monitor and manage observability and telemetry platforms across large-scale AI infrastructure clusters, including compute, GPU, storage, and network systems. Build dashboards, alerts, reporting, and automated fault detection and remediation workflows, while maintaining operational procedures and improving tooling.

What they look for

Grafana Loki Mimir VictoriaMetrics Python Go Scripting API Automation Monitoring ITSM Integration HaloITSM Webhooks GitOps CI/CD Configuration Management Incident Automation

Requirements

The role calls for experience with Grafana, Loki, Mimir, and VictoriaMetrics, along with Python or Go scripting and API automation. Candidates should also be familiar with monitoring-to-ITSM integrations, GitOps and CI/CD, configuration management, and proactive incident automation and self-healing.

Full description

Opticore IT is a specialist Network Engineer and Project Management consultancy offering a wide variety of opportunities to work within fast-paced, challenging environments across our client base spanning multiple sectors including Finance, Broadcast Media, Telecommunications and more.

Opticore IT are currently searching for Site Reliability Engineers to stand up, tune and automate the observability and telemetry platforms for three large scale AI infrastructure clusters, creating the proactive monitoring and automated remediation capability that underpins the customer's AI infrastructure service. This is a fully remote opportunity operating insideIR35.

What you'll be doing:

  • Monitor the health of all compute, GPU, storage and network infrastructure across the clusters.
  • Own and manage Grafana, Loki, Mimir, VictoriaMetrics and supporting telemetry platforms.
  • Design and maintain dashboards, alerting rules and automated health checks.
  • Analyse trends to identify degradation before it causes service impact.
  • Produce operational reporting, capacity forecasting and platform health metrics.
  • Develop automated workflows that detect faults and trigger remediation actions.
  • Integrate monitoring systems with HaloITSM and hardware vendor support portals.
  • Build auto ticketing, escalation and notification capabilities, including automated dispatch of field engineers.
  • Reduce operational risk through self healing and proactive response mechanisms.
  • Manage configuration and deployments through Git and CI/CD pipelines.
  • Maintain runbooks and operational procedures, and continually improve operational tooling and automation.

What you'll bring:

  • Observability Stack (Grafana, Loki, Mimir, VictoriaMetrics)
  • Python or Go Scripting & API Automation
  • Monitoring to ITSM Integration (HaloITSM, Webhooks, Vendor Portals)
  • GitOps & CI/CD Configuration Management
  • Proactive Incident Automation & Self Healing

Diversity:

At Opticore IT we embrace diversity and are committed to equal opportunities. We actively recruit for an inclusive and diverse workforce and as such, want to ensure we do everything we can to support your application.

We want you to feel empowered to let us know if you require any adjustments to be made with your application or interview process so please speak to our recruitment team.

Similar roles