U

AI Platform Support Engineer

UtiliSave LLC New York, New York, United States · $65K–$80K/yr

Financial Services · 11-50 employees

5 h ago
Remote support-engineer Mid (2-5 yrs) Full-time United States
Log in to apply, save this posting, or score it against your profile with AI.

About the role

The AI Platform Support Engineer will maintain and optimize the production AI Assistant Platform, including managing RAG pipelines and refining LLM agent behavior. They will also collaborate with cross-functional teams to triage issues, document technical processes, and support data extraction workflows.

What they look for

AI platform support RAG pipelines LLM agent behavior Prompt engineering Python JavaScript SQL AWS Amazon Bedrock Amazon Q Business AWS Textract Data pipelines Vector databases JIRA Cloud storage management Technical documentation

Requirements

Candidates should have 2–4 years of experience in AI/ML, cloud platforms, or data engineering, with proficiency in Python or JavaScript and SQL. A strong understanding of LLM concepts, RAG systems, and cloud services like AWS is required, along with excellent communication skills.

Benefits

Health insurance Dental insurance Vision insurance 401(k) with company match Generous PTO 11 paid holidays

Full description

About UtiliSave Join a team that has delivered over $700 million in refunds and savings to clients-and help us reach $1 billion. For over three decades, UtiliSave has been a leader in utility bill auditing and cost recovery. As our company rapidly expands its investment in AI and cloud technology, we're seeking an AI Platform Support Engineer to help build, maintain, and grow our production AI platform.

About the Role This is a ground-floor opportunity to grow alongside a company in the middle of a major AI and technology transformation. Reporting directly to the AI Lead, you will work hands-on with our AI Assistant Platform, which leverages large language models, retrieval-augmented generation (RAG), and embedding-based search to serve auditor and operational workflows. Our current production stack runs on AWS (Amazon Bedrock, Amazon Q Business, AWS Textract, and S3), but we value strong fundamentals in AI engineering over exclusive expertise in any single cloud.

This is a full-time position with exciting growth potential. The ideal candidate is an energetic and curious team player, comfortable learning new technologies quickly, and brings initiative to a fast-moving environment. This role offers a clear path to grow into senior AI engineering or platform architect responsibilities as we scale..

Key Responsibilities

- Support the day-to-day operation and maintenance of the AI Assistant Platform, including monitoring system health, triaging issues, and coordinating fixes with the development team.

- Build and maintain RAG pipelines-chunking, embedding generation, vector indexing, retrieval tuning, and evaluation-to keep the knowledge base accurate and relevant.

- Configure and refine LLM agent behavior, including instruction tuning, tool/Action Group testing, and prompt engineering to improve answer quality for auditor queries.

- Assist with data pipeline tasks including metadata extraction, JSON generation, SQL loading, and semantic indexing.

- Coordinate and execute testing cycles for AI features, collect structured feedback from auditors, and track resolution in JIRA.

- Support document extraction workflows for utility bill processing, validating accuracy and expanding template coverage to new formats.

- Evaluate, pilot, and recommend emerging AI tools and capabilities (e.g., Claude Code, Claude for Excel, Cursor IDE, Amazon Bedrock Agent Core) for adoption across the organization.

- Maintain technical documentation for AI platform components, data flows, agent configurations, and operational runbooks.

- Assist with cloud storage organization, data source management, and cost optimization across AI services.

- Support future integration between the AI platform and CRM by helping define data exchange interfaces and testing data flows.

- Collaborate cross-functionally with auditors, developers, and leadership to translate business needs into AI platform improvements.

How to Apply Email your resume and a short note describing:

•          Your experience with AI tools, cloud platforms, or data pipelines.

•          A technical challenge you solved and what you learned from it.

•          What excites you about working on a production AI platform.

Send materials to recruiting@utilisave.com with the subject line “AI Platform Support Engineer.”

Qualifications

- 2–4 years of experience in a technical role involving AI/ML tools, cloud platforms, data engineering, or software development support.

- Solid working knowledge of modern AI and LLM concepts, including prompt engineering, retrieval-augmented generation (RAG), embeddings, vector databases, and agent-based architectures.

- Demonstrated experience building or operating RAG or embedding-based systems (from prototype to production).

- Hands-on experience with at least one major cloud platform (AWS, Azure, or GCP). Experience with AWS AI services (Bedrock, Q Business, Textract, S3) is a strong plus, but equivalent experience on other clouds is welcome.

- Proficiency in Python (preferred) or JavaScript for scripting, data processing, and automation.

- Experience with SQL databases for querying, loading data, and basic schema design.

- Familiarity with AI-assisted development tools such as Cursor IDE, Claude Code, or GitHub Copilot.

- Familiarity with work-tracking tools such as JIRA, Azure DevOps, or similar.

- Strong communication skills, with the ability to document technical processes and communicate status to both technical and non-technical stakeholders.

- Self-starter mentality, strong curiosity about AI advancements, and a willingness to learn quickly.

- High attention to detail when working with data pipelines, configurations, and testing workflows.

- Exposure to document extraction/OCR tools is a plus.

- Bachelor's degree preferred but not required; equivalent hands-on experience accepted.

Compensation and Benefits

•          Competitive base salary (starting target range: $65,000–$80,000) plus performance-based bonus.

•          Comprehensive benefits, including health, dental, and vision insurance, 401(k) with company match.

•          Generous PTO plus 11 paid holidays.

•          Job Type: Fully remote role. Work Hours 9–6 PM EST, must be based in US in a state with no more than 1 hour time difference from EST. Must be authorized to permanently work in US, with no need for visa support.

Similar roles