CommIT

Senior Data Science Engineer (LLM & NLP)

CommIT Warsaw, Masovian Voivodeship, Poland

Software Development · 501-1,000 employees

Yesterday
Senior (5-10 yrs) Full-time Poland
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

You will research, develop, and deploy LLM, NLP, and ML models while owning the entire development lifecycle from problem definition to production deployment. Responsibilities include building conversational AI solutions, managing RAG pipelines, and maintaining production-ready microservices on AWS.

What they look for

LLM NLP Python Machine Learning Prompt Engineering PyTorch TensorFlow AWS Kubernetes Docker SQL NoSQL RAG Microservices Data Science Software Engineering

Requirements

The role requires 5+ years of experience in Data Science or AI Engineering with at least 3 years of hands-on experience in LLMs and NLP. Candidates must possess strong Python skills, proficiency in deep learning frameworks, and experience with containerized applications and cloud infrastructure.

Full description

An AI-driven financial technology company leveraging proprietary AI models and advanced language technologies to deliver fundamental insights on global stocks in multiple languages. Its generative AI technology is integrated into brokerage platforms and financial institutions, providing millions of investors with instant, data-driven stock analysis.

As a Senior Data Science Engineer, you will research, develop, and deploy LLM, NLP, and ML models, as well as the model-driven services powering conversational AI solutions.

You will own the entire development lifecycle — from problem definition and data exploration to model development, evaluation, and deployment of production-ready services.

Responsibilities:

  • Conversational AI & LLMs: multi-turn dialogue, context handling and answer generation over financial data; prompt engineering, structured outputs, tool use and agent workflows; RAG pipelines over financial documents; fine-tune or train own LLMs where an API model isn't the best fit; reduce hallucinations, latency and cost per request.
  • NLP models: train, fine-tune and maintain BERT-based models (intent detection, classification, entity extraction, embeddings); prepare and label data; decide when a smaller specialized model should replace an LLM call.
  • LLM services in production: Python services within a 20+ microservice system; model routing, fallbacks, retries, caching, rate-limit handling; versioned REST APIs; clean, tested code and code reviews.
  • Evaluation & monitoring: quality metrics and evaluation datasets; automated evaluation including LLM-as-a-judge and regression tests for prompt/model changes; tracing of LLM calls; experiments and A/B tests.
  • AWS: train, deploy and operate models on AWS (EKS, Lambda, S3, SageMaker, GPU instances); CI/CD for models and prompts with DevOps; track and reduce cost.
  • Collaboration: work with product, backend, DevOps and financial domain experts; contribute to architecture and modelling decisions.

Requirements

Must-have:

  • 5+ years of commercial experience in Data Science, Machine Learning or AI Engineering
  • 3+ years hands-on with LLMs and NLP
  • Strong Python, OOP and software engineering fundamentals
  • Proficient prompt engineering; experience with LLM evaluation
  • Good understanding of modern deep-learning architectures; hands-on with PyTorch or TensorFlow
  • SQL and NoSQL databases
  • Docker and containerized applications; deploying and operating services on Kubernetes
  • Daily use of AI coding tools (Claude Code, Cursor or similar)
  • Upper-Intermediate English or higher (spoken and written)
  • Fluency in Ukrainian
  • BSc or higher in Computer Science, Software Engineering or a related field

Nice to have:

  • RAG, vector databases and semantic search
  • Fine-tuning or training LLMs
  • Cloud platforms (AWS, GCP, Azure)
  • LangChain, LangGraph, LlamaIndex or similar
  • Observability: Grafana, Prometheus, Langfuse, LangSmith
  • Financial markets / fintech / trading domain knowledge
  • Mathematical optimization (LP/MILP, constraint programming)
  • Kaggle competitions