TestYantra Software Solutions

Data Engineer

TestYantra Software Solutions Krakow, Lesser Poland Voivodeship, Poland

Software Development · 501-1,000 employees

Yesterday
Remote data-engineer Senior (5-10 yrs) Contractor Poland
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design and build a robust data model and pipelines for an enterprise Knowledge Catalogue. Collaborate with cross-functional teams to ensure data quality, lineage, and effective integration with knowledge management services.

What they look for

Data Engineering SQL Python Data Modeling Data Pipelines Data Governance Metadata Management Knowledge Management API Integration Data Quality Data Lineage Knowledge Graphs Ontologies Semantic Search Cloud Data Platforms Workflow Tools

Requirements

Requires proven experience as a Data Engineer with strong proficiency in SQL, Python, and data-processing technologies. Candidates should have practical knowledge of data governance, metadata management, and experience integrating complex data systems.

Full description

We’re looking for a Data Engineer to build the data model and pipelines that underpin Client’s enterprise Knowledge Catalogue and Knowledge Manager experience. You’ll organise and connect information about domains, sub-domains, Knowledge Stewards, projects, sources, ownership, overlaps, status and lifecycle, making it easier for users and approved applications to discover, understand and consume trusted knowledge.

What you’ll do

  • Design and build the Knowledge Catalogue data model covering domains, sub-domains, Stewards, projects, sources, ownership, overlaps, status and lifecycle.
  • Develop reliable pipelines to ingest, transform, enrich and maintain catalogue information from approved platform and BGI sources.
  • Integrate catalogue data with Knowledge Manager, metadata, ontology, quality, publication, search and retrieval services.
  • Implement data-quality, lineage, provenance, access and lifecycle controls to keep catalogue information trusted and current.
  • Enable catalogue capabilities for browsing, semantic discovery, knowledge context, feedback and knowledge-health insights.
  • Work with Knowledge Source Analysts, Knowledge Stewards, architects, engineers and BGI project teams to agree data requirements and resolve quality or ownership issues.
  • Contribute to APIs, testing, monitoring, documentation and operational processes for catalogue data services.

What you need to have to succeed in this role

  • Proven experience as a Data Engineer or in a similar role delivering production-grade data models and pipelines.
  • Strong experience with SQL, Python and data-processing technologies, including structured and semi-structured data.
  • Experience designing data models and pipelines for catalogues, metadata, data governance, knowledge management or enterprise platforms.
  • Practical understanding of data quality, lineage, provenance, ownership, access controls and lifecycle management.
  • Experience integrating data through APIs, databases, event streams or cloud data platforms.
  • Familiarity with knowledge graphs, ontologies, semantic search, graph databases or vector platforms is advantageous.
  • Experience with data catalogues, search platforms, workflow tools or enterprise information systems is desirable.
  • Strong collaboration and communication skills, with the ability to work across product, architecture, engineering, Knowledge Steward and BGI teams.

Similar roles