Data Engineer
TestYantra Software Solutions Krakow, Lesser Poland Voivodeship, Poland
Software Development · 501-1,000 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Design and build a robust data model and pipelines for an enterprise Knowledge Catalogue. Collaborate with cross-functional teams to ensure data quality, lineage, and effective integration with knowledge management services.
What they look for
Requirements
Requires proven experience as a Data Engineer with strong proficiency in SQL, Python, and data-processing technologies. Candidates should have practical knowledge of data governance, metadata management, and experience integrating complex data systems.
Full description
We’re looking for a Data Engineer to build the data model and pipelines that underpin Client’s enterprise Knowledge Catalogue and Knowledge Manager experience. You’ll organise and connect information about domains, sub-domains, Knowledge Stewards, projects, sources, ownership, overlaps, status and lifecycle, making it easier for users and approved applications to discover, understand and consume trusted knowledge.
What you’ll do
- Design and build the Knowledge Catalogue data model covering domains, sub-domains, Stewards, projects, sources, ownership, overlaps, status and lifecycle.
- Develop reliable pipelines to ingest, transform, enrich and maintain catalogue information from approved platform and BGI sources.
- Integrate catalogue data with Knowledge Manager, metadata, ontology, quality, publication, search and retrieval services.
- Implement data-quality, lineage, provenance, access and lifecycle controls to keep catalogue information trusted and current.
- Enable catalogue capabilities for browsing, semantic discovery, knowledge context, feedback and knowledge-health insights.
- Work with Knowledge Source Analysts, Knowledge Stewards, architects, engineers and BGI project teams to agree data requirements and resolve quality or ownership issues.
- Contribute to APIs, testing, monitoring, documentation and operational processes for catalogue data services.
What you need to have to succeed in this role
- Proven experience as a Data Engineer or in a similar role delivering production-grade data models and pipelines.
- Strong experience with SQL, Python and data-processing technologies, including structured and semi-structured data.
- Experience designing data models and pipelines for catalogues, metadata, data governance, knowledge management or enterprise platforms.
- Practical understanding of data quality, lineage, provenance, ownership, access controls and lifecycle management.
- Experience integrating data through APIs, databases, event streams or cloud data platforms.
- Familiarity with knowledge graphs, ontologies, semantic search, graph databases or vector platforms is advantageous.
- Experience with data catalogues, search platforms, workflow tools or enterprise information systems is desirable.
- Strong collaboration and communication skills, with the ability to work across product, architecture, engineering, Knowledge Steward and BGI teams.
Similar roles
-
Senior Data Engineer II
Oscar Health New York, New York, United States · $181K–$237K/yr
-
Data Engineer
AcuityMD $113K–$159K/yr
-
Staff Data Engineer, Analytics
Afresh San Francisco, California, United States · $168K–$250K/yr
-
Data Engineer - Agentic AI
Defense Unicorns Springfield, Virginia, United States · $149K–$201K/yr
-
Senior Data Engineer
Southend Pharmacy Houston, Texas, United States · €45K–€65K/yr
-
Senior Data Engineer (Talent Pool)
ioet San José de Alluriquín, Santo Domingo de los Tsáchilas, Ecuador