Data Management Engineer Cloud ETL Sr
Softtek Colombia
IT Services and IT Consulting · 10,001+ employees
About the role
The Data Management Engineer will analyze and translate business requirements into SQL-based data validation controls and quality checks. They will also develop, optimize, and maintain scalable data solutions using Python, PySpark, and Databricks while collaborating with stakeholders to ensure data governance compliance.
What they look for
Requirements
Candidates must hold a bachelor's degree in a relevant field and possess at least 3 years of experience in data engineering or data management. Strong proficiency in SQL, Python, PySpark, and experience with cloud-based data platforms are required for this role.
Full description
Data Management Engineer - Cloud
Required – Soft Skills
· Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field.
· Minimum of 3 years of experience in Data Engineering, Data Quality, Data Management, or related disciplines.
· Strong hands-on experience with SQL, Python, and PySpark.
· Experience working with Databricks and cloud-based data platforms.
· Experience developing, consuming, and integrating REST APIs.
· Solid knowledge of data validation, testing methodologies, and Data Quality practices.
· Experience translating business requirements into technical data validation and quality controls.
· Experience designing, developing, and optimizing scalable data solutions.
· Experience performing unit testing, data validation, and business validation activities.
· Experience creating and maintaining technical and functional documentation.
· Strong analytical and problem-solving skills.
· Strong verbal and written communication skills.
· Ability to collaborate effectively with business stakeholders and cross-functional teams.
· Ability to manage multiple priorities in a fast-paced environment.
· Advanced English proficiency.
Nice to Have – Technical Skills
· Experience with Collibra Data Quality & Observability (DQ&O).
· Knowledge of Data Governance and Data Management best practices.
· Experience working within Financial Services or other highly regulated industries.
· Familiarity with cloud ecosystems such as Microsoft Azure, AWS, or similar cloud platforms.
· Experience supporting enterprise-scale Data Quality initiatives and migration projects.
· Knowledge of Data Governance frameworks, metadata management, and data stewardship practices.
Responsibilities (Activities to be Performed)
· Analyze existing Data Quality rules, logic, and business requirements.
· Translate business requirements into SQL-based data validation controls and quality checks.
· Develop, optimize, and maintain solutions using SQL, Python, and PySpark.
· Implement and configure Data Quality controls within Collibra Data Quality & Observability (DQ&O).
· Design, develop, and integrate REST APIs to support data validation, automation, and system integrations.
· Leverage Databricks and cloud-native technologies to develop scalable Data Quality solutions.
· Perform unit testing, data validation, reconciliation, and business validation activities.
· Collaborate with business stakeholders to review findings, validate outcomes, and refine Data Quality rules.
· Create and maintain technical, operational, and functional documentation.
· Support the migration, validation, and deployment of more than 200 enterprise Data Quality controls.
· Execute migration activities using a standardized and reusable migration framework.
· Coordinate migration waves across multiple business domains and stakeholder groups.
· Monitor implementation quality and ensure compliance with Data Quality standards and governance requirements.
· Contribute to continuous improvement initiatives related to Data Quality processes and controls.
Required Languages
· English: Advanced
Additional Information
Travel Requirements
· Not specified.
Special Conditions
· Contract: Initial 3-month contract, with the possibility of extension based on project needs and performance. Full-time dedication
· Work Modality: Hybrid / Remote (to be defined according to business needs).
· Location: Colombia