Senior Data Engineer(BQ)

Who We Are

We seek a highly skilled Senior BigQuery Data Engineer with strong Python expertise to design and deliver high-performance data solutions within OneMIS. This pivotal role supports complex reporting functions and leads the migration of on-premise data platforms to Google Cloud Platform (GCP). You will manage large-scale financial datasets, ensuring secure, compliant, and low-latency data solutions for analytics and decision-making. This role demands technical mastery, problem-solving acumen, and a deep understanding of data best practices in the financial sector

What You’ll Be Doing

• Design, develop, and maintain scalable BigQuery data warehouse solutions (architecture, schema, data modeling)

• Lead cloud-native data warehouse design and implementation to replace on-premise infrastructure

• Optimize BigQuery datasets, tables, and views for performance, cost, and governance through partitioning, clustering, query tuning, and workload management

• Build robust data processing pipelines and workflows feeding BigQuery from diverse sources

• Develop and maintain efficient ETL/ELT processes for large-volume financial data ingestion, transformation, and loading

• Implement comprehensive data quality checks, validation, and reconciliation processes

• Utilize and optimize core GCP services: BigQuery, Cloud Composer (Apache Airflow) for workflow orchestration, Dataflow (Apache Beam) for batch/streaming, and Cloud Storage

• Develop, test, and deploy high-quality Python code for data processing, automation, API integrations, and custom solutions, adhering to best practices (Git, testing, documentation)

• Explore and integrate other relevant GCP technologies (e.g., GKE, Cloud Functions, Pub/Sub) and implement security, access control, and compliance

• Collaborate with product owners, analysts, and engineering teams to align solutions with business requirements

• Actively participate in agile ceremonies and foster team collaboration

• Support data needs for BI tools (Qlik Sense, Tableau, Looker).

• Apply strong understanding of banking/financial sector data, regulations, and reporting for compliance.

What We’re Looking For

• Bachelor’s degree in Computer Science, Engineering, or related field

• At least 5+ years of data engineering experience

• Strong SQL knowledge, preferably on Google Cloud Platform (GCP).

• Expert-level Python programming skills for data manipulation, scripting, and application development.

• Proven experience with Cloud Computing, demonstrating practical application of cloud services.

• Direct hands-on experience with core GCP services: BigQuery, Cloud Composer (Apache Airflow) for DAG development/orchestration, Dataflow (Apache Beam) for batch/streaming pipelines, and Cloud Storage

• Good understanding of data warehousing concepts, data flows, and data feeds

• Experience with Git-based source control, particularly Bitbucket

• Experience working in an agile development environment with familiar agile ceremonies

• Solid understanding of the banking and financial sector, including data types and regulatory landscapes

• Ability to work collaboratively in a dynamic environment

Nice to Have:

• Experience with other GCP services (GKE, Cloud Functions, Pub/Sub, Dataproc)

• Familiarity with CI/CD pipelines and DevOps practices

• Experience with Infrastructure as Code (Terraform)

• Knowledge of data visualization tools (Qlik Sense, Tableau, Looker)

• Understanding of data governance, data quality, and metadata management

• Experience with real-time data processing