Senior Data Engineer

Work Location: Fulton, Maryland or Washington DC

Experience: 10 + years

Role Description

The candidate must be a hands-on Data Engineer with the ability to lead the work, engage directly with the client, understand requirements, and design and develop effective solutions. The role also requires Oracle/PL/SQL development and database-modernization experience, including migration from Oracle to PostgreSQL in the cloud. Strong communication and the ability to collaborate effectively are essential.

Technical Requirements

• Data Pipeline Development: Design, implement, and manage robust data pipelines using Python, PySpark, and SQL to efficiently extract, transform, and load data from diverse batch and streaming sources.
• AWS Expertise: Demonstrate expertise in core AWS services such as AWS DMS, AWS Glue, AWS Step Functions, Amazon S3, Amazon Redshift, Amazon RDS, Amazon EMR, AWS IAM, and AWS Lambda, and apply them to build scalable and reliable data solutions.
• Data Modeling: Develop and maintain efficient data models to support analytical and reporting needs.
• Oracle/PL/SQL Development: Develop, maintain, troubleshoot, and optimize Oracle database objects and PL/SQL components, including stored procedures, packages, functions, triggers, views, and complex SQL queries.
• Oracle-to-PostgreSQL Cloud Migration: Assess Oracle schemas and PL/SQL code, identify compatibility gaps, convert database objects and SQL logic to PostgreSQL, and support cloud migration planning, data validation, testing, performance tuning, cutover, and post-migration stabilization.
• Database Management: Administer databases using AWS services such as Amazon RDS or Amazon Redshift, with a focus on schema design, performance optimization, and monitoring.
• Data Warehousing: Use Amazon Redshift or Snowflake to create high-performing analytical databases that support data-driven decision-making.
• ETL Best Practices: Implement industry best practices for ETL processes, including data validation, error handling, and data-quality checks.
• Performance Optimization: Optimize query performance through continuous database tuning and effective use of AWS scalability capabilities.
• Monitoring and Logging: Establish robust monitoring and logging mechanisms using AWS CloudWatch, AWS CloudTrail, or comparable tools to ensure pipeline reliability.
• Security and Compliance: Follow security best practices and applicable compliance standards, tailoring solutions to meet GDPR, HIPAA, or other regulatory requirements.
• Automation: Automate deployment and scaling of data pipelines using infrastructure-as-code tools such as AWS CloudFormation and Terraform.
• Collaboration: Collaborate closely with cross-functional teams, including data scientists, analysts, and other stakeholders, to understand their data needs and provide effective solutions.
• Continuous Learning: Stay current with developments in AWS services and data-engineering methodologies and apply new insights to enhance the data infrastructure.

Soft Skills

• Strong communication skills and the ability to work effectively with diverse technical and business groups.

Benefits

We offer a competitive and comprehensive benefits package that includes the following:

• Medical/Prescription Drug Plan
• Dental Plan
• Vision Plan
• Basic Life Insurance
• Accidental Death & Dismemberment Insurance
• Short Term Disability Insurance
• Long-Term Disability Insurance
• 401K Retirement Plan
• Flexible Spending
• Employee Assistance Program (EAP)
• Voluntary Supplemental Health, Life and Legal Benefits
• Paid time off and Holidays

If you are eager to become part of our team, and make a difference through impactful projects, don't miss this chance!

Reveal Global Consulting is an Equal Opportunity Employer. We believe that every employee has the right to be treated with dignity and respect. Consequently, we will not discriminate based on age, race, creed, color, sex, national origin, citizenship, disability, marital status, or any other protected characteristic. Our management team is dedicated to ensuring full compliance of this policy with respect to recruitment, advertising, hiring, placement, promotion, rates of pay, or other forms of compensation, selection for training, layoffs, termination, and general treatment during employment. All individuals have unique abilities.

We encourage you to visit our website at www.revealgc.com to learn more about Reveal Global Consulting.