Bright Vision Technologies

Senior Data Engineer

Bright Vision Technologies Menlo Park, California, United States

Information Technology & Services · 11-50 employees

20 h ago
Remote data-engineer Principal (10+ yrs) Contractor Visa sponsorship United States
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

The Senior Data Engineer will lead hands-on development for large-scale enterprise cloud migration and modernization programs. They will design and manage data pipelines, workflows, and data lake architectures using modern big data technologies.

What they look for

PySpark Spark Cloudera Data Platform Apache Iceberg Apache Airflow SQL Data Modeling ETL ELT Git CI/CD DevOps Data Engineering Big Data Cloud Migration Data Lake

Requirements

Candidates must have a bachelor's degree and over 10 years of IT experience, including at least 6 years in Data Engineering and Big Data. Proficiency in PySpark, SQL, Apache Airflow, and Cloudera Data Platform is required.

Full description

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title: Senior Data Engineer Location: 100% Remote (U.S.) Experience Required: 10+ years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.Job Summary

The ideal candidate is a hands-on developer with deep technical expertise in modern data engineering technologies and experience working in large-scale enterprise cloud migration and modernization programs.

Required Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
  • 10+ years of IT experience with 6+ years in Data Engineering and Big Data development.
  • Strong hands-on experience with PySpark and Spark-based data processing.
  • Experience developing data pipelines on Cloudera Data Platform (CDP).
  • Strong knowledge of Apache Iceberg table architecture and data lake concepts.
  • Experience designing and managing workflows using Apache Airflow.
  • Experience with SQL and data modeling techniques.
  • Strong understanding of ETL/ELT development and data transformation frameworks.
  • Experience working with large-scale structured and unstructured datasets.
  • Knowledge of Git, CI/CD pipelines, and DevOps practices.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Excellent communication and collaboration skills.

Preferred Qualifications

  • Experience with AWS services including S3, Glue, Lambda, ECS/EKS, EMR, RDS, IAM, and CloudWatch.
  • Experience building cloud-native data lake and Lakehouse solutions.
  • Strong knowledge of data partitioning, performance tuning, and query optimization.
  • Experience with Kafka or event-driven data processing frameworks.
  • Experience with Java or Python application development.
  • Experience implementing data quality, metadata, and data governance solutions.
  • Healthcare, Medicaid, Claims Processing, or Insurance industry experience.
  • Experience working in Agile development environments.
  • AWS Certification and/or Cloudera Certification preferred.
  • Experience supporting large-scale cloud migration and modernization initiatives.

How to Apply Would you like to know more about this opportunity? For immediate consideration, please send your resume to venkat.r@bvteck.com or contact us at (908) 505-3899. Learn more about Bright Vision Technologies at www.bvteck.com. Bright Vision Technologies is an Equal Opportunity Employer.  Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.

Similar roles