I

Data Engineer – Oil & Gas

ITMates United States

Services et conseil en informatique · 2-10 employés

Oct 01
Remote data-engineer Senior (5-10 yrs) Contractor United States
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

You will build and maintain batch and streaming data pipelines to ingest field, sensor, and ERP data into a cloud lakehouse. Additionally, you will model data for analytics and collaborate with reservoir and production engineers to optimize pipeline performance.

What they look for

SQL Python Spark Databricks Snowflake Kafka Airflow dbt Data Engineering Time-series data IoT Azure AWS Data Modeling OSIsoft PI OPC UA

Requirements

Candidates must have at least 5 years of data engineering experience with strong proficiency in SQL, Python, and Spark. Experience with cloud data stacks, orchestration tools, and high-volume time-series data is required.

Full description

Client: oil and gas company (upstream operator, Houston HQ) · Location: remote, LATAM, Houston business hours · Level: senior · Engagement: full-time contractor

You will build the pipelines that move well, production and sensor data from the field into a cloud lakehouse used by engineers and analysts.

What you will do

  • Ingest time-series data from SCADA and historians (OSIsoft PI, OPC UA) alongside ERP and production accounting sources
  • Build batch and streaming pipelines on Databricks or Snowflake with Spark, Kafka and Airflow
  • Model data in a medallion architecture for production, drilling and maintenance analytics
  • Enforce data quality, lineage and access controls
  • Work with reservoir and production engineers to turn their questions into datasets
  • Optimize pipeline cost and performance

What you bring

  • 5+ years in data engineering
  • Strong SQL and Python, plus Spark in production
  • Experience on Azure or AWS data stacks
  • Orchestration with Airflow or similar, and dbt for transformations
  • Experience with high-volume time-series or IoT data
  • Advanced English

Nice to have

  • Oil and gas domain knowledge (WITSML, PPDM, OSDU)
  • PI System integration experience
  • Spanish or Portuguese for work with LATAM operations

Similar roles