Data Engineer
Shamrock Trading Corporation Overland Park, Kansas, United States
Truck Transportation · 1,001-5,000 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
The Data Engineer will design and maintain scalable cloud-based data pipelines and analytical platforms using Databricks and AWS services. They will collaborate with cross-functional teams to ensure data quality, governance, and the reliable delivery of business intelligence.
What they look for
Requirements
Candidates must have a bachelor's degree in a technical field and 2-4 years of experience in cloud-based data engineering. Proficiency in Databricks, Spark, Python, SQL, and AWS infrastructure is required for this role.
Benefits
Full description
About Shamrock Trading Corporation
Shamrock Trading Corporation is a family of brands that has been serving the transportation and logistics industries since 1986. Shamrock offers factoring solutions, export financing, third-party logistics, a fuel card program and trucking technology.
Shamrock’s mission since the start has been to create value and success for our customers, our partners and our people. Strong ethics, dedication to our customers and close attention to the marketplace are critical to the success and growth of the Shamrock brands. Shamrock is headquartered in Overland Park, Kansas, with multiple offices throughout the U.S. Overland Park is a great place to live, work and play, being conveniently located within driving distance of everything Kansas City has to offer. Housed within the heart of Overland Park, our offices include 4 gorgeous towers on the East and West sides of Metcalf Ave. With a heavy community presence and a winning culture, Shamrock is a great place to work in Overland Park!
Why You’ll Love Working Here
Our award-winning culture is a testament to our commitment to growth, recognition and empowerment. From day one, we prioritize employees first, encouraging them to think and act like owners and providing endless opportunities for growth and self-development, both personally and professionally. Shamrock has been recognized as one of America’s 2025 “Most Loved Workplaces” by Newsweek.
At Shamrock, we hire bright, ambitious people and give them the tools they need for a successful, long-term career here. Shamrock also offers a premier set of benefits for employees and their families:
- Training and Development: Ongoing training and professional development opportunities
- Medical: Fully paid healthcare, dental and vision premiums for employees and eligible dependents, and gym benefits
- Financial: Generous company 401(k) contributions and employee stock ownership after one year
- Work-Life Balance: Competitive PTO and fully paid time off opportunities to volunteer within your community
Regular onsite attendance is an essential function of this position. The role requires direct collaboration with cross-functional teams, real-time problem-solving, and timely responses to customer and operational needs. As a customer-facing position, onsite presence facilitates efficient communication with colleagues and subject matter experts, enabling effective service delivery and faster resolution of customer inquiries and issues. The role also requires participation in team meetings, operational processes, and occasional onsite trainings that are critical to achieving customer service objectives.
About the Role
Shamrock Trading Corporation is looking for a Data Engineer who wants to utilize their expertise in modern data platforms, microservices architectures, application programming interfaces, data pipeline development/support and analytical reporting skills by joining our Data Services team. This role is responsible for gathering and analyzing data from several internal and external sources, designing a cloud-focused data platform for analytics and business intelligence, reliably providing data to our analysts.
This role requires a significant understanding of data engineering and analytical techniques. An ideal candidate will have strong technical capabilities, business acumen, and the ability to work effectively with cross-functional teams
What You’ll Do
- Develop & Maintain Scalable Data Pipelines: Build, optimize, and maintain ETL/ELT pipelines using Databricks, Apache Spark, and Delta Lake.
- Optimize Data Processing: Implement performance tuning techniques to improve Spark-based workloads.
- Cloud Data Engineering: Work with AWS services (S3, ECS, Lambda, Glue, etc.) to design and implement robust data architectures.
- Real-time & Streaming Data: Develop streaming solutions using Kafka and Databricks Structured Streaming.
- Data Quality & Governance: Implement data validation, observability, and governance best practices using Unity Catalog or other tools.
- Cross-functional Collaboration: Partner with analysts, data scientists, and application engineers to ensure data meets business needs.
- Automation & CI/CD: Implement infrastructure-as-code (IaC) and CI/CD best practices for data pipelines using tools like Terraform, and GitHub Actions.
What You’ll Bring
- Bachelor’s degree in computer science, data science or related technical field, or equivalent practical experience
- 2-4 years of experience in data engineering, with a focus on cloud-based platforms.
- Strong hands-on experience with Databricks (including Spark, Delta Lake, and MLflow).
- Experience building and maintaining AWS based data pipelines: currently utilizing AWS Lambda, Docker / ECS, MSK, Airflow, Databricks, Unity Catalog
- Development experience utilizing one or more of the following:
- Git ecosystem (GitHub, GitLab, etc.)
- Python
- Databricks (PySpark, SQL, Spark Declarative Pipelines/DLT, Databricks Asset Bundles)
- Kafka and the Kafka Connect ecosystem (Schema Registry,Avro, etc.)
- Familiarity with CI/CD for data pipelines and infrastructure as code (GitHub Actions, Terraform)
- Strong SQL skills for data transformation and performance tuning.
- Understanding of data security and governance best practices.
- Enthusiasm for working directly with customer teams (Business units and internal IT)
What Will Set You Apart
- Proven experience with relational and NoSQL databases (e.g. Postgres, Microsoft SQL Server, MongoDB, etc.)
- Familiarity with data lakehouse architectures and optimization strategies.
- Familiarity with API architectures such as FastAPI, AWS API Gateways, and OpenAPI Specifications
- Familiarity with data visualization techniques using tools such as Databricks Dashboards, Grafana, PowerBI, and Excel.
Apply Today!
We’re so excited to connect with you! If you want to work with forward-thinking people in an award-winning culture, submit your application today.
#LI-MB1 #LI-Onsite
Having trouble submitting your application? Contact us at Recruiting@shamrocktradingcorp.com for support.
Similar roles
-
Experienced - Data Engineer DATABRICKS - NextHub Bari
Deloitte Italia Bari, Apulia, Italy · €28K–€44K/yr
-
Senior Data Engineer - Databricks Specialist
University of Otago Otago, New Zealand
-
Senior Data Engineer
UBDS Group Manchester, England, United Kingdom
-
Data Engineer
UBDS Group London, England, United Kingdom · £40K–£48K/yr
-
Data Engineer II, AWS Analytics Engineering
Amazon Seattle, Washington, United States · $132K–$179K/yr
-
Data Engineer Intern
Munich Re Singapore, Singapore, Singapore