Lead AWS Data Engineer

Job Title: Lead AWS Data Engineer

Location: Miami, Florida or Irving, Texas (Hybrid)

Duration: Contract to Hire

A Career that Empowers You to Build Your Future The Lead Data Engineer is responsible for overseeing the data engineering team and driving the strategic direction of data initiatives. The role involves managing projects, ensuring the scalability of data solutions, and collaborating with stakeholders to meet organizational goals.

Your Responsibilities on the Team

• Lead

and manage the data engineering team, including project planning, resource allocation, and performance management.

• Develop

and enforce data engineering standards, processes, and best practices, ensuring consistency and quality across all data projects.

• Collaborate

with stakeholders, including business leaders, data scientists, and IT teams, to understand and prioritize data-related business needs and translate them into actionable technical requirements.

• Ensure

data solutions are scalable, secure, and aligned with the long-term goals of the organization, considering both current and future data needs.

• Drive

the adoption of new technologies, tools, and methodologies that improve the efficiency, reliability, and scalability of data engineering practices.

• Oversee

the development and maintenance of comprehensive data documentation, including data architecture diagrams, process flows, and technical specifications.

• Manage

the team's technical debt, ensuring that legacy systems are modernized and that new solutions are built with maintainability and scalability in mind.

• Provide

technical leadership in the resolution of complex data issues, guiding the team in troubleshooting and problem-solving efforts

Knowledge

• Extensive

experience with data pipeline orchestration tools (e.g., Apache Airflow, Luigi) and data integration platforms (e.g., Apache NiFi, Glue).

• Strong

leadership and project management skills, with experience leading cross-functional teams and managing multiple projects simultaneously.

• Expertise

in cloud data platforms (AWS) and big data ecosystems, with a focus on optimizing cost, performance, and scalability.

• Proficient

in advanced data modeling, including the design of enterprise data warehouses, data lakes, and data marts.

• In-depth

knowledge of data governance practices, including data cataloging, data lineage, and data quality management.

• Experience

with enterprise data management frameworks, such as Master Data Management (MDM) and metadata management.

• Advanced

skills in programming and scripting languages (e.g., Python, Java, Scala) for developing and automating data workflows.

• Experience

with real-time data processing and event-driven architectures, leveraging tools such as Apache Kafka, Spark Streaming, and AWS Lambda.

Your Toolbox

• Bachelor's

or Master's degree in Computer Science, Information Technology, or a related field.

• 7-10

years of experience in data engineering, with significant leadership and project management experience.

• AWS,

Snowflake, Azure

• AWS

Glue, AWS AppFlow, Prefect, dbt, S3, Qlik

• SQL,

Python, Java

• Exceptional

ability to influence and engage senior leaders with data-driven insights.

• Expert

in resolving complex, high-stakes problems with innovative solutions.

• Leads

with a collaborative spirit, driving team success through shared goals.

• Sets

the standard for integrity within the organization, fostering a culture of trust and ethical behavior.

• Demonstrates

unwavering resilience in the face of adversity, guiding the team through challenges.

• Acts

as a change agent, leading transformative initiatives that drive business success.

• Leads

and coordinates efforts across multiple departments, ensuring alignment with organizational goals.

• Provides

visionary leadership, inspiring and developing future leaders within the organization.

• Establishes

a culture of accountability, ensuring that all team members meet their commitments and deliver high-quality work.