Description

The Data Engineer on WW Grocery Stores Tech will be pivotal in architecting and implementing scalable, high-performance data solutions that power critical decision-making processes. This role will involve close collaboration with Software Development Engineer (SDE) teams, Business Intelligence Engineers, functional teams, and third-party partners to source and integrate data from various sources, including real-time streams. The ideal candidate will possess a strong technical background, a passion for solving complex problems, and the ability to thrive in a fast-paced, collaborative environment.

Key job responsibilities

• Design and implement scalable, fault-tolerant data pipelines to ingest, process, and analyze large volumes of data from diverse sources, including third-party APIs and real-time streams.

• Collaborate closely with core technology SDE teams to integrate data pipelines with existing systems and applications, ensuring seamless data flow and interoperability.

• Partner with Business Intelligence Engineers to understand business requirements and deliver actionable insights through well-architected data solutions.

• Work closely with functional teams to identify data needs and provide technical guidance on data-related initiatives.

• Establish and maintain strong relationships with third-party partners to source data via APIs and other external sources, ensuring data quality and reliability.

Implement best practices for data governance, security, and compliance to protect sensitive data and ensure regulatory compliance.

• Monitor data pipelines for performance, reliability, and scalability, proactively identifying and addressing issues to minimize downtime and optimize performance.

• Stay abreast of emerging technologies and trends in data engineering, and evaluate opportunities for innovation and improvement.

About the team

We enable sophisticated, fact-based decision making across WWGDT by delivering constantly evolving technology and analytic capabilities. This team will solve challenging and novel problems every day and have the opportunity to redefine the grocery industry while collaborating with multiple teams across WWGDT and WholeFoods Market(WFM). You will be able to enjoy and contribute to the unique blend of Amazon and WFM Tech culture. You will be based out of Austin, TX, one of the best places to live and work. Most importantly, you’ll be contributing to WFM's Higher Purpose of Nourishing People and the Planet!

We are open to hiring candidates to work out of one of the following locations:

Austin, TX, USA

Basic Qualifications

• 4+ years of data engineering experience

• Experience with data modeling, warehousing and building ETL pipelines

• Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions

• Knowledge of distributed systems as it pertains to data storage and computing

Preferred Qualifications

• Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)

• Knowledge of batch and streaming data architectures like Kafka, Kinesis, Flink, Storm, Beam

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.