Data Engineer

Data Engineer

  • Location SAN BRUNO, CA
  • Career Area Data Science and Analytics
  • Job Function Data Science and Analytics
  • Employment Type -
  • Position Type -
  • Requisition 1292334BR

What you'll do at

We are hiring for Data Engineer/Machine Learning Engineer at all levels to join our data science team, which comprises of data engineers and data scientists. Our team is chartered with developing statistical and machine learning models and building a robust platform to enable the application of data science to in-store technology. We work closely with each other and the business stakeholders at Walmart. Data scientists and Data Engineers in our team participate in the full life cycle of model development, which spans from business problem discovery to model deployment and monitoring.

Specifically, data engineers will:
• Work with business stakeholders to understand the business requirements and the data available to solve the corresponding problems
• Work with very large data sets and build large scale data processing platforms, implement data governance and operational controls, solve complex performance challenges and build robust ETL pipelines
• Gather and process raw data at scale from different business domains, build real time data ingestion pipeline into a data lake in Hadoop/Google Cloud/other cloud solutions
• Influence teams to improve data infrastructure in a product work-oriented environment
.• Build automated deployments of databases and machine learning models
• Implement controls, processes and best practices in data engineering
• Build tools and automation to facilitate and collect metrics for data and operational governance, data lineage, data quality and monitoring.
• Be proactive and take ownership of the projects and tasks assigned
• Provide and support the implementation of business solutions
• Collaborate with other data scientists and data engineers in our team
• Lead small and participate in large project teams
• Coach junior members and share knowledge with the broader team
• Continue to widen and deepen data engineering and data analytics skill sets
• Live by our Company culture and values

Minimum Qualifications

Bachelor of Science and 2 years' data science experience OR Master of Science and 1 years' data science experience.

Preferred Qualifications

2+ years of relevant industry experience
• Experience in engineering scalable data platforms using technologies including Spark (batch/streaming), Hadoop, Hive, HBase, Kafka, Airflow.
• Experience in building data output streams and API’s using Java and Kafka
• Development experience with Python, Java
• Solid hands-on experience in building data pipelines, deploying and managing Big Data infrastructure, working with large structured and unstructured data sets
• Experience in Relational databases, Data Warehousing, SQL, ETL and/or NOSQL databases.• Strong verbal and written communication skills

About Walmart Labs

Imagine working in an environment where one experiment can catapult an entire industry toward a smarter future. That’s what we do at Walmart Labs. We’re a team of 5,000+ software engineers, data scientists, designers and product managers within Walmart, the world’s largest retailer, delivering innovations that improve how our customers shop and our enterprise operates.

Hello, Silicon Valley

You don’t have to choose between your career and your lifestyle. In Silicon Valley, you can have both.

Discover Silicon Valley
Silicon Valley
View of Silicon Valley from the hills after a passing storm

All the benefits you need for you and your family

  • 100% coverage for in network preventative care
  • Retirement Plan
  • Vision Plans
  • Dental Plans
  • Exclusive Discounts

Recently viewed jobs