Staff Software Engineer, Big Data

Staff Software Engineer, Big Data

What you'll do at

You'll be responsible for design, development and operations of large-scale data systems operating at petabytes scale. You will be focusing on real-time indexing pipelines, streaming analytics, distributed machine learning infrastructure and other tasks as part of Search BigData team. You'll interact with the engineers, product managers and architects to provide scalable robust technical solutions.
• Design, develop, and implement large-scale distributed systems that process large volume of data; focusing on scalability, latency, and fault-tolerance in every system built.
• Design, develop, and operate web analytics solutions processing billions on daily clickstream events.
• Create systems that orchestrate and execute complex workflows in big-data pipelines.
• Evaluate and fine tune systems for speed, robustness, and cost efficiency.
• Create datasets, tools, and services supporting big data, search and machine learning operations.
• Own full life-cycle of business solutions – from requirements definition to launching in production.
• Troubleshoot business and production issues.
• Own multiple systems across the search big data platforms, and work with engineers, program managers, and engineering leaders to identify opportunities for business impact.
• Participate in setting a vision and objectives for the team in alignment with business and market needs.

Minimum Qualifications

• Bachelor's degree in Computer Science or related technical field.
• 4+ years of object-oriented programming experience in Java or Scala.
• 3+ years of experience in building of large scale data pipelines using big data technologies (i.e. Spark/Kafka/Cassandra/Hadoop/Hive/Presto/Airflow).
• 3+ years of experience in systems design, algorithms, and distributed systems.
• 3+ years of experience in scripting languages (e.g. Python), and SQL.

Preferred Qualifications:
• Large scale distributed systems experience, including scalability and fault tolerance.
• Exposure to infrastructure management tech (Docker, Kubernetes)
• Exposure to cloud infrastructure, such as Open Stack, Azure, GCP, or AWS
• A continuous drive to explore, improve, enhance, automate and optimize systems and tools.
• Strong computer science fundamentals in data structures and algorithms
• Exposure to information retrieval, statistics and machine learning.
• Excellent oral and written communication skills.

About Walmart Labs

Imagine working in an environment where one experiment can catapult an entire industry toward a smarter future. That’s what we do at Walmart Labs. We’re a team of 5,000+ software engineers, data scientists, designers and product managers within Walmart, the world’s largest retailer, delivering innovations that improve how our customers shop and our enterprise operates.

Hello, Silicon Valley

You don’t have to choose between your career and your lifestyle in Silicon Valley. Here, you can have both.

Discover Silicon Valley
Silicon Valley
View of Silicon Valley from the hills after a passing storm

All the benefits you need for you and your family

  • 100% coverage for in network preventative care
  • Retirement Plan
  • Vision Plans
  • Dental Plans
  • Exclusive Discounts

Recently viewed jobs