Staff Software / Hadoop Backend Engineer

Staff Software / Hadoop Backend Engineer

What you'll do at

The @WalmartLabs Personalization team consists of platform, application engineers, scientists and product visionaries all working together to design, prototype and build technology-driven products and experiences that will change the future landscape of ecommerce. We are focused on building the global service layer that will enable the end-to-end customer experience, from finding the product to delivering it to the customer. This will span many markets, business models and form factors; therefore, we are looking for engineers who will bring not only an abundance of experiences in technologies, but an abundant curiosity to innovate.

You'll be responsible for design, development and operations of large-scale data systems operating at terabyte scale. You will be focusing on real-time data ingestion/streaming, batch ETL/pipeline building, distributed machine learning infrastructure and other tasks as part of Personalization data science and engineering team. You'll interact with the engineers, product managers and architects to provide scalable robust technical solutions.

  • Design, develop, and implement large-scale distributed systems that process large volume of data; focusing on scalability, latency, and fault-tolerance in every system built.
  • Create systems that orchestrate and execute complex workflows in big-data pipelines.
  • Evaluate and fine tune systems for speed, robustness, and cost efficiency.
  • Design features and models from structured and unstructured data.
  • Create datasets, tools, and services supporting big data and analytics operations.
  • Interact with engineers, product managers and architects to provide scalable robust technical solutions and troubleshoot business and production issues.
  • Own full life-cycle of business solutions from requirements definition to launching in production.

Minimum Qualifications

  • Bachelor's degree in Computer Science or related field and 8+ years industry experience, or Master's degree in Computer Science or related field and 4+ years industry experience.
  • 4+ years of object-oriented programming experience in Java or Scala.
  • 3+ years of experience in building of large scale data pipelines using big data technologies (i.e. Spark/Kafka/Storm/Hadoop/Cascading/Apache Hive/Pig Latin).
  • 3+ years of experience in systems design, algorithms, and distributed systems.
  • 3+ years of experience in scripting languages (e.g. Python, Bash), and SQL.
  • Strong computer science fundamentals in data structures and algorithms
  • Experience with Continuous Integration and related tools

Preferred Qualifications

  • Experience in building large scale distributed systems with scalability and fault tolerance.
  • Experience in multi-cloud production environment deployment and maintenance.
  • Strong experience in debugging, performance tuning and optimization for scalability and high availability.
  • A continuous drive to explore, improve, enhance, automate and optimize systems and tools.
  • Passion for performance debugging and benchmarking
  • Excellent oral and written communication skills.

About Walmart Labs

Imagine working in an environment where one experiment can catapult an entire industry toward a smarter future. That’s what we do at Walmart Labs. We’re a team of 5,000+ software engineers, data scientists, designers and product managers within Walmart, the world’s largest retailer, delivering innovations that improve how our customers shop and our enterprise operates.

Hello, Silicon Valley

You don’t have to choose between your career and your lifestyle in Silicon Valley. Here, you can have both.

Discover Silicon Valley
Silicon Valley
View of Silicon Valley from the hills after a passing storm

All the benefits you need for you and your family

  • 100% coverage for in network preventative care
  • Retirement Plan
  • Vision Plans
  • Dental Plans
  • Exclusive Discounts

Recently viewed jobs