Systems Software Engineer, Data Team (Big Fast Dat...

Systems Software Engineer, Data Team (Big Fast Data Tech)

What you'll do at

As a Systems Software Engineer on our BFD (Big Fast Data) Tech Team, you will be working on large scale systems that enable the efficient processing and analysis of big data at the Walmart scale. We will develop various tools to enable Walmart to make data-driven decisions and speed the delivery of revenue generating services. With a huge customer base around the globe, a career at Walmart will give you opportunities to make people’s lives better.

BFD Tech's full-stack approach and end-to-end team responsibility mean that you will be involved in building an entire system from design, implementation, packaging and deployment to user and developer support. The specific challenges will vary from one system to the next, but expect BFD themes to include large scale data processing, real-time distributed systems, cluster resource management, and working with key data that powers Walmart. Expect to dive into the open source community, whether as adoptee or contributor, to take on any project you need to make it do your bidding----or take on new code to push the frontier of what's possible.

Position Description
• Design, prototype and develop reusable tools for the processing and analysis of petabytes of data
• Work on the next generation resource management frameworks
• Work on the Hadoop/Spark ecosystem projects
• Work with and further develop open-source software such as Apache Yarn, Apache Hive, Apache Mesos, Apache Spark, and more
• Be at the forefront of solutions for distributed processing, live-data-stream computation, real-time indexing, capacity planning, and performance tuning

Minimum Qualifications

• BS/MS/PhD in Computer Science, Computer Engineering, CSE, ECE, or related field
• Passionate about building massively scalable infrastructure
• Extensive experience working with large scale data processing
• Strong proficiency in developing and debugging C/C++ and/or Java on *nix
• Extensive Unix/Linux systems-programming experience
• Past experience with distributed databases, distributed systems, server architectures and file systems is also a huge plus

Preferred Qualifications

The Desired Skill-set:
• Expertise in distributed/scalable systems and algorithms with awareness of time and space complexity
• Strong background in process design for reliable systems; strong "big picture" awareness of systems
• Good generalist experience, with ability and willingness to read and write into all layers of the software stack
• Experience working with operations or with deployment, monitoring, and other sustainable operation of software
• Working knowledge of standard tools for optimizing and testing code; a plus to have experience building tools/apps, software libraries/frameworks, and/or working with custom-built tools

About Walmart Labs

Imagine working in an environment where one experiment can catapult an entire industry toward a smarter future. That’s what we do at Walmart Labs. We’re a team of 5,000+ software engineers, data scientists, designers and product managers within Walmart, the world’s largest retailer, delivering innovations that improve how our customers shop and our enterprise operates.

Hello, Silicon Valley

You don’t have to choose between your career and your lifestyle. In Silicon Valley, you can have both.

Discover Silicon Valley
Silicon Valley
View of Silicon Valley from the hills after a passing storm

All the benefits you need for you and your family

  • 100% coverage for in network preventative care
  • Retirement Plan
  • Vision Plans
  • Dental Plans
  • Exclusive Discounts

Recently viewed jobs