Staff Systems Engineer (Hadoop Cluster System Admi...

Staff Systems Engineer (Hadoop Cluster System Administration)

  • Location SUNNYVALE, CA
  • Career Area Information Technology
  • Job Function Information Technology
  • Employment Type -
  • Position Type -
  • Requisition 1159388BR

What you'll do at

The WalmartLabs Big Fast Data Operations team is seeking an entry-level systems administrator interested in working at the intersection of Linux system administration, Hadoop cluster system operations, and system administration automation. The Big Fast Data team operates a multi-tenant Hadoop-based computational platform utilized by many of Walmart’s data scientists and application engineering teams for their big data processing capabilities, and also leads Walmart’s initiatives to use cloud-based technologies for big data applications. We’re looking for an engineer that can help build and support our big data environment, working in areas such as hardware platform management, automation, Linux system administration, and writing web-based administrative support applications, all while participating in a pager rotation to make sure that everything is always up and running.

Responsibilities include:

* Performing system administration tasks to maintain and improve the big data environment, ranging from tactical server and operating system administration to planning and executing projects that upgrade or reconfigure online systems

* Developing software that combines open-source and custom components to simplify and automate routine big data management tasks, for example, writing command-line or web-based interfaces that automate common procedures in a user-friendly manner

* Work to investigate new big data tools and technologies and their application to common use cases and design patterns, such as big data processing using cloud-based platforms

* Providing technical assistance to a broad community of big data infrastructure users, such as software application engineers and data scientists

* Contribute to architectural decisions based on the changing needs of the cluster and its users.

* Participating in a periodic on-call pager rotation of systems operations engineers responsible for the continuous availability of Walmart’s big data infrastructure

Minimum Qualifications

* Bachelor’s degree in Computer Science, Information Technology, or related discipline, or equivalent experience
* Experience with Linux system administration, networking, storage system configuration, performance tuning
* Experience with at least one scripting language, such as bash, Python, Perl, or Ruby
* Ability to explain technical concepts to a non-technical audience
* Experience working in highly-available cluster environments.
* Experience with monitoring solutions- (e.g., ganglia, grafana, Nagios, check_mk)
* Experience with configuration management- preferably Puppet or Ansible.

Preferred Qualifications

* Experience building web-based user services using common web frameworks, such as Python/Django, PHP/Fuel, or Ruby on Rails
* Experience with SQL database systems and database technologies (e.g., MySQL, Oracle, Cassandra)
* Experience working with Hadoop big data technologies, such as Hadoop Streaming, Hive, Pig, HBase, or related technologies

About Walmart Labs

Imagine working in an environment where one experiment can catapult an entire industry toward a smarter future. That’s what we do at Walmart Labs. We’re a team of 5,000+ software engineers, data scientists, designers and product managers within Walmart, the world’s largest retailer, delivering innovations that improve how our customers shop and our enterprise operates.

Hello, Silicon Valley

You don’t have to choose between your career and your lifestyle in Silicon Valley. Here, you can have both.

Discover Silicon Valley
Silicon Valley
View of Silicon Valley from the hills after a passing storm

All the benefits you need for you and your family

  • 100% coverage for in network preventative care
  • Retirement Plan
  • Vision Plans
  • Dental Plans
  • Exclusive Discounts

Recently viewed jobs