Senior Software Engineer - Hadoop
- Location SAN BRUNO, CA
- Career Area Software Development and Engineering
- Job Function Software Development and Engineering
- Employment Type -
- Position Type -
- Requisition 1331782BR
What you'll do at
• Resolve issues related to several data platform components and open source database solutions like Presto/Druid or cloud native components
• Resolve issues related to commercial tools and products, which are an integral part of platform
• Be a gate keeper to ensure sanity of production systems
• Builds tools to continuously monitor and alert platform components & data pipelines • Continually improve CI/CD tools, processes and procedures
• Participate in ongoing design, implementation, and maintenance of systems and tools across our data platform
• Write and maintain infrastructure documentation
• Own production incidents/issues and provide level 2 response to infrastructure incidents and alerts
You have a deep interest and passion for production systems, one who loves to debug issues, learn new technologies and write quick utilities to manage and maintain platform. You have strong problem solving, analytical skills, decision-making and communication skills. You are self-driven and motivated with the desire to work in a fast-paced, results-driven agile environment with varied responsibilities. Also to ensure highest degree of support for this critical platform, you must be willing to be part of a team that supports 24x7 on rotation basis.
• Bachelor's/Master's Degree with 6-10 yrs. of experience in Computer Science or related streams
• 3+ years of experience of managing data platform, ETL pipelines
• Strong understanding of internals of at least 1 distributed processing framework like Map reduce, Hive, or Spark
• Strong understanding of continuous integration, deployment and operations concepts
• Experience with code repositories (Git) and continuous integration tools (Jenkins, Maven) and software provisioning and deployment automation tools (Ansible)
• Excellent knowledge of Linux system
• Experience with configuration management
• Experience with a UNIX shell scripting languages such as Bash, Ruby, Perl or Python
• System administration exposure
• Experience in building scalable/highly available distributed systems in production a plus
• Ability to work with distributed teams in a collaborative and productive manner
• A self-motivated learner and builder with strong customer focus and obsession with quality
About Walmart Labs
Hello, Silicon Valley
You don’t have to choose between your career and your lifestyle. In Silicon Valley, you can have both.Discover Silicon Valley
Fioli Gardens, Woodside
View an art exhibit, take a nature hike, explore the historic Filoli House, or take a class at this gorgeous 654–acre property.
Get your art fix at this internationally recognized collection of over 30,000 works of modern and contemporary art.
Computer History Museum
Large-scale exhibits, an acclaimed speaker series, docent-led tours and an award-winning education program bring computer history to life.
Hike or jog throughout the year on terrain dedicated to academic programs, environmental restoration and habitat conservation.
Golden Gate Park, SF
Events, attractions, meadows, lakes, and a Japanese Tea Garden provide for a true escape, without leaving the city.
The Tech Museum
This family-friendly interactive science and technology center in San Jose provides a glimpse into the most inventive place on Earth — Silicon Valley.
Santana Row - San Jose
Stylish boutiques, world-class shopping, and delectable cuisine = a San Jose shopping trifecta.
Pacifica State Beach
Learn to surf or visit the “World’s Most Scenic Taco Bell” at this 0.75 mile long crescent shaped escape, a symbol of successful habitat restoration.
Golden Gate Cemetery
This national cemetery comprises 161 acres dedicated to all the members of the armed forces who served our country.
All the benefits you need for you and your family
- 100% coverage for in network preventative care
- Retirement Plan
- Vision Plans
- Dental Plans
- Exclusive Discounts