Staff Software / Hadoop Backend Engineer
- Location SUNNYVALE, CA
- Career Area Software Development and Engineering
- Job Function Software Development and Engineering
- Employment Type -
- Position Type -
- Requisition 1212098BR
What you'll do at
You'll be responsible for design, development and operations of large-scale data systems operating at terabyte scale. You will be focusing on real-time data ingestion/streaming, batch ETL/pipeline building, distributed machine learning infrastructure and other tasks as part of Personalization data science and engineering team. You'll interact with the engineers, product managers and architects to provide scalable robust technical solutions.
- Design, develop, and implement large-scale distributed systems that process large volume of data; focusing on scalability, latency, and fault-tolerance in every system built.
- Create systems that orchestrate and execute complex workflows in big-data pipelines.
- Evaluate and fine tune systems for speed, robustness, and cost efficiency.
- Design features and models from structured and unstructured data.
- Create datasets, tools, and services supporting big data and analytics operations.
- Interact with engineers, product managers and architects to provide scalable robust technical solutions and troubleshoot business and production issues.
- Own full life-cycle of business solutions from requirements definition to launching in production.
- Bachelor's degree in Computer Science or related field and 8+ years industry experience, or Master's degree in Computer Science or related field and 4+ years industry experience.
- 4+ years of object-oriented programming experience in Java or Scala.
- 3+ years of experience in building of large scale data pipelines using big data technologies (i.e. Spark/Kafka/Storm/Hadoop/Cascading/Apache Hive/Pig Latin).
- 3+ years of experience in systems design, algorithms, and distributed systems.
- 3+ years of experience in scripting languages (e.g. Python, Bash), and SQL.
- Strong computer science fundamentals in data structures and algorithms
- Experience with Continuous Integration and related tools
- Experience in building large scale distributed systems with scalability and fault tolerance.
- Experience in multi-cloud production environment deployment and maintenance.
- Strong experience in debugging, performance tuning and optimization for scalability and high availability.
- A continuous drive to explore, improve, enhance, automate and optimize systems and tools.
- Passion for performance debugging and benchmarking
- Excellent oral and written communication skills.
About Walmart Labs
Hello, Silicon Valley
You don’t have to choose between your career and your lifestyle in Silicon Valley. Here, you can have both.Discover Silicon Valley
Filoli Gardens, Woodside
View an art exhibit, take a nature hike, explore the historic Filoli House, or take a class at this gorgeous 654–acre property.
Get your art fix at this internationally recognized collection of over 30,000 works of modern and contemporary art.
Computer History Museum
Large-scale exhibits, an acclaimed speaker series, docent-led tours and an award-winning education program bring computer history to life.
Hike or jog throughout the year on terrain dedicated to academic programs, environmental restoration and habitat conservation.
Golden Gate Park, SF
Events, attractions, meadows, lakes, and a Japanese Tea Garden provide for a true escape, without leaving the city.
The Tech Museum
This family-friendly interactive science and technology center in San Jose provides a glimpse into the most inventive place on Earth — Silicon Valley.
Santana Row - San Jose
Stylish boutiques, world-class shopping, and delectable cuisine = a San Jose shopping trifecta.
Pacifica State Beach
Learn to surf or visit the “World’s Most Scenic Taco Bell” at this 0.75 mile long crescent shaped escape, a symbol of successful habitat restoration.
Golden Gate Cemetery
This national cemetery comprises 161 acres dedicated to all the members of the armed forces who served our country.
All the benefits you need for you and your family
- 100% coverage for in network preventative care
- Retirement Plan
- Vision Plans
- Dental Plans
- Exclusive Discounts