Director, Big Data Infrastructure

Director, Big Data Infrastructure

What you'll do at

We’re looking for a leader that has extensive experience building big data applications using the Hadoop ecosystem and related technologies, both on traditional clusters and cloud platforms, to collaborate with our internal product development teams constructing scalable and performant big data applications using cloud-based infrastructure.

You’ll interact with the engineers, product managers and architects to provide scalable robust technical solutions.

Minimum Qualifications

• Collaborating closely with application team architects and engineers to identify technologies and platforms suitable for their big data processing requirements, and then assisting those teams with onboarding, development, deployment, and debugging on those platforms
• Effectively handle multiple initiatives and be accountable for delivering multiple releases on schedule with highest quality standards
• Investigating new big data tools and technologies for their potential application to common use cases; establishing best practices, developing design patterns, and working with platform engineers and product managers to specify and deliver new major technology features
• Technical Leadership: Drive high-level architectural decisions and designs based on business priorities and requirements. Lead the team in providing technical vision and guidance to a broad community of big data infrastructure users, such as software application engineers and data scientists, through research, investigation, collaboration, and hands-on debugging, often driven by specific use case requirements. Ensure that application big data solutions adhere to best practices and enterprise standards for scalability, availability, efficiency, data lifecycle management, information security, fault tolerance, and disaster recovery
• People Management: Coach and mentor first-level managers and tech leads. Identify, implement, and communicate best practices for engineering. Build a high-performance team

Preferred Qualifications

• Hands-on experience with managing and optimizing big data processing systems using Hadoop Streaming, Hive or Spark; ODBC/JDBC connectivity such as HiveServer and Thrift; and streaming data management using Kafka
• Familiarity with the strengths, weaknesses, and idiosyncrasies of big data solutions of cluster-based platforms (e.g., Hortonworks, Cloudera, and MapR) as compared to as cloud resource providers (e.g., Google Cloud Platform, Microsoft Azure, and similar object storage and ephemeral compute paradigms)
• Experience building and nurturing high-performing big-data engineering and/or infrastructure teams

About Walmart Labs

Imagine working in an environment where one experiment can catapult an entire industry toward a smarter future. That’s what we do at Walmart Labs. We’re a team of 5,000+ software engineers, data scientists, designers and product managers within Walmart, the world’s largest retailer, delivering innovations that improve how our customers shop and our enterprise operates.

Hello, Silicon Valley

You don’t have to choose between your career and your lifestyle. In Silicon Valley, you can have both.

Discover Silicon Valley
Silicon Valley
View of Silicon Valley from the hills after a passing storm

All the benefits you need for you and your family

  • 100% coverage for in network preventative care
  • Retirement Plan
  • Vision Plans
  • Dental Plans
  • Exclusive Discounts

Recently viewed jobs