Software Engineer III

Software Engineer III

What you'll do at

Ingest raw Clickstream data from omniture and home grown solutions at walmart. Build scalable data pipelines to cleanse and transform the data and meet the SLAs. Make the data available for consumption in reporting tools like Tableau and Thoughtspot to facilitate decision making and planning. Migrating data to newer infrastructure and technologies including cloud based solutions.

• Work closely with the Clickstream Data Analytics business and Product Manager to understand the business requirements and translate it into technical design
• Collaborate with project stakeholders and technical teams to identify scope, plan user stories for each sprint and effectively communicate status, issues/blockers, risks
• Design and develop data pipeline to pull information from heterogeneous data sources and ingest into Data lake to help with Clickstream Data Analytics Reporting using Hadoop (Hive, Spark), relational databases, MPP databases and related technologies
• Design and develop Data Quality/Audit framework to Audit the data movement and provide data lineage from Source to Data Lake
• Design and develop workflow using CA Automic platform for data pipeline automation
• Design and develop reports and dashboards using business Intelligence tools like Tableau and Thoughtspot
• Create and maintain data models in data modelling tools like Erwin.
• Create reusable scripts in Unix and Python as needed to accomplish tasks.
• Perform unit testing, integrated testing and fix issues and bugs discovered during testing
• Develop Templates/standards for re-usability
• Review code developed and ensure data quality and standards are followed
• Identify performance issue in the batch jobs, identify the bottleneck and fine-tune the jobs to meet SLAs
• Maintain code in centralized code repository and promote code for QA and Production environments
• Co-ordinate with off-shore team for project deliverables
• Be available to support production jobs and analyze the root cause of issues and failures.

Minimum Qualifications

Minimum education and experience required:
Master’s degree or equivalent in Computer Science, Software Engineering, or related field and 2 years of Data engineering and analytics experience.

Skills Required:
Experience in building high volume, scalable, reliable and reusable software components in realistic timelines, adhering to development goals and principles. Hands-on experience implementing large-scale Data Warehouse projects, with Hadoop development experience using Hive. Hands-on experience in Hive SQL with query optimization, relational databases (RDBMS), database concepts, dimensional modeling and database design. Demonstrated knowledge of Data Modelling in Hive using tools like Erwin. Experience in MPP DB’s like Teradata and related utilities. Hands on experience building data pipelines using ETL tools. Experience with Business Intelligence tools like Business Objects, Tableau and Thoughtspot. Experience in Scripting using unix shell script & python.Experience in designing, developing and scheduling jobs using Automic.

Should have domain knowledge in website traffic analytics. Should have experience in working with cross functional teams. Should demonstrate flexibility in working with geographically distributed teams. Should have experience in working with product management and agile methodologies. Should have experience supporting production data pipelines and availability for on call support.

About Walmart Labs

Imagine working in an environment where one experiment can catapult an entire industry toward a smarter future. That’s what we do at Walmart Labs. We’re a team of 5,000+ software engineers, data scientists, designers and product managers within Walmart, the world’s largest retailer, delivering innovations that improve how our customers shop and our enterprise operates.

Hello, Silicon Valley

You don’t have to choose between your career and your lifestyle in Silicon Valley. Here, you can have both.

Discover Silicon Valley
Silicon Valley
View of Silicon Valley from the hills after a passing storm

All the benefits you need for you and your family

  • 100% coverage for in network preventative care
  • Retirement Plan
  • Vision Plans
  • Dental Plans
  • Exclusive Discounts

Recently viewed jobs