Lead Data Engineer – Content Platform

Chewy is hiring a Lead Data Engineer for our Content Platform team in Minneapolis, MN Or Boston , MA.

This is a high-profile position that will have exposure across the entire business, influencing the vision and implementation of architecture, design and features for this critical business line.

As part of a dynamic team, this role offers a tremendous opportunity for professional growth in the leading online pet retailer in the US.

The role will allow you to act as an individual contributor as part of a team of strong engineers building services for competition Engine and delivery mechanism to allow for full operationalization of targeting as an evergreen strategy used to drive high value actions (HVA) and improve the overall site experience for Chewy customers.

.

The role will have tremendous visibility in the technology & business organization of Chewy

What youll do:

• Develop, train, deploy, evaluate and refine data pipelines for ML/DL models at scale in a production environment.

• Implement data-driven solutions in a production environment using tools such as Hadoop, Hive, Spark, and Kafka

• Explore structured/unstructured data sources and deliver ‘quick wins’ by building robust data pipelines for ML/DL models

• Write simple and sustainable code that reflects a constant understanding of the business impacts.

• Act in the capacity of a Data engineer to actively participate in the definition, design, development, testing and implementation of Data Pipelines using the Agile methodology

• Create or modify complex programs, modules, routines, scripts and data objects from a detailed design where efficiency, performance and reliability are critical

• Work with and advise both business and technology teams (internal and external) on how best to implement desired features and enhancements

• Ensure that technical solutions follow best practices, are reliable, are easily maintainable and are scalable under sustained load

• Participate in design and code reviews

• Collaborate to identify, isolate and resolve malfunctions related to software

• Conduct knowledge transition on solutions to the designated application support team(s)

• Create and evolve application documentation as required

• Operate in compliance with IT standards, policies, procedures, and best practices

• Work in an agile development environment and collaborate with multiple teams while experimenting with new technologies helping create solutions that puts Chewy on the cutting edge.

What youll need:

• 8+ Years 
– Active development experience with Python, Anaconda, Spark, Hive, Kafka.

• 4+ Years experience in Relational database and No-SQL development

• 6+ Tears of Experience Big Data (in Hadoop), data warehousing, consumer analytics and near real time data processing (Spark Streaming)

• 8+ Hands-on experience in developing and managing development of Data Integration applications with experience in both batch and online systems.

• Have experience building a data integration tool

• Experience working across fully automated stacks in a CI/CD ecosystem

• Experience with distributed data stores at scale

• Hands-on experience leading the design, development, and deployment of business software at scale

• Be a hands-on Engineer spending significant percentage of their time writing code or debugging tricky issues.

• Knowledge of professional software engineering practices for the full software development life cycle including coding standards, code reviews, source control management, build processes, testing, and operations

• Experience mentoring and training the engineering community on complex technical issues

• Sharp analytical abilities and proven design skills & a working knowledge of design patterns

• Experience with cloud & orchestration technologies (AWS Services, Terraform, Ansible, etc.)

• Have or (more importantly) be willing to learn deep domain knowledge in the area of retail e-commerce.

• Strong verbal and written communication skills

• BS degree in Computer Science, a similar technical field of study, or equivalent practical experience