Sr Data Engineer

Lowe’s Technology organization believes that in-person collaboration is highly effective and helps build relationships and strengthens our culture.

As such, we are leveraging an Open Office approach in how we work, meaning our tech associates will leverage time in the office to focus on highly collaborative activities as well as some remote / work from home time for autonomous endeavors.

Each role has different business-driven collaboration needs that will require in-office presence.

Job Summary:

The primary purpose of this role is to translate business requirements and functional specifications into
logical program designs and to deliver modules, stable application systems, and Data or Platform solutions.

This includes developing, configuring, or modifying complex integrated business and/or enterprise infrastructure or application solutions within various computing environments.

This role facilitates the implementation and maintenance of complex business and enterprise Data or Platform solutions to ensure successful deployment of released applications.

Key Responsibilities:

• Translates complex cross-functional business requirements and functional specifications into logical program designs, modules, stable application systems, and data solutions; partners with Product Team to understand business needs and functional specifications
• Collaborates with cross-functional teams to ensure specifications are converted into flexible, scalable, and maintainable solution designs; evaluates project deliverables to ensure they meet specifications and architectural standards
• Guides development teams in the design and build of complex Data or Platform solutions and ensures that teams are in alignment with the architecture blueprint, standards, target state architecture, and strategies
• Coordinates, executes, and participates in component integration (CIT) scenarios, systems integration testing (SIT), and user acceptance testing (UAT) to identify application errors and to ensure quality software deployment
• Participates and coaches others in all software development end-to-end product lifecycle phases by applying and sharing an in-depth understanding of complex company and industry methodologies, policies, standards, and controls
• Has solid grasp of software design patterns and approaches; understands application level software architecture; makes technical trade-off decisions at application level
• Automates and simplifies team development, test, and operations processes; develops detailed architecture plans for large scale enterprise architecture projects and drives the plans to fruition
• Solves complex architecture/design and business problems; solutions are extensible; works to simplify, optimize, remove bottlenecks, etc.
• Provides mentoring and guidance to more junior level engineers; may provide feedback and direction on specific engineering tasks

Data Engineering Responsibilities

• Executes the development, maintenance, and enhancements of data ingestion solutions of varying complexity levels across various data sources like DBMS, File systems (structured and unstructured), APIs and Streaming on on-prem and cloud infrastructure; demonstrates strong acumen in Data Ingestion toolsets and nurtures and grows junior members in this capability
• Excels in one or more domains; understands pipelines and business metrics and develops expertise on cloud-based data stacks and pipeline development
• Builds, tests and enhances data curation pipelines integration data from wide variety of sources like DBMS, File systems, APIs and streaming systems for various KPIs and metrics development with high data quality and integrity
• Supports the development of feature / inputs for the data models in an Agile manner; Hosts Model Via Rest APIs; ensures non-functional requirements such as logging, authentication, error capturing, and concurrency management are accounted for when model hosting
• Works with Data Science team to understand mathematical models and algorithms; recommends improvements to analytic methods, techniques, standards, policies and procedures; participates in continuous improvement activities including training opportunities; trains others
• Works to ensure the manipulation and administration of data and systems are secure and in accordance with enterprise governance by staying compliant with industry best practices, enterprise standards, corporate policy and department procedures; handles the manipulation (extract, load, transform), data visualization, and administration of data and systems securely and in accordance with enterprise data governance standards
• Maintains the health and monitoring of assigned data engineering capabilities that span analytic functions by triaging maintenance issues; ensures high availability of the platform; monitors workload demands; works with Infrastructure Engineering teams to maintain the data platform; serves as an SME of one or more application

Qualifications

Minimum Qualifications:

• Bachelors Degree in Engineering, Computer Science, CIS, or related field (or equivalent work experience in a related field)
• 5 years of experience in Data, BI or Platform Engineering, Data Warehousing/ETL, or Software Engineering
• 4 years of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC)

Data Engineering Qualifications

• 3 years of experience in Hadoop or any Cloud Bigdata components (specific to the Data Engineering role)
• Expertise in Java/Scala/Python, SQL, Scripting, Teradata, Hadoop (Sqoop, Hive, Pig, Map Reduce), Spark (Spark Streaming, MLib), Kafka or equivalent Cloud Bigdata components (specific to the Data Engineering role)

Preferred Qualifications:

• In most cases Lowe’s will not be able to provide sponsorship for roles located in the Tech Hub
• Experience with Apache Presto and/or Apache Druid
• Masters Degree in Computer Science, CIS, or related field
• 5 years of IT experience developing and implementing business systems within an organization
• 5 years of experience working with defect or incident tracking software
• 5 years of experience writing technical documentation in a software development environment
• 3 years of experience working with an IT Infrastructure Library (ITIL) framework
• 3 years of experience leading teams, with or without direct reports
• 5 years of experience working with source code control systems
• Experience working with Continuous Integration/Continuous Deployment tools
• 5 years of experience in systems analysis, including defining technical requirements and performing high level design for complex solutions

Lowe’s is an equal opportunity affirmative action employer and administers all personnel practices without regard to race, color, religion, sex, age, national origin, disability, sexual orientation, gender identity or expression, marital status, veteran status, genetics or any other category protected under applicable law.