Business Intelligence Engineer: IV (Lead)

nn nn Description: nn nn n n This is an exciting opportunity to be part of the Data & Analytics Delivery Organization at Client.

Client is going through a digital transformation and insights from our data are driving the transformation of Client Group into a Luxury Customer Platform and providing the best customer experience across all our brands.n n We are looking for a Senior Data Engineer that will have the unique combination of business acumen needed to interface directly with key stakeholders to understand the problem along with the skills and vision to translate the need into a world-class technical solution using the latest technologies.

You will be in a hands-on role and responsible for building data engineering solutions for NMG Enterprise using cloud-based data platform.

You will provide day-to-day technical deliverables and participate in technical design, development, and support for data engineering workloads.n n Job Requirements n Understand and Analyze data from multiple data sources and develop technology to integrate the enterprise data layern Create robust and automated pipelines to ingest and process structured and unstructured data from source systems into analytical platforms using batch and streaming mechanisms leveraging cloud native toolsetn Work activity includes processing complex data sets, leveraging technologies used to process these disparate data sets and understanding the correlations as well as patterns that exist between these different data setsn Implement orchestrations of data pipelines and environment using Airflown Implement custom applications using the Kinesis, Lambda and other AWS toolset as required to address streaming use casesn Implement automation to optimize data platform compute and storage resourcesn Develop and enhance end to end monitoring capability of cloud data platformsn Participate in educating and cross training other team membersn Provide regular updates to all relevant stakeholdersn Participate in daily scrum calls and provide clear visibility to work productsn n Job Requirements n BS in Computer Science or related fieldn 6+ years of experience in the data engineering and analytic spacen 5+ years of Python experience.

Solid programing experience in Python
– needs to be an expert in this 4/5 level.

(Must have strong Python skills, along with lambdas and Airflow Dag processing.)n 5+ years of RDBMS concepts with strong data analysis and SQL experiencen 4+ years of Linux OS command line tools and bash scripting proficiencyn 1+ year of experience working on Big Data Processing Frameworks and Toolsn Exposure to software engineering such as parallel data processing, data flows, RESTn APIs, JSON, XML, and micro service architecturesn Certification preferably AWS Certified Big Data or any other cloud data platforms, big data platformsn n Nice to have: n Kubernetes and Docker experience a plusn Prior working experience on data science work benchn Knowledge of machine learning pipelines (e.g., train/test splitting, scoring process, etc.)n n