Azure Data Engineer

Position Data Engineer Location Denver CO Duration10 Months Client TransAmerica Positions 3 Candidate Expectations Experience with building optimal data pipeline architectures on Azure platform.

Experience in Implementing developing Azure Databricks clusters, notebooks, jobs.

Working knowledge on Azure Data Factory, Azure DataLake Gen2, Azure functions, Logic Apps.

Develop real-time processing by using Stream Analytics and Azure Databricks.

Develop batch processing solutions by using Data Factory and Azure Databricks.

Hands on Experience Integrating data from DataLake to Azure SQL Data Warehouse(Synapse) using ADF polybase.

Should be a skilled engineer helping customer teams to build the data foundations to drive their Analytics business use cases.

Experience with Ingesting and integrating data from a large number of disparate data sources.

Knowledge of RDBMS, ETL and Data warehouse technologies.

Ability to understand complex business processes.

Experience with one or more languages Python Pyspark, T-SQL, Spark, Scala.

Experience with pyspark Spark SQL.

Ability to work with large volumes of data from multiple sources.

Strong understanding of Azure environment (PaaS, IaaS) and experience in working with Hybrid model.

Assist business users on functional and data requirements to enhance data models and pipelines.

Basic Qualifications 2 years of experience with Azure SQL, Azure Synapse and other Cloud Data Services.

2 years of experience with version control and DevOps or DataOps.

3 years programming with SQL, Python, Scala or R.

3 years developing, deploying, and testing data pipelines in Azure.

3 years of data engineering with Hadoop, Spark, Databricks, SSIS or other data integration tool.

3 years of working experience with SQL Server, data warehousing and data analytics projects.

If any one interested please reach out 508-407-7221