Big Data Developer

Big Data Developer Full-time Irvine, CA or Irving, TX Job Description: * This role needs to be well versed with innovation and trends in the world of data processing which includes data management, data quality and data curation.* The Senior Pro Data Engineering is passionate about all things data, data processing as well as the desire to turn data processing into a competitive advantage.* The work activity includes processing complex data sets, leveraging technologies used to process these disparate data sets and understanding the correlations as well as patterns that exist between these different complex data sets.* Works closely with other teams/ members of the team to develop solutions to meet business requirements, perform assessments, POC’s and establish an execution/ development plan.* Forecasts technical challenges and develop implementation strategies.* Identifies enabling technologies and has the skills to develop solutions based on identified technologies as required* Prepares and presents white papers and proposals.* Employs lateral thinking to develop innovative solutions to meet business needs * Ability to communicate complex technical ideas in a straightforward and compelling way Job Qualifications: * ?8+ years of experience in area of data management and/or data curation* Experienced with data normalization and denormalization techniques* Experienced in implementing largescale event based streaming architectures* Experienced in data encryption, data security, data transformation and data archiving techniques* Experience with Hadoop, Spark batch, Hive, Presto, Kafka, Pivotal Cloud Foundry* Experience with Relational SQL and NoSQL databases* Experience with GCP cloud services such as DataProc, GCE, GKEetc.* Experience with Stream-processing systems such as Storm and Spark-Streaming* Experience with Object-oriented/object function scripting languages such as Python, Java, Scala.* Experienced with Java, Angular JS, Spring Cloud/Spring Boot, Kafka, Spark, Hive* Knowledge of API and Microservice development* Working knowledge of cloud architectures on AWS or GCP* Experienced in Agile methodology and/or pair programming* Knowledge of AI/Client concepts and technologies* Strong communication skills* Strong writing and documentation skills* Experienced in working with cross functional teams, building alignment and collaboration* BA/BS in Computer Science or related field, or equivalent experience