Data Analytics Engineer Senior

Summary:

The Data and Analytics Engineer III is responsible for design, development and implementation of optimal solutions to integrate, store, process and analyze huge data sets. This includes an understanding of methodology, design, specifications, programming, delivery, monitoring, and support standards. Individual must have extensive knowledge of designing and developing Data Warehousing ETL applications, data pipelines and delivering advanced analytics, with open source Big Data processing frameworks such as Hadoop version 2 technologies. Experience in ETL technologies like NiFi, Talend, Informatica or IBM Datastage is also preferred. Individual must have proven competency in programming utilizing distributed computing principles. The Data and Analytics Engineer Senior is also responsible for supporting the business goals and objectives for the Data Management & Analytics Department, the Information Management Organization, and the organization as a whole. 

Requirements:

• Bachelor degree in Computer Science, Engineering, Math or related field is required. Master’s degree is preferred. 
• Proficiency with Hadoop v2, MapReduce, Spark, HDFS, Python or R. 
  
• Experience with data integration in ETL technologies such as NiFi, Talend, Informatica or IBM Datastage
  
• Proficiency with Big Data querying tools, such as Pig, Hive, and Impala. 
  
• Experience with messaging systems, such as Kafka or MQ
  
• Knowledge of Hadoop cluster management, with all included services 
  
• Experience with building stream-processing systems, using solutions such as Flume, Storm or Spark-Streaming is preferred.
  
• Good understanding of Lambda Architecture 
  
• Advanced level of SQL programing and query performance tuning techniques for Data Integration and Consumption using design for optimum performance against large data asset within an OLTP, OLAP and MPP architecture. 
  
• Solid understanding of BI and analytics landscape, preferable in large-scale development environments. 
  
• Must have the communication skills and ability to develop and present solutions to all levels of management (including executive levels). 
  
• Must have demonstrated the ability to solve complex problems with minimal direction. 
  
• Must be able to interact effectively and patiently with customers especially while under pressure. 
  
• The ability to work on multiple projects/tasks simultaneously to meet project deadlines for self and others as required. 
  
• Ability to establish and maintain positive working relationships with other employees. 
• Minimum of six (6) years of experience in MapReduce, Spark programming NiFi, Talend, Informatica or IBM Datastage. 
  
• Minimum of six (6) years of experience developing analytics solutions with large data sets within an OLAP and MPP architecture. 
  
• Minimum of Ten (10) years of experience with design, architecture and development of Enterprise scale platforms built on open source frameworks. 
  
• Certifications in Hadoop or Java are a plus. 
  

Work Type: 

Full Time