Hadoop Engineer

Hadoop MAP R Engineer

5 to 10 years - duration

London - Hybrid 2-3 days onsite

£525 - £550 INSIDE IR35

Job Description: 

• Troubleshoot problems , able to guide the team thru issues and provide guidelines, best practice to keep the clusters up and running. Able to review pull requests and changes proposed by other team members. Provide technical implementation guidelines. Make sure Amadeus standard are followed: change management and security . Drive the PCI-DSS audit on the clusters with the auditor. Install new MapR version and clusters.
• Able to do day to day activities linked to the run of the cluster: capacity and quota management, adding / removing nodes from the cluster, first level investigation, OS management. Automation and scripting : Ansible / Puppet for the management of the clusters, stored in GIT repositories

MapR (Hadoop) ecosystem: skill set

• Yarn / Spark / Hadoop / Oozie ( no Impala )
• 1 cluster Mapr7 using FS
• 2 clusters Mapr 6 ( multi-tenants ) for applications using bigdata solutions
• RHEL 7/8 for the OS

Configuration Management and Automation

• MEP ecosystem
• Ansible ( + AWX )
• Puppet
• Git / Bitbucket + Jenkin
• BMC Blade logic
• Monitoring, Incidents, & Alerting: Amadeus ARGOs / Thanos
• Logging : splunk
• Security
• IAM
• Active Directory,
• MapR Qualys vulnerability scanning
• stack under PCI auditing