Senior Devops Engineer
Propertyfinder Group
Total des années d'expérience :16 years, 3 Mois
Working in AWS as the main platform, simplified the infrastructure to remove extra layers of unnecessary caching.
Implemented Akamai as the main caching layer for all seven countries web platform.
Improved and Implemented deployment CI/CD pipeline for all services .
Improved docker based PR environments to reduce deployment time .
Implemented parallel pipeline for code UnitTests.
DNS migration to and from AWS and Akamai dns service.
Implemented high availability for all services being used in stack e.g
Elasticsearch/rabbitmq/memcached etc
Implemented and improved montoring using sensu for all three categories of monitoring.
Implemented from scratch ECS based deployment pipeline.
Updated and implemented Jenkins DSL to maintain Jenkins jobs as a code base
Upgraded Jenkins from 1.6 to 2.3
Implemented service deployment automation (using Ansible) for each service individually to make them as independent as possible.
Migrated Puppet to Ansible for consolidation and less complexity reasons.
Working in an agile continuous delivery environment.
Working in AWS as the main platform.
Improved Nagios and Splunk monitoring dashboard by implementing automation
Implemented PCI DSS standards for Tomcat/Java based service.
Application and Infrastrucure security audit and automated improvements implementation.
Consolidation of Cloudformation Templates using troposphere.
Working in agile setup to improve service performance and automated deployment flow.
Implemented backup scripts for all services to have automated restore points.
Setup DR design and strategy to guarantee one hour recovery time.
Setup replication strategy between Oracle11g intra region.
Implemented high availability for all services running in the stack.
Implemented Ansible as the main CM tool as there was not automation being used for deployments and standardisation
Implemented Foreman to launch infrastructure resources using a wrapper API for Vmware.
Implemented automation for monitoring registration/deregistration of services and resources.
Setup monitoring to cover all three categories i.e host level, service level and performance based.
Migrated to AWS infrastructure from Vmware setup using lift and shift and a bit of re organising the infrastructure setup.
Setup vpn networking from AWS VPC to office based Cisco end points to have seamless networking.
Improved and maintained Jenkins setup for introducing more deployment and work flows for
stabilising the overall infrastructure.
Cloudreach is an AWS solutions consultancy company which not only advises in AWS services but also provides DevOps solutions to its customers. I am working as AWS platform engineer taking care of different projects which involves different companies on different scales to migrate services from their current data centres or any infrastructure to AWS services. This role not only involves lift and shift of infrastructures to AWS but also evaluation of the best possible solution with the best performing AWS services according to
the requirements.
Main objectives for most of projects I am involved with were:
Main objectives for most of projects I am involved with are:
Design a secure, scalable, operationally robust infrastructure (primarily on AWS).
Develop solutions that are cloud-agnostic where possible. Ensuring we design solutions with a balance on operations and development.
Continuously improve and refine the build and deployment process.
Provide leadership on best technology and process practice to drive the operations team forward.
Projects :
Kamarama BT failover lamp stack built in AWS with stack coding provided by Kamarama using
AWS EC2, RDS. The stack was then load tested by AWS bees with machine guns and scanned for
vulneribilites using Nessus scanner to make sure its secure and robust enough to handle the required
traffic.
News International device applications (Sun Goals, Times Sports and Sun News ) stack
infrastructure built on AWS to support different functionalities and required traffic using AWS EC2,
Cloudformation, RDS, IAM and S3 services, code running was Ruby on RAILS with a combination
of Nginx and Unicorn monitored by Monit. Code being deployed via Git repos.
Kantar Web application Globalpark migration to AWS with support of bootstrapped chef recipes
using the cloudformation template. AWS technologies used, RDS, EC2, EBS and CF templating.
Sky infrastructure support and migration of applications backend to AWS. Building environment
through cloudformation templating then configuration management via chef . Applications/Services
migrated include DNS, Cassandra, Hazelcast, Quova, Logstash, Rsyslog and bespoke java
applications . Completed a sub project of transition from chef to Ansible .
ITV infrastructure rebuild, providing complete solution architecture I.e High Availability, Disastor
Recovery, Backup/Restory and continuous integration for services such as
DNS/Puppet/Foreman/Monitoring-Sensu/RabbitMq/Mysql and micro services. Automation of all services.
Originally started the role to support the LAMP architecture of the www.lovefilm.(se|de|no|dk|com)
websites and supporting the whole infrastructure based on Linux (RedHat and SuSe). Designing solutions
around the following: LAMP ( Perl based code mod_perl), Intrusion Detection Systems (IDS), system
security, data centre rack installation and remote system management, inc. HP ILO and HP Insight Systems
Manager, Amazon AWS (EC2 ) management and complete administration sometimes used RightScale,
XEN staging architecture. Including server UNIX (Linux), storage, security, Apache httpd service
management, configuration and installation / proxy services such as HAPROXY, Loadbalancers,
experience building resilient server solutions inc. mail servers (Postfix), performance / fault monitoring via
Nagios and Ganglia while maintaining both to be reliable and granular (SNMP, Nagios and Ganglia),
change control (ITSM, Remedy and Jira). Also was involved in perl and CPAN module management and
deployment. Backups \[using Amanda and Zamanda solutions\]. Auto configuration tool CFENGINE
configuration and management used to manage automation of new hosts and rapid deployments. RedHat
RPM creation/modification and deployment using internal custom configured repositories. Also responsible
for intermediate MySql issues for eg replication or memory issues and patching. Running several queries to
gather required information. Managed memcache and gearman which were being used in the environment
for swift database access.
Projects :
* Continuous remote deployment of linux hosts using PXE/Kickstart with updated configurations
according to requirements and then post configurations to ensure consistency in remote regional
* DC’s (mission critical servers in a 24x7 environment)
Was heavily involved then in migration of the whole Lovefilm infrastructure to Amazon
infrastructure which involved to learn the full Amazon architecture first and then get involved in
migration tasks such as building servers migrating services one by one liaising with the rest of teams
to support them in migration tasks, it was nearly a 8 month project and during that supporting the
current Lovefilm architecture 24x7 was mandatory.
Set up monitoring in two different tools used by Amazon translating from Nagios
* Migrating CPAN modules used by Lovefilm to Amazon internal supporting tool.
After the successful migration of Lovefilm DE and GB websites I was involved with two team
members to work on migrating Nordics regions which was different as the Nordics was using
Amazon EC2 infrastructure.
Started working in Blackberry NOC looking after the whole Blackberry infrastructure for EMEA region.
As a NOC Systems Administrator, responsible for the Linux/Windows servers/services supporting the whole blackberry infrastructure also monitoring networking components (Cisco) equipments for any abnormality using monitoring softwares (SMARTS, BigBrother, Remedy, OpsWare). After spending seven months there I was promoted to the position Service Engineering Specialist in the Logging department taking care of storage and logging infrastructure for whole Blackberry traffic including administering of more then 500+ spread globally in Data centres in (North America, USA, France, China, Belgium). Deployment and support of core logging infrastructure, performing software implementations and upgrades, resolving and documenting service incidents, capacity management validation, maintaining highly resilient and business critical systems, testing and certifying new technologies and working within the defined change management processes to plan and schedule changes.
Completing requests from other teams, resolving issues and planning changes using a centralized interface (Remedy Action Request System).
Linux/Unix troubleshooting for any problems involving SLES distro for eg IO wait issues, performance issues, load balancing DNS, working with 30TB of data per day
Basic familiarity with Oracle architecture, basic knowledge of SQL and Oracle tools. Providing internal support to the reporting architecture which is built on Oracle.
Conducted interviews to hire new team members plus training them one to one on regular team operations process.
Advance Routing, Network Simulation (Opnet), Virtual Private Networks, Wireless Lans, Network Security, Wireless Communications (All courses CISCO based) Dissertation: Quantitative Analysis of MPLS in VPN technology chniques and Advanced Web Databases.