Data Engineer
AtoS IT solutions and Services
مجموع سنوات الخبرة :15 years, 10 أشهر
Provide technical requirements engineering and designing the solution architecture of ASP.NET web-based Security System for Al-Bustan (Compound) Security Department.
Currently I'm in position of \[Technical Project Manager\] for ZAIN Big Data Project:
- Providing technical management and support for implementing EMC/Atos BIG Data Solution integrating ZAIN OSS/BSS systems in addition to providing an intelligent event processor which is specifically designed for the telecommunications industry and enabling of modular fashion Atos Codex Use-Cases.
- Good understanding of Real Time Intelligence (RTI), Cloudera Big Data platform based on DELL EMC Hadoop deployment Architecture with Isilon Data Nodes and VxRack Compute Nodes.
- Good understanding of Hadoop framework and Cloudera platform, Apache NIFI/Flume for data routing and IoT services. Kafka Message broker. Talend, Pentaho and Sqoop for data transfer.
Python/R exposing Spark for non-SQL analytics and Hive/Impala for SQL-based Analytics.
- Good understanding of Complex Events Processing and Real Time Intelligence.
* Technical planning and installation of automatic vehicle location and control system (AVLC),
commissioning and training for the use of the main data supply tool (LEOData) covering data supply
for physical network, route variant and time schedule subject areas.
* Good understanding of both localized and centralized Traffic Light Priority mechanisms.
* Good understanding of transit routing mechanism especially on top of OSM (Open Street Map).
* Installation and configuration of databases.
* Creation of documentation such as system and product descriptions.
* Execution of error analyses and trouble shooting in cooperation with the customer in order to ensure
correct functioning of the system and enhancing the overall system operating.
* Being involved in fixing routing problems in Brighton & Hove \[England\] and Canberra \[Australia\].
* Designing the initial version of LEOData supply for Hong Kong bus subset network.
Designing, analyzing and enhancing ETL jobs collecting data from variant sources.
Designing and implementing an unmanaged C++ application retrieving data out of NASDAQ X-STREAM Client API (stock trading system) loading MSMQ (queuing system) for farther processing by INFORMATICA ETL jobs used to store daily trading information into main stock data-warehouse.
Designing BI reports, optimizing queries performance, designing Data models.
Developing web applications for library related activities and events using Microsoft Web technology (ASP.Net over SQL Server and Visual Source Safe) and JavaScript and Ajax scripting techniques.