Senior Data Architect
Afiniti
مجموع سنوات الخبرة :10 years, 7 أشهر
• Lead the deployment and integration of Apache Airflow and Apache Spark, driving the migration of data processing
jobs from Talend to Python-based Airflow workflows.
• Manage the end-to-end architecture, analysis, and implementation of large-scale big data projects, leveraging cuttingedge technologies to deliver high-impact data models and insights.
• Develop and maintain robust value chains, addressing the challenges of acquiring, evaluating, and distilling data from
diverse sources, ensuring its value and effective utilization in critical decision-making processes.
• Extract strategic insights from complex and varied data sources, providing a competitive advantage by identifying
trends, patterns, and actionable information for key stakeholders.
• Collaborate closely with cross-functional teams, actively contributing to the development of assets, offerings, and
thought leadership initiatives, fostering a culture of innovation and collaboration within the organization.
• Continuously refine data architecture strategies and methodologies, optimizing data storage, retrieval, and analysis
processes to enhance overall data quality, performance, and accessibility.
• Managed, architected, and analyzed big data to develop data-driven insights and high-impact data models, driving
business growth and innovation.
• Created value chains to overcome challenges in acquiring, evaluating, and distilling data from multiple sources,
ensuring its value and effective use in decision-making processes.
• Extracted strategic insights from diverse data sources, providing a competitive advantage by identifying trends,
patterns, and actionable information.
• Collaborated with cross-functional teams, contributing to the development of assets, offerings, and thought
leadership initiatives across the organization.
• Continuously refined data architecture strategies and methodologies to optimize data storage, retrieval, and analysis,
enhancing overall data quality and accessibility.
• Employed advanced analytics techniques to support data-driven decision-making, facilitating the seamless integration
of analytics into business processes.
• Developed automated, scalable batch data pipelines, enhancing data processing efficiency and reliability.
• Deployed Enterprise BI tools, formulating strategies to improve data processes and design automation, while ensuring
data quality.
• Created insightful reports using Data Studio and Power BI to support data-driven decision-making.
• Defined new processes, identified optimal tools and technologies for each project, and maintained data integrity
through intelligent data sensors.
• Optimized and accelerated data flows to eliminate bottlenecks, collaborating with various teams to adapt to evolving
client requirements.
• Provided data-driven insights to support teams and coordinated with stakeholders to implement the desired business
models.
• Collaborated with Project Managers, Business Analysts, and Developers on diverse projects to clearly define business
needs, expectations, timelines, and execution methods, effectively communicating with various business groups.
• Provided data warehousing services to financial institutions using Ingres and PostgreSQL databases.
• Assisted in the design and implementation of data marts and data warehousing applications, extracting data from
OLTP systems to staging areas using ELT, and loading data to target databases using ETL processes as per business
requirements.
• Developed and tested interactive dashboards, ad-hoc reports, and analytical documents to showcase client business
insights.
• Optimized and authored complex queries to obtain required data sets for analysis.
• Created OLAP cubes and XML schemas for data marts, enabling top management to perform QBE and What-If
analyses.
• Performed data transformations, using roll-up and drill-down Analysis etc. Interpretation and analysis of data and trends, using statistical techniques.
• Pre-emptively working to resolve data quality issues and developing mechanisms to determine data omitting metrics.
• Performed additional role of scrum master after three months of joining to give updates in scrum of scrum to the higher management and removed 80% of the blockers within one day.
• Successfully managed a team of Business Intelligence Developers and Analysts across 12 sprints out of which 7 were completed with 100% velocity.
• Ensured software solutions are developed under Scrum Agile framework. Implemented data mining strategies to build a database of meaningful data.
• Created data visualization graphs and charts to make meaning of data for data value chain stakeholders Developed and followed standard operating procedure for verifying data integrity.
• Managing and development of Data Ware-House.
• Analyzing data from multiple sources, simultaneously optimizing statistical efficiency and quality by developing data collection systems and filtering data to remove outliers.
• Reporting on Tableau and Power BI.
• Migration of data from AWS S3 to Redshift warehouse using AWS Glue.
• Created Data Warehouse in Redshift cluster for reporting.
• Scheduled and executed SSIS Packages using SQL Server Agent.
• Designed SSIS Packages to extract data from various data sources such as Access database, Excel spreadsheet, and flat files and load data into destination databases for further Data Analysis and Reporting.
• Managed the planning and development of design and procedures for metrics reports.
• Compiled relevant data from a variety of sources including SQL and Oracle database.
• Developed new reports and delegated tasks to team members.
• Maintained project documentation for all activities related to the development section's operations.
• Created Stored Procedures, Triggers, Functions, Indexes, Views, Joins and T-SQL code for applications.
• Managed indexes, statistics and optimized queries by using execution plan for tuning the database.
• Responsible for performance tuning and Optimization of stored procedures using SQL Profiler and Database tuning wizard.
• Designed and developed data models for the data warehouse using star and snowflake schema.
• Used SSIS to create ETL packages to validate, extract, transform and load data to data warehouse and data marts.
• Designed SSIS Packages to extract data from various data sources such as Access database, Excel spreadsheet, and flat files and load data into destination databases for further Data Analysis and Reporting.
• Experience in using multiple data flow transformations provided by SSIS such as Data Conversion, Conditional Split, Merge and Union all.
• Scheduled and executed SSIS Packages using SQL Server Agent.
• Generated Reports using Global Variables, Expressions and Functions for the reports.
• Actively involved in generating Matrix, Sub reports and complex reports with multi value parameters for the analysis of Performance.
لقد تم حذف الرابط بسبب انتهاكه لسياسة الموقع. يرجى التواصل مع قسم الدعم لمزيد من المعلومات.