Senior Software Engineer - Test
Sandvine Technologies
Total years of experience :13 years, 0 Months
• Involved in CIT, SIT, UAT, Production parallel run testing based on the requirements surveys completed by development team.
• Conducted meetings as needed in SIT and daily test meetings in UAT with downstream users.
• Tested Map Reduce programs to parse the raw data, populate staging tables and store the data in HDFS.
• Created Hive queries which helped analysts spot emerging trends by comparing fresh data with historical claim metrics.
• Used Flume-ng to move data from individual data sources to Hadoop system.
• Used MRUnit framework to test the Map Reduce code.
• Involved in setting up the testing environments and prepare test data for testing flows to validate and prove positive and negative cases
• Validated the Map reduce, Pig, Hive Scripts by pulling the data from the Hadoop and validating it with the data in the files and reports.
• Involved in all over the quality controls (Hadoop & Teradata), data validations, Key business checks, RTAS implementation of Hadoop ETL flow and Teradata landing zone/target tables.
• Coordinated various project specific access requests related to Hadoop components like Edge node and HDFS directories, Hive tables, Autosys instances, Mainframe LPARs.
• Coordinating various database requests like Access category, DB questionnaire, Initial Environment Setup, DDL notepad through nexus and other ticketing portals.
• Performed various Hadoop controls like date checks, record checks, balance checks, threshold limits for records and balances etc. for various SORs (system of records) like Data and stat files on checkpoint basis.
• Performed data validations between summary files and extract files after ETL flow.
• Performed various Vertica database controls like comparisons between Landing zone tables and tracing tables generated during the ETL process.
• Created the data extract by connecting to Vertica database to place the files on Microstrategy server.
• Scheduled the Oozie workflow jobs with pig scripts and Sqoop (importing/exporting) process. Scheduling the workflow jobs with Autosys due to calendar flexibility for all environments.
• Prepared the Linux Shell scripts with profile files by maintaining all global environment/application level variables.
• Performed Defect Reporting, Analyzing, Tracking and Report Generation JIRA.
• Attended the daily Bug review meetings, weekly status meetings and walkthroughs and interacted with Business Analysts and Developers for resolving Defects.
• Performance testing metrics were captured for all test phases before migration of components like validation scripts/Autosys JILS/DMX ETL jobs etc. to Production.
• Consulted certification teams regarding the associate KBEs tested for project and creating reusable test scripts to execute/provide results.
• Coordinated with all the teams, representatives, and downstream users involved in testing for sign off approvals.
• Experienced in validating the source data with the target data in data warehousing application and also in reports in Client/Server and Web Based environment.
• Involved in developing Test Cases, Test Plans, Test Execution, Defect Tracking and Report Generation using JIRA based on functional specifications.
• Involved in end-to-end defect management of assigned projects.
• Identified defects, assess root cause, and prepared detailed information for developers and business stakeholders.
• Experienced in Data Validation and Backend testing of databases to check the integrity of data.
• And also used extensively HQL Queries to analyze the HDFS data
• Experience in testing of Data Warehouse/ETL Applications developed in Talend using Oracle, Hadoop, SQL Server and UNIX and also have ability to evaluate ETL/BI specifications and processes.
• Experience in UNIX, RDBMS, Hadoop, HIVE (HQL), Oracle (PL/SQL), MS Access.
• Experienced in Black Box, White Box, Integration, Regression, Functional, Front End and Back End Testing.
• Involved in establishing automated Hadoop Integration testing system and implementing oozie workflow.
• Responsible for Analysis and Defect Tracking using HP Quality Center/ALM.
• Implemented Optimization techniques for better performance on the ETL side and also on the database side
• Experience with different file systems /databases like Oracle, HDFS Teradata, and MS SQL Server to extract and load data using sqoop.
• Participated in business requirement walk through, design walk through and analyzed Business requirements and Coordinated with the business analysts and developers to discuss issues in interpreting the requirements.
• Analyzed the user requirements, functional specifications and Use Case documents and created the Test Plans, Test cases for Functional testing.
• Worked closely with ETL team in each phase of project (data requirement analysis, data field analysis, data mapping and ETL testing)
• Built external mapping to transfer data from SQL Server database to Oracle Data Warehouse. This includes writing SQL Statements.
• Coordinated in testing Data Stage ETL using complex stored procedures.
• Acted as first point of contact for all critical issues related to data mapping and data sourcing.
• Developed test plan with testing scenarios from the end user perspective for User Acceptance Testing (UAT).
• Reviewed and tested Informatica ETL code
• Involved in Integration Testing, and Data Testing including boundary testing.
• Developed procedures to ensure conformity, compliance with standards and lack of redundancy, translating business rules and functionality requirements.
• Actively participated in Functional testing, System testing, and Ad-hoc testing.
• Analyzed bugs, worked with development team and ETL team members in fixing defects and validating the solutions.
• Worked on Autosys for Batch Processing ETL, PL/SQL subprograms and performed backend testing.
• Tested many ETL packages for the project according to data mapping requirements.
• Interacted with the development and product management team to find out the end user actions and scenarios.
• Tested adhoc and standard reports generated by using MicroStrategy.
• Involved in providing the Testing effort estimates and provided the timely feedback on progress of the testing activity.
• Updated QA Manager and Lead weekly with the testing status, which included Test Task Plan, Defect Management, and Test Metrics.
• Successfully Coordinated User Acceptance Testing (UAT) on each release of the project with the help of end user requirements.
• Involved in doing Business analysis and Requirements gathering for new Informatica mappings.
• Coordinate all aspects of the solution delivery including design, development, testing, and deployment
B.Tech in Computer Science secured 1st position and passed out in the year 2009.