SAP Testing - Due Diligence Questionnaire v0 1

SAP Testing - Due Diligence Questionnaire Sl No 1

Area SAP (System Landscape & Architecture)

2 3 4 5 6 7 8 9

SAP Solman

Current Status of The Project Current Status of Testing

Testing Process

12

13 14

What are the SAP modules involved in the project ? Could we get the information the SAP Landscape? What is the level usability of Solution Manager ? Do you have the Business Hierarchy and Business processes defined in Solution Manager? What is the current status of SAP implementation/rollout? If not already completed, what is the timeline for SAP implementation/rollout? What is the level of Testing done currently? Please provide an overview of the testing need (elaborate on the project objective, expectations, deliverables, scope and timelines). What are the key pain areas with regard to the current testing process?

15 16 17

Is UAT being currently done? Who currently does the UAT? What is the average number of defects found during UAT?

Types of Testing

Documentation

20 21 22 23 24 25 26 27 28 29

30 31 32 33 34 35 36 37 38

Defect Management

39 40 41 42 43

Automation Testing

44

47 48 49 50

Test Environment

51 52 53 54 55 56 57 58 59

Currently only the test results are uploaded on the sharepoint , Weekly Burn Down chart yes Development Testing and UAT Testing

we have entry criteria but no formal document maintained yes , Business subjective based on a project but on average we have 15 defects 1 we do maintain FS & TS

No of Cycle of testing done in each environment? Are the SAP Testing Base Documented available (FS,TS ) ? Are they up to date ? What is the current level of documentation available with regard to processes, configurations, and custom development? Do checklists and guidelines exist for testing?

60-70% is documented

Is a predefined template available with you for the test Case? Do we follow the existing test Case template or a new template? Is there a central repository for all testing artifacts (plans, test cases, test conditions etc.)? Is there a master test strategy document? Is there any master test plan document ? Can the same be shared ? Is there a testing approach / test plan created for Each Release ? Assumption is that the SAP test scenarios are identified. Could we know, across what all modules does these scenarios spread ? Are the manual test cases available for these test scenarios ? Do we have a Manual Test case repository ? If yes, could you please share the breakup of test cases module wise? How are the test cases categorized (say for e.g., Simple, Medium and Complex)? Could you please provide sample test cases for each category? cases for each category? If no manual test cases presently, what is the tentative plan of total manual test cases to be developed ? Are the test cases detailed or is it at a transaction code level ? number of Transaction for each scenarios ? What is the typical size of the test cases (in number of steps)? Are the Test Results for the different testing is captures? Where its stored? Test Results are in place for all the modules ? What are the list of Test Deliverables? Do we have Requirement Traceability Matrix? What is the current defect leakage percentage? What is the frequency of issues raised or enhancements required in the application?

yes

Is the application process flow stable or unstable? Do we have a Defect Management processes in place ? What is the tool use for the same ? Let us know the Defect management process ? What is the average number of defects found during last testing? Whether defects analysied and categorized? Is Test automation in scope?

stable yes , Sharepoint

Testing scope is defined for Projects

Test Scripts are stored in particular project sharepoint no no all the modules yes yes Slide no 4&5

NA it is detailed on transactional level 10 project sharepoint yes Test results no 1% 3-5 issues per module per week

15 in UAT Upgarde Project yes , RCA done only for business in Accounts Payable area worksoft available for Automation

If no for the above Question , then Do we have any information on the Automation feasibility study conducted? What percentage of tests is automated? What are the testing tools being used for Test Management, Automation (Functional and Performance)? Please let us know their version? Can you support in providing license to the testing tools like HP QC and other automation tools etc ? Is there any Performance testing conducted currently? If yes, what tools is used?

45 46

Information on Interfaces / Legacy Systems/3rd Party Tools Regression testing

Knowledge Transfer

TCS Confidential

Analysis (Observation / Comments) SAP PS - 10% , SAP PM - 25%,FI30% , HR - 30%,MM/SD- 25 % , BI/BW - 60% working on a Australia Rollout - very initial phase All Modules Attached Doc using it, Abdul No ECC 6 EHP6 SP08 Yearly Upgrade Development Testing done by Functional Analyst/Developer and UAT is done by Business Currently Occupies a lot of Business time for testing No

Is there any common test methodology that is being used for testing of all the applications? What are the metrics that are currently captured? What is the frequency at which the metrics are captured and reported? Do the applications have Service Level Agreements (SLAs) in place today? What are the types of testing currently done of each release ? and at what frequencies? 1.Unit testing 2.System Integration testing 3.Interface testing 4.Data conversion/Migration testing 5.Test Automation 6.Performance testing – stress and volume testing 7.User acceptance testing(UAT) 8.Regression testing(Manual/Automation) Do we have any specified Entry and exit criteria defined for each testing?

18 19

Response from the meeting

Are you planning for any SAP roll out?

10 11

Question What is the level of customization in the SAP ?

10% not sure Worksoft - 8.7.0.846 no no

Will the test data be provided by the Business team for test automation ? What are the SAP boxes available in the landscape ? (Dev, Quality, Prod). What box would be used for different testing? Do we have Release Management Process in place ? If yes can we have the Release Plan ? Do 3rd party tools testing are in scope? If yes what the 3rd party tools used which would integrate with SAP? Are there any legacy systems currently interfacing with SAP products? Please list the interfaces (or at least a count). Is Enterprise Portal in scope ? Is there any regression testing bed already available ? What is the number of Regression Test cycles planned per year ? Has there been any Risk Profiling done on the test cases to arrive at the list of test cases for regression test suite ? What is the selection procedure of a test case for a regression test cycle ? Do Business Team would provide a Knowledge transfer to TCS about the QA approach and case studies?

no Slide no 3 yes , done on a weekly basis no

yes no none no NA No

8/20/2014

Page 1

TCS Confidential

8/20/2014

Page 2