Introduction to Data Archiving.pdf

Introduction to Data Archiving

Georg Fischer, Product Manager PDMS SAP AG

This presentation outlines our general product direction and should not be relied on in making a purchase decision. This presentation is not subject to your license agreement or any other agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or to develop or release any functionality mentioned in this presentation. This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this document, except if such damages were caused by SAP intentionally or grossly negligent.

Agenda

1. 2. 3. 4. 5. 6.

Overview Data Archiving Basics Data Archiving Applied Access to Archived Data Data Archiving Projects More Information

Data Archiving

Online Display

Access

Database

Application Data

File System

Data Objects

Archive and Delete

Storage System

Data Objects

Store

Benefits

Value Generation

1

through Data Archiving powered by SAP NetWeaver

System Availability Faster and easier upgrade to higher software releases. Shorter runtime for backup and recovery.

3

Better Performance Shorter response times in dialog mode for all employees.

2

Use of Resources Reduced hardware costs for Disk, CPU, Memory as well as administration costs.

4

Legal Compliance Meeting data retention requirements and setting up end-of-life scenarios.

Use of Resources – Storage Savings

Archiving

Data Records 10 GB

Mirrors 20 GB

Compression to 20 %

2 GB

2 GB

Backup to Tape

Total savings in this scenario: 97.5%

System Copies 80 GB

Use of Resources – Distribution of Storage Costs “Hard disk costs represent less than a quarter of storage costs.” (Giga Information Group)

Various (Training, other costs

10% Hard disk

Personnel

23%

45%

Storage Mgmt. Environment (Soft- & Hardware) (Electricity, physical space)

3%

19%

“Administration costs for 1 Terabyte storage are five to seven times higher than the storage costs” (Dataquest/Gartner)

Better Performance – Areas of Improvement

Reduce display of mature data Faster DB access Faster access to single documents 2500

MB / msec

2000

MSEG MB

MB51 msec

1500

1000

500

0 Month 1

Month 2

Month 3

Month 4

Number of Legal Requirements Keeps Increasing

Laws and regulations affecting ever more media and data types

Laws and regulations growing across industries and countries

Laws and regulations requiring data to be kept for longer periods

Agenda

1. 2. 3. 4. 5. 6.

Overview Data Archiving Basics Data Archiving Applied Access to Archived Data Data Archiving Projects More Information

Data Archiving and Storage Storage System Partner (Optional)

SAP Business Suite

ArchiveLink

Storage System Database

File System

Storage System HSM System Alternative Storage

Application Data

Data Objects

Data Objects

Data Archiving in Relation to Optical Archiving

Incoming Documents

Outgoing Documents

Hyperlink

Archive Files Print Lists

Archive Development Kit (ADK) Runtime solution for data archiving Development tool for data archiving solutions SAP Application developers integrate archiving functionality into the application Customer Archiving solutions for customer-specific tables and extensions

Database

SAP Business Suite Applications

ADK Adjustment of code page, number format, structure

changes, compression, file handling, job scheduling

Archive Files

Archiving Object Definition of logical units in business processes All programs required for archiving, for example preprocessing, read, write and delete programs Definition of required Customizing Archiving Object

Customizing

Data

Programs

Archive Administration – Access via Role or Transaction SARA

Archive Administration – Central Access to Archiving Logs

Archive Administration – Tables and Archiving Objects

Archive Administration – Archive Information System

Archive Administration – Statistics

Archive Management – Overview of Archiving Sessions

Agenda

1. 2. 3. 4. 5. 6.

Overview Data Archiving Basics Data Archiving Applied Access to Archived Data Data Archiving Projects More Information

Accessing Archived Data

Database

Retrieval from DB + Archive Business processes

DRB

Business view Application

SAP System

Archive Files

AS 100%

ADK

x% Index / Archive Infostructure

Archive Information System

Flexible creation of archive file indexes Configurable infostructures stored in transparent database tables Manually filled using selected archive file(s) Automatically filled during archive delete phase

Retrieval of archived data Technical view for all archiving objects Document lists Based on infostructures Based on ad hoc evaluation of selected archive files Use of display variants

Generic tool also for customer developments

Using the Archive Information System

Archive Information System Archive Retrieval Configurator

Archive Explorer

Create

Read Archive Information Structure

Archive Retrieval Configurator Selection of the archiving object Selection of the required field catalog Selection and activation of the desired infostructure

Status Management Fill the infostructure with the required archive file content

Archive Explorer Select infostructure Make field selections Browse document list Detailed display from the archive

Archive Files

Document Relationship Browser (DRB)

User Interface Archive Explorer Transaction ALO1 User role SAP_DRB Application transactions

Display Database Display of business processes across archive and database boundaries Application Data

Infrastructure

Archive Files

DRB – Find Related Documents

DRB – Display the Relationship Tree

Display Archived Data from Within an Application

Exception: Reloading Archived Data

1

Reloading archived data back into the DB should be considered only in the following cases:

2

Scenario

Scenario Reload in the test system Data in a test environment can be reloaded at any time, since this does not affect operational data (cannot result in business inconsistencies)

Reload immediately after archiving Restoring the database due to an error (e.g. incorrect selection, incorrect customizing of residence times)

Reload function is not available for all archiving objects

Agenda

1. 2. 3. 4. 5. 6.

Overview Data Archiving Basics Data Archiving Applied Access to Archived Data Data Archiving Projects More Information

Finding the Right Time

1

A „healthy“ System Data Archiving should not be seen as the last resort for preventing total system collapse after all other means have been exhausted.

2

Early Planning Ensure that the performance of your systems remains efficient.

3

Interdisciplinary Process Data Archiving requires a high degree of cooperation between user and IT departments.

Table Growth in Accounting at a Customer Site

Month 12

Month 11

Month 10

Month 9

Month 8

Month 7

Month 6

Month 5

Month 4

Month 3

Month 2

500 450 400 350 300 250 200 150 100 50 0 Month 1

[GB]

Database Size

Date

Date

Size in GB

Monthly Growth in GB

Month 1

33.17

1.90

Month 2

36.09

2.92

Month 3

73.78

37.69

Month 4

137.96

64.18

Month 5

190.01

52.05

Month 6

256.99

66.98

Month 7

324.87

67.88

Month 8

376.00

51.13

Month 9

428.37

52.37

Considerations Before Data Archiving

Is the data still required? No

Yes

Can the data be summarized?

Yes

Summarize data Yes

No

Can the data be deleted? Deactivate the creation of the data

No

Yes

Delete data!

Can the data be archived? No Data remains in the database

Yes

Archive data!

Detailed Data Archiving Statistics

Automatically collected statistics can be used to Demonstrate the use and need for data archiving Better plan future archiving projects Recognize resource bottlenecks early on

Statistics can be Stored Displayed Standard statistics log Analyze statistics in Archive Administration (transaction SARA) Space information: Database space and disk space Amount: Number of data objects, structures, and delete jobs Time: Job duration

Rule of thumb: Compression factor of five – DB size vs. file size The greater the number and the variation of archiving objects used, the closer the factor is to five

Statistics

Customer Example – Visualized 10.000

Estimated DB size without archiving

9.2 TB

8.000

6.000

5.5 TB

Total amount archived

Allocated DB space

4.000

3.8 TB 3.2 TB

Total database size

2.000

2004

2005

2006

Jan

Nov

Sep

Jul

May

Mar

Jan

Nov

Sep

Jul

May

Mar

Jan

Nov

Sep

Jul

May

Mar

Jan

Size in GB

2007

Agenda

1. 2. 3. 4. 5. 6.

Overview Data Archiving Basics Data Archiving Applied Access to Archived Data Data Archiving Projects More Information

Important Sources of Information ILM in SAP Service Marketplace http://service.sap.com/ilm Is Your Missing ILM Strategy Putting You at Risk? From Birth to Burial Information Lifecycle Management at SAP

Data Archiving: Media Library Presentations Introduction to Data Archiving Media Library Literature & Brochures Data Management Guide Introduction to Data Archiving Reports and Transactions for Accessing Archived Data

Data Volume Management http://service.sap.com/dvm Archive Migration and Archive Conversion http://service.sap.com/slo

Data Archiving in Print - 2nd Edition Revised new edition with up-todate information for SAP NetWeaver 7.0 SAP ERP 6.0

New functions and technologies, e.g. Introduction to ILM Archive Routing XML-based archiving Table analysis with TAANA

Authors SAP archiving experts

More information www.sappress.de ISBN: 978-3-89842-796-8 (German) ISBN: 1-59229-008-6 (English) ISBN: 4-8222-5130-6 (Japanese) – 1st edition

SAP Customer Training

BIT660 Data Archiving

Level 3 3 Days BIT670 Data Archiving – Retrieval

Level 3 2 Days BC680*/WDE680 (USA/Germany)

Level 3 2 Days *on demand only

http:/www.sap.com/education

Thank You!

Copyright 2009 SAP AG. All Rights Reserved

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice. Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors. Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation. IBM, DB2, DB2 Universal Database, OS/2, Parallel Sysplex, MVS/ESA, AIX, S/390, AS/400, OS/390, OS/400, iSeries, pSeries, xSeries, zSeries, System i, System i5, System p, System p5, System x, System z, System z9, z/OS, AFP, Intelligent Miner, WebSphere, Netfinity, Tivoli, Informix, i5/OS, POWER, POWER5, POWER5+, OpenPower and PowerPC are trademarks or registered trademarks of IBM Corporation. Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries. Oracle is a registered trademark of Oracle Corporation. UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group. Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc. HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C®, World Wide Web Consortium, Massachusetts Institute of Technology. Java is a registered trademark of Sun Microsystems, Inc. JavaScript is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape. MaxDB is a trademark of MySQL AB, Sweden. SAP, R/3, mySAP, mySAP.com, xApps, xApp, SAP NetWeaver, and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries all over the world. All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may vary.

The information in this document is proprietary to SAP. No part of this document may be reproduced, copied, or transmitted in any form or for any purpose without the express prior written permission of SAP AG. This document is a preliminary version and not subject to your license agreement or any other agreement with SAP. This document contains only intended strategies, developments, and functionalities of the SAP® product and is not intended to be binding upon SAP to any particular course of business, product strategy, and/or development. Please note that this document is subject to change and may be changed by SAP at any time without notice. SAP assumes no responsibility for errors or omissions in this document. SAP does not warrant the accuracy or completeness of the information, text, graphics, links, or other items contained within this material. This document is provided without a warranty of any kind, either express or implied, including but not limited to the implied warranties of merchantability, fitness for a particular purpose, or noninfringement. SAP shall have no liability for damages of any kind including without limitation direct, special, indirect, or consequential damages that may result from the use of these materials. This limitation shall not apply in cases of intent or gross negligence. The statutory liability for personal injury and defective products is not affected. SAP has no control over the information that you may access through the use of hot links contained in these materials and does not endorse your use of third-party Web pages nor provide any warranty whatsoever relating to third-party Web pages.

Copyright 2009 SAP AG. Alle Rechte vorbehalten Weitergabe und Vervielfältigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und in welcher Form auch immer, ohne die ausdrückliche schriftliche Genehmigung durch SAP AG nicht gestattet. In dieser Publikation enthaltene Informationen können ohne vorherige Ankündigung geändert werden. Die von SAP AG oder deren Vertriebsfirmen angebotenen Softwareprodukte können Softwarekomponenten auch anderer Softwarehersteller enthalten. Microsoft®, WINDOWS®, NT®, EXCEL®, Word®, PowerPoint® und SQL Server® sind eingetragene Marken der Microsoft Corporation. IBM, DB2, DB2 Universal Database, OS/2, Parallel Sysplex, MVS/ESA, AIX, S/390, AS/400, OS/390, OS/400, iSeries, pSeries, xSeries, zSeries, System i, System i5, System p, System p5, System x, System z, System z9, z/OS, AFP, Intelligent Miner, WebSphere, Netfinity, Tivoli, Informix, i5/OS, POWER, POWER5, POWER5+, OpenPower und PowerPC sind Marken oder eingetragene Marken der IBM Corporation. Adobe, das Adobe Logo, Acrobat, PostScript und Reader sind Marken oder eingetragene Marken von Adobe Systems Inc. in den USA und/oder anderen Ländern. ORACLE® ist eine eingetragene Marke der ORACLE Corporation. UNIX®, X/Open®, OSF/1® und Motif® sind eingetragene Marken der Open Group. Citrix®, das Citrix-Logo, ICA®, Program Neighborhood®, MetaFrame®, WinFrame®, VideoFrame®, MultiWin® und andere hier erwähnte Namen von Citrix-Produkten sind Marken von Citrix Systems, Inc. HTML, DHTML, XML, XHTML sind Marken oder eingetragene Marken des W3C®, World Wide Web Consortium, Massachusetts Institute of Technology. JAVA® ist eine eingetragene Marke der Sun Microsystems, Inc. JAVASCRIPT® ist eine eingetragene Marke der Sun Microsystems, Inc., verwendet unter der Lizenz der von Netscape entwickelten und implementierten Technologie. MaxDB ist eine Marke von MySQL AB, Schweden. SAP, R/3, mySAP, mySAP.com, xApps, xApp, SAP NetWeaver, und weitere im Text erwähnte SAP-Produkte und -Dienstleistungen sowie die entsprechenden Logos sind Marken oder eingetragene Marken der SAP AG in Deutschland und anderen Ländern weltweit. Alle anderen Namen von Produkten und Dienstleistungen sind Marken der jeweiligen Firmen. Die Angaben im Text sind unverbindlich und dienen lediglich zu Informationszwecken. Produkte können länderspezifische Unterschiede aufweisen.

Die in dieser Publikation enthaltene Information ist Eigentum der SAP. Weitergabe und Vervielfältigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und in welcher Form auch immer, nur mit ausdrücklicher schriftlicher Genehmigung durch SAP AG gestattet. Bei dieser Publikation handelt es sich um eine vorläufige Version, die nicht Ihrem gültigen Lizenzvertrag oder anderen Vereinbarungen mit SAP unterliegt. Diese Publikation enthält nur vorgesehene Strategien, Entwicklungen und Funktionen des SAP®-Produkts. SAP entsteht aus dieser Publikation keine Verpflichtung zu einer bestimmten Geschäfts- oder Produktstrategie und/oder bestimmten Entwicklungen. Diese Publikation kann von SAP jederzeit ohne vorherige Ankündigung geändert werden. SAP übernimmt keine Haftung für Fehler oder Auslassungen in dieser Publikation. Des Weiteren übernimmt SAP keine Garantie für die Exaktheit oder Vollständigkeit der Informationen, Texte, Grafiken, Links und sonstigen in dieser Publikation enthaltenen Elementen. Diese Publikation wird ohne jegliche Gewähr, weder ausdrücklich noch stillschweigend, bereitgestellt. Dies gilt u. a., aber nicht ausschließlich, hinsichtlich der Gewährleistung der Marktgängigkeit und der Eignung für einen bestimmten Zweck sowie für die Gewährleistung der Nichtverletzung geltenden Rechts. SAP haftet nicht für entstandene Schäden. Dies gilt u. a. und uneingeschränkt für konkrete, besondere und mittelbare Schäden oder Folgeschäden, die aus der Nutzung dieser Materialien entstehen können. Diese Einschränkung gilt nicht bei Vorsatz oder grober Fahrlässigkeit. Die gesetzliche Haftung bei Personenschäden oder Produkthaftung bleibt unberührt. Die Informationen, auf die Sie möglicherweise über die in diesem Material enthaltenen Hotlinks zugreifen, unterliegen nicht dem Einfluss von SAP, und SAP unterstützt nicht die Nutzung von Internetseiten Dritter durch Sie und gibt keinerlei Gewährleistungen oder Zusagen über Internetseiten Dritter ab.