Monday 7 March 2011

Data Archival

What is Archival?
Archival is a process of moving out the data which is currently not active to a location only meant for record keeping. In other words the data that would no longer be affected or will affect any transaction will be moved. Archival can be Physical Separation of data (moving the data from current location/device to a new/different location/device) or Logical Separation of data (logically grouping the data and moving within the same area).
Logical Separation is done by creating another table/record whose structure is a copy of the existing record and moving the non active data to the new record within the same database.

  • To improve application performance – better response time of application online pages, reports and batch processes
  • To reduce hardware and storage costs
  • To simplify tuning and maintaining large databases
  • To help PeopleSoft application developers on response time
  • To assist database managers/administrators
  • To be used for Audit, compliance and information governance specialists
  • To reduce the transaction data growing at the exponential rate
  • To retain the detailed information for a longer time
  • Statutory & Legislative requirements to hold historical data
Why Historical Data is required?
Long term data retention requirements
  • Past Payroll data
  • Previous fiscal year books of account
  • Customer problems/issue logs
  • Providing better response to worker/customer
  • History Timesheets / Payslip
  • CRM Cases
  • Closed/Billed historical Invoices
Regulatory Compliance
  • UK/India statutory and legislative requirements
  • Internal/External Audit
Archival approach – Our Experience
On receiving the requirement from the client we have made a list of modules that the user has implemented. We have made an analysis of the data and the tables that were involved with these modules. We divided our approach into 5 different steps.

PeopleSoft Data Archival Manager:
After analysis of industry leading archival products for PeopleSoft, DAM is the tool we  selected to perform the archival activity at one of our leading staffing client. Pictorial representation of archival data movement is given below,

Value Addition:

Our value addition to the PeopleSoft Data Archival Manger includes,
  • Inbuilt Database Maintenance activity on archive tables.
  • Table locking to preserve structure on archive tables.
  • Approach to handle non structured tables.
  • Unique approach to handle partitioned object archival

Data Archival duration:
Data Archival project varies based on the type of the archival (Physical/Logical), Tool used. Our recommendation for PeopleSoft application archival is PeopleSoft Data Archival Manager. It just works with minor tweeking.

For more details, feel free to contact us