Jesus Osuna

Mar 07 2011

Data Profiling and Data Remediation Priority for Migrating Legacy Systems Part II

In Part I of this blog, I stated that before embarking on a large scale data migration from a legacy system into a new system, it is important to establish a game plan.  In Part II, once you have established the game plan, it is important to establish priorities for the Data Remediation Plan.

To build a Data Remediation Plan, you need to establish metrics by which to measure and prioritize the effort.  This will be very helpful when you have conflicting resource constraints and need to know where to begin.

In Part I, I demonstrated the importance of setting priorities for data by Mandatory field, Data Retention Policy, Data Load (null records),  Data Loss (truncation and duplication of records), Data Quality.  Once all of these parameters have been determined, you are now left with the records that need to be remediated. I will use a fictitious metrics table to provide examples of how to set up the priority for tackling each one.  

Read More

Mar 03 2011

Data Profiling and Data Remediation Priority for Migrating Legacy Systems Part I

Before embarking on a large scale data migration from a legacy system into a new system, it is important to establish a game plan.  Part of the game plan is to profile the data that will be migrated.  Unfortunately, too many times I see Data Analyst diving into the source database and begin writing extensive SQL queries that provide various permutations of data profiling reports before determining if the data is even relevant to the new system.   I believe that by having a game plan for data profiling and subsequently, establishing a remediation plan, the organization will save a lot of time and money.

Read More

 

Disclaimer

The words and opinions expressed here are those of each article's respective author, and do not necessarily represent the views of CapTech Ventures.