Working with the large ministerial department, it identified the challenges it was experiencing when extracting processed data from a SQL Server database using a simple query and the standard SSMS Export Data tool. The CSV file was then being shared to a third party, meaning it was extremely important to create a secure and effective process to collate and share data.   

The volume of data being collated was large, and errors being reported were vague so analysing the data to locate the cause was problematic. A process to split the extracted data into smaller, more manageable chunks was developed together with processes to load and analyse the extracted data. 

Being able to split the data into manageable and targeted chunks meant the problem data could be identified. The data being extracted was combined from several different sources, this meant that there was inconsistency in data quality and formatting with the result that a single standard extract process would not work. 

An end user friendly solution was developed to allow individuals to securely and efficiently extract data and convert to an acceptable format prior to sharing with third party members.  

This project was about identifying issues in the existing project, and creating an innovative solution to save time, errors and better the process moving forward.  

  • The client now has a sleek process that generates files in more manageable sizes that we know can be re-loaded.  
  • These files can now be provided with a compatible data loading process.  
  • The data can now be provided with confidence that it can be used by the third party. 

 
If you enjoyed this story, or have an upcoming project in mind, please don’t hesitate to contact us via enquiries@risual.com or 0300 303 2044. Alternatively, you can submit an enquiry here  Contact – risual

About the author