300GB Test2 Migration Results via SharePoint Online High Speed Migration (Small Files)

300GB Test2 Migration Results via SharePoint Online High Speed Migration (Small Files)

Updated Aug 19th: Quick Synopsis 97 hours @ 3.26GB/hr

As a followup from my last post regarding the migration speed during a high speed migration, Mikael Svenson (@mikaelsvenson) pointed out the dataset that I was using was comprised of very large video files. He postulated that that smaller files would slow the migration process down during the import.

The problem I had with this is I didnt have a good way to generate the test data for a test migration That is until he offered to create me a tool which would generate test data.

So without further ado, my new dataset for testing:

small file migration results

What you see here is 31 folders of documents with 131k files ranging in between 1Mb and 5MB with the overall dataset size of 316GB. A big factor that affects this test is that all of these folders and documents are part of one package (think serial) and thus would not take advantage of parallel processing. (more to come on that soon).

In addition I wont cover here the individual steps I took to package and ship this information to Office 365, you can find more information about that here.

The DataSet

  • Size: 316GB
  • Files: 130,862 Files and 31 Folders
  • Target: One Drive for Business on Office 365

The Results

After submitting the jobs for migration I saw documents start being created almost immediately after the job was submitted at 5:20 PM on 7/20/2015. The last file was migrated on 7/24/2015 at 6:24PM.

  • Duration: 4 days, 1 hour, and 4 minutes
  • Speed: 3.26GB/Hr (316GB/97.06666666666667

In the end the migration speed was cut in half from the large speed migration, however this is still more than 3GB an hour is not bad at all for a small file comprised dataset.

Leave a Reply

Your email address will not be published. Required fields are marked *