Hot Downloads

Welcome, Guest
Username: Password: Remember me

TOPIC: Robocopy copy speeds

Robocopy copy speeds 6 years 4 months ago #34993

  • skepticals
  • skepticals's Avatar
  • Offline
  • Expert Member
  • Posts: 783
  • Karma: 0
I have servers connected with Gig Ethernet and copied data for almost 39 hours. The end result was 139 Megabytes/Min. The data was a ton of small files so I think the processing of ACLs, permissions, etc takes longer than large files.

Does anyone recall how fast their data transfers?
The administrator has disabled public write access.

Re: Robocopy copy speeds 6 years 4 months ago #34994

  • TheBishop
  • TheBishop's Avatar
  • Offline
  • Moderator
  • Posts: 1719
  • Thank you received: 8
  • Karma: 5
I did some tests a year or so ago by copying big files off DVDs across our Gigabit network and noticed we only got full network throughput for the first 20 seconds or so. After this initial surge it tailed off to a slower rate as the servers were then working directly to/from disk - I think the initial surge was until the disk caches became overwhelmed
The administrator has disabled public write access.

Re: Robocopy copy speeds 6 years 4 months ago #35002

  • Chris
  • Chris's Avatar
  • Offline
  • Administrator
  • Posts: 1446
  • Thank you received: 13
  • Karma: 8
Sounds about right guys - the main issue as mentioned are the small files that increase the disk response and delay dramatically.

Theoretically you should be able to obtain speeds of 120MB/sec on a 1 Gigabit link, however in most cases the hdd subsystem is the bottleneck.

Taking the 139Mb/min Skepticals obtain, you must have had an incredible large amount of small files;
Chris Partsenidis.
Founder & Editor-in-Chief
www.Firewall.cx
The administrator has disabled public write access.

Re: Robocopy copy speeds 6 years 4 months ago #35005

  • S0lo
  • S0lo's Avatar
  • Offline
  • Moderator
  • Posts: 1577
  • Thank you received: 7
  • Karma: 3
skepticals, 139 MB/min is rather slow for GigaBit Ethernet as Chris noted.

What happens when you transfer a single very large file? if it is much faster, then the problem is probably related to the overhead of the "many small files" as you menssioned, specially if you have so many folders/subfolders there, as the creation of folders at the destnation takes allot of time.

By the way, FTP sucks for the same reason too. I usually zip/transfer/unzip when having so many files and folders.
Studying CCNP...

Ammar Muqaddas
Forum Moderator
www.firewall.cx
The administrator has disabled public write access.

Re: Robocopy copy speeds 6 years 4 months ago #35032

  • skepticals
  • skepticals's Avatar
  • Offline
  • Expert Member
  • Posts: 783
  • Karma: 0
The speed ranged from 139-300. The copies ran for days. There were tons of files!

I had to move 3TB of data. Most of which were small PDR/Word style files.
The administrator has disabled public write access.
Time to create page: 0.080 seconds

CCENT/CCNA

Cisco Routers

  • SSL WebVPN
  • Securing Routers
  • Policy Based Routing
  • Router on-a-Stick

VPN Security

  • Understand DMVPN
  • GRE/IPSec Configuration
  • Site-to-Site IPSec VPN
  • IPSec Modes

Cisco Help

  • VPN Client Windows 8
  • VPN Client Windows 7
  • CCP Display Problem
  • Cisco Support App.

Windows 2012

  • New Features
  • Licensing
  • Hyper-V / VDI
  • Install Hyper-V

Linux

  • File Permissions
  • Webmin
  • Groups - Users
  • Samba Setup