Peer Software Forums: Replicating a large number of files - Peer Software Forums

Jump to content

Page 1 of 1
  • You cannot start a new topic
  • You cannot reply to this topic

Replicating a large number of files

#1 Guest_janneman_*

  • Group: Guests

Posted 30 April 2008 - 06:48 AM

Suppose you are replicating a few 100,000 files. Our cusotmer reports that using a robocopy-like tool, it takes up to 20 hours to scan source and target folders across a high speed WAN link to find out that the servers are in sync and no files need copying. How could PeerSync help in this scenario?

I'm sure the multi-threading feature will help. But I don't know that, given the number of remote sites, it will help enough. You really want an agent sitting on the target server to help with the scanning. Instead of polling 100,000 files individually over the network, it would be so much more efficient if you could just ask the agent to send you a list of all the filenames & filesizes & dates. I can see that PeerSync has an agent: PSListener. But I haven't been able to work out whether PSListener works in the way described.

Thanks for any clarification.
0

#2 User is offline   PS_Support Icon

  • Advanced Member
  • PipPipPip
  • Group: Admin
  • Posts: 818
  • Joined: 05-December 03

Posted 05 May 2008 - 05:59 PM

Janneman,

The multi-threading feature should improve your scan time significantly by allowing your jobs to be processed concurrently instead of sequentially.

In addition, you may also want to consider the Enhanced Scanning feature available for v7.4 (which works in conjunction with the Multi-threading feature) to further improve your scan performance. This feature dynamically builds sub jobs within each main job in your profile so that folder scans can be processed in parallel.

The ByteReplicator (PSListener) will allow you to transfer only the changed portion of a file instead of the entire file.

I would recommend trying these options by including them in a trial version of PeerSync (http://www.peersoftware.com/downloads/trial_download2.aspx?mydownloadstr=8) to see firsthand the benefits they can bring to your environment. If you have any difficulty with the trial, contact support@peersoftware.com.
Peer Software, Inc.
Technical Support Team
0
Page 1 of 1
  • You cannot start a new topic
  • You cannot reply to this topic

1 User(s) are reading this topic
0 members, 1 guests, 0 anonymous users