Page 1 of 1 1
Topic Options
#198494 - 2010-04-29 03:35 PM Byte level synch (command line) tool
Mart Moderator Offline
KiX Supporter
*****

Registered: 2002-03-27
Posts: 4673
Loc: The Netherlands
Hi Guy's,

I'm looking for a good command line (so it is easily scriptable) byte level backup application.
We have a quote from one of our suppliers but we also want to have some other applications to be able to compare them all.

I looked at rsync and it looks promising. Only downside is that you need to install a Linux emulation environment (some DLL’s) for it to work properly.

What I basically need is a command lien tool that does byte level backups so with a 100MB file that was backed up yesterday and now has 1MB added then only the extra 1MB should be copied.

Someone must be doing something like this already. Suggestions are welcome.
_________________________
Mart

- Chuck Norris once sold ebay to ebay on ebay.

Top
#198500 - 2010-04-29 04:21 PM Re: Byte level synch (command line) tool [Re: Mart]
Richard H. Administrator Offline
Administrator
*****

Registered: 2000-01-24
Posts: 4946
Loc: Leatherhead, Surrey, UK
First question is why bother with such a small file?

RSYNC is not really a byte level sychronisation, it is a "chunk" level sync.

If you are only appending the data to the source file then you can do this much more simply by just comparing the lengths of the files, copying off the right number of bytes from the larger and sending them over.

Have a look a MS SyncToy if it's just the automation that's giving you trouble.

Also have a look at RichCopy (if you can find the binaries) which has some advanced copying features.

Finally, Unison is a cross platform syncronisation tool which looks like it will do what you need.

Top
#198502 - 2010-04-29 04:34 PM Re: Byte level synch (command line) tool [Re: Richard H.]
Mart Moderator Offline
KiX Supporter
*****

Registered: 2002-03-27
Posts: 4673
Loc: The Netherlands
The 100MB was just an example. In real life it could be files between 1MB and several GB's.
I looked at MS Synctoy but not in depth. I'll also have a look at RichCopy.

Thanks.
_________________________
Mart

- Chuck Norris once sold ebay to ebay on ebay.

Top
#198503 - 2010-04-29 04:35 PM Re: Byte level synch (command line) tool [Re: Mart]
Richard H. Administrator Offline
Administrator
*****

Registered: 2000-01-24
Posts: 4946
Loc: Leatherhead, Surrey, UK
 Originally Posted By: rich
Finally, Unison is a cross platform syncronisation tool which looks like it will do what you need.


Reposted in case you missed the update.

Top
#198508 - 2010-04-29 07:06 PM Re: Byte level synch (command line) tool [Re: Richard H.]
Glenn Barnas Administrator Offline
KiX Supporter
*****

Registered: 2003-01-28
Posts: 4402
Loc: New Jersey
I have used Unison extensivly, and scripted around it with Kix every which way from Sunday..

In one method, I install Unison as a service using SrvAny and spin up a unison client on demand via a Kix script. This works well in a 1:1 relationship. I used this to sync a central server's folder structure with 250+ branch office servers. The remote servers would compare their folder timestamp with the central server and submit a request if the data was out of sync. The central server spawns up to 10 (configurable) sync sessions, bringing more up as they complete. This allowed a full sync of 250 servers to complete within an hour.

I have a package that uses Kix & KF to implement a client-server environment. The client sends a request to a server, the server spins up a Unison listener on an available port and replies to the client with the port number. The client then spins up a Unison client and specifies the target server port. This allows multiple, bidirectional sync processes between multiple servers. I had this running between the US and AUS offices.

Unison is very WAN friendly compared to the other solutions.

Glenn
_________________________
Actually I am a Rocket Scientist! \:D

Top
Page 1 of 1 1


Moderator:  Arend_, Allen, Jochen, Radimus, Glenn Barnas, ShaneEP, Ruud van Velsen, Mart 
Hop to:
Shout Box

Who's Online
0 registered and 476 anonymous users online.
Newest Members
batdk82, StuTheCoder, M_Moore, BeeEm, min_seow
17885 Registered Users

Generated in 0.056 seconds in which 0.027 seconds were spent on a total of 13 queries. Zlib compression enabled.

Search the board with:
superb Board Search
or try with google:
Google
Web kixtart.org