Page 1 of 1 1
Topic Options
#205831 - 2012-09-27 11:50 AM User migration script
GeorgeLittle Offline
Fresh Scripter

Registered: 2011-02-08
Posts: 47
Loc: UK
Hi All,

So I am just about to undertake a desktop refresh and am sure that somone must have created a similar script to do the following

Find all the local data by extensions modified in the last x months and then copy out to share

Provide a log of the copy
Provide a log of the excluded files

Top
#205834 - 2012-09-27 03:03 PM Re: User migration script [Re: GeorgeLittle]
Glenn Barnas Administrator Offline
KiX Supporter
*****

Registered: 2003-01-28
Posts: 4291
Loc: New Jersey
Having written a Kix app that scanned folder structures with tens of thousands of files in hundreds of folders to sync files between the US and Austrailia, the fastest way is to run "dir *.ext /S /B" with the WshPipe UDF and convert the response to an array for processing. The modified version of the WshPipe UDF on my web site returns an array of each line of output. It returns the complete path, simplifying the copy command.

Using Kix DIR (and the UDFs that employ them) are not nearly as fast. The other UDFs that use FSO are faster than the Kix DIR, but not as fast as the native DIR command, but do offer more options. I don't see the need for anything fancy here.. look for and copy one file extention type, then the next, and so on.

Glenn
_________________________
Actually I am a Rocket Scientist! \:D

Top
#205839 - 2012-09-27 07:23 PM Re: User migration script [Re: Glenn Barnas]
NTDOC Administrator Offline
Administrator
*****

Registered: 2000-07-28
Posts: 11571
Loc: CA
Well Robocopy can easily do this and is even native to Windows 7/Server 2008 computers and an available download for XP/Server 2003

Glenn often uses another similar tool but I could never get it to work the way he seems to use it.

Top
#205841 - 2012-09-27 07:47 PM Re: User migration script [Re: NTDOC]
Glenn Barnas Administrator Offline
KiX Supporter
*****

Registered: 2003-01-28
Posts: 4291
Loc: New Jersey
If you're referring to Unison, it's not an appropriate choice for a simple copy. XXcopy or RoboCopy would do the job if you wanted everything. The "Dir" solution above allows you to obtain a list of potential files and then apply Kix logic to the copy/log operations.

Glenn
_________________________
Actually I am a Rocket Scientist! \:D

Top
#205857 - 2012-09-29 02:44 AM Re: User migration script [Re: Glenn Barnas]
NTDOC Administrator Offline
Administrator
*****

Registered: 2000-07-28
Posts: 11571
Loc: CA
Well for those interested here are a couple of files that can make using Robocopy to do jobs like this very easy. You can create multiple jobs and or different batch files to make specific command line calls, etc to run the job or all jobs.

Files need to be saved with the extension .RCJ

For XP and Server 2003 you will need to download the Windows Server 2003 Resource Kit Tools and install it.
System requirements
Supported operating systems: Windows Server 2003, Windows XP


Though it's probably way overkill for most, here are some links to read and learn more about Robocopy and file copy/storage in general.

Microsoft Robocopy






Main Robocopy job file
 Code:
:: Job file example by AdvancedSetup on 9/28/2012 6:00:00 PM
:: Example Robocopy job to copy a user profile from one computer or folder to another.
:: Robocopy Job C:\ProfileMoves\CopyProfiles.RCJ
::
:: Robocopy, or "Robust File Copy", is a command-line directory replication utility.
::
:: It has been available as part of the Windows Resource Kit starting with Windows NT 4.0,
:: and was introduced as a standard feature of Windows Vista, Windows 7 and Windows Server 2008.
::
:: Note - Hotfix update for Robocopy on Windows 7 / Server 2008 (updates to version 6.1.7601)
:: http://support.microsoft.com/kb/2639043/en-us
::
::
:: Robocopy - Technet
:: http://technet.microsoft.com/en-us/library/cc733145%28v=ws.10%29.aspx
::
:: Robocopy - Wikipedia
:: http://en.wikipedia.org/wiki/Robocopy
::
::
:: The format of Robocopy Job Files is straightforward
:: They contain one Robocopy parameter per line (parameters containing colons, e.g. /LOG:logfile or /MAX:n, count as
:: one parameter and must be specified on a single line, with no spaces around the colon).
:: Leading white space is ignored, as is any text after two consecutive colons, which is considered to be a comment.
::
:: Files must be saved with the extenson .RCJ
::
::
:: Main options were left in this file to allow easier modifications if or when needed without having to
:: look them up again but can all be removed and simply the commands you want listed.
::
:: Example usage
:: (note that Robocopy can call Source and Destination from the command line for more flexibility or you can add it as part of the Job file)
::
:: Example command line to run to the job file using Robocopy.exe
:: ROBOCOPY.EXE "C:\USERS\JOHNDOE"  "\\SERVER\USERS\JOHNDOE" /job:C:\ProfileMoves\CopyCommands.RCJ /job:C:\ProfileMoves\FilesToCopy.RCJ
::
::
:: Usage               ROBOCOPY source destination [file [file]...] [options]
:: source              Source Directory (drive:\path or \\server\share\path).
:: destination         Destination Dir  (drive:\path or \\server\share\path).
:: file                File(s) to copy  (names/wildcards: default is "*.*").
::
::
:: Source Directory
:: "C:\USERS\JOHNDOE"
::
::
:: Destination Directory
:: "\\SERVER\USERS\JOHNDOE"
::
::
:: Copy options
::
:: /S                  copy Subdirectories, but not empty ones.
:: /E                  copy subdirectories, including Empty ones.
:: /LEV:n              only copy the top n LEVels of the source directory tree.
:: /Z                  copy files in restartable mode.
:: /B                  copy files in Backup mode.
:: /ZB                 use restartable mode; if access denied use Backup mode.
:: /EFSRAW             copy all encrypted files in EFS RAW mode.
:: /COPY:copyflag[s]   what to COPY for files (default is /COPY:DAT).
::                     (copyflags : D=Data, A=Attributes, T=Timestamps).
::                     (S=Security=NTFS ACLs, O=Owner info, U=aUditing info).
:: /SEC                copy files with SECurity (equivalent to /COPY:DATS).
:: /COPYALL            COPY ALL file info (equivalent to /COPY:DATSOU).
:: /NOCOPY             COPY NO file info (useful with /PURGE).
:: /SECFIX             FIX file SECurity on all files, even skipped files.
:: /TIMFIX             FIX file TIMes on all files, even skipped files.
:: /PURGE              delete dest files/dirs that no longer exist in source.
:: /MIR                MIRror a directory tree (equivalent to /E plus /PURGE).
:: /MOV                MOVe files (delete from source after copying).
:: /MOVE               MOVE files AND dirs (delete from source after copying).
:: /A+:[RASHCNET]      add the given Attributes to copied files.
:: /A-:[RASHCNET]      remove the given Attributes from copied files.
:: /CREATE             CREATE directory tree and zero-length files only.
:: /FAT                create destination files using 8.3 FAT file names only.
:: /256                turn off very long path (> 256 characters) support.
:: /MON:n              MONitor source; run again when more than n changes seen.
:: /MOT:m              MOnitor source; run again in m minutes Time, if changed.
:: /RH:hhmm-hhmm       Run Hours - times when new copies may be started.
:: /PF                 check run hours on a Per File (not per pass) basis.
:: /IPG:n              Inter-Packet Gap (ms), to free bandwidth on slow lines.
:: /SL                 copy symbolic links versus the target.
:: /MT[:n]             Do multi-threaded copies with n threads (default 8).
::                     n must be at least 1 and not greater than 128.
::                     This option is incompatible with the /IPG and /EFSRAW options.
::                     Redirect output using /LOG option for better performance.
:: /DCOPY:copyflag[s]  what to COPY for directories (default is /DCOPY:DA).
::                     (copyflags : D=Data, A=Attributes, T=Timestamps).
:: /NODCOPY            COPY NO directory info (by default /DCOPY:DA is done).
::
:: Copy subdirectories and start in restartable mode
/S
/Z
::
::
:: File Selection Options
::
:: /A                  copy only files with the Archive attribute set.
:: /M                  copy only files with the Archive attribute and reset it.
:: /IA:[RASHCNETO]     Include only files with any of the given Attributes set.
:: /XA:[RASHCNETO]     eXclude files with any of the given Attributes set.
:: /XF file [file]...  eXclude Files matching given names/paths/wildcards.
:: /XD dirs [dirs]...  eXclude Directories matching given names/paths.
:: /XC                 eXclude Changed files.
:: /XN                 eXclude Newer files.
:: /XO                 eXclude Older files.
:: /XX                 eXclude eXtra files and directories.
:: /XL                 eXclude Lonely files and directories.
:: /IS                 Include Same files.
:: /IT                 Include Tweaked files.
:: /MAX:n              MAXimum file size - exclude files bigger than n bytes.
:: /MIN:n              MINimum file size - exclude files smaller than n bytes.
:: /MAXAGE:n           MAXimum file AGE - exclude files older than n days/date.
:: /MINAGE:n           MINimum file AGE - exclude files newer than n days/date.
:: /MAXLAD:n           MAXimum Last Access Date - exclude files unused since n.
:: /MINLAD:n           MINimum Last Access Date - exclude files used since n.
::                     (If n < 1900 then n = n days, else n = YYYYMMDD date).
:: /XJ                 eXclude Junction points. (normally included by default).
:: /FFT                assume FAT File Times (2-second granularity).
:: /DST                compensate for one-hour DST time differences.
:: /XJD                eXclude Junction points for Directories.
:: /XJF                eXclude Junction points for Files.
::
::
:: Excludes files with a Last Modified Date older than n days or specified date.
:: If n is less than 1900, then n is expressed in days. Otherwise, n is a date expressed as YYYYMMDD
/maxage:180 :: exclude files over 6 months old
/XJ
/XO
:: Exclude the following folders from being copied
/XD
Content.IE5
Cookies
History
MSOCache
TEMP
"System Volume Information"
"Temporary Internet Files"
::
:: Exclude the following files from being copied
"*.TMP"
"~*.*"
pagefile.sys
::
::
:: Retry Options
::
:: /R:n                number of Retries on failed copies: default 1 million.
:: /W:n                Wait time between retries: default is 30 seconds.
:: /REG                Save /R:n and /W:n in the Registry as default settings.
:: /TBD                wait for sharenames To Be Defined (retry error 67).
::
/R:25
/W:60
::
::
:: Logging Options
::
:: /L                  List only - don't copy, timestamp or delete any files.
:: /X                  report all eXtra files, not just those selected.
:: /V                  produce Verbose output, showing skipped files.
:: /TS                 include source file Time Stamps in the output.
:: /FP                 include Full Pathname of files in the output.
:: /BYTES              Print sizes as bytes.
:: /NS                 No Size - don't log file sizes.
:: /NC                 No Class - don't log file classes.
:: /NFL                No File List - don't log file names.
:: /NDL                No Directory List - don't log directory names.
:: /NP                 No Progress - don't display percentage copied.
:: /ETA                show Estimated Time of Arrival of copied files.
:: /LOG:file           output status to LOG file (overwrite existing log).
:: /LOG+:file          output status to LOG file (append to existing log).
:: /UNILOG:file        output status to LOG file as UNICODE (overwrite existing log).
:: /UNILOG+:file       output status to LOG file as UNICODE (append to existing log).
:: /TEE                output to console window, as well as the log file.
:: /NJH                No Job Header.
:: /NJS                No Job Summary.
:: /UNICODE            output status as UNICODE.
::
/TEE
/LOG:C:\ProfileMoves\FileToCopyLog.txt
/NDL
/NP
::
::
:: /V Produces verbose output (including skipped files)
/V
::
:: Job Options
::
:: /JOB:jobname        take parameters from the named JOB file.
:: /SAVE:jobname       SAVE parameters to the named job file
:: /QUIT               QUIT after processing command line (to view parameters).
:: /NOSD               NO Source Directory is specified.
:: /NODD               NO Destination Directory is specified.
:: /IF                 Include the following Files.
::
::
:: END of Job file
::



Files to Copy job file
 Code:
:: List of file types to copy.  To exclude files add a double colon :: in front of the file type as a remark or comment.
:: That will prevent that file type from being copied to the destination
:: To add a file extension create a new line and add it like the others listed below
::
:: File list created by AdvancedSetup on 9/28/2012 6:00:00 PM
::
:: NOTE ****** .EXE, .COM, .DAT files have been excluded on purpose if you want or need
:: to copy many more files than those listed below you may want to just use the default *.*
::
/IF
*.3dm
*.3DMF
*.3DS
*.3DT
*.3DV
*.3FX
*.3g2
*.3GA
*.3GP
*.3GR
*.4MD
*.7z
*.ABF
*.ABR
*.ACA
*.accdb
*.ACE
*.ACL
*.ACM
*.ACMB
*.ACO
*.ACT
*.ADA
*.ADM
*.ADT
*.AEP
*.AF2
*.AF3
*.ai
*.aif
*.AIR
*.ANI
*.API
*.ART
*.ARTX
*.ASC
*.asf
*.ASI
*.ASM
*.asp
*.aspx
*.AST
*.asx
*.ASZ
*.avi
*.AWK
*.AZW
*.AZW1
*.AZW2
*.BAK
*.BAR
*.BAS
*.BAT
*.BCP
*.BDF
*.BDMV
*.BFC
*.BFX
*.BIB
*.BIF
*.BIN
*.bmp
*.BUD
*.BZ2
*.c
*.cab
*.CAP
*.CAS
*.CBL
*.cbr
*.CBT
*.CDA
*.CDL
*.CDM
*.CDR
*.CDT
*.CEL
*.cer
*.cfg
*.cfm
*.CFML
*.CHM
*.class
*.CLP
*.CLPI
*.CLS
*.CMF
*.cpp
*.crx
*.cs
*.csr
*.css
*.CSV
*.CTX
*.cue
*.CUR
*.DAO
*.db
*.dbf
*.DIC
*.doc
*.DSS
*.DST
*.dtd
*.DUN
*.DVP
*.dwg
*.DWZ
*.dxf
*.DXN
*.DXP
*.efx
*.EMF
*.EML
*.eps
*.EPS2
*.epub
*.FFL
*.FFO
*.FLA
*.flv
*.FLX
*.FM3
*.fnt
*.fon
*.FRM
*.gadget
*.gbr
*.GCD
*.gif
*.gpx
*.h
*.HPGL
*.hqx
*.HT
*.htm
*.html
*.ibooks
*.ICL
*.ICO
*.iff
*.indd
*.ini
*.iso
*.java
*.JPEG
*.jpg
*.js
*.jsp
*.KEY
*.kml
*.LAB
*.LEX
*.LIT
*.lnk
*.log
*.LSP
*.m3u
*.m4a
*.MAP
*.MAQ
*.MAR
*.MAT
*.max
*.MCD
*.MCF
*.MDB
*.MDL
*.MID
*.MIDI
*.MKI
*.MKV
*.MLV
*.MOD
*.MON
*.mov
*.mp3
*.mp4
*.mpa
*.MPEG
*.mpg
*.MPP
*.msg
*.MSP
*.MTV
*.MUS
*.MWF
*.N2K
*.obj
*.odt
*.OFX
*.OGG
*.OMA
*.ORG
*.OST
*.otf
*.OTS
*.OTT
*.OTX
*.PAD
*.pages
*.PAK
*.PAN
*.PAR
*.PAS
*.PB
*.PBK
*.PCB
*.PCD
*.PCL
*.pct
*.pdb
*.PDD
*.pdf
*.PDG
*.PDM
*.PFB
*.PGP
*.PHN
*.php
*.PIC
*.PK2
*.PK3
*.PK4
*.PKA
*.pl
*.PLC
*.PLT
*.PM
*.PM3
*.PM4
*.PM5
*.PM6
*.PNG
*.POT
*.pp
*.PPD
*.PPS
*.PPT
*.PRF
*.PRN
*.ps
*.psd
*.PSP
*.pspimage
*.PST
*.PTM
*.PUB
*.PX
*.py
*.QB
*.QBB
*.QBE
*.QBF
*.QCP
*.QDF
*.QFX
*.QIF
*.QIZ
*.QT
*.QTVR
*.ra
*.RAM
*.rar
*.RAW
*.RB
*.RC
*.REC
*.REG
*.RIF
*.rm
*.RPD
*.RPF
*.RSC
*.rtf
*.RUN
*.RWZ
*.SAM
*.SCR
*.SCX
*.SDR
*.SDW
*.SEC
*.SF2
*.SFX
*.SGI
*.SGML
*.sit
*.sln
*.SNP
*.sql
*.SQZ
*.srt
*.SSV
*.svg
*.swf
*.SXC
*.SXD
*.SXG
*.SXI
*.SXM
*.SXW
*.TBK
*.tex
*.tga
*.thm
*.tif
*.TIFF
*.TLX
*.TORRENT
*.ttf
*.txt
*.TY
*.UDF
*.UOP
*.UOS
*.UOT
*.URL
*.UUE
*.vbs
*.VBX
*.vcd
*.vcf
*.vcxproj
*.VM
*.vob
*.VSS
*.VST
*.VSTO
*.VUE
*.VWR
*.VWX
*.W3D
*.wav
*.WB1
*.WB2
*.WBK
*.WBT
*.WCD
*.WCH
*.WFX
*.WG1
*.WG2
*.WID
*.WIM
*.WIN
*.WIX
*.WK1
*.WK3
*.WK4
*.WKB
*.WKE
*.WKI
*.WKQ
*.WKS
*.wma
*.WMC
*.WMDB
*.WMF
*.wmv
*.WNF
*.WP5
*.wpd
*.wps
*.WRI
*.WRK
*.WS
*.WS2
*.WSD
*.wsf
*.WSZ
*.XCF
*.XE
*.xhtml
*.XIF
*.XLB
*.XLC
*.XLD
*.XLM
*.xlr
*.xls
*.XLSM
*.xml
*.XQT
*.yuv
*.ZIP
*.zipx
:: ******* END OF LIST  **********

Top
#205859 - 2012-09-29 03:45 AM Re: User migration script [Re: NTDOC]
Lonkero Administrator Offline
KiX Master Guru
*****

Registered: 2001-06-05
Posts: 22335
Loc: OK
doc, you're insane!
with that list of links you put even MCA into shame!
_________________________
!

download KiXnet

Top
#205860 - 2012-09-29 03:54 AM Re: User migration script [Re: Lonkero]
NTDOC Administrator Offline
Administrator
*****

Registered: 2000-07-28
Posts: 11571
Loc: CA
LOL - Well some of the newer Admins haven't read up on a lot of this stuff so thought I'd share the wealth.
Top
#205865 - 2012-09-29 04:16 AM Re: User migration script [Re: NTDOC]
Lonkero Administrator Offline
KiX Master Guru
*****

Registered: 2001-06-05
Posts: 22335
Loc: OK
and talking about that entity, someone needs to find out once and for all, was it a group of ppl or just a one man referring to himself as we.
still annoyis me not knowing, after 10 freakin' years!!!
_________________________
!

download KiXnet

Top
Page 1 of 1 1


Moderator:  Jochen, Allen, Radimus, Glenn Barnas, ShaneEP, Arend_, Mart 
Hop to:
Shout Box

Who's Online
0 registered and 176 anonymous users online.
Newest Members
diefnet, Arogya, gkustra, emnipetro, Hirze
17644 Registered Users

Generated in 0.031 seconds in which 0.011 seconds were spent on a total of 13 queries. Zlib compression enabled.

Search the board with:
superb Board Search
or try with google:
Google
Web kixtart.org