Unfortunately no one can be told what fun_plug is - you have to see it for yourself.
You are not logged in.
rsync is having an issue copying some specific files from volume 1 to volume 2 for some reason. It errors everytime (set to backup everyday at 4am, incremental). Does anyone know what the i/o error 5 is?
I'm using DNS323 with 2 500GB Seagate HDDs using FFP0.5. Here is the script that initiates the backup:
---script----
srcpath='/mnt/HD_a2/Media /mnt/HD_a2/External_Backup'
export PATH=/ffp/sbin:/ffp/bin:$PATH
dstpath=/mnt/HD_b2/Backup
ffppath=/ffp
date=`date +"%m-%d-%Y_%H:%M:%S"`
mkdir $dstpath/$date
$ffppath/bin/rsync -avx --link-dest=$dstpath/current $srcpath $dstpath/$date > /mnt/HD_a2/logs/snapshot.log 2>&1
var=`ls -lA $dstpath/$date | wc -l`
if [ $var -ne 0 ]
then
rm $dstpath/current
ln -s $date $dstpath/current
fi
----end of script----
Then here is the log file from the backup after it's run:
----log file-----
sending incremental file list
Media/.DS_Store
Media/Movies/
Media/Movies/.DS_Store
Media/Movies/Get Him To The Greek.2010.DvdRip.Xvid {1337x}-Noir.avi
Media/Movies/The.Expendables.2010.480p.BRRip.XviD.AC3-ViSiON.avi
Media/Movies/Twelve.2010.DVDSCR.XviD-BLUNTROLA.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Twelve.2010.DVDSCR.XviD-BLUNTROLA.avi": Input/output error (5)
Media/Movies/Working.Miracles.2010.DVDRip.XviD-VoMiT.avi
Media/Movies/ruby-npersonal.avi
Media/Movies/Disney Movies/
Media/Movies/Disney Movies/.DS_Store
Media/Movies/Disney Movies/1940 - Pinocchio.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1940 - Pinocchio.avi": Input/output error (5)
Media/Movies/Disney Movies/1945 - The Three Caballeros.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1945 - The Three Caballeros.avi": Input/output error (5)
Media/Movies/Disney Movies/1950 - Cinderella.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1950 - Cinderella.avi": Input/output error (5)
Media/Movies/Disney Movies/1951 - Alice in Wonderland.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1951 - Alice in Wonderland.avi": Input/output error (5)
Media/Movies/Disney Movies/1971 - Bedknobs and Broomsticks.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1971 - Bedknobs and Broomsticks.avi": Input/output error (5)
Media/Movies/Disney Movies/1977 - Pete's Dragon.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1977 - Pete's Dragon.avi": Input/output error (5)
Media/Movies/Disney Movies/1989 - The Little Mermaid.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1989 - The Little Mermaid.avi": Input/output error (5)
Media/Movies/Disney Movies/1994 - The Lion King.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1994 - The Lion King.avi": Input/output error (5)
Media/Movies/Disney Movies/2002 - Treasure Planet.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2002 - Treasure Planet.avi": Input/output error (5)
Media/Movies/Disney Movies/2003 - Kim Possible - A Stitch In Time.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2003 - Kim Possible - A Stitch In Time.avi": Input/output error (5)
Media/Movies/Disney Movies/2003 - The Jungle Book 2.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2003 - The Jungle Book 2.avi": Input/output error (5)
Media/Movies/Disney Movies/2007 - Cinderella III - A Twist in Time.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2007 - Cinderella III - A Twist in Time.avi": Input/output error (5)
Media/Movies/Disney Movies/2008 - The Little Mermaid - Ariel's Beginning.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2008 - The Little Mermaid - Ariel's Beginning.avi": Input/output error (5)
Media/Movies/Disney Movies/Thomas and Friends - Misty Island Rescue.avi
Media/Music/
WARNING: Media/Movies/Twelve.2010.DVDSCR.XviD-BLUNTROLA.avi failed verification -- update discarded (will try again).
Media/Movies/Twelve.2010.DVDSCR.XviD-BLUNTROLA.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Twelve.2010.DVDSCR.XviD-BLUNTROLA.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1940 - Pinocchio.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1940 - Pinocchio.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1940 - Pinocchio.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1945 - The Three Caballeros.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1945 - The Three Caballeros.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1945 - The Three Caballeros.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1950 - Cinderella.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1950 - Cinderella.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1950 - Cinderella.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1951 - Alice in Wonderland.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1951 - Alice in Wonderland.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1951 - Alice in Wonderland.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1971 - Bedknobs and Broomsticks.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1971 - Bedknobs and Broomsticks.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1971 - Bedknobs and Broomsticks.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1977 - Pete's Dragon.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1977 - Pete's Dragon.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1977 - Pete's Dragon.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1989 - The Little Mermaid.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1989 - The Little Mermaid.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1989 - The Little Mermaid.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1994 - The Lion King.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1994 - The Lion King.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1994 - The Lion King.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/2002 - Treasure Planet.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/2002 - Treasure Planet.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2002 - Treasure Planet.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/2003 - Kim Possible - A Stitch In Time.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/2003 - Kim Possible - A Stitch In Time.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2003 - Kim Possible - A Stitch In Time.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/2003 - The Jungle Book 2.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/2003 - The Jungle Book 2.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2003 - The Jungle Book 2.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/2007 - Cinderella III - A Twist in Time.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/2007 - Cinderella III - A Twist in Time.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2007 - Cinderella III - A Twist in Time.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/2008 - The Little Mermaid - Ariel's Beginning.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/2008 - The Little Mermaid - Ariel's Beginning.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2008 - The Little Mermaid - Ariel's Beginning.avi": Input/output error (5)
ERROR: Media/Movies/Twelve.2010.DVDSCR.XviD-BLUNTROLA.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1940 - Pinocchio.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1945 - The Three Caballeros.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1950 - Cinderella.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1951 - Alice in Wonderland.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1971 - Bedknobs and Broomsticks.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1977 - Pete's Dragon.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1989 - The Little Mermaid.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1994 - The Lion King.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/2002 - Treasure Planet.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/2003 - Kim Possible - A Stitch In Time.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/2003 - The Jungle Book 2.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/2007 - Cinderella III - A Twist in Time.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/2008 - The Little Mermaid - Ariel's Beginning.avi failed verification -- update discarded.
Media/Music/Train - Drops of Jupiter/Train - Drops of Jupiter (01) She's On Fire.mp3
Media/Music/Train - Drops of Jupiter/Train - Drops of Jupiter (02) I Wish You Would.mp3
Media/Music/Train - Drops of Jupiter/Train - Drops of Jupiter (03) Drops of Jupiter.mp3
Media/Music/Train - Drops of Jupiter/Train - Drops of Jupiter (04) It's About You.mp3
Media/Music/Train - Drops of Jupiter/Train - Drops of Jupiter (05) Hopeless.mp3
Media/Music/Train - Drops of Jupiter/Train - Drops of Jupiter (06) Respect.mp3
Media/Music/Train - Drops of Jupiter/Train - Drops of Jupiter (07) Let It Roll.mp3
Media/Music/Train - Drops of Jupiter/Train - Drops of Jupiter (08) Something More.mp3
Media/Music/Train - Drops of Jupiter/Train - Drops of Jupiter (09) Whipping Boy.mp3
Media/Music/Train - Drops of Jupiter/Train - Drops of Jupiter (10) Getaway.mp3
Media/Music/Train - Drops of Jupiter/Train - Drops of Jupiter (11) Mississippi.mp3
Media/Music/Train - My Private Nation/Train - My Private Nation (01) Calling All Angels.mp3
Media/Music/Train - My Private Nation/Train - My Private Nation (02) All American Girl.mp3
Media/Music/Train - My Private Nation/Train - My Private Nation (03) When I Look To The Sky.mp3
Media/Music/Train - My Private Nation/Train - My Private Nation (04) Save The Day.mp3
Media/Music/Train - My Private Nation/Train - My Private Nation (05) My Private Nation.mp3
Media/Music/Train - My Private Nation/Train - My Private Nation (06) Get To Me.mp3
Media/Music/Train - My Private Nation/Train - My Private Nation (07) Counting Airplanes.mp3
Media/Music/Train - My Private Nation/Train - My Private Nation (08) Following Rita.mp3
Media/Music/Train - My Private Nation/Train - My Private Nation (09) Your Every Color.mp3
Media/Music/Train - My Private Nation/Train - My Private Nation (10) Lincoln Avenue.mp3
Media/Music/Train - My Private Nation/Train - My Private Nation (11) I'm About To Come Alive.mp3
Media/Music/Train - Save Me San Francisco [2009]/
Media/Music/Train - Save Me San Francisco [2009]/01 Train - Save Me San Francisco.mp3
Media/Music/Train - Save Me San Francisco [2009]/02 Train - Hey, Soul Sister.mp3
Media/Music/Train - Save Me San Francisco [2009]/03 Train - I Got You.mp3
Media/Music/Train - Save Me San Francisco [2009]/04 Train - Parachute.mp3
Media/Music/Train - Save Me San Francisco [2009]/05 Train - This Ain't Goodbye.mp3
Media/Music/Train - Save Me San Francisco [2009]/06 Train - If It's Love.mp3
Media/Music/Train - Save Me San Francisco [2009]/07 Train - You Already Know.mp3
Media/Music/Train - Save Me San Francisco [2009]/08 Train - Words.mp3
Media/Music/Train - Save Me San Francisco [2009]/09 Train - Brick By Brick.mp3
Media/Music/Train - Save Me San Francisco [2009]/10 Train - Breakfast In Bed.mp3
Media/Music/Train - Save Me San Francisco [2009]/11 Train - Marry Me.mp3
Media/Music/Train - Save Me San Francisco [2009]/Train - Save Me San Francisco [Front].jpg
Media/Music/Train - Train/Train - Train (01) Meet Virginia.mp3
Media/Music/Train - Train/Train - Train (02) I Am.mp3
Media/Music/Train - Train/Train - Train (03) If You Leave.mp3
Media/Music/Train - Train/Train - Train (04) Homesick.mp3
Media/Music/Train - Train/Train - Train (05) Free.mp3
Media/Music/Train - Train/Train - Train (06) Blind.mp3
Media/Music/Train - Train/Train - Train (07) Eggplant.mp3
Media/Music/Train - Train/Train - Train (08) Idaho.mp3
Media/Music/Train - Train/Train - Train (09) Days.mp3
Media/Music/Train - Train/Train - Train (10) Rat.mp3
Media/Music/Train - Train/Train - Train (11) Swaying.mp3
Media/Music/Train - Train/Train - Train (12) Train.mp3
Media/Music/Train - Train/Train - Train (13) Heavy.mp3
sent 25372490393 bytes received 9562 bytes 1445850.07 bytes/sec
total size is 347104658480 speedup is 13.68
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1040) [sender=3.0.5]
---end of log file----
as you can see, some do copy fine (the Train music and some movies at the top). But the Disney movies are having issues, as well as another movie (not in the Disney folder).
Any ideas?
Thanks!
Last edited by bound4h (2010-09-24 01:43:24)
Offline
Usually indicates a filesystem error. What FS types are you using? Have you checked the permissions as well?
Offline
It's whatever FS the DNS-323 formats them when you have them in the Standard configuration (each drive is separate). And the FW is 1.08 and the permissions are all (for every Disney movie in that folder) 777 and nobody:501. So I have no clue man. Thanks for tryin
Last edited by bound4h (2010-09-24 04:03:53)
Offline
Just for fun, try renaming one of the problem files to something really short and easy like test.avi and see if rsync likes that better.
As for the FS, you have the option of EXT2 or EXT3.
Last edited by FunFiler (2010-09-24 06:25:07)
Offline
Which version of rsync are you using?
I had similar problems with rsync 3.0.6. Once I upgraded to rsync 3.0.7, I still got warnings, albeit a lot fewer warnings, but the errors completely went away.
See: http://dns323.kood.org/forum/viewtopic.php?id=5334
Offline
FunFiler wrote:
As for the FS, you have the option of EXT2 or EXT3.
I have EXT2 for both Volumes in Standard config.
thebeck wrote:
Which version of rsync are you using?
What command would I use to determine this?
Thanks!
Last edited by bound4h (2010-09-28 17:02:55)
Offline
rsync --version
Offline
Ok, I have version 3.0.5. How do I update to 3.0.7 using Fonz's package in the thread you posted, FunFiler? Do I have to uninstall the previous version? Will this affect my current jobs, assuming they aren't running at the time of course.
Thanks!
Offline
Download the new rsync archive and put it into a folder such as /ffp/packages (the same as the distribution).
Then, cd to the directory where the new rsync is and type
funpkg -u rsync-3.0.7-1.tgz
You will see something like:
/mnt/HD_a2/ffp/packages # funpkg -u rsync-3.0.7-1.tgz
Installing package rsync-3.0.7-1 ...
rsync is a replacement for rcp that has many more features.
rsync uses the "rsync algorithm" which provides a very fast method for
bringing remote files into sync. It does this by sending just the
differences in the files across the link, without requiring that both
sets of files are present at one of the ends of the link beforehand.
This makes rsync a good remote file distribution/synchronisation utility
in a dialup PPP/SLIP environment.
Note: it requires rsync on the destination machine.
There is a Computer Science Technical Report on the rsync algorithm
included in the distribution, and is also available as
ftp://samba.anu.edu.au/pub/rsync/tech_report.ps
[pkgsrc]
Removing package rsync-3.0.5-1 ...It should have zero impact on any existing jobs.
Last edited by FunFiler (2010-09-29 03:13:23)
Offline
Got it updated, thanks!
Now, I started the incremental backup and now we wait...Will post back with results
Offline
Bah, no luck. Here is the new log file for the backup:
----start log file-----
sending incremental file list
Media/Movies/Invictus.mkv
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Invictus.mkv": Input/output error (5)
Media/Movies/Twelve.2010.DVDSCR.XviD-BLUNTROLA.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Twelve.2010.DVDSCR.XviD-BLUNTROLA.avi": Input/output error (5)
Media/Movies/Disney Movies/1940 - Pinocchio.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1940 - Pinocchio.avi": Input/output error (5)
Media/Movies/Disney Movies/1945 - The Three Caballeros.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1945 - The Three Caballeros.avi": Input/output error (5)
Media/Movies/Disney Movies/1950 - Cinderella.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1950 - Cinderella.avi": Input/output error (5)
Media/Movies/Disney Movies/1951 - Alice in Wonderland.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1951 - Alice in Wonderland.avi": Input/output error (5)
Media/Movies/Disney Movies/1971 - Bedknobs and Broomsticks.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1971 - Bedknobs and Broomsticks.avi": Input/output error (5)
Media/Movies/Disney Movies/1977 - Pete's Dragon.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1977 - Pete's Dragon.avi": Input/output error (5)
Media/Movies/Disney Movies/1989 - The Little Mermaid.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1989 - The Little Mermaid.avi": Input/output error (5)
Media/Movies/Disney Movies/1994 - The Lion King.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1994 - The Lion King.avi": Input/output error (5)
Media/Movies/Disney Movies/2002 - Treasure Planet.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2002 - Treasure Planet.avi": Input/output error (5)
Media/Movies/Disney Movies/2003 - Kim Possible - A Stitch In Time.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2003 - Kim Possible - A Stitch In Time.avi": Input/output error (5)
Media/Movies/Disney Movies/2003 - The Jungle Book 2.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2003 - The Jungle Book 2.avi": Input/output error (5)
Media/Movies/Disney Movies/2007 - Cinderella III - A Twist in Time.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2007 - Cinderella III - A Twist in Time.avi": Input/output error (5)
Media/Movies/Disney Movies/2008 - The Little Mermaid - Ariel's Beginning.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2008 - The Little Mermaid - Ariel's Beginning.avi": Input/output error (5)
WARNING: Media/Movies/Invictus.mkv failed verification -- update discarded (will try again).
Media/Movies/Invictus.mkv
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Invictus.mkv": Input/output error (5)
WARNING: Media/Movies/Twelve.2010.DVDSCR.XviD-BLUNTROLA.avi failed verification -- update discarded (will try again).
Media/Movies/Twelve.2010.DVDSCR.XviD-BLUNTROLA.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Twelve.2010.DVDSCR.XviD-BLUNTROLA.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1940 - Pinocchio.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1940 - Pinocchio.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1940 - Pinocchio.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1945 - The Three Caballeros.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1945 - The Three Caballeros.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1945 - The Three Caballeros.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1950 - Cinderella.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1950 - Cinderella.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1950 - Cinderella.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1951 - Alice in Wonderland.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1951 - Alice in Wonderland.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1951 - Alice in Wonderland.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1971 - Bedknobs and Broomsticks.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1971 - Bedknobs and Broomsticks.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1971 - Bedknobs and Broomsticks.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1977 - Pete's Dragon.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1977 - Pete's Dragon.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1977 - Pete's Dragon.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1989 - The Little Mermaid.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1989 - The Little Mermaid.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1989 - The Little Mermaid.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/1994 - The Lion King.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/1994 - The Lion King.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/1994 - The Lion King.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/2002 - Treasure Planet.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/2002 - Treasure Planet.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2002 - Treasure Planet.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/2003 - Kim Possible - A Stitch In Time.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/2003 - Kim Possible - A Stitch In Time.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2003 - Kim Possible - A Stitch In Time.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/2003 - The Jungle Book 2.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/2003 - The Jungle Book 2.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2003 - The Jungle Book 2.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/2007 - Cinderella III - A Twist in Time.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/2007 - Cinderella III - A Twist in Time.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2007 - Cinderella III - A Twist in Time.avi": Input/output error (5)
WARNING: Media/Movies/Disney Movies/2008 - The Little Mermaid - Ariel's Beginning.avi failed verification -- update discarded (will try again).
Media/Movies/Disney Movies/2008 - The Little Mermaid - Ariel's Beginning.avi
rsync: read errors mapping "/mnt/HD_a2/Media/Movies/Disney Movies/2008 - The Little Mermaid - Ariel's Beginning.avi": Input/output error (5)
ERROR: Media/Movies/Invictus.mkv failed verification -- update discarded.
ERROR: Media/Movies/Twelve.2010.DVDSCR.XviD-BLUNTROLA.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1940 - Pinocchio.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1945 - The Three Caballeros.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1950 - Cinderella.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1951 - Alice in Wonderland.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1971 - Bedknobs and Broomsticks.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1977 - Pete's Dragon.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1989 - The Little Mermaid.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/1994 - The Lion King.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/2002 - Treasure Planet.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/2003 - Kim Possible - A Stitch In Time.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/2003 - The Jungle Book 2.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/2007 - Cinderella III - A Twist in Time.avi failed verification -- update discarded.
ERROR: Media/Movies/Disney Movies/2008 - The Little Mermaid - Ariel's Beginning.avi failed verification -- update discarded.
sent 34957766177 bytes received 8520 bytes 1970062.54 bytes/sec
total size is 352132224569 speedup is 10.07
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7]
----end of log file-----
What's odd is that the very first one "invictus.m4v" seems like a normal filename? So I wouldn't think the file name is causing the issue. The permissions are all 777:nobody:501, too.
Ahhhhhh
Offline
How many files are involved here?
Rsync makes a list of all the files that it needs to work with and keeps that list in RAM. If RAM fills up and does not leave much RAM for the file operations, you could get this sort of error.
You might try running rsync on just one of the offending files, just to see if it works. You'd have to change your srcpath and dstpath setting in your script accordingly. If that works, try doing entire directories, etc.
If this seems to help, then it might be possible that your INITIAL rsync may have to be done in piecemeal fashion like this. Since many of your files are probably media files like music files, they probably will not change. Rsync may need to keep a shorter "work list" in memory if it discovers that many files have not changed and so do not have to be updated. So, after an initial rsync, subsequent executions may succeed.
I do something similar with rsync and I *think* I've noticed that if I add a ton of new files to my rsync dirs, I sometimes see errors like these. I don't recall exactly how I fixed it, but I may have done something like I described.
You might try running "top" and watch the free memory status while you start up rsync. Recall that the DNS-323 does not have a lot of RAM and so it is easy to bump up against the limits.
While you are running "top", you might check for processes that are using up a lot of RAM. On my machine, top shows about 17076K free when it really isn't doing anything. My biggest process is sshd at 2.2%. When I startup rsnapshot (wrapper around rsync) the free memory drops to 1500K or so.
If you've got some memory hogging process running, that may limit the number of files rsync can process. You might try shutting down that process and see if rsync runs better.
My only other thought is that the files are actually damaged, but I assume that you can still read them OK.
Offline
karlrado,
top shows that /webs/web (or something like that) is using 11%, consistently. Although, when I just type 'top', I don't see avail mem, etc. All I see is the PID, PPID, VMEM (or soemething like that), %MEM, %CPU and the process name. I did all that from memory, but I know there is no column that shows exact RAM use in Kb, only the Virtual column. Do you run top with any parameters?
Also, when I try to run a check disk (through the DNS323 admin page) it says it fails. I can't remember the exact wording, but it doesn't even get to 1%. And after it fails, the only button is Restart for the DNS. BUT, I can access files just fine on the target volume (Volume 1) and I don't hear clicking noises, etc, common of drives failing. I can't pull out the drive and hook it up anywhere bc I only have laptops and no enclosures.
Also, I use the --link-dest option of rsync bc I have it running nightly and don't want duplicate backups, so it just links to a newly created folder called "current". The process is here: http://dns323.kood.org/howto:backup (near the bottom).
So if I use the hard-linking option of rsync, can I just "cp" the files over and then use rsync to incrementally backup moving forward? Or does rsync have to do the initial backup?
Any ideas?
Offline
We're trying to rule things out instead of adding to the list of possibilities.
Are you able to access/use the original files without disk errors? If so, let's not complicate things with disk checking discussions. Besides, you probably have to take the disks offline to check them; I don't know what is up with the disk check in the web interface. I'll assume that you can play your music and watch the movies off the DNS.
I suggested running top WHILE your failing snapshot script is running to see if it is using a ton of memory. The result might still be useful.
Assuming my guess that you are running out of memory is still a possibility, you might try limiting the number of files with the --include option to rsync. Look it up to see the exact usage.
But the idea is that you could add
--exclude "*" --include "Disney Movies"
or something like that to the rsync command in the script so that a smaller set of files is considered. I think that the above would only sync the files with Disney in the path.
You could do the same thing with Music, etc.
Since you were getting errors in the Disney directories, this may be a way to "get through" the Disney directory for the initial backup.
If syncing only part of your tree works, then I think memory was the problem. You could then sync the other parts of your tree in a similar fashion.
Hopefully, later, on subsequent launches of your snapshot script, without the exclude and include options, you won't run out of memory because the files have already been synced and won't stay in the list of work to do, which is where the memory is being used up.
Offline
Figured out the issue, in case anyone comes across this issue in the future and finds this thread.
It was simple, but did not discover this until I realized SMART tests were failing. The source disk was starting to fail, and a lot of the files were becoming corrupt, hence why rsync could not access them. Looking back it makes perfect sense, but hopefully this helps someone with the same error in the future.
Offline