DSM-G600, DNS-3xx and NSA-220 Hack Forum

Unfortunately no one can be told what fun_plug is - you have to see it for yourself.

You are not logged in.

Announcement

#1 2008-05-18 16:54:05

bspvette86
Member
Registered: 2008-05-09
Posts: 81

Anyone using EXT3 on DNS-323

Just curious if anyone is taking advantage of the "hidden" ext3 capability of the DNS-323.  Is there some problem with ext3 that caused Dlink to remove the ext2/ext3 prompt that is shown in the documentation?  I was playing around with a scratch drive last night and it appears to work. 

Cheers!
bspvette

Offline

 

#2 2008-05-18 18:11:18

fordem
Member
Registered: 2007-01-26
Posts: 1938

Re: Anyone using EXT3 on DNS-323

How about a search?

In the early firmware versions (I believe prior to 1.02b) the ext3 file system was offered as a choice in the format menu, and seems to have been linked to reports of massive data corruption - I do know that after the option was removed the reports seem to have stopped, I don not know if any work was done on the ext3 implementation in the ensuing firmware revisions - 1.03/1.04/1.05 - but if you're offering to "guinea pig" it, then go brave.

Offline

 

#3 2008-05-19 23:38:59

bspvette86
Member
Registered: 2008-05-09
Posts: 81

Re: Anyone using EXT3 on DNS-323

It is not listed in the "Known_issues" section of the wiki. 

Sure, I'll guinea pig on 1.05.

Cheers!
K

Offline

 

#4 2008-05-20 19:27:44

bspvette86
Member
Registered: 2008-05-09
Posts: 81

Re: Anyone using EXT3 on DNS-323

I am now "guinea pigging" EXT3 on 1.05 in a raid 1 config.  Other than the reformat to EXT2 message that pops up when I log into the Web config, it appears to be functioning without a hitch.  I have copied roughly 9000 files totaling 38GB of various types of media content.  Directory structure and playback appears to be working correctly.

Anyone have first hand experience on what problems to expect and how easily to reproduce?  I plan on running a mass file compare later this week after loading up a bunch more data, break/rebuild raid, and doing a handfull of standard and nonstandard shutdown, powerloss scenarios.

Cheers!
BSP

Offline

 

#5 2008-05-21 00:01:40

bspvette86
Member
Registered: 2008-05-09
Posts: 81

Re: Anyone using EXT3 on DNS-323

I'm up to 175 GB with no problems now.  Have a handfull of fairly large .ts and backup files.  (ie 9, 12, 16, and 84GB)

Offline

 

#6 2008-05-21 00:53:33

fordem
Member
Registered: 2007-01-26
Posts: 1938

Re: Anyone using EXT3 on DNS-323

Have you tried a restore or a compare of the stored data?

One of the things I do for peace of mind is run a verify as a part of the backup.

Offline

 

#7 2008-05-21 01:37:54

bspvette86
Member
Registered: 2008-05-09
Posts: 81

Re: Anyone using EXT3 on DNS-323

fordem wrote:

Have you tried a restore or a compare of the stored data?

One of the things I do for peace of mind is run a verify as a part of the backup.

Fordem,
I plan on verifying "Everything" and stressing the buh jee beez out of it.  I've been a hack since home computers came with LED displays, were backed up on cassette recorders, upgrading from 1k to 4k of memory was a big deal, and modems had acoustic couplers...  Boy was it hard to clean up after the new years party when we used the paper tape punch holes for confetti!

Right now I am in the process of filling up 500GB and have done some spot checks.  I figured if no-one else has tested this recently, I might as well give it a go.  Maybe if all goes well, we can put the pressure back on Dlink to re-enable EXT3.

Cheers!
BSP

Offline

 

#8 2008-05-21 02:15:30

fordem
Member
Registered: 2007-01-26
Posts: 1938

Re: Anyone using EXT3 on DNS-323

bspvette86 wrote:

I've been a hack since home computers came with LED displays, were backed up on cassette recorders, upgrading from 1k to 4k of memory was a big deal, and modems had acoustic couplers...  Boy was it hard to clean up after the new years party when we used the paper tape punch holes for confetti!
BSP

Gentlemen - I think I've been officially replaced as the oldest forum member - champagne, cigars and a ticker tape parade are in order here.

BSP - so what was your first system?

Offline

 

#9 2008-05-21 02:21:31

Dlink
Member
Registered: 2007-11-21
Posts: 106

Re: Anyone using EXT3 on DNS-323

fordem wrote:

bspvette86 wrote:

I've been a hack since home computers came with LED displays, were backed up on cassette recorders, upgrading from 1k to 4k of memory was a big deal, and modems had acoustic couplers...  Boy was it hard to clean up after the new years party when we used the paper tape punch holes for confetti!
BSP

Gentlemen - I think I've been officially replaced as the oldest forum member - champagne, cigars and a ticker tape parade are in order here.

BSP - so what was your first system?

So does this mean BSP will start making posts about Raid and BACKUP to fill in your Role fordem? hah.

Offline

 

#10 2008-05-21 02:33:21

fordem
Member
Registered: 2007-01-26
Posts: 1938

Re: Anyone using EXT3 on DNS-323

Dlink wrote:

So does this mean BSP will start making posts about Raid and BACKUP to fill in your Role fordem? hah.

Don't go sassing your elders now smile

Offline

 

#11 2008-05-21 05:14:00

bspvette86
Member
Registered: 2008-05-09
Posts: 81

Re: Anyone using EXT3 on DNS-323

fordem wrote:

BSP - so what was your first system?

My first computer was a Rockwell AIM-65 see http://oldcomputers.net/AIM-65.html
(had some of the optional boards pictured there as well)

So far I have 24441 files taking up 314GB on EXT3.  All directory structure is OK.  All File sizes are OK.  Spot checking via binary compare on a handfull of files of varying sizes and locations are all OK.  Running CRC compare of all files checks out OK.

Turning on FTP, UPnP, Itunes and checking....  100% uptime test so far.  No crash or reboots other than initial format to EXT3.

Cheers!
BSP

PS.  Unlike Fordem, I use Raid-0.  But similar to Fordem, I use protection!

Last edited by bspvette86 (2008-05-21 06:38:41)

Offline

 

#12 2008-05-21 10:59:30

SilentException
Member
From: Island of Krk, Croatia
Registered: 2008-05-04
Posts: 148

Re: Anyone using EXT3 on DNS-323

bspvette86 wrote:

PS.  Unlike Fordem, I use Raid-0.  But similar to Fordem, I use protection!

condoms? tongue


D-Link DNS-323 v1.05 fun_plug-ed + many mods,  2 x 320GB Seagate Barracuda 7200.10 RAID0, Cat6 Gigabit Network, 9k Jumbo Frames, Average (WRITE): 19,32 MB/sec, Average (READ): 28,6 MB/sec

Offline

 

#13 2008-05-21 11:30:23

HighWater
Member
Registered: 2007-08-10
Posts: 19

Re: Anyone using EXT3 on DNS-323

SilentException wrote:

bspvette86 wrote:

PS.  Unlike Fordem, I use Raid-0.  But similar to Fordem, I use protection!

condoms? tongue

Or his Geekness tongue

OT: hope it works, else i'm gonna waste my spare time aswell tongue

Offline

 

#14 2008-05-21 16:50:27

Biscotte
Member
Registered: 2007-05-21
Posts: 81

Re: Anyone using EXT3 on DNS-323

Off topic and not something that you shout about really but . . .

My first computer was a mainframe with card input at the tech college.  Seem to remember it was an IBM 4130.  Ran my programmes twice a week and got kicked off if it failed to finish within two minutes - FORTRAN and Algol.

When I went to university we had a state of the art Mini.  A PDP 11/8 with one k of core store.  It was a multi-user jobbie with five terminals, and paper tape output.  One of the guys used to programme it in assembler - we were not worthy. 

And that nice concurrent CPM.  What ever happened to that?  Used it on my Apricot for a while.  And the ZX81 . . . with the new fangled cassettes . . .

Before you ask, yes I still use WordStar version 7.0 - probably the best of at least 14 word processors I have had to learn (and love).  Keep your word for windows (doesn't deserve capitals).  F3, F3, F3, yes ring any bells for any of you?  I remember WPS plus was one of the very worst. 

Dbase 2 and Dbase 3 and Condor and FoxPro and  . . . I still think SuperCalc is the best spreadsheet.  What is all that having to put a plus sign in front of a formula thing all about?  Pixx poor programming if you ask me - oh yeah, it's a miscosoft product - a rarity in that you can kill most of its programmes from the keyboard (!) without really trying. 

Never really got into that Unix stuff.  The boys were very - only idiots don’t understand UNIX - which rather put me off. 

Now I'll just sit here and wait for the - that's nowt lad, when I was a boy  . . . here it comes !

Biscotte

Offline

 

#15 2008-05-21 17:20:52

bspvette86
Member
Registered: 2008-05-09
Posts: 81

Re: Anyone using EXT3 on DNS-323

SilentException wrote:

condoms? tongue

Power conditioning UPS.... lol  APC back-ups lol

Last edited by bspvette86 (2008-05-21 17:23:36)

Offline

 

#16 2008-05-21 17:42:42

bspvette86
Member
Registered: 2008-05-09
Posts: 81

Re: Anyone using EXT3 on DNS-323

Quick Update:
Been running 48 hours now with no problems.  Have written over 500 GB of data with no data corruption or directory problems.  (the types of errors I found googling)

The one problem I have found so far is that when FTPing an 89GB file, the DNS-323 closes the connection at the two hour mark.  Have tried the same send twice now and it bombed at two hours both times.  The same file transferred and verified via SMB fine...

Testing continues...

Cheers!
BSP

Offline

 

#17 2008-05-21 20:00:04

fordem
Member
Registered: 2007-01-26
Posts: 1938

Re: Anyone using EXT3 on DNS-323

bspvette86 wrote:

Power conditioning UPS.... lol  APC back-ups lol

Now - when I said backup - APC was not what I had in mind wink

Offline

 

#18 2008-05-22 04:30:46

bspvette86
Member
Registered: 2008-05-09
Posts: 81

Re: Anyone using EXT3 on DNS-323

I have been thrashing this thing to death the last coupled days and have yet to find any data issues.  I have written and read close to 1 TB of data, filled the disks to 100% and got the email alert, done large local copies and tars within the unit from telnet,  let the power management sleep the drives, created large numbers of small files, mixed sizes of files, a few really large files, created large directory trees,  used the various services (SMB, UPnP, iTunes, FTP) from various devices and OSes without any reboots. 

At this point, I am going to do some bad things like pulling the power, popping a drive out to break the RAID-1, rebooting in the middle of file copies, etc... to see if that has any impact on anything other than the file that is being updated in the middle of the failure.

Does anyone have any other specific tests they would like to see run?

Cheers!
BSPvette

Last edited by bspvette86 (2008-05-22 04:32:39)

Offline

 

#19 2008-05-22 12:14:57

jdoering
Member
Registered: 2008-04-10
Posts: 95

Re: Anyone using EXT3 on DNS-323

Personally the risk I see here is that unless there's some science to why EXT3 was a problem on the DNS-323 in the first place; that a random low-volume test won't tell us much about whether or not that problem went away.

EXT3 has been (/is) a very reliable filesystem in many production *nix servers long before the DNS-323 existed... so intrinsically I don't see why it should have been a problem for the 323 in the first place. (Note that in addition to being much newer to computers than some of you in general; I'm also newer to the DNS-323 than anything pre-1.04.) But reports are that it was a problem... so unless there's been active work to UNDERSTAND and fix it; how much confidence do you have that low-volume single-user testing validates an improvement? (Any single user testing is relatively low-volume compared to massive parallel efforts that tend to expose "random" bugs).

That said; I typically like to live on the edge and with technology ask why not rather than why... so in spirit I agree with the experiment; but in this case I do wonder about bang-for-the-buck.

-Jeff

Offline

 

#20 2008-05-22 17:14:19

bspvette86
Member
Registered: 2008-05-09
Posts: 81

Re: Anyone using EXT3 on DNS-323

jdoering wrote:

Personally the risk I see here is that unless there's some science to why EXT3 was a problem on the DNS-323 in the first place; that a random low-volume test won't tell us much about whether or not that problem went away.

EXT3 has been (/is) a very reliable filesystem in many production *nix servers long before the DNS-323 existed... so intrinsically I don't see why it should have been a problem for the 323 in the first place. (Note that in addition to being much newer to computers than some of you in general; I'm also newer to the DNS-323 than anything pre-1.04.) But reports are that it was a problem... so unless there's been active work to UNDERSTAND and fix it; how much confidence do you have that low-volume single-user testing validates an improvement? (Any single user testing is relatively low-volume compared to massive parallel efforts that tend to expose "random" bugs).

That said; I typically like to live on the edge and with technology ask why not rather than why... so in spirit I agree with the experiment; but in this case I do wonder about bang-for-the-buck.

-Jeff

Jeff,
I understand your concerns and my next line of testing includes going back to version 1.02 of the firmware to confirm that I can duplicate the data loss issues.  Please note that between 1.02 and 1.03 the core release of the linux kernel used in the DNS-323 made a version change.  It would be interesting if the problem happens in 1.02 but not in 1.03.  That would have made the removal of EXT3 unnecissary.

My bang-for-the-buck is general improvement of the product.  I really really really hate to see products loose functionality rather than being fixed correctly. 

Cheers!
bspvette

mad Don't treat the symptoms, fix the root cause!!! mad

Offline

 

#21 2008-05-23 18:16:28

bspvette86
Member
Registered: 2008-05-09
Posts: 81

Re: Anyone using EXT3 on DNS-323

Latest update: still unable to find corrupted data with EXT3 on 1.05.

Broke RAID-1 by removing all partitions from Left disk /dev/sdb via fdisk and hot pulling the drive to simulate a failure.  Amber light came on and Recieved email notification.  Files A-OK. (even the backup file being written)  Status on the web status page did not update to reflect the broken raid until after rebooting the unit.  Rebooted the unit after plugging in the "new" disk and the left light was off rather than amber.  The DNS mounted the EXT3 raid partition as EXT2 (there was a message about this in the dmesg)  The "new" disk was formatted as EXT2 and synced ok.  Raid partition would no longer mount as EXT3.  (probably due to the removal of "standard" ext3 support and the fact that half the raid was now ext2).

This is the end of my 1.05 testing for now.  I plan on blowing everything away at this point and reverting back to 1.02 to test with the version that was known to have issues with EXT3.

Updates to follow....

Party on Wayne!
bspvette

Offline

 

#22 2008-05-24 05:44:51

bspvette86
Member
Registered: 2008-05-09
Posts: 81

Re: Anyone using EXT3 on DNS-323

Well, that didn't take long to break with firmware 1.00.  Started with a complete reset to defaults after backdating the firmware, two "new" (subtitute: non-partitioned) disks,  Formatted to EXT3 and Raid-1.  Kicked off a copy of my pictures folders and when I came back, massive corruption,  directory entries duplicated, etc...     Raid 1 kept loosing sync and rebuilding.

Moving on to Firmware 1.01 to do the same test....
  Duplicate directory entries,  corruption.  Pretty quick!

Moving on to Firmware 1.02 to do the same test.....
  Duplicate directory entries, Corruption. 

Moving on to Firmware 1.03 to do the same test.....
  So far so good....


Cheers!
bspvette

Last edited by bspvette86 (2008-05-24 15:05:18)

Offline

 

#23 2008-05-25 23:25:00

bspvette86
Member
Registered: 2008-05-09
Posts: 81

Re: Anyone using EXT3 on DNS-323

With firmware 1.00 through 1.02 I was able to find file/directory corruption with EXT3 in under an hour with less than 40GB of data.  I have been running EXT3 on firmware 1.03 for over 24 hours now with no detected errors.

Looks to me like the root kernel change made in 1.03 probably solved the EXT3 issues.  I am going to continue flogging 1.03 for a bit.  Not sure if anyone else wants to be a guinea pig at this point.

Regards,
bspvette86

Offline

 

#24 2008-05-28 02:36:25

bspvette86
Member
Registered: 2008-05-09
Posts: 81

Re: Anyone using EXT3 on DNS-323

I have wrapped up my 1.03 testing of EXT3 after two days without finding any corruption.  I am skipping tests on 1.04 and going back to 1.05 for all remaining testing.

Cheers!
bspvette86

Offline

 

#25 2008-05-30 05:16:46

bomaroast
Member
Registered: 2008-05-30
Posts: 11

Re: Anyone using EXT3 on DNS-323

What exactly is the "hiddin way" of formatting using ext3?

Offline

 

Board footer

Powered by PunBB
© Copyright 2002–2010 PunBB