Re: Need to make a single 3TB partition

Y

Yousuf Khan

Arno wrote:

> In comp.sys.ibm.pc.hardware.storage Yousuf Khan wrote:

>> Arno wrote:

>>> Maybe Windows thinks that you cannot possibly want to span on

>>> removable devices? It has this habit of thinking it knows

>>> what you do and do not want but at the same time is far too

>>> stupid to pull it off.


>

>> Yeah, it looks like the case here. The technote says Microsoft doesn't

>> support this on USB or Firewire drives.


>

> Well, it does make some sense. Personally, I think the idea

> of "removable" devices is fundamentally flawed, and mounting and

> umounting as in Linux/unix is the far better approach. Bit apparently

> MS customers just yank out devices if it is mechanically possible.

> That could be a deisaster if the devices are RAIDed/

>

>

>>> Incidentially the 800GB seems to be a problem with the enclosure,

>>> there is no limit (that I know of) at 39.5 bit adress length.

>>> Maybe give this pice of trash back?


>

>> Is it possible that there is a BIOS limitation, beyond 2TB? The

>> motherboard I'm using is a rather plain desktop mobo, it may not be

>> expecting such huge devices to join in?


>

> USB does not go over the BIOS, at least not in Linux. 2TB is 41

> bit. No limit on byte level I can see. Number of sectors would

> be 32. Ah, I think I see the problem. USB is using the storage

> SCSI command set. It has either 32 bit or 64 bit for the sector

> number. If the enclosure is resonably current, it should

> support 64 bit sector numbers. Linux need compiled in kernel

> support for large block devices to be able to handle block

> devices > 2TB. This support has been there for some years, but

> may be missing from your kernel. The config option is

> CONFIG_LBDAF and found under "enable block layer" in 2.6.32.




I asked the same question to Janos Mathe, the developer of HD Sentinel,

he believes that the USB-SATA chipset is to blame here. These are his words:



> It seems it is an overflow issue in addressing.

> I'm sure it is not related to BIOS as the BIOS would only cause troubles

> on disks which are under its control (for example if they were connected

> to the motherboard and you'd try to boot from it). USB devices are controlled by the USB drivers of the OSes (Windows/Linux).

>

> I suspect the problem is related to the JMicron USB-ATA bridge which

> translates the USB packets to ATA commands sent to the SATA drives.

> I quickly checked the specs of this chip at http://www.jmicron.com/PDF/JM20336/JM20336.pdf

> but as I see, JMicron do not mention the maximum drive capacity to be used.

> However, I think at the time of release (2005) they were not prepared

> for such BIG concatenated array and that's why the LBA addressing wraps around over 2 TB.

> If I can help, please let me know.




So it looks like there may be nothing that can be done here.



Yousuf Khan
 
C

Char Jackson

On Wed, 31 Mar 2010 13:40:32 -0400, Yousuf Khan

wrote:



>Arno wrote:

>> In comp.sys.ibm.pc.hardware.storage Yousuf Khan wrote:

>>> Arno wrote:

>>>> Maybe Windows thinks that you cannot possibly want to span on

>>>> removable devices? It has this habit of thinking it knows

>>>> what you do and do not want but at the same time is far too

>>>> stupid to pull it off.


>>

>>> Yeah, it looks like the case here. The technote says Microsoft doesn't

>>> support this on USB or Firewire drives.


>>

>> Well, it does make some sense. Personally, I think the idea

>> of "removable" devices is fundamentally flawed, and mounting and

>> umounting as in Linux/unix is the far better approach. Bit apparently

>> MS customers just yank out devices if it is mechanically possible.

>> That could be a deisaster if the devices are RAIDed/

>>

>>

>>>> Incidentially the 800GB seems to be a problem with the enclosure,

>>>> there is no limit (that I know of) at 39.5 bit adress length.

>>>> Maybe give this pice of trash back?


>>

>>> Is it possible that there is a BIOS limitation, beyond 2TB? The

>>> motherboard I'm using is a rather plain desktop mobo, it may not be

>>> expecting such huge devices to join in?


>>

>> USB does not go over the BIOS, at least not in Linux. 2TB is 41

>> bit. No limit on byte level I can see. Number of sectors would

>> be 32. Ah, I think I see the problem. USB is using the storage

>> SCSI command set. It has either 32 bit or 64 bit for the sector

>> number. If the enclosure is resonably current, it should

>> support 64 bit sector numbers. Linux need compiled in kernel

>> support for large block devices to be able to handle block

>> devices > 2TB. This support has been there for some years, but

>> may be missing from your kernel. The config option is

>> CONFIG_LBDAF and found under "enable block layer" in 2.6.32.


>

>I asked the same question to Janos Mathe, the developer of HD Sentinel,

>he believes that the USB-SATA chipset is to blame here. These are his words:

>

>> It seems it is an overflow issue in addressing.

>> I'm sure it is not related to BIOS as the BIOS would only cause troubles

>> on disks which are under its control (for example if they were connected

>> to the motherboard and you'd try to boot from it). USB devices are controlled by the USB drivers of the OSes (Windows/Linux).

>>

>> I suspect the problem is related to the JMicron USB-ATA bridge which

>> translates the USB packets to ATA commands sent to the SATA drives.

>> I quickly checked the specs of this chip at http://www.jmicron.com/PDF/JM20336/JM20336.pdf

>> but as I see, JMicron do not mention the maximum drive capacity to be used.

>> However, I think at the time of release (2005) they were not prepared

>> for such BIG concatenated array and that's why the LBA addressing wraps around over 2 TB.

>> If I can help, please let me know.


>

>So it looks like there may be nothing that can be done here.

>

> Yousuf Khan




Was my suggestion (RAID controller versus USB controller) considered?
 
Y

Yousuf Khan

Char Jackson wrote:

> Was my suggestion (RAID controller versus USB controller) considered?






The problem with putting the drives through a RAID controller is that

I'd have to bring these drives into the computer case and and connect

them permanently. I am trying to keep them as backup drives, therefore

they need to remain in the external case.
 
A

Arno

In comp.sys.ibm.pc.hardware.storage Yousuf Khan wrote:

> Arno wrote:

>> In comp.sys.ibm.pc.hardware.storage Yousuf Khan wrote:

>>> Arno wrote:

>>>> Maybe Windows thinks that you cannot possibly want to span on

>>>> removable devices? It has this habit of thinking it knows

>>>> what you do and do not want but at the same time is far too

>>>> stupid to pull it off.


>>

>>> Yeah, it looks like the case here. The technote says Microsoft doesn't

>>> support this on USB or Firewire drives.


>>

>> Well, it does make some sense. Personally, I think the idea

>> of "removable" devices is fundamentally flawed, and mounting and

>> umounting as in Linux/unix is the far better approach. Bit apparently

>> MS customers just yank out devices if it is mechanically possible.

>> That could be a deisaster if the devices are RAIDed/

>>

>>

>>>> Incidentially the 800GB seems to be a problem with the enclosure,

>>>> there is no limit (that I know of) at 39.5 bit adress length.

>>>> Maybe give this pice of trash back?


>>

>>> Is it possible that there is a BIOS limitation, beyond 2TB? The

>>> motherboard I'm using is a rather plain desktop mobo, it may not be

>>> expecting such huge devices to join in?


>>

>> USB does not go over the BIOS, at least not in Linux. 2TB is 41

>> bit. No limit on byte level I can see. Number of sectors would

>> be 32. Ah, I think I see the problem. USB is using the storage

>> SCSI command set. It has either 32 bit or 64 bit for the sector

>> number. If the enclosure is resonably current, it should

>> support 64 bit sector numbers. Linux need compiled in kernel

>> support for large block devices to be able to handle block

>> devices > 2TB. This support has been there for some years, but

>> may be missing from your kernel. The config option is

>> CONFIG_LBDAF and found under "enable block layer" in 2.6.32.




> I asked the same question to Janos Mathe, the developer of HD Sentinel,

> he believes that the USB-SATA chipset is to blame here. These are his words:




>> It seems it is an overflow issue in addressing.

>> I'm sure it is not related to BIOS as the BIOS would only cause troubles

>> on disks which are under its control (for example if they were connected

>> to the motherboard and you'd try to boot from it). USB devices are controlled by the USB drivers of the OSes (Windows/Linux).

>>

>> I suspect the problem is related to the JMicron USB-ATA bridge which

>> translates the USB packets to ATA commands sent to the SATA drives.

>> I quickly checked the specs of this chip at http://www.jmicron.com/PDF/JM20336/JM20336.pdf

>> but as I see, JMicron do not mention the maximum drive capacity to be used.

>> However, I think at the time of release (2005) they were not prepared

>> for such BIG concatenated array and that's why the LBA addressing wraps around over 2 TB.

>> If I can help, please let me know.




> So it looks like there may be nothing that can be done here.




> Yousuf Khan




Hmm. Could be right. Missing large block device support in Linux

should not make it show up as smaller, just prevent it from being

used in its full capacity. Seems indeed that you are out of luck.



Arno

--

Arno Wagner, Dr. sc. techn., Dipl. Inform., CISSP -- Email: arno@wagner.name

GnuPG: ID: 1E25338F FP: 0C30 5782 9D93 F785 E79C 0296 797F 6B50 1E25 338F

----

Cuddly UI's are the manifestation of wishful thinking. -- Dylan Evans
 
C

Char Jackson

On Wed, 31 Mar 2010 17:02:46 -0400, Yousuf Khan

wrote:



>Char Jackson wrote:

>> Was my suggestion (RAID controller versus USB controller) considered?


>

>

>The problem with putting the drives through a RAID controller is that

>I'd have to bring these drives into the computer case and and connect

>them permanently. I am trying to keep them as backup drives, therefore

>they need to remain in the external case.




With sufficiently long cables, you wouldn't have to bring the drives

into the computer case.



From 1999 until about 2003 I had a system that was maxed out with 4

IDE hard drives, so I installed 4 more drives in a second computer

case and powered them from the power supply in that PC case, but

connected their data cables to an IDE controller card installed in my

main PC, giving me a total of 8 (smallish) drives. Before that, I did

essentially the same thing with some SCSI drives, (the controller was

internal but the drives were external), so the concept of "external

drives that think they're internal" has been around for a long time,

including a long time before I stumbled upon it.
 
Y

Yousuf Khan

Char Jackson wrote:

> On Wed, 31 Mar 2010 17:02:46 -0400, Yousuf Khan

> wrote:

>> The problem with putting the drives through a RAID controller is that

>> I'd have to bring these drives into the computer case and and connect

>> them permanently. I am trying to keep them as backup drives, therefore

>> they need to remain in the external case.


>

> With sufficiently long cables, you wouldn't have to bring the drives

> into the computer case.




The purpose of these drives is not for full-time storage needs, they are

only for backup and archival requirements. Think of them as fulfilling

the same purpose as tape drives. So connecting them to an internal

SATA/RAID controller is totally out of the question, the drives in

question may be powered down and put away in a closet after backups.



Yousuf Khan
 
C

Char Jackson

On Thu, 01 Apr 2010 17:32:59 -0400, Yousuf Khan

wrote:



>Char Jackson wrote:

>> On Wed, 31 Mar 2010 17:02:46 -0400, Yousuf Khan

>> wrote:

>>> The problem with putting the drives through a RAID controller is that

>>> I'd have to bring these drives into the computer case and and connect

>>> them permanently. I am trying to keep them as backup drives, therefore

>>> they need to remain in the external case.


>>

>> With sufficiently long cables, you wouldn't have to bring the drives

>> into the computer case.


>

>The purpose of these drives is not for full-time storage needs, they are

>only for backup and archival requirements. Think of them as fulfilling

>the same purpose as tape drives. So connecting them to an internal

>SATA/RAID controller is totally out of the question, the drives in

>question may be powered down and put away in a closet after backups.

>

> Yousuf Khan




Sounds like you need a less expensive version of this:

http://www.newegg.com/Product/Product.aspx?Item=N82E16822165200



Up to 4TB capacity, multiple USB ports, 2 10/100/1000 ports, etc.
 
Y

Yousuf Khan

Char Jackson wrote:

> On Thu, 01 Apr 2010 17:32:59 -0400, Yousuf Khan

> wrote:

>> The purpose of these drives is not for full-time storage needs, they are

>> only for backup and archival requirements. Think of them as fulfilling

>> the same purpose as tape drives. So connecting them to an internal

>> SATA/RAID controller is totally out of the question, the drives in

>> question may be powered down and put away in a closet after backups.

>>

>> Yousuf Khan


>

> Sounds like you need a less expensive version of this:

> http://www.newegg.com/Product/Product.aspx?Item=N82E16822165200

>

> Up to 4TB capacity, multiple USB ports, 2 10/100/1000 ports, etc.




Yeah, *way* less expensive! Considering the price of the rackmount unit

you linked to ($1652), I'm not doing too badly with what I put together

at 3TB, and a cost of less than $250. I might also have trouble putting

that rackmount into a closet or cupboard later. :)



Yousuf Khan
 
A

Arno

In comp.sys.ibm.pc.hardware.storage Yousuf Khan wrote:

> Char Jackson wrote:

>> On Thu, 01 Apr 2010 17:32:59 -0400, Yousuf Khan

>> wrote:

>>> The purpose of these drives is not for full-time storage needs, they are

>>> only for backup and archival requirements. Think of them as fulfilling

>>> the same purpose as tape drives. So connecting them to an internal

>>> SATA/RAID controller is totally out of the question, the drives in

>>> question may be powered down and put away in a closet after backups.

>>>

>>> Yousuf Khan


>>

>> Sounds like you need a less expensive version of this:

>> http://www.newegg.com/Product/Product.aspx?Item=N82E16822165200

>>

>> Up to 4TB capacity, multiple USB ports, 2 10/100/1000 ports, etc.




> Yeah, *way* less expensive! Considering the price of the rackmount unit

> you linked to ($1652), I'm not doing too badly with what I put together

> at 3TB, and a cost of less than $250. I might also have trouble putting

> that rackmount into a closet or cupboard later. :)




> Yousuf Khan




For cupboard I reccomend using 2.5" drives, far lower heat

generation. I have one running in my cupboard for several

years now, it is a factor.



Arno



--

Arno Wagner, Dr. sc. techn., Dipl. Inform., CISSP -- Email: arno@wagner.name

GnuPG: ID: 1E25338F FP: 0C30 5782 9D93 F785 E79C 0296 797F 6B50 1E25 338F

----

Cuddly UI's are the manifestation of wishful thinking. -- Dylan Evans
 
Z

zappo

Arno wrote:

> In comp.sys.ibm.pc.hardware.storage Yousuf Khan

> wrote:

>> Char Jackson wrote:

>>> On Thu, 01 Apr 2010 17:32:59 -0400, Yousuf Khan

>>> wrote:

>>>> The purpose of these drives is not for full-time storage needs,

>>>> they are only for backup and archival requirements. Think of them

>>>> as fulfilling the same purpose as tape drives. So connecting them

>>>> to an internal SATA/RAID controller is totally out of the

>>>> question, the drives in question may be powered down and put away

>>>> in a closet after backups.

>>>>

>>>> Yousuf Khan

>>>

>>> Sounds like you need a less expensive version of this:

>>> http://www.newegg.com/Product/Product.aspx?Item=N82E16822165200

>>>

>>> Up to 4TB capacity, multiple USB ports, 2 10/100/1000 ports, etc.


>

>> Yeah, *way* less expensive! Considering the price of the rackmount

>> unit you linked to ($1652), I'm not doing too badly with what I put

>> together at 3TB, and a cost of less than $250. I might also have

>> trouble putting that rackmount into a closet or cupboard later. :)


>

>> Yousuf Khan


>

> For cupboard I reccomend using 2.5" drives, far lower heat

> generation. I have one running in my cupboard for several

> years now, it is a factor.

>

> Arno




He's not talking about running it in his cupboard, he's talking about putting

it in his cupboard after its been written to, after its been disconnected.



And you can not get two 1.5TB drives in 2.5" format currently anyway.
 
C

Char Jackson

On Fri, 02 Apr 2010 11:44:25 -0400, Yousuf Khan

wrote:



>Char Jackson wrote:

>> On Thu, 01 Apr 2010 17:32:59 -0400, Yousuf Khan

>> wrote:

>>> The purpose of these drives is not for full-time storage needs, they are

>>> only for backup and archival requirements. Think of them as fulfilling

>>> the same purpose as tape drives. So connecting them to an internal

>>> SATA/RAID controller is totally out of the question, the drives in

>>> question may be powered down and put away in a closet after backups.

>>>

>>> Yousuf Khan


>>

>> Sounds like you need a less expensive version of this:

>> http://www.newegg.com/Product/Product.aspx?Item=N82E16822165200

>>

>> Up to 4TB capacity, multiple USB ports, 2 10/100/1000 ports, etc.


>

>Yeah, *way* less expensive! Considering the price of the rackmount unit

>you linked to ($1652), I'm not doing too badly with what I put together

>at 3TB, and a cost of less than $250. I might also have trouble putting

>that rackmount into a closet or cupboard later. :)

>

> Yousuf Khan




I admit, I was trying to shock you a bit. :)

But seriously, I was going on the assumption that your current

hardware isn't doing what you need, at least so far. So my next

question was whether any hardware would do what you want, and I think

the answer is yes. So now it's just a matter of finding something

affordable, or finding a way to make your current hardware work.
 
Y

Yousuf Khan

Char Jackson wrote:

> I admit, I was trying to shock you a bit. :)

> But seriously, I was going on the assumption that your current

> hardware isn't doing what you need, at least so far. So my next

> question was whether any hardware would do what you want, and I think

> the answer is yes. So now it's just a matter of finding something

> affordable, or finding a way to make your current hardware work.

>




Well, I had thought that the hardware that I got would do what I needed.

But the concatenation didn't work right.



Yousuf Khan
 

Similar threads

Back
Top Bottom