Unix Technical Forum

SAN vs Internal Disks

This is a discussion on SAN vs Internal Disks within the Pgsql Performance forums, part of the PostgreSQL category; --> On Fri, Sep 07, 2007 at 02:10:32PM -0700, david@lang.hm wrote: > >3. Easy to set up "warm standby" functionality. ...


Go Back   Unix Technical Forum > Database Server Software > PostgreSQL > Pgsql Performance

FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #31 (permalink)  
Old 04-19-2008, 11:32 AM
Decibel!
 
Posts: n/a
Default Re: SAN vs Internal Disks

On Fri, Sep 07, 2007 at 02:10:32PM -0700, david@lang.hm wrote:
> >3. Easy to set up "warm standby" functionality. (Then again, if the
> >postgres server fails miserably, it's likely to be due to a disk
> >crash).

>
> and if postgres dies for some other reason the image on disk needs repair,
> unless you script stopping postgres when the SAN does it's snapshots,
> those snapshots are not going to be that good. the problems are useually
> repairable, but that makes starting your warm spare harder.


Uh, the "image" you get from a PITR backup "needs repair" too. There's
absolutely nothing wrong with using a SAN or filesystem snapshot as a
backup mechanism, as long as it's a true snapshot, and it includes *all*
PostgreSQL data (everything under $PGDATA as well as all tablespaces).

Also, to reply to someone else's email... there is one big reason to use
a SAN over direct storage: you can do HA that results in 0 data loss.
Good SANs are engineered to be highly redundant, with multiple
controllers, PSUs, etc, so that the odds of losing the SAN itself are
very, very low. The same isn't true with DAS.

But unless you need that kind of HA recovery, I'd tend to stay away from
SANs.

BTW, if you need *serious* bandwidth, look at things like Sun's
"thumper" (I know there's at least one other company that makes
something similar). 40-48 drives in a single 4U chassis == lots of
throughput.

Finally, if you do get a SAN, make sure and benchmark it. I've seen more
than one case of a SAN that wasn't getting anywhere near the performance
it should be, even with a simple dd test.
--
Decibel!, aka Jim Nasby decibel@decibel.org
EnterpriseDB http://enterprisedb.com 512.569.9461 (cell)

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.3 (FreeBSD)

iD8DBQFG5wDWdO30qud8SkgRAoa3AKCf2kGRPFEhuR8qQsjPGr xjE/JXmQCguXXw
DR6ou+IDn7IA1sotpOWiR58=
=wrN4
-----END PGP SIGNATURE-----

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #32 (permalink)  
Old 04-19-2008, 11:32 AM
Michael Stone
 
Posts: n/a
Default Re: SAN vs Internal Disks

On Tue, Sep 11, 2007 at 03:55:51PM -0500, Decibel! wrote:
>Also, to reply to someone else's email... there is one big reason to use
>a SAN over direct storage: you can do HA that results in 0 data loss.
>Good SANs are engineered to be highly redundant, with multiple
>controllers, PSUs, etc, so that the odds of losing the SAN itself are
>very, very low. The same isn't true with DAS.


You can get DAS arrays with multiple controllers, PSUs, etc. DAS !=
single disk.

Mike Stone


---------------------------(end of broadcast)---------------------------
TIP 2: Don't 'kill -9' the postmaster

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #33 (permalink)  
Old 04-19-2008, 11:32 AM
Decibel!
 
Posts: n/a
Default Re: SAN vs Internal Disks

On Tue, Sep 11, 2007 at 05:09:00PM -0400, Michael Stone wrote:
> On Tue, Sep 11, 2007 at 03:55:51PM -0500, Decibel! wrote:
> >Also, to reply to someone else's email... there is one big reason to use
> >a SAN over direct storage: you can do HA that results in 0 data loss.
> >Good SANs are engineered to be highly redundant, with multiple
> >controllers, PSUs, etc, so that the odds of losing the SAN itself are
> >very, very low. The same isn't true with DAS.

>
> You can get DAS arrays with multiple controllers, PSUs, etc. DAS !=
> single disk.


It's still in the same chassis, though, which means if you lose memory
or mobo you're still screwed. In a SAN setup for redundancy, there's
very little in the way of a single point of failure; generally only the
backplane, and because there's very little that's on there it's
extremely rare for one to fail.
--
Decibel!, aka Jim Nasby decibel@decibel.org
EnterpriseDB http://enterprisedb.com 512.569.9461 (cell)

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.3 (FreeBSD)

iD8DBQFG5x/AdO30qud8SkgRAtINAJ4mrVwe+jPOQUAAHNO9xhhVV/P/3ACeJ7VX
ebgTOjKeHteXR2ERXbqCLiA=
=OEY+
-----END PGP SIGNATURE-----

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #34 (permalink)  
Old 04-19-2008, 11:32 AM
david@lang.hm
 
Posts: n/a
Default Re: SAN vs Internal Disks

On Tue, 11 Sep 2007, Decibel! wrote:

> On Tue, Sep 11, 2007 at 05:09:00PM -0400, Michael Stone wrote:
>> On Tue, Sep 11, 2007 at 03:55:51PM -0500, Decibel! wrote:
>>> Also, to reply to someone else's email... there is one big reason to use
>>> a SAN over direct storage: you can do HA that results in 0 data loss.
>>> Good SANs are engineered to be highly redundant, with multiple
>>> controllers, PSUs, etc, so that the odds of losing the SAN itself are
>>> very, very low. The same isn't true with DAS.

>>
>> You can get DAS arrays with multiple controllers, PSUs, etc. DAS !=
>> single disk.

>
> It's still in the same chassis, though, which means if you lose memory
> or mobo you're still screwed. In a SAN setup for redundancy, there's
> very little in the way of a single point of failure; generally only the
> backplane, and because there's very little that's on there it's
> extremely rare for one to fail.


not nessasarily. direct attached doesn't mean in the same chassis,
external drive shelves attached via SCSI are still DAS

you can even have DAS attached to a pair of machines, with the second box
configured to mount the drives only if the first one dies.

David Lang

---------------------------(end of broadcast)---------------------------
TIP 2: Don't 'kill -9' the postmaster

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #35 (permalink)  
Old 04-19-2008, 11:32 AM
Harsh Azad
 
Posts: n/a
Default Re: SAN vs Internal Disks

Yeah, the DAS we are considering is Dell MD3000, it has redundant hot
swappable raid controllers in active-active mode. Provision for hot spare
hard-disk. And it can take upto 15 disks in 3U, you can attach two more
MD1000 to it, giving a total of 45 disks in total.

-- Harsh

On 9/12/07, david@lang.hm <david@lang.hm> wrote:
>
> On Tue, 11 Sep 2007, Decibel! wrote:
>
> > On Tue, Sep 11, 2007 at 05:09:00PM -0400, Michael Stone wrote:
> >> On Tue, Sep 11, 2007 at 03:55:51PM -0500, Decibel! wrote:
> >>> Also, to reply to someone else's email... there is one big reason to

> use
> >>> a SAN over direct storage: you can do HA that results in 0 data loss.
> >>> Good SANs are engineered to be highly redundant, with multiple
> >>> controllers, PSUs, etc, so that the odds of losing the SAN itself are
> >>> very, very low. The same isn't true with DAS.
> >>
> >> You can get DAS arrays with multiple controllers, PSUs, etc. DAS !=
> >> single disk.

> >
> > It's still in the same chassis, though, which means if you lose memory
> > or mobo you're still screwed. In a SAN setup for redundancy, there's
> > very little in the way of a single point of failure; generally only the
> > backplane, and because there's very little that's on there it's
> > extremely rare for one to fail.

>
> not nessasarily. direct attached doesn't mean in the same chassis,
> external drive shelves attached via SCSI are still DAS
>
> you can even have DAS attached to a pair of machines, with the second box
> configured to mount the drives only if the first one dies.
>
> David Lang
>
> ---------------------------(end of broadcast)---------------------------
> TIP 2: Don't 'kill -9' the postmaster
>




--
Harsh Azad
=======================
Harsh.Azad@gmail.com

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #36 (permalink)  
Old 04-19-2008, 11:32 AM
Tobias Brox
 
Posts: n/a
Default Re: SAN vs Internal Disks

[Decibel! - Tue at 06:07:44PM -0500]
> It's still in the same chassis, though, which means if you lose memory
> or mobo you're still screwed. In a SAN setup for redundancy, there's
> very little in the way of a single point of failure; generally only the
> backplane, and because there's very little that's on there it's
> extremely rare for one to fail.


Funny, the only time we lost a database server was due to a backplane
failure ...

---------------------------(end of broadcast)---------------------------
TIP 5: don't forget to increase your free space map settings

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #37 (permalink)  
Old 04-19-2008, 11:33 AM
Michael Stone
 
Posts: n/a
Default Re: SAN vs Internal Disks

On Tue, Sep 11, 2007 at 06:07:44PM -0500, Decibel! wrote:
>On Tue, Sep 11, 2007 at 05:09:00PM -0400, Michael Stone wrote:
>> You can get DAS arrays with multiple controllers, PSUs, etc. DAS !=
>> single disk.

>
>It's still in the same chassis, though,


I think you're confusing DAS and internal storage.

Mike Stone

---------------------------(end of broadcast)---------------------------
TIP 3: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faq

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 05:45 AM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.2.0
www.UnixAdminTalk.com