Unix Technical Forum

Re: Optimicing Postgres for SunSolaris10 on V240

This is a discussion on Re: Optimicing Postgres for SunSolaris10 on V240 within the Pgsql Performance forums, part of the PostgreSQL category; --> Berner, First, I've corrected you e-mail so that it goes to the list, and not to me directly. > ...


Go Back   Unix Technical Forum > Database Server Software > PostgreSQL > Pgsql Performance

FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 04-19-2008, 09:45 AM
Josh Berkus
 
Posts: n/a
Default Re: Optimicing Postgres for SunSolaris10 on V240

Berner,

First, I've corrected you e-mail so that it goes to the list, and not to
me directly.

> I use my PostgreSQL 8.0.4 as Catalogue-Database for Bacula.
> Bacula is a Backupsoftware.


Yes. The lead contributor to Bacula is a active PostgreSQL project
participant; I'll see if he'll look into your issue.

> When I backing up System (lot of very small Files) then PostgreSQL seams to by the bottleneck by inserting Catalogueinformation of every single File.
> The System on which Postgres runs is a Sun Solaris 10 Server on a Sun Fire V240 with 1GB RAM, 1CPU (SUNW,UltraSPARC-IIIi at 1.3GHz), 2 Ultra SCSI-3 Disks 73GB at 10k RPM which are in Raid1 (Solaris Softraid).
>
> Can someone gif me a hint for compiling PostgreSQL or configuring the Database.
>
> fsync is already disabled..


This is a bad idea if you care about your database.

So, PostgreSQL 8.1 is now official supported by Sun and ships with
Solaris 10 update 2 or later. It is recommended that you use that
rather and an out-of-date version. Second, see
www.powerpostgresql.com/PerfList

--Josh Berkus


---------------------------(end of broadcast)---------------------------
TIP 2: Don't 'kill -9' the postmaster

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 04-19-2008, 09:45 AM
Marc Cousin
 
Posts: n/a
Default Re: Optimicing Postgres for SunSolaris10 on V240

Hi...

Bacula does no transaction right now, so every insert is done separately with
autocommit.
Moreover, the insert loop for the main table is done by several individual
queries to insert data in several tables (filename, dir, then file), so this
is slow.
There's work underway to speed that up, using a big COPY to a temp table,
then queries to dispatch the records in the right places as fast as
possible. The patch has been made, but as it is a noticeable change in the
core, will take some time to be integrated... See the thread about that in
the bacula devel list a few weeks ago... Anyhow, our benchmark for now shows
a 10-20 times speedup with postgresql, fsync stays on, and it becomes faster
than mysql, and scales with the number of cpus... I cannot tell when/if it
will be included, but there's work on this.

For now, the only thing you can do is fsync=off, knowing you're taking a
chance with the data (but it's not that big a problem, as it's only bacula's
database, and can be rebuilt from the tapes or from a dump...) or a writeback
disk controller.



On Friday 17 November 2006 19:44, Josh Berkus wrote:
> Berner,
>
> First, I've corrected you e-mail so that it goes to the list, and not to
> me directly.
>
> > I use my PostgreSQL 8.0.4 as Catalogue-Database for Bacula.
> > Bacula is a Backupsoftware.

>
> Yes. The lead contributor to Bacula is a active PostgreSQL project
> participant; I'll see if he'll look into your issue.
>
> > When I backing up System (lot of very small Files) then PostgreSQL seams
> > to by the bottleneck by inserting Catalogueinformation of every single
> > File. The System on which Postgres runs is a Sun Solaris 10 Server on a
> > Sun Fire V240 with 1GB RAM, 1CPU (SUNW,UltraSPARC-IIIi at 1.3GHz), 2
> > Ultra SCSI-3 Disks 73GB at 10k RPM which are in Raid1 (Solaris Softraid).
> >
> > Can someone gif me a hint for compiling PostgreSQL or configuring the
> > Database.
> >
> > fsync is already disabled..

>
> This is a bad idea if you care about your database.
>
> So, PostgreSQL 8.1 is now official supported by Sun and ships with
> Solaris 10 update 2 or later. It is recommended that you use that
> rather and an out-of-date version. Second, see
> www.powerpostgresql.com/PerfList
>
> --Josh Berkus
>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 2: Don't 'kill -9' the postmaster


---------------------------(end of broadcast)---------------------------
TIP 7: You can help support the PostgreSQL project by donating at

http://www.postgresql.org/about/donate

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 04:41 AM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.2.0
www.UnixAdminTalk.com