Unix Technical Forum

Re: [BUGS] BUG #2567: High IOWAIT

This is a discussion on Re: [BUGS] BUG #2567: High IOWAIT within the Pgsql Performance forums, part of the PostgreSQL category; --> Please cc the list so others can help. How large is the database? What indexes are on the tables ...


Go Back   Unix Technical Forum > Database Server Software > PostgreSQL > Pgsql Performance

FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 04-19-2008, 09:15 AM
Jim Nasby
 
Posts: n/a
Default Re: [BUGS] BUG #2567: High IOWAIT

Please cc the list so others can help.

How large is the database? What indexes are on the tables you're inserting into? What speed is the drive?

Since it's a single SCSI drive I'm assuming it's only 10k RPM, which means the theoretical maximum you can hit is 160 transfers per second. At 40 inserts per second (I'm assuming each insert is it's own transaction), you're already at 40 WAL operations per second, minimum. Plus whatever traffic you have to the data tables.

Your biggest win would be to batch those inserts together into transactions, if possible. If not, the commit_delay settings might help you out.

There may be some further gains to be had by tweaking the background writer settings; it might be too aggressive in your application.

That update statement could also be causing a lot of activity, depending on what it's doing.
--
Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com
Pervasive Software http://pervasive.com work: 512-231-6117
vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461



-----Original Message-----
From: Kumarselvan S [mailto:kumar@nexge.com]
Sent: Wed 8/9/2006 11:33 PM
To: Jim Nasby
Subject: RE: [BUGS] BUG #2567: High IOWAIT

Yes , it is not a Bug.
Here the some Info abt the Hardware
It has an SCSI Drive.
It an dell made quad processor machine.

The changes to Postgresql.conf
1. max_connections =50
2. shared buffer = 30000
3. Temp buffer 20000

Regards,
Kumar
-----Original Message-----
From: Jim C. Nasby [mailto:jnasby@pervasive.com]
Sent: Thursday, August 10, 2006 3:57 AM
To: kumarselvan
Cc: pgsql-performance@postgresql.org
Subject: Re: [BUGS] BUG #2567: High IOWAIT

This isn't a bug; moving to pgsql-performance.

On Tue, Aug 08, 2006 at 08:42:02AM +0000, kumarselvan wrote:
> i have installed the postgres as mentioned in the Install file. it is a 4
> cpu 8 GB Ram Machine installed with Linux Enterprise version 3. when i am
> running a load which will perfrom 40 inserts persecond on 2 tables and 10
> updates per 10seconds on differnt table IOWait on avg going upto 70% due

to
> which i am not able to increase the load. Is there is any other way to
> install the postgres on multiprocessor machine.. can any one help me on
> this...


You haven't given us nearly enough information. What kind of hardware is
this? RAID? What changes have you made to postgresql.conf?
--
Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com
Pervasive Software http://pervasive.com work: 512-231-6117
vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461


quad




---------------------------(end of broadcast)---------------------------
TIP 9: In versions below 8.0, the planner will ignore your desire to
choose an index scan if your joining column's datatypes do not
match

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 04-19-2008, 09:15 AM
Markus Schaber
 
Posts: n/a
Default Re: [BUGS] BUG #2567: High IOWAIT

Hi, Jim,

Jim Nasby wrote:

> Your biggest win would be to batch those inserts together into
> transactions, if possible.


Using COPY instead of INSERT might even give better wins, and AFAIK some
client libs use COPY internally (e. G. tablewriter from libpqxx).

> If not, the commit_delay settings might help you out.


As far as I understand, this will only help for concurrent inserts by
different clients, dealing throughput for latency. Please correct me if
I'm wrong.

HTH,
Markus
--
Markus Schaber | Logical Tracking&Tracing International AG
Dipl. Inf. | Software Development GIS

Fight against software patents in EU! www.ffii.org www.nosoftwarepatents.org

---------------------------(end of broadcast)---------------------------
TIP 3: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faq

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 04:18 AM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.2.0
www.UnixAdminTalk.com