I am a newbie, as you all know, but I am still embarassed asking this
question. I started my tuning career by changing shared_buffers. Soon I
discovered that I was hitting up against the available RAM on the system.
So, I brought the number down. Then I discovered max_fsm_pages. I could take
that up quite high and found out that it is a 'disk' thing. Then I started
increasing checkpoint_segments,which is also a disk thing. However, setting
it to 25, and then increasing any of the other 2 variables, the postgresql
daemon stops working. meaning it does not start upon reboot. When I bring
shared_buffers or max_fsm_pages back down, the daemon starts and all is
normal. This happens on a 1 GB RAM machine and a 4 GB RAM machine.

Anyone know what I am doing wrong?

System: FreeBSD 6.1, Postgresql 8.09, 2 GB RAM

--
Yudhvir Singh Sidhu
408 375 3134 cell

Do you have an overall plan (besides "make it go faster!") or are you
just trying out the knobs as you find them?

This may be helpful:
http://www.powerpostgresql.com/Downl...d_conf_80.html

On May 23, 2007, at 9:22 AM, Y Sidhu wrote:

> I am a newbie, as you all know, but I am still embarassed asking
> this question. I started my tuning career by changing
> shared_buffers. Soon I discovered that I was hitting up against the
> available RAM on the system. So, I brought the number down. Then I
> discovered max_fsm_pages. I could take that up quite high and found
> out that it is a 'disk' thing. Then I started increasing
> checkpoint_segments,which is also a disk thing. However, setting it
> to 25, and then increasing any of the other 2 variables, the
> postgresql daemon stops working. meaning it does not start upon
> reboot. When I bring shared_buffers or max_fsm_pages back down, the
> daemon starts and all is normal. This happens on a 1 GB RAM machine
> and a 4 GB RAM machine.
>
> Anyone know what I am doing wrong?
>
> System: FreeBSD 6.1, Postgresql 8.09, 2 GB RAM
>
> --
> Yudhvir Singh Sidhu
> 408 375 3134 cell


---------------------------(end of broadcast)---------------------------
TIP 2: Don't 'kill -9' the postmaster

I cannot answer that question on the grounds that it may incriminate me.
Hehe. I am really trying to get our vacuum times down. The cause of the
problem, I believe, are daily mass deletes. Yes, I am working on performing
vacuums more than once a day. No, I am not considering partitioning the
offending table because a few scripts have to be changed. I am also turning
the knobs as I find them.

Any help is appreciated b'cause "I can't hold er t'gether much longer
kap'n." Sorry, that's the best 'Scotty' I can do this morning.

Yudhvir
=============

On 5/23/07, Ben <bench@silentmedia.com> wrote:
>
> Do you have an overall plan (besides "make it go faster!") or are you
> just trying out the knobs as you find them?
>
> This may be helpful:
> http://www.powerpostgresql.com/Downl...d_conf_80.html
>
> On May 23, 2007, at 9:22 AM, Y Sidhu wrote:
>
> > I am a newbie, as you all know, but I am still embarassed asking
> > this question. I started my tuning career by changing
> > shared_buffers. Soon I discovered that I was hitting up against the
> > available RAM on the system. So, I brought the number down. Then I
> > discovered max_fsm_pages. I could take that up quite high and found
> > out that it is a 'disk' thing. Then I started increasing
> > checkpoint_segments,which is also a disk thing. However, setting it
> > to 25, and then increasing any of the other 2 variables, the
> > postgresql daemon stops working. meaning it does not start upon
> > reboot. When I bring shared_buffers or max_fsm_pages back down, the
> > daemon starts and all is normal. This happens on a 1 GB RAM machine
> > and a 4 GB RAM machine.
> >
> > Anyone know what I am doing wrong?
> >
> > System: FreeBSD 6.1, Postgresql 8.09, 2 GB RAM
> >
> > --
> > Yudhvir Singh Sidhu
> > 408 375 3134 cell
>
>


--
Yudhvir Singh Sidhu
408 375 3134 cell

Mass deletes are expensive to clean up after. Truncates are better if
you can, but, as it sounds like you can't, you might look into
vacuum_cost_delay and its many variables. It will make your vacuums
run longer, not shorter, but it will also make them have less of an
impact, if you configure it properly for your workload.

As you've found out, it's probably better not to poke things randomly
in the hope of making it faster.

On May 23, 2007, at 9:43 AM, Y Sidhu wrote:

> I cannot answer that question on the grounds that it may
> incriminate me. Hehe. I am really trying to get our vacuum times
> down. The cause of the problem, I believe, are daily mass deletes.
> Yes, I am working on performing vacuums more than once a day. No, I
> am not considering partitioning the offending table because a few
> scripts have to be changed. I am also turning the knobs as I find
> them.
>
> Any help is appreciated b'cause "I can't hold er t'gether much
> longer kap'n." Sorry, that's the best 'Scotty' I can do this morning.
>
> Yudhvir
> =============
>
> On 5/23/07, Ben <bench@silentmedia.com> wrote:
> Do you have an overall plan (besides "make it go faster!") or are you
> just trying out the knobs as you find them?
>
> This may be helpful:
> http://www.powerpostgresql.com/Downl...d_conf_80.html
>
> On May 23, 2007, at 9:22 AM, Y Sidhu wrote:
>
> > I am a newbie, as you all know, but I am still embarassed asking
> > this question. I started my tuning career by changing
> > shared_buffers. Soon I discovered that I was hitting up against the
> > available RAM on the system. So, I brought the number down. Then I
> > discovered max_fsm_pages. I could take that up quite high and found
> > out that it is a 'disk' thing. Then I started increasing
> > checkpoint_segments,which is also a disk thing. However, setting it
> > to 25, and then increasing any of the other 2 variables, the
> > postgresql daemon stops working. meaning it does not start upon
> > reboot. When I bring shared_buffers or max_fsm_pages back down, the
> > daemon starts and all is normal. This happens on a 1 GB RAM machine
> > and a 4 GB RAM machine.
> >
> > Anyone know what I am doing wrong?
> >
> > System: FreeBSD 6.1, Postgresql 8.09, 2 GB RAM
> >
> > --
> > Yudhvir Singh Sidhu
> > 408 375 3134 cell
>
>
>
>
> --
> Yudhvir Singh Sidhu
> 408 375 3134 cell

> When I bring shared_buffers or max_fsm_pages back down, the daemon
> starts and all is
> normal.

Linux has a system setting for the maximum number of shared memory that a
process can allocate. When Postgres wants more, Linux says "No."
Look in the docs for the setting (sysctl whatsisname).
VACUUM VERBOSE will tell you if you need to put more max_fsm_pages or not.


---------------------------(end of broadcast)---------------------------
TIP 4: Have you searched our list archives?

http://archives.postgresql.org

> increasing checkpoint_segments,which is also a disk thing. However, setting
> it to 25, and then increasing any of the other 2 variables, the postgresql
> daemon stops working. meaning it does not start upon reboot. When I bring

Sounds like you need to increase your shared memory limits.
Unfortunately this will require a reboot on FreeBSD

See:

http://www.postgresql.org/docs/8.2/s...resources.html

Last time I checked PostgreSQL should be complaining about the shared
memory on startup rather than silently fail though. Check your logs
perhaps. Though I believe the RC script will cause the message to be
printed interactively at the console too, if you run it. (Assuming you
are using it installed from ports).

--
/ Peter Schuller

PGP userID: 0xE9758B7D or 'Peter Schuller <peter.schuller@infidyne.com>'
Key retrieval: Send an E-Mail to getpgpkey@scode.org
E-Mail: peter.schuller@infidyne.com Web: http://www.scode.org



-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.3 (FreeBSD)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFGVKbIDNor2+l1i30RCPPjAJ9LwcsT+PnFHW3zwWD6C8 HFvCPLCQCgofDd
dlXxha9H0uJreDV0fEnlXVI=
=L25V
-----END PGP SIGNATURE-----

Y Sidhu wrote:
> I cannot answer that question on the grounds that it may incriminate me.
> Hehe. I am really trying to get our vacuum times down. The cause of the
> problem, I believe, are daily mass deletes. Yes, I am working on performing
> vacuums more than once a day. No, I am not considering partitioning the
> offending table because a few scripts have to be changed. I am also turning
> the knobs as I find them.

Yudhvir, I don't think the tuning options are going to make any
difference to your vacuum times.

I don't know if this been brought up already, but the way vacuum works
in 8.1 and 8.2 is that when it scans the table for the second time, it
does a WAL flush for every block that had deleted tuples on it. That's
really expensive, in particular if you don't have a separate drive for
the WAL, and/or you don't have a battery backed up cache in your controller.

You could try turning fsync=off to see if it helps, but be warned that
that's dangerous. If you have a power failure etc. while the database is
busy, you can get data corruption. So do that to see if it helps on a
test matchine, and if it does, put WAL on another drive or get a
controller with battery backed up cache. Or wait until release 8.3,
which should fix that issue.

--
Heikki Linnakangas
EnterpriseDB http://www.enterprisedb.com

---------------------------(end of broadcast)---------------------------
TIP 7: You can help support the PostgreSQL project by donating at

http://www.postgresql.org/about/donate

On May 23, 2007, at 4:40 PM, Peter Schuller wrote:

> Sounds like you need to increase your shared memory limits.
> Unfortunately this will require a reboot on FreeBSD

No, it does not. You can tune some of the sysv IPC parameters at
runtime. the shmmax and shmall are such parameters.


---------------------------(end of broadcast)---------------------------
TIP 9: In versions below 8.0, the planner will ignore your desire to
choose an index scan if your joining column's datatypes do not
match