Unix Technical Forum

Hundreds of database and FSM

This is a discussion on Hundreds of database and FSM within the Pgsql Performance forums, part of the PostgreSQL category; --> A few months ago a couple guys got "bragging rights" for having the most separate databases. A couple guys ...


Go Back   Unix Technical Forum > Database Server Software > PostgreSQL > Pgsql Performance

FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 04-19-2008, 09:45 AM
Craig A. James
 
Posts: n/a
Default Hundreds of database and FSM

A few months ago a couple guys got "bragging rights" for having the most separate databases. A couple guys claimed several hundred databases and one said he had several thousand databases. The concensus was that Postgres has no problem handling many separate databases.

I took that to heart and redesigned our system; we now have about 150 "primary data sources" that are used to build couple of "warehouses" that our customers actually search. Each database has about 20 tables. The total size (all databases and all tables together) is not huge, about 40 million rows. Eventually the warehouse (customer accessible) databases will be moved to separate servers, configured and indexed specifically for the task.

The only problem I've encountered is messages in the log:

NOTICE: number of page slots needed (131904) exceeds max_fsm_pages (100000)
HINT: Consider increasing the configuration parameter "max_fsm_pages" to a value over 131904.

So I dutifully followed this advice:

max_fsm_pages = 320000
max_fsm_relations = 20000

This is based on our current 150 databases times 20 tables, or 3000 tables total. But I wasn't sure if sequences count as "relations", which would double the number. So I set it at 20K relations to allow for growth.

Is there anything else I need to worry about? What happens if I go to, say, 500 databases (aside from increasing the FSM numbers even more)? 1000 databases?

The servers are 4 GB, dual Xeon, Postgres 8.1.4 on Linux FC4.

Thanks,
Craig


---------------------------(end of broadcast)---------------------------
TIP 3: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faq

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 04-19-2008, 09:45 AM
Alvaro Herrera
 
Posts: n/a
Default Re: Hundreds of database and FSM

Craig A. James wrote:

> This is based on our current 150 databases times 20 tables, or 3000 tables
> total. But I wasn't sure if sequences count as "relations", which would
> double the number.


They don't because they don't have free space.

--
Alvaro Herrera http://www.CommandPrompt.com/
PostgreSQL Replication, Consulting, Custom Development, 24x7 support

---------------------------(end of broadcast)---------------------------
TIP 5: don't forget to increase your free space map settings

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 04-19-2008, 09:45 AM
Steinar H. Gunderson
 
Posts: n/a
Default Re: Hundreds of database and FSM

On Wed, Nov 15, 2006 at 02:31:45PM -0300, Alvaro Herrera wrote:
>> This is based on our current 150 databases times 20 tables, or 3000 tables
>> total. But I wasn't sure if sequences count as "relations", which would
>> double the number.

> They don't because they don't have free space.


OTOH, indexes do.

/* Steinar */
--
Homepage: http://www.sesse.net/

---------------------------(end of broadcast)---------------------------
TIP 5: don't forget to increase your free space map settings

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 04:16 AM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.2.0
www.UnixAdminTalk.com