Unix Technical Forum

OLAP and PG and deja-vu

This is a discussion on OLAP and PG and deja-vu within the pgsql Hackers forums, part of the PostgreSQL category; --> Just finished writing the PG rules to maintain a bunch of materialized (aggregate) views on a ROLAP cube --- ...


Go Back   Unix Technical Forum > Database Server Software > PostgreSQL > pgsql Hackers

FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 04-11-2008, 04:38 AM
Mischa Sandberg
 
Posts: n/a
Default OLAP and PG and deja-vu

Just finished writing the PG rules to maintain a bunch of materialized
(aggregate) views on a ROLAP cube --- yes, I've seen Jonathan
Gardner's "matview" for postgres; didnt cover what I needed :-(. PG
happens to be pretty convenient for roll-your-own OLAP, thanks to
RULES and ARRAY datatypes. So it hasn't been a pain to implement.
As it happens, what I've done amounts to implementing covering indexes
(that's another thread), and an aid for join-selectivity/result-size
estimation.

And suddenly I had a case of deja-vu...

A decade ago, working with Sybase 4.8/MSSQL 4.2, you could only
enforce FK relationships by coding them in triggers.

Then, one day, declarative-FK's could be recognized by the engine
itself. Suddenly, the query planner could make real use of those
relations, typically dropping them out of complex joins. Hurrah!

Now, here I am, doing what every ROLAP system needs: the ability to
store and query aggregates of the fact table, then parsing a query to
determine which (smallest) level of aggregate can answer the query.

There are many such app-level query generators that bear the brunt of
keeping track of, and choosing from, multiple aggregates --- a task
that's on a par with creating appropriate indexes, and about as much
fun.

Maybe one could kill a couple of birds with one stone, by making
materialized views visible to the query optimizer?

Discussion?


---------------------------(end of broadcast)---------------------------
TIP 5: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faq

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 04:56 AM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.2.0
www.UnixAdminTalk.com