Unix Technical Forum

Re: [pgsql-hackers-win32] win32 performance - fsync question

This is a discussion on Re: [pgsql-hackers-win32] win32 performance - fsync question within the pgsql Hackers forums, part of the PostgreSQL category; --> >> * Linux, with fsync (default), write-cache enabled: usually no data >> corruption, but two runs which had > ...


Go Back   Unix Technical Forum > Database Server Software > PostgreSQL > pgsql Hackers

FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 04-11-2008, 03:50 AM
Magnus Hagander
 
Posts: n/a
Default Re: [pgsql-hackers-win32] win32 performance - fsync question

>> * Linux, with fsync (default), write-cache enabled: usually no data
>> corruption, but two runs which had

>
>Are you verifying that all the data that was committed was
>actually stored? Or
>just verifying that the database works properly after rebooting?


I verified the data.


>I'm a bit surprised that the write-cache lead to a corrupt
>database, and not
>merely lost transactions. I had the impression that drives
>still handled the
>writes in the order received.


In this case, it was lost transactions, not data corruption. Should be
more careful. I had copy/pasted the "no data corruption", should specify
what was lost.

A couple of the latest transactions were gone, but the database came up
in a consistent state, if a bit old.

Since Linux wasn't the stuff I actually was testing, I didn't run very
many tests on it though.

//Magnus

---------------------------(end of broadcast)---------------------------
TIP 2: you can get off all lists at once with the unregister command
(send "unregister YourEmailAddressHere" to majordomo@postgresql.org)

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 04-11-2008, 03:51 AM
Greg Stark
 
Posts: n/a
Default Re: [pgsql-hackers-win32] win32 performance - fsync question


"Magnus Hagander" <mha@sollentuna.net> writes:

> > I'm a bit surprised that the write-cache lead to a corrupt database, and
> > not merely lost transactions. I had the impression that drives still
> > handled the writes in the order received.

>
> In this case, it was lost transactions, not data corruption.
> ...
> A couple of the latest transactions were gone, but the database came up
> in a consistent state, if a bit old.


That's interesting. It would be very interesting to know how reliably this is
true. It could potentially vary depending on the drive firmware.

I can't see any painless way to package up this kind of test for people to run
though. Powercycling machines repeatedly really isn't fun and takes a long
time. And testing this on vmware doesn't buy us anything.

--
greg


---------------------------(end of broadcast)---------------------------
TIP 9: the planner will ignore your desire to choose an index scan if your
joining column's datatypes do not match

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 03:24 AM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.2.0
www.UnixAdminTalk.com