Unix Technical Forum

large data management

This is a discussion on large data management within the SQL Server forums, part of the Microsoft SQL Server category; --> Hi all, I have a problem with sqlserver 2000 and large data management. I have a database with a ...


Go Back   Unix Technical Forum > Database Server Software > Microsoft SQL Server > SQL Server

FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 03-01-2008, 03:42 PM
Enorme Vigenti
 
Posts: n/a
Default large data management

Hi all, I have a problem with sqlserver 2000 and large data management.
I have a database with a large tables.
Every table has a continuative input data flow
every morning a job delete old records from the tables (delete one most
old day)
but sometimes I belive that this operation is blocking for the table and
the continuative data flow on that table fails for timeout.
Infact the delete operation is most espesive in time resource. (4-5 hour
for every table)
I must say that the table has an index on datetime field.
I can't use trucate table because I can't delete all records.
In delete table can't use the option "with no lock"
perhaps I must to recalc datatime index on a table before delete? any
other idea?
tnx in advance
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 03-01-2008, 03:42 PM
Erland Sommarskog
 
Posts: n/a
Default Re: large data management

Enorme Vigenti (LSimon5@libero.it) writes:
> Hi all, I have a problem with sqlserver 2000 and large data management.
> I have a database with a large tables.
> Every table has a continuative input data flow
> every morning a job delete old records from the tables (delete one most
> old day)
> but sometimes I belive that this operation is blocking for the table and
> the continuative data flow on that table fails for timeout.
> Infact the delete operation is most espesive in time resource. (4-5 hour
> for every table)
> I must say that the table has an index on datetime field.
> I can't use trucate table because I can't delete all records.
> In delete table can't use the option "with no lock"
> perhaps I must to recalc datatime index on a table before delete? any
> other idea?


Had you been on SQL 2005, you could have used partitioned tables. This
requires Enterprise Edition, I should hasten to add. With partitioned
table, deleting old data can be as smooth as a metadata operation,
if you set it up correctly.

On SQL 2000 (and SQL 2005 Standard and lower editions) you can use
partitioned views. This requires some more work, but is still doable.
And again the delete can be as simple as dropping the table.

SQL Server MVP Stefan Delmarco has a good article on partitoned views
on http://www.fotia.co.uk/fotia/FA.02.S...dViews.01.aspx.

--
Erland Sommarskog, SQL Server MVP, esquel@sommarskog.se

Books Online for SQL Server 2005 at
http://www.microsoft.com/technet/pro...ads/books.mspx
Books Online for SQL Server 2000 at
http://www.microsoft.com/sql/prodinf...ons/books.mspx
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 03-01-2008, 03:42 PM
Enorme Vigenti
 
Posts: n/a
Default Re: large data management

Erland Sommarskog ha scritto:

> Had you been on SQL 2005, you could have used partitioned tables. This
> requires Enterprise Edition, I should hasten to add. With partitioned
> table, deleting old data can be as smooth as a metadata operation,
> if you set it up correctly.
>
> On SQL 2000 (and SQL 2005 Standard and lower editions) you can use
> partitioned views. This requires some more work, but is still doable.
> And again the delete can be as simple as dropping the table.
>
> SQL Server MVP Stefan Delmarco has a good article on partitoned views
> on http://www.fotia.co.uk/fotia/FA.02.S...dViews.01.aspx.
>

Many thanks :-)
Very good!
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 04:03 PM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.2.0
www.UnixAdminTalk.com