fastest way to deduplicate a list
This is a discussion on fastest way to deduplicate a list within the SQL Server forums, part of the Microsoft SQL Server category; --> Im trying to dedupe a table with only one field on it. The table has 40 million records in ...
| |||||||
| FAQ | Members List | Calendar | Search | Today's Posts | Mark Forums Read |
03-01-2008, 03:43 PM
| ||||
| ||||
 fastest way to deduplicate a list Im trying to dedupe a table with only one field on it. The table has 40 million records in it. What is the fastest way? 1) create a table with a unque constraint on it insert into that table? 2) create a table without a unique constraint on it and use insert into table select distinct un from table2? 3) another way? Michael      |
|
03-01-2008, 03:43 PM
| ||||
| ||||
| Re: fastest way to deduplicate a list Michael Evanchik (mre224@yahoo.com) writes: > Im trying to dedupe a table with only one field on it. The table has > 40 million records in it. What is the fastest way? > > 1) create a table with a unque constraint on it insert into that > table? I assume that you would use the IGNORE_DUP_KEY option? Else the scheme wouldn't work. That could very well be the fastest method. -- Erland Sommarskog, SQL Server MVP, esquel@sommarskog.se Books Online for SQL Server 2005 at http://www.microsoft.com/technet/pro...ads/books.mspx Books Online for SQL Server 2000 at http://www.microsoft.com/sql/prodinf...ons/books.mspx |
Linear Mode
