General network error

Hi guys,

Anyone encountered this error.

An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available. Source: "Microsoft OLE DB Provider for SQL Server" Hresult: 0x80004005 Description: "[DBNETLIB][ConnectionRead (recv()).]General network error. Check your network documentation.".

The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the
component, but the error is fatal and the pipeline stopped executing.

Need your help...

thanks

I have the same error and we still do not have a solution. We have over 100 remote locations we are sending data to and just one of them this week started to give us this error. We are sending just 39 rows, all columns allow null values, nothing looks bad with the data. Can use ISQL to insert a row mannually, but using DTS or our ETL tool (with OLE DB) gives us the error.sql

GACUTIL.exe Not Available

Hello,

I am going through some examples on how to build custom tasks, and apparently, I don't have the gacutil.exe utility. I guess it does not come with the .NET Framework 1.1 or 2.0.

How do I get this utility?

Thank you for your help!

cdun2

Try installing the .Net Framework SDK 2.0 if it is really nowhere to be found. If you are using Visual Studio, I would have expected to be there as the SDK is part of the default install, it may even be required. Have you done a full Search on your machine?

It is not included with the smaller .Net Framework redistribution package aimed at client mahines.

|||

Thank you, I will look into this.

cdun2

FYI: SQL Reporting Services download is available!

http://www.microsoft.com/sql/reporting/productinfo/trial.asp
If you have a SQL 2000 license, you can use the software. I don't work for
Microsoft, but I am excited enough to see this that I wanted to send out the
link. I have been waiting a long time to move beyond the limits of
Infomaker or crystal reports to something that is more integrated with SQL.
It has pdf output capabilities btw. I am going to start trying this out
immediately, I suggest DBAs check this out.
--
*******************************************************************
Andy S.
MCSE NT/2000, MCDBA SQL 7/2000
andymcdba1@.NOMORESPAM.yahoo.com
Please remove NOMORESPAM before replying.
Always keep your antivirus and Microsoft software
up to date with the latest definitions and product updates.
Be suspicious of every email attachment, I will never send
or post anything other than the text of a http:// link nor
post the link directly to a file for downloading.
This posting is provided "as is" with no warranties
and confers no rights.
*******************************************************************Just wanted to pass this along from my first attempt.
Note from the Readme file, I found you need VB .NET 2003 for the Report
designer.
Before you install the product, check for a file called authz.dll in
c:\winnt\system32. It'll hold up the install for the Reporting Services
server part if it is missing. It is a file that comes either from
contacting MS support for the file in Q320211 or from another Win 2k machine
that was upgraded from a previous service pack to SP 4 instead of SP 4
directly.
You know there always has to be prerequisites <g>
--
*******************************************************************
Andy S.
MCSE NT/2000, MCDBA SQL 7/2000
andymcdba1@.NOMORESPAM.yahoo.com
Please remove NOMORESPAM before replying.
Always keep your antivirus and Microsoft software
up to date with the latest definitions and product updates.
Be suspicious of every email attachment, I will never send
or post anything other than the text of a http:// link nor
post the link directly to a file for downloading.
This posting is provided "as is" with no warranties
and confers no rights.
*******************************************************************
Andy S.
MCSE NT/2000, MCDBA SQL 7/2000
andymcdba1@.NOMORESPAM.yahoo.com
Please remove NOMORESPAM before replying.
Always keep your antivirus and Microsoft software
up to date with the latest definitions and product updates.
Be suspicious of every email attachment, I will never send
or post anything other than the text of a http:// link nor
post the link directly to a file for downloading.
This posting is provided "as is" with no warranties
and confers no rights.
*******************************************************************

FYI: SQL Reporting Services download is available!

http://www.microsoft.com/sql/report...tinfo/trial.asp
If you have a SQL 2000 license, you can use the software. I don't work for
Microsoft, but I am excited enough to see this that I wanted to send out the
link. I have been waiting a long time to move beyond the limits of
Infomaker or crystal reports to something that is more integrated with SQL.
It has pdf output capabilities btw. I am going to start trying this out
immediately, I suggest DBAs check this out.
****************************************
***************************
Andy S.
MCSE NT/2000, MCDBA SQL 7/2000
andymcdba1@.NOMORESPAM.yahoo.com
Please remove NOMORESPAM before replying.
Always keep your antivirus and Microsoft software
up to date with the latest definitions and product updates.
Be suspicious of every email attachment, I will never send
or post anything other than the text of a http:// link nor
post the link directly to a file for downloading.
This posting is provided "as is" with no warranties
and confers no rights.
****************************************
***************************Just wanted to pass this along from my first attempt.
Note from the Readme file, I found you need VB .NET 2003 for the Report
designer.
Before you install the product, check for a file called authz.dll in
c:\winnt\system32. It'll hold up the install for the Reporting Services
server part if it is missing. It is a file that comes either from
contacting MS support for the file in Q320211 or from another Win 2k machine
that was upgraded from a previous service pack to SP 4 instead of SP 4
directly.
You know there always has to be prerequisites <g>
****************************************
***************************
Andy S.
MCSE NT/2000, MCDBA SQL 7/2000
andymcdba1@.NOMORESPAM.yahoo.com
Please remove NOMORESPAM before replying.
Always keep your antivirus and Microsoft software
up to date with the latest definitions and product updates.
Be suspicious of every email attachment, I will never send
or post anything other than the text of a http:// link nor
post the link directly to a file for downloading.
This posting is provided "as is" with no warranties
and confers no rights.
****************************************
***************************
Andy S.
MCSE NT/2000, MCDBA SQL 7/2000
andymcdba1@.NOMORESPAM.yahoo.com
Please remove NOMORESPAM before replying.
Always keep your antivirus and Microsoft software
up to date with the latest definitions and product updates.
Be suspicious of every email attachment, I will never send
or post anything other than the text of a http:// link nor
post the link directly to a file for downloading.
This posting is provided "as is" with no warranties
and confers no rights.
****************************************
***************************

Fuzzy Lookup componant eating all available virtual memory

Hey,

I have a large set of data that I need to match against another large set of data. The reference table has 9.8mill rows and my input has 14.6mill rows. I started with a new project. I added my connection, then a task to clear the result table, then my data flow, then my OLE source, then my Fuzzy Lookup task, then my SQL Server Destination. I set the connection of my OLE source and set the query to pull the data. Then I set the connection of my Fuzzy Lookup task, set the reference table and told it to create a new index (the problem also occurs if I use a generated index) and then set up the matching criteria. Then I set the connection and destination for the SQL Server Destination.

After setting all this up, I hit Run. The thing ran great until ~ 800k rows and then it failed. I ran it several times and it always failed right around 800k with a message saying there was not enough space and then an error with buffers being passed to the Fuzzy Lookup component. I opened Task Manager and watched the resources as it ran and was amazed at what I saw. The Fuzzy Lookup component eats up every bit of Virtual Memory available and when it can't take any more, it errors out. I tried setting the Max Memory setting on the component and it seems to have no effect. I also played with the buffer settings on the data flow task to no avail. I even went as far as to put an identity on my input table and create a function that outputs selects that use a between on the identity to break the data into 600k chunks. I set up a ForEach component and DTS variables, but the Fuzzy Lookup component does not free the VM after the iteration of the ForEach component!

I ended up running each chunk of 600k one at a time. I have to automate this for the future, so I need a solution. Does anyone have an idea for me?

The errors I get are:

[Fuzzy Lookup 1 [3067]] Warning: Not enough storage is available to complete this operation.

[DTS.Pipeline] Warning: A call to the ProcessInput method for input 3068 on component "Fuzzy Lookup 1" (3067) unexpectedly kept a reference to the buffer it was passed. The refcount on that buffer was 2 before the call, and 1 after the call returned.

[DTS.Pipeline] Error: The ProcessInput method on component "Fuzzy Lookup 1" (3067) failed with error code 0x8007000E. The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.

[DTS.Pipeline] Error: Thread "WorkThread0" has exited with error code 0x8007000E.

[OLE DB Source [1923]] Error: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.

[DTS.Pipeline] Error: The PrimeOutput method on component "OLE DB Source" (1923) returned error code 0xC02020C4. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.

[DTS.Pipeline] Error: Thread "SourceThread0" has exited with error code 0xC0047038.

[DTS.Pipeline] Error: Thread "WorkThread1" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown.

[DTS.Pipeline] Error: Thread "WorkThread1" has exited with error code 0xC0047039.

|||

Pls check to see whether http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=191199&SiteID=1 helps.

Thanks

Wenyang

|||

I found that thread after posting and tried the solutions there, but they had no effect on the package. It still almost linearly eats up all virtual memory. By the time it is at 800k records, it has eaten up 40gb of virtual memory.

The server is:

Dual AMD 64bit Processors

2TB storage with 650GB free

8GB ram

Windows Server 2003 64bit

SQL Server 2005 64bit

Of note also is that I have tried running the package from the command line with identical results. Here is what I used:

dtexec /f package1.dtsx /ref n

|||I had the VM size increased to 200gb and I can do 3m sets now. It still isn't to where I need to to be for automation, but it will let me get the job done for now. If anyone has some ideas on what might be wrong, please please let me know!!|||

Hey James,

Did you have any luck with this? I'm in exactly the same situation you are in regarding fuzzy lookup taking all memory. If you or anyone else figured out a work around it would be great to hear.

Thanks,

SL

|||There's been fixes for memory leak issues with the fuzzy components in the past. Could you check KB 912423: "FIX: Memory leaks occur when you use Fuzzy Lookup and Fuzzy Grouping to transform a SQL Server 2005 Integration Services package"?

Fuzzy Lookup componant eating all available virtual memory

Hey,

I have a large set of data that I need to match against another large set of data. The reference table has 9.8mill rows and my input has 14.6mill rows. I started with a new project. I added my connection, then a task to clear the result table, then my data flow, then my OLE source, then my Fuzzy Lookup task, then my SQL Server Destination. I set the connection of my OLE source and set the query to pull the data. Then I set the connection of my Fuzzy Lookup task, set the reference table and told it to create a new index (the problem also occurs if I use a generated index) and then set up the matching criteria. Then I set the connection and destination for the SQL Server Destination.

After setting all this up, I hit Run. The thing ran great until ~ 800k rows and then it failed. I ran it several times and it always failed right around 800k with a message saying there was not enough space and then an error with buffers being passed to the Fuzzy Lookup component. I opened Task Manager and watched the resources as it ran and was amazed at what I saw. The Fuzzy Lookup component eats up every bit of Virtual Memory available and when it can't take any more, it errors out. I tried setting the Max Memory setting on the component and it seems to have no effect. I also played with the buffer settings on the data flow task to no avail. I even went as far as to put an identity on my input table and create a function that outputs selects that use a between on the identity to break the data into 600k chunks. I set up a ForEach component and DTS variables, but the Fuzzy Lookup component does not free the VM after the iteration of the ForEach component!

I ended up running each chunk of 600k one at a time. I have to automate this for the future, so I need a solution. Does anyone have an idea for me?

The errors I get are:

[Fuzzy Lookup 1 [3067]] Warning: Not enough storage is available to complete this operation.

[DTS.Pipeline] Warning: A call to the ProcessInput method for input 3068 on component "Fuzzy Lookup 1" (3067) unexpectedly kept a reference to the buffer it was passed. The refcount on that buffer was 2 before the call, and 1 after the call returned.

[DTS.Pipeline] Error: The ProcessInput method on component "Fuzzy Lookup 1" (3067) failed with error code 0x8007000E. The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.

[DTS.Pipeline] Error: Thread "WorkThread0" has exited with error code 0x8007000E.

[OLE DB Source [1923]] Error: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.

[DTS.Pipeline] Error: The PrimeOutput method on component "OLE DB Source" (1923) returned error code 0xC02020C4. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.

[DTS.Pipeline] Error: Thread "SourceThread0" has exited with error code 0xC0047038.

[DTS.Pipeline] Error: Thread "WorkThread1" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown.

[DTS.Pipeline] Error: Thread "WorkThread1" has exited with error code 0xC0047039.

|||

Pls check to see whether http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=191199&SiteID=1 helps.

Thanks

Wenyang

|||

I found that thread after posting and tried the solutions there, but they had no effect on the package. It still almost linearly eats up all virtual memory. By the time it is at 800k records, it has eaten up 40gb of virtual memory.

The server is:

Dual AMD 64bit Processors

2TB storage with 650GB free

8GB ram

Windows Server 2003 64bit

SQL Server 2005 64bit

Of note also is that I have tried running the package from the command line with identical results. Here is what I used:

dtexec /f package1.dtsx /ref n

|||I had the VM size increased to 200gb and I can do 3m sets now. It still isn't to where I need to to be for automation, but it will let me get the job done for now. If anyone has some ideas on what might be wrong, please please let me know!!|||

Hey James,

Did you have any luck with this? I'm in exactly the same situation you are in regarding fuzzy lookup taking all memory. If you or anyone else figured out a work around it would be great to hear.

Thanks,

SL

|||There's been fixes for memory leak issues with the fuzzy components in the past. Could you check KB 912423: "FIX: Memory leaks occur when you use Fuzzy Lookup and Fuzzy Grouping to transform a SQL Server 2005 Integration Services package"?

function vs stored procedure

I know this is a stupid question (actually, maybe its not..?)

They seem to be identical in some ways, but not available to the outside world. what are some differences?i think its the ability to use the UDF inline that makes it easier.If you had to perform the same calculation in a procedure, you'd have to return the value as an output parameter. not necessarily difficult but mnore coding.

heres an answer fromAdvanced SQL Server Stored Procedure Programming Chat

Q: (SRC): Are there inherent performance benefits to using Stored procedure vs. User Defined Functions?

A: There is no difference in performance. Because of the enforced prevention of side-effects in a UDF, only UDFs can be used in queries.

ofcors, UDFs have some limitations too( like you cannot use non-deterministic built-in functions..like getdate() .etc), which am assuming you are aware of.

hth|||To elaborate a bit, a UDF can also return tabular (in addition to scalar) data, and thus can be joined to.

While this might seem similar to a view, it has one substantila advantage: it can be parameterized! So for potentially enormous result sets, a UDF can improve efficiency enormously.|||You also have to be careful using UDFs in other queries cause you can end up calling the func for every row returned and that can be painful. Also there are a number of normal SQL statements you can't do in funcs.

function oversight for SQL server

Has anyone a reference on a comprehensive oversight of functions available for SQL server? I suspect that some special functions like in DB2 or ORACLE are not available with SQL server, but I want to do a comparison.........Look in bol - it gives a list of functions.
There may be things that are available in other databases but not in sql server but that may well be because sql server concentrates more on database functionality and expects the system to be designed as such.|||Originally posted by nigelrivett
Look in bol - it gives a list of functions.
There may be things that are available in other databases but not in sql server but that may well be because sql server concentrates more on database functionality and expects the system to be designed as such.

Thanks for the suggestion,

However, i am not looking to buy a book, just need a list of functions that i can download from a SQL server related site...
functions I am refering to are, among others things like RANK(), which to me are perfectly handy in a SQL tool-set...|||Here is a start...

http://msdn.microsoft.com/library/en-us/tsqlref/ts_fa-fz_9dyr.asp?frame=true|||Yes, thank you that is exactly what I was looking for......

Full-text searching

Are there any plans to add full-text searching capability to SQLCE? I know it's available in SQL Server Express but it would still be useful for an embedded/desktop application -- SQLite recently added this.We have this feature on our radar, but time lines for this have not been fixed yet

Full-text searching

Are there any plans to add full-text searching capability to SQLCE? I know it's available in SQL Server Express but it would still be useful for an embedded/desktop application -- SQLite recently added this.We have this feature on our radar, but time lines for this have not been fixed yet

full-text queries with express edition

Hi,
I understand that full-text indexing is not available in the express
edition.
My situation is that we have to write an application to take advantage of
full-text-indexing when available.
Quesitions are.
1. Does "freetext" and "contains" queries works on express edition?
(by doing a full table scan or something like that)
2. If it does not, how do I write the c# that recognize the capability,
so that c# code can send/execute different queries based on
"full-text-capability" of sql-server.
any direction is deeply appreciated.
Thanks
Nalaka
1) It currently does not work on SQL FTS.
2) I believe the February issue of SQL Server pro has an article on how to
get this working using pure tsql.
Hilary Cotter
Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html
Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com
"Nalaka" <nalaka12@.nospam.nospam> wrote in message
news:u%23h7eJNMGHA.2336@.TK2MSFTNGP12.phx.gbl...
> Hi,
> I understand that full-text indexing is not available in the express
> edition.
> My situation is that we have to write an application to take advantage of
> full-text-indexing when available.
> Quesitions are.
> 1. Does "freetext" and "contains" queries works on express edition?
> (by doing a full table scan or something like that)
> 2. If it does not, how do I write the c# that recognize the capability,
> so that c# code can send/execute different queries based on
> "full-text-capability" of sql-server.
> any direction is deeply appreciated.
> Thanks
> Nalaka
>
|||Nalaka wrote on Mon, 13 Feb 2006 11:19:10 -0800:

> Hi,
> I understand that full-text indexing is not available in the express
> edition.
> My situation is that we have to write an application to take advantage of
> full-text-indexing when available.
> Quesitions are.
> 1. Does "freetext" and "contains" queries works on express edition?
> (by doing a full table scan or something like that)
> 2. If it does not, how do I write the c# that recognize the capability,
> so that c# code can send/execute different queries based on
> "full-text-capability" of sql-server.
> any direction is deeply appreciated.
In my code I first do the following:
select FULLTEXTCATALOGPROPERTY('STKcatalog', 'ItemCount'),
FULLTEXTCATALOGPROPERTY('STKcatalog', 'PopulateStatus')
If NULLs returned, FTS is not available for the named catalog (in my case
STKcatalog). I also use these values to double check whether the index is
being rebuilt, and to make sure that the ItemCount value is close to my
table row count. This way if there is not FTS catalog, or it's being
populated, I can switch my query to use LIKE rather than CONTAINS.
Dan