General network error - SqlInternalConnection.OpenAndLogin

We are having some major issues with suspicious errors while using Biztalk
that we believe may be linked to network issues or possibly a bad NIC. So
we wrote a small app to continuously "ping" - really it issues a small
select against a table - the DB every 2 seconds. We had lots of errors
crop up doing this. In doing so seemed to narrow some issues down to
ADO.NET's pooling along with problems in teh network. Apparently if there
were network issues and the pooled connection got "hosed", the whole
connection was doomed and we'd receive errors "General network errors" on
the next attempt to use the hosed connection.
Now, we have disabled pooling and getting the below exception. Does anyone
know what normally causes this exception to occur out of the "OpenAndLogin"
method?
Kevin

Event Type: Error
Event Source: DatabasePing
Event Category: None
Event ID: 0
Date: 8/18/2004
Time: 6:04:35 PM
User: N/A
Computer:
Description:
System.Data.SqlClient.SqlException: General network error. Check your
network documentation.
at System.Data.SqlClient.SqlInternalConnection.OpenAn dLogin()
at System.Data.SqlClient.SqlInternalConnection..ctor( SqlConnection
connection, SqlConnectionString connectionOptions)
at System.Data.SqlClient.SqlConnection.Open()
at DatabasePing.DatabasePing._IssueSelect(String query, String
connectionString)
at DatabasePing.DatabasePing._IssuePing(Object stateInfo)
For more information, see Help and Support Center at
http://go.microsoft.com/fwlink/events.asp.
"Kevin C" <kc@.noneya.com> wrote in message
news:erH94FfhEHA.4064@.TK2MSFTNGP12.phx.gbl...
> We are having some major issues with suspicious errors while using Biztalk
> that we believe may be linked to network issues or possibly a bad NIC. So
> we wrote a small app to continuously "ping" - really it issues a small
> select against a table - the DB every 2 seconds. We had lots of errors
> crop up doing this. In doing so seemed to narrow some issues down to
> ADO.NET's pooling along with problems in teh network. Apparently if there
> were network issues and the pooled connection got "hosed", the whole
> connection was doomed and we'd receive errors "General network errors" on
> the next attempt to use the hosed connection.
> Now, we have disabled pooling and getting the below exception. Does
anyone
> know what normally causes this exception to occur out of the
"OpenAndLogin"
> method?
>
.. . .

> System.Data.SqlClient.SqlException: General network error. Check your
The same connectivity problem that was screwing up your pooled connections
is preventing new connections.
David

General network error - SqlInternalConnection.OpenAndLogin

We are having some major issues with suspicious errors while using Biztalk
that we believe may be linked to network issues or possibly a bad NIC. So
we wrote a small app to continuously "ping" - really it issues a small
select against a table - the DB every 2 seconds. We had lots of errors
crop up doing this. In doing so seemed to narrow some issues down to
ADO.NET's pooling along with problems in teh network. Apparently if there
were network issues and the pooled connection got "hosed", the whole
connection was doomed and we'd receive errors "General network errors" on
the next attempt to use the hosed connection.
Now, we have disabled pooling and getting the below exception. Does anyone
know what normally causes this exception to occur out of the "OpenAndLogin"
method?
Kevin
----
--
Event Type: Error
Event Source: DatabasePing
Event Category: None
Event ID: 0
Date: 8/18/2004
Time: 6:04:35 PM
User: N/A
Computer:
Description:
System.Data.SqlClient.SqlException: General network error. Check your
network documentation.
at System.Data.SqlClient.SqlInternalConnection.OpenAndLogin()
at System.Data.SqlClient.SqlInternalConnection..ctor(SqlConnection
connection, SqlConnectionString connectionOptions)
at System.Data.SqlClient.SqlConnection.Open()
at DatabasePing.DatabasePing._IssueSelect(String query, String
connectionString)
at DatabasePing.DatabasePing._IssuePing(Object stateInfo)
For more information, see Help and Support Center at
http://go.microsoft.com/fwlink/events.asp."Kevin C" <kc@.noneya.com> wrote in message
news:erH94FfhEHA.4064@.TK2MSFTNGP12.phx.gbl...
> We are having some major issues with suspicious errors while using Biztalk
> that we believe may be linked to network issues or possibly a bad NIC. So
> we wrote a small app to continuously "ping" - really it issues a small
> select against a table - the DB every 2 seconds. We had lots of errors
> crop up doing this. In doing so seemed to narrow some issues down to
> ADO.NET's pooling along with problems in teh network. Apparently if there
> were network issues and the pooled connection got "hosed", the whole
> connection was doomed and we'd receive errors "General network errors" on
> the next attempt to use the hosed connection.
> Now, we have disabled pooling and getting the below exception. Does
anyone
> know what normally causes this exception to occur out of the
"OpenAndLogin"
> method?
>
. . .

> System.Data.SqlClient.SqlException: General network error. Check your
The same connectivity problem that was screwing up your pooled connections
is preventing new connections.
Davidsql

General network error - SqlInternalConnection.OpenAndLogin

We are having some major issues with suspicious errors while using Biztalk
that we believe may be linked to network issues or possibly a bad NIC. So
we wrote a small app to continuously "ping" - really it issues a small
select against a table - the DB every 2 seconds. We had lots of errors
crop up doing this. In doing so seemed to narrow some issues down to
ADO.NET's pooling along with problems in teh network. Apparently if there
were network issues and the pooled connection got "hosed", the whole
connection was doomed and we'd receive errors "General network errors" on
the next attempt to use the hosed connection.
Now, we have disabled pooling and getting the below exception. Does anyone
know what normally causes this exception to occur out of the "OpenAndLogin"
method?
Kevin
----
--
Event Type: Error
Event Source: DatabasePing
Event Category: None
Event ID: 0
Date: 8/18/2004
Time: 6:04:35 PM
User: N/A
Computer:
Description:
System.Data.SqlClient.SqlException: General network error. Check your
network documentation.
at System.Data.SqlClient.SqlInternalConnection.OpenAndLogin()
at System.Data.SqlClient.SqlInternalConnection..ctor(SqlConnection
connection, SqlConnectionString connectionOptions)
at System.Data.SqlClient.SqlConnection.Open()
at DatabasePing.DatabasePing._IssueSelect(String query, String
connectionString)
at DatabasePing.DatabasePing._IssuePing(Object stateInfo)
For more information, see Help and Support Center at
http://go.microsoft.com/fwlink/events.asp."Kevin C" <kc@.noneya.com> wrote in message
news:erH94FfhEHA.4064@.TK2MSFTNGP12.phx.gbl...
> We are having some major issues with suspicious errors while using Biztalk
> that we believe may be linked to network issues or possibly a bad NIC. So
> we wrote a small app to continuously "ping" - really it issues a small
> select against a table - the DB every 2 seconds. We had lots of errors
> crop up doing this. In doing so seemed to narrow some issues down to
> ADO.NET's pooling along with problems in teh network. Apparently if there
> were network issues and the pooled connection got "hosed", the whole
> connection was doomed and we'd receive errors "General network errors" on
> the next attempt to use the hosed connection.
> Now, we have disabled pooling and getting the below exception. Does
anyone
> know what normally causes this exception to occur out of the
"OpenAndLogin"
> method?
>
. . .
> System.Data.SqlClient.SqlException: General network error. Check your
The same connectivity problem that was screwing up your pooled connections
is preventing new connections.
David

fuzzy search

Is there a built in capability in Sql server 2005 to do a search which can handle spelling errors. for eg.

We are doing a search for "hanovr" and our database contains "hanover" . In cases when there is a spelling error searching using LIKE,CONTAINS,FREETEXT are not giving me the results. Is there an out of the box solution for this problem.

Please Advice.

Oracle has a function, Soundex if I remember right, that worked off the auditory equivalent value.

I don't remember if sql server has something like that or not.

|||

Duh. Just looked it up and there is one. Check it out!

|||

there is also a version of soundex in sql server. check it here:http://msdn2.microsoft.com/en-us/library/aa259235(sql.80).aspx

|||

There are actually 2 functions in SQL using which you can check whether 2 values are matching or not. SOUNDEX and DIFFERENCE. These functions actually ignore the vowels ( a,e,i,o,u ).

The SOUNDEX function returns a four-character code to evaluate the similarity of two strings.

The DIFFERENCE function returns the difference ( ranging from 0 to 4, 0 is the highest possible difference and 4 is the least possible difference ) between the SOUNDEX values of two character expressions. Run below queries.

select soundex ('hanovr' ) , soundex ('hanover' ) , difference ('hanovr' ,'hanover' )select soundex ('hanovr' ) , soundex ('hanovr' ) , difference ('hanovr' ,'hanovr' )

I've used them previously with not much luck. You can if possible go with some .net libraries to check spelling mistakes.

Hope this will help.

|||

I was looking for something similar - a search mechanism that deals with misspellings. Came acrosshttp://shuffletext.com/highlight, which is a little misspelling search component in beta.

Figured I'd jump on the thread, as it works pretty good. No problems integrating, but there's a couple of annoying things: it doesn't hand you back any info on how good the match was, and sometimes the first result isn't always the best result.

sql

Fuzzy Grouping errors

Hi - we have been evaluating using Fuzzy Grouping and Lookup for maintaining our large list of customer records. Initial testing with Grouping on about 300K records went great but now with a larger sample of 7.3 million records we are running into problems. It doesn't appear to be system limitation - the index is built reasonably quickly and without errors but when it starts the matching we get these errors:

[Fuzzy Grouping Inner Data Flow : DTS.Pipeline] Error: The ProcessInput method on component "Fuzzy Lookup" (86) failed with error code 0x8000FFFF. The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.

[Fuzzy Grouping Inner Data Flow : DTS.Pipeline] Error: Thread "WorkThread0" has exited with error code 0x8000FFFF.

[Fuzzy Grouping Inner Data Flow : DTS.Pipeline] Error: Thread "WorkThread1" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown.

[Fuzzy Grouping Inner Data Flow : OLE DB Source [1]] Error: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.

[Fuzzy Grouping Inner Data Flow : DTS.Pipeline] Error: Thread "WorkThread1" has exited with error code 0xC0047039.

[Fuzzy Grouping Inner Data Flow : DTS.Pipeline] Error: The PrimeOutput method on component "OLE DB Source" (1) returned error code 0xC02020C4. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.

[Fuzzy Grouping Inner Data Flow : DTS.Pipeline] Error: Thread "SourceThread0" has exited with error code 0xC0047038.

One thing we did find is that our test server didn't have SP1 installed and that seemed to help a lot (we were getting buffer errors prior to SP1). One other note - the desination table is populated with all the data but no scoring has been applied to it.

Does anyone have any ideas what could be causing this?

Thanks!

Keith Doyle

Had the same problem, and thanks to you, I managed to get this running by doing multiple passes on around 200k rows in each pass.

I also get lots of errors that say"Buffer Manager found Virtual Memory Low but unable to swap out any buffer". The package works inspite of these errors when rowcount is low enough.

DTSDebugHost.exe consumes a lot of Memory during processing. LSASS also seems unnaturally high. I added a lot of Paging memory and that seemed to improve things to the extent that DTSDebugHost usage increased even further :-). But from the PerfMon stats, it looks to me like DTSDebug isnt using paging memory. The other processes actually released memory instead.

I use SQL2005Ent SP1 on Win2003R2 - on Intel X-64.

I hope and pray that there is a fix on the way. Bcos I found Fuzzy quite useful.

|||

I tried out a few things:

1. Added RAM

2. Used DTEXec instead of running in Debug mode in BIDS

3. Reduced columns

Have so far succeeded in 600k rows and am running 1.5 million now, and havent encountered any Buffer Manager errors so far (WIP, and fingers crossed)

My perfmon observations are however repeated. I have a suspicion Fuzzy does not use File Paging efficiently (or not at all). I had more than 8 GB of pagefile space allocated, but my Memory utilization never went beyond Physical Ram. If anything, all other running processes got squeezed out.

I have run some heavy mining stuff on the same infrastructure, without any crashes(even before I added RAM). So why is Fuzzy Grouping crashing? Or is it SSIS?

Another observation - Memory usage did not drop back after closing Devenv or DTExec. Memory gets freed only after a machine restart.

I hope someone at Microsoft tells us what the problem is. And gives us a fix please!!!

|||

Great info - I am seeing the exact same thing. See the other thread I opened for "Fuzzy Grouping: Any success with > 3 million records?". I'll post my latest test results there - please copy your info from this thread to that one.

Thanks!!

|||

I'll have someone investigate at this end and we'll get back to these threads. Thanks for the grat info.

One thing would be to try executing using DTExec outside the debug environment. Or try "Start without Debugging." I doubt this will solve the problem entirely, but it will reduce any effect of the IDE on the problem.

Donald

|||

Please see the follow up to this thread at:

http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=417880&SiteID=1&mode=1

sql

Fuzzy Grouping error when progress: Finding similar records

I get this errors when progress is : Finding similar records

[DTS.PIPELINE] Information: The buffer manager detected that the system was low on virtual mermory, but was unable to swap out any buffers. 6 buffers where considered and 6 where locked. Either not enough memory is available to the pipeline because not enough is installed, other processes are using it, or too many buffers are locked.

I'm triying to fuzzy match in a table with 1.000.000 records.

My computer RAM is 1GB.

How can I resolve the problem?

Tanks,

Eusebio.

There was a known memory issue in FuzzyLookup which will become more evident in certain circumstance(long running pkg against a large reference table) - FuzzyGrouping uses FuzzyLookup underneath, so it shares the problem. This was fixed for SP1.

For now you can try the possilbe work arounds of setting BufferTempStoragePath or/and inreasing virtual memory size which were discussed in this thread http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=122391&SiteID=1

Thanks

Wenyang

Function call in Dataset Query

Hello Guys,

I have a question that seems easy but I can not figure out...

Premise:

Have Custom code that fixes Divide by Zero Errors in SSRS. I have added the code to the Custom Code area in Report Properties correctly.

I have a Dataset that has a calculation for a column within a select statement

Query Pseudocode:

select ...[FRC%]=convert(decimal(13,2),sum(cost))/convert(decimal(13,2),sum(income))...
,year
from

(subquery"blah" )

Union

(Subquery"blah")

Custom Code:

Public Function SafeDiv(ByVal numerator as Double, ByVal denominator as Double) as Double
if denominator = 0 then
return 0
else
return numerator/denominator
end if
End Function

How To use:

If you have a field that does division and you need to eliminate the divide by zero error that occurs with SSRS then type =code.SafeDiv(first,second) in the field.

Problem:

How do I add this code reference in the following dataset select statement

select ...[FRC%]=convert(decimal(13,2),sum(cost))/convert(decimal(13,2),sum(income))...
,year
from

(subquery"blah" )

Union

(Subquery"blah") table1

---

I tried to do this:

from this:

[FRC%]=convert(decimal(13,2),sum(cost))/convert(decimal(13,2),sum(income)) ...

to this

[FRC%]=code.Safediv(convert(decimal(13,2),sum(cost)),convert(decimal(13,2),sum(income))) ...

---

But it did not work...gave me this error:

TITLE: Microsoft Report Designer

An error occurred while executing the query.
Cannot find either column "code" or the user-defined function or aggregate "code.safediv", or the name is ambiguous.

ADDITIONAL INFORMATION:

Cannot find either column "code" or the user-defined function or aggregate "code.safediv", or the name is ambiguous. (Microsoft SQL Server, Error: 4121)

For help, click: http://go.microsoft.com/fwlink?ProdName=Microsoft+SQL+Server&ProdVer=09.00.1399&EvtSrc=MSSQLServer&EvtID=4121&LinkId=20476

BUTTONS:

OK

---

Help!

P.S.

this is a Matrix report and this select statement is within one of the datasets that fill a matrix.

anyone...?|||

Hello,

Unfortunately, you can't use custom code in your SQL query (as you've found). What you can do is supply both fields in the calculation (cost and income) to the report and have it do the percentage, or create a 'SafeDiv' function in SQL and do it there.

Hope this helps.

Jarret

|||

On the DataSet

Use Generic Query Designer

Then you can use

="Select tableName.ProductID, "& code.Safediv(Parameters) & " as ColumnName

From tableName"

Try to adapts it to your report.

I hope it help you.

|||Thanks I will try it...|||

I think this will work...I will reply with result...

Thank You!

Fulltextsearch Error in Userinstance

I've enabled the Fulltextsearch in some Tables of my DB.
In SQL Server Management Studio the querys are all have results and running free of errors.

If i will use the same querys in VWD, they're running in a SqlException. Translated from german:
The Fulltextsearch cant be used in the Userinstance.

But a SelectCommand from the WebSite to the IndexState:
SELECT crawl_end_date FROM sys.fulltext_indexes WHERE fulltext_catalog_id = 10
works fine.

What i'm wrong?

The ConnectionString i'm using:
="Data Source=.\SQLEXPRESS;AttachDbFilename=|DataDirectory|\Support.mdf;Integrated Security=True;User Instance=True" providerName="System.Data.SqlClient"

The FulltextService (msftesql.exe) is running under a UserAccount.

Thanx

Klaus

Hi Klaus,

Full Text Search can not be used in a User Instance. If you need the functionality of FTS, you'll need to attach your database to the main instance and connect to that.

Regards,

Mike Wachal
SQL Express team

-
Check out my tips for getting your answer faster and how to ask a good question: http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=307712&SiteID=1

|||

Hi Mike,

User Instance is the magic word.

Change my connectionstring like connectionstring.com says and all works fine.

Thanks for the hint to the right way.

Klaus

Full-Text Search gets syntax error and kills the transaction

I am having problems with syntax errors being generated from the search clause of a full-text search. When the syntax error is raised, the batch and transaction are stopped. Placing the search within a SQL Try/Catch allows the batch to continue, but the transaction is uncommitable.

I need to trap and handle the full-text search syntax error then control the commit or rollback of the transaction based on other transactions.

Below is a simplified version of the type of logic I am working with. The XACT_STATE goes to -1 because of the syntax error generated by the full-text search. This forces a rollback of the whole transaction.

Declare@.sSearch NVarChar(50)

/* @.sSearch is passed by a web page and could come back empty or with an invalid Full-Text search clause*/

Begin Transaction

Begin Try

Print XACT_STATE()

Select*

/*The table 'KnowledgeBase' is a table with a populated Full-Text Search*/

FromContainstable(KnowledgeBase,*,@.sSearch)

End Try

Begin Catch

Print XACT_STATE()

Print 'Number- ' + Convert(VarChar,ERROR_NUMBER()) + ', ' +

'Severity- ' + Convert(VarChar,ERROR_SEVERITY()) + ', ' +

'State- ' + Convert(VarChar,ERROR_STATE()) + ', ' +

'Message- "' + ERROR_MESSAGE() + '"'

End Catch

/*Some other logic would be here*/

Commit Transaction

I'm moving this post to the Transact-SQL forum because it's a better venue for code-related questions.

Regards,

Gail

FullText Search Error 1075: The dependency service does not exist or

Hi Guys,
Can you please help me with the following problem:
My website keeps crashing and the FullText Search cannot start. I keep
getting errors 7003 in the Event Log with the following message:
Event Type: Error
Event Source: Service Control Manager
Event Category: None
Event ID: 7003
Date: 3/8/2008
Time: 3:18:24 PM
User: N/A
Computer: MASTER
Description:
The SQL Server FullText Search (MSSQLSERVER) service depends on the
following nonexistent service: NTLMSSP
For more information, see Help and Support Center at
http://go.microsoft.com/fwlink/events.asp.
When trying to start the service from Services window I get the
following error:
FullText Search Error 1075: The dependency service does not exist or
has been marked for deletion
Checked the Dependencies in Registry and sqlserver has the following
dependencies: RPCSS NTLMSSP
I have had to restart the server multiple times and cannot figure out
what the problem is.
Windows Server 2003 Standart Edition
SQL Server 2005 Workgroup Edition
Please help
AlbanoOn Mar 9, 2:56=A0am, alstef...@.gmail.com wrote:
> Hi Guys,
> Can you please help me with the following problem:
> My website keeps crashing and the FullText Search cannot start. I keep
> getting errors 7003 in the Event Log with the following message:
> Event Type: Error
> Event Source: Service Control Manager
> Event Category: None
> Event ID: 7003
> Date: =A03/8/2008
> Time: =A03:18:24 PM
> User: =A0N/A
> Computer: MASTER
> Description:
> The SQL Server FullText Search (MSSQLSERVER) service depends on the
> following nonexistent service: NTLMSSP
> For more information, see Help and Support Center athttp://go.microsoft.co=
m/fwlink/events.asp.
> When trying to start the service from Services window I get the
> following error:
> FullText Search Error 1075: The dependency service does not exist or
> has been marked for deletion
> Checked the Dependencies in Registry and sqlserver has the following
> dependencies: RPCSS NTLMSSP
> I have had to restart the server multiple times and cannot figure out
> what the problem is.
> Windows Server 2003 Standart Edition
> SQL Server 2005 Workgroup Edition
> Please help
> Albano
Try this
1. Open the registry key HKEY_LOCAL_MACHINE\System\CurrentControlSet
\Services\msftesql
2. Rename the value DependOnService to anything
3. Restart the server
This have helped me.