Pages: 1

#1 2014-06-30 08:27:45

Titou
Member
Registered: 2014-05-11
Posts: 12

Massive tests issue

mORMotNightlyBuild 2014-06-29
Delphi XE6
TestSQL3.exe -> ok
Host configuration : i7 860 @ 2.80GHz, 16 Go, 64 bits, Win 7 Pro SP1

I try to create many clients. I use the Otl library (Parallel.Async). I launch 50 clients per application. And I launch this application several times. With 600 clients there are no problem. When I reach approximatively 800 clients, I get this kind of error on many clients :

20140630 09142417 EXC   EWinHTTP ("winhttp.dll error 12002 ()") at 002ABF35 PcmClient.TPcmClient.SendEventAndItsAttributes (1292)  stack trace 00005A52 System.@FreeMem (4364) 000091D0 System.BeginThread (23435) 00009433 System.CharFromWChar (24252) 00009BD6 System.@LStrCat3 (26794) 0017438B mORMot.TSQLRestServerURIContext.ExecuteORMGet (25596) 0016C9BA mORMot.TSQLRest.BatchUpdate (23295) 0016FF55 mORMot.TSQLRestClientURI.EngineUpdateBlob (24283) 0017033D mORMot.TSQLRestClientURI.BatchUpdate (24348) 00005A6E System.@ReallocMem (4423) 002B1FAF PcmClients.Finalization 002B2945 PcmClients.Finalization 0019E708 IdWinsock2.Stub_select (6144) 00022BC3 System.SysUtils.AddBuf (12137) 00022C83 System.SysUtils.AddBuf (12175) 00005A6E System.@ReallocMem (4423) 00009249 System.@NewUnicodeString (23634) 000236D2 System.SysUtils.WideFormatBuf (12502)

And this king of message on the server.

20140630 09142144 EXC   EHttpApiServer ("HttpSendHttpResponse failed: Une opération a été tentée sur une connexion réseau qui n’existe pas (1229)") at 00223997 SynCrtSock.EHttpApiServer.RaiseOnError (4735)  stack trace 000BE6DC System.Classes.ThreadProc (14601) 00009BF6 System.ThreadWrapper (23707)

Any Idea about that?

Offline

#2 2014-06-30 08:56:56

Titou
Member
Registered: 2014-05-11
Posts: 12

Re: Massive tests issue

Additional informations
The http server is created this way :   Server := TSQLHttpServer.Create('8080', [Database], '+', useHttpApiRegisteringURI);

The appplication is started with Administrator rights.

I doesn't get the message "Impossible to register URL". So, I suppose the server uses the http.sys.

Offline

#3 2014-06-30 09:42:08

ab
Administrator
From: France
Registered: 2010-06-21
Posts: 14,659
Website

Re: Massive tests issue

Do sample "21 - HTTP Client-Server performance" work?
It does cover what you expect to test.
You can run several clients at once on several computers, for better support.

I guess the error is on the client side code.
The client got an error ERROR_WINHTTP_TIMEOUT.

How do you create the clients?
Ensure each client thread has his own client instance.

What is the CPU level?
Are you working on the same computer, or over a network?

Offline

#4 2014-07-01 08:07:57

Titou
Member
Registered: 2014-05-11
Posts: 12

Re: Massive tests issue

The sample 21 works well.

Test started with 500 threads, 100 client(s) per thread and 10000 rows to be inserted...
Assertion(s) failed: 0 / 40496
Number of clients connected at once: 50000
Time to process: 7.13s
Operation per second: 2804

The mORMot server and clients are on the same host.

PROCESSOR_LEVEL=6

---

To facilitate the analysis, I removed from my code all the parts that doesn't concern the mORMot.
So the main unit shrinks from 1471 lines to 149 lines.
I redid all the tests.

The main unit:

unit PcmClient;

interface

uses
  System.SysUtils, System.Variants, System.Classes, System.Generics.Collections, System.Types, TypInfo, IniFiles, DateUtils, Winapi.WinSock,
  IdBaseComponent, IdComponent, IdTCPConnection, IdTCPClient, IdGlobal, IdHash, IdHashMessageDigest, IdException, IdExceptionCore,
  SynCommons, mORMot, mORMotSQLite3, SynSQLite3Static, mORMotHttpClient, SynMustache,
  PcmClientData;

type
  TPcmClient = class
  private
    ClId: integer;
    LogClId: RawUTF8;
    PcmClientModel: TSQLModel;
    OrmClient: TSQLRestClientURI;
    PcmClientConfig: TSQLPcmClientConfig;
    PcmClientAction: TSQLPcmClientAction;
    NextActionIndex: integer;
    procedure GetNextAction;
    procedure ProcessActionChangeProperty;
    procedure ProcessActionEvent;
    procedure ProcessActionFile;
    procedure ProcessActionHeartbeat;
  public
    constructor Create(aId: integer); overload;
    destructor Destroy; override;
    procedure Execute;
  end;

implementation

constructor TPcmClient.Create(aId: integer);
var
  SynLog: ISynLog;
begin
  inherited Create;
  SynLog := TSQLLog.Enter(Self);
  ClId := aId;
  LogClId := RawUTF8(IntToStr(ClId) + '>');

  PcmClientModel := CreatePcmClientModel;
  OrmClient := TSQLHttpClient.Create(HOST_NAME, PORT_NAME, PcmClientModel);
  PcmClientConfig := TSQLPcmClientConfig.Create(OrmClient, ClId);

  PcmClientAction := TSQLPcmClientAction.Create();
  NextActionIndex := 0;
  GetNextAction;

  if PcmClientConfig.ID <> ClId then
    SynLog.Log(sllCustom1, 'Client id doens''t exists:' + IntToStr(ClId))
  else
    SynLog.Log(sllCustom1, LogClId + PcmClientConfig.SerialNumber);
end;

destructor TPcmClient.Destroy();
begin
  PcmClientConfig.Free;
  OrmClient.Free;
  PcmClientModel.Free;
  inherited;
end;

procedure TPcmClient.GetNextAction;
begin
  Inc(NextActionIndex);
  PcmClientAction.Offset := 0;
  OrmClient.Retrieve('ClId = ? AND Idx = ?', [], [ClId, NextActionIndex], PcmClientAction);
  PcmClientAction.Init;
end;

procedure TPcmClient.Execute;
var
  SynLog: ISynLog;
begin
  SynLog := TSQLLog.Enter(Self);
  repeat
    // Here is normally the IdSocket processing
    // The code below is executed on E: EIdReadTimeout
    if PcmClientAction.CanExecuteNow then
    begin
      case PcmClientAction.Act of
        acNone: ;
        acConnect: ;
        acDisconnect: ;
        acHeartbeat: ProcessActionHeartbeat;
        acChangeProperty: ProcessActionChangeProperty;
        acEvent: ProcessActionEvent;
        acFile: ProcessActionFile;
      end;
      GetNextAction;
    end;
    Sleep(100);
  until false;
end;

procedure TPcmClient.ProcessActionHeartbeat;
var
  Activity: integer;
begin
  Activity := StrToIntDef(PcmClientAction.Data, 0);
  TSynLog.Add.Log(sllCustom1, LogClId + PcmClientAction.Desc);
end;

procedure TPcmClient.ProcessActionChangeProperty;
var
  PropName: RawUTF8;
  PropValue: RawUTF8;
  SynLog: ISynLog;
begin
  SynLog := TSQLLog.Enter(Self);
  begin
    SynCommons.Split(PcmClientAction.Data, '|', PropName, PropValue);
    if PcmClientConfig.PropertyExists(PropName) then
    begin
      PcmClientConfig.SetPropertyValue(PropName, PropValue);
      SynLog.Log(sllCustom1, LogClId + PcmClientAction.Desc);
    end;
  end;
end;

procedure TPcmClient.ProcessActionEvent;
var
  EventName: RawUTF8;
  Attributes: RawUTF8;
  AttributesList: TRawUTF8List;
  SynLog: ISynLog;
begin
  SynLog := TSQLLog.Enter(Self);
  SynCommons.Split(PcmClientAction.Data, '|', EventName, Attributes);
  SynLog.Log(sllCustom1, LogClId + PcmClientAction.Desc);
end;

procedure TPcmClient.ProcessActionFile();
var
  FileName: RawUTF8;
  MetaData: RawUTF8;
  MetaDataList: TRawUTF8List;
  FileData: TSQLRawBlob;
  SynLog: ISynLog;
begin
  SynLog := TSQLLog.Enter(Self);
  SynCommons.Split(PcmClientAction.Data, '|', FileName, MetaData);
  OrmClient.RetrieveBlob(TSQLPcmClientAction, PcmClientAction.ID, 'FileData', FileData);
  SynLog.Log(sllCustom1, LogClId + PcmClientAction.Desc);
end;

end.

Here the project code. I use the OTL library.

program PcmClients;

{$APPTYPE CONSOLE}
{$R *.res}

uses
  System.SysUtils, IdExceptionCore,
  SynCommons, mORMot,
  OtlParallel, OtlTask,
  PcmClient in 'PcmClient.pas',
  PcmClientData in 'PcmClientData.pas';

var
  i: integer;
  StartIndex: integer;
  EndIndex: integer;

begin
  with TSQLLog.Family do
  begin
    // ExceptionIgnore.Add(EIdReadTimeout);
    PerThreadLog := ptOneFilePerThread;
    DestinationPath := ExtractFilePath(ParamStr(0));
    Level := LOG_STACKTRACE + [sllCustom1];
    EchoToConsole := Level;
  end;

  StartIndex := StrToIntDef(ParamStr(1), 1);
  EndIndex := StrToIntDef(ParamStr(2), 1);
  for i := StartIndex to EndIndex do
  begin
    Parallel.Async(
      procedure
      var
        PcmClient: TPcmClient;
      begin
        try
          PcmClient := TPcmClient.Create(i);
          PcmClient.Execute;
        except
          on E: Exception do
            Writeln(E.ClassName, ': ', E.Message);
        end;
      end);
    // Il faut une pause entre chaque démarrage car sinon on a une erreur sur l'accès au fichier .map si on l'utilise
    Sleep(1000);
  end;

end.

The application are lauched several times like this.
The parameters are the clients ID.

start PcmClients.exe 1 50
pause
start PcmClients.exe 51 100
pause
start PcmClients.exe 101 150
pause
start PcmClients.exe 151 200
pause

There is no problem up to 700 clients. With 800 clients the errors appear.

The database for the clients is created by a separated tool.
The actions are created randomly for each client.
For this test, there are 5 "static" files for the action "File" : (21, 25, 48, 71, 782 Kb).

Below a log from a client (without .map file)


C:\PcmClients\1\PcmClients.exe 0.0.0.0 (2014-07-01 08:28:12)
Host=PC-THPF-OLD User=rsi CPU=8*9-6-7685 OS=13.1=6.1.7601 Wow64=1 Freq=2727587
Environment variables=ALLUSERSPROFILE=C:\ProgramData	APPDATA=C:\Users\rsi\AppData\Roaming	CommonProgramFiles=C:\Program Files (x86)\Common Files	CommonProgramFiles(x86)=C:\Program Files (x86)\Common Files	CommonProgramW6432=C:\Program Files\Common Files	COMPUTERNAME=PC-THPF-OLD	ComSpec=C:\Windows\system32\cmd.exe	FP_NO_HOST_CHECK=NO	HOMEDRIVE=C:	HOMEPATH=\Users\rsi	LOCALAPPDATA=C:\Users\rsi\AppData\Local	LOGONSERVER=\\PC-THPF-OLD	NUMBER_OF_PROCESSORS=8	OS=Windows_NT	Path=C:\Program Files (x86)\Embarcadero\RADStudio\12.0\bin;C:\Users\Public\Documents\RAD Studio\12.0\Bpl;C:\Program Files (x86)\Embarcadero\RADStudio\12.0\bin64;C:\Users\Public\Documents\RAD Studio\12.0\Bpl\Win64;C:\Program Files (x86)\Embarcadero\RAD Studio\12.0\bin;C:\Users\rsi\Documents\RAD Studio\12.0\Bpl;C:\Program Files (x86)\Embarcadero\RAD Studio\12.0\bin64;C:\Users\rsi\Documents\RAD Studio\12.0\Bpl\Win64;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Users\Public\Documents\RAD Studio\12.0\Bpl	PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC	PROCESSOR_ARCHITECTURE=x86	PROCESSOR_ARCHITEW6432=AMD64	PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 30 Stepping 5, GenuineIntel	PROCESSOR_LEVEL=6	PROCESSOR_REVISION=1e05	ProgramData=C:\ProgramData	ProgramFiles=C:\Program Files (x86)	ProgramFiles(x86)=C:\Program Files (x86)	ProgramW6432=C:\Program Files	PROMPT=$P$G	PSModulePath=C:\Windows\system32\WindowsPowerShell\v1.0\Modules\	PUBLIC=C:\Users\Public	SESSIONNAME=Console	SystemDrive=C:	SystemRoot=C:\Windows	TEMP=C:\Users\rsi\AppData\Local\Temp	TMP=C:\Users\rsi\AppData\Local\Temp	USERDOMAIN=PC-ThPf-old	USERNAME=rsi	USERPROFILE=C:\Users\rsi	windir=C:\Windows	windows_tracing_flags=3	windows_tracing_logfile=C:\BVTBin\Tests\installpackage\csilogfile.log
TSQLLog 1.18 2014-07-01T09:04:00

20140701 09040029 cust1 58>E030000013080058
20140701 09042822 cust1 58>[58] (1) PropertyChanged
20140701 09043523 cust1 58>[58] (2) Event
20140701 09045614 cust1 58>[58] (3) PropertyChanged
20140701 09051136 cust1 58>[58] (4) PropertyChanged
20140701 09054648 cust1 58>[58] (5) PropertyChanged
20140701 09062323 cust1 58>[58] (6) File
20140701 09071113 cust1 58>[58] (7) File
20140701 09074113 cust1 58>[58] (8) Event
20140701 09083228 EXC   EWinHTTP ("winhttp.dll error 12002 ()") at 0068E483  stack trace 00406A52 0040A1D0 0040A433 00405A61 00406A8F 0040ADE0 005657A2 00561BEF 00561F8E 00561F9B 00692100 006921A0 00699BBB 005FD864 005E47BA 005E3D66 004086F6 0040DE30 0040DDC8 005E3B77 
20140701 09085844 cust1 58>[58] (9) File

Below a log from a client (with .map file)


C:\PcmClients\5\PcmClients.exe 0.0.0.0 (2014-07-01 09:15:23)
Host=PC-THPF-OLD User=rsi CPU=8*9-6-7685 OS=13.1=6.1.7601 Wow64=1 Freq=2727587
Environment variables=ALLUSERSPROFILE=C:\ProgramData	APPDATA=C:\Users\rsi\AppData\Roaming	CommonProgramFiles=C:\Program Files (x86)\Common Files	CommonProgramFiles(x86)=C:\Program Files (x86)\Common Files	CommonProgramW6432=C:\Program Files\Common Files	COMPUTERNAME=PC-THPF-OLD	ComSpec=C:\Windows\system32\cmd.exe	FP_NO_HOST_CHECK=NO	HOMEDRIVE=C:	HOMEPATH=\Users\rsi	LOCALAPPDATA=C:\Users\rsi\AppData\Local	LOGONSERVER=\\PC-THPF-OLD	NUMBER_OF_PROCESSORS=8	OS=Windows_NT	Path=C:\Program Files (x86)\Embarcadero\RADStudio\12.0\bin;C:\Users\Public\Documents\RAD Studio\12.0\Bpl;C:\Program Files (x86)\Embarcadero\RADStudio\12.0\bin64;C:\Users\Public\Documents\RAD Studio\12.0\Bpl\Win64;C:\Program Files (x86)\Embarcadero\RAD Studio\12.0\bin;C:\Users\rsi\Documents\RAD Studio\12.0\Bpl;C:\Program Files (x86)\Embarcadero\RAD Studio\12.0\bin64;C:\Users\rsi\Documents\RAD Studio\12.0\Bpl\Win64;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Users\Public\Documents\RAD Studio\12.0\Bpl	PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC	PROCESSOR_ARCHITECTURE=x86	PROCESSOR_ARCHITEW6432=AMD64	PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 30 Stepping 5, GenuineIntel	PROCESSOR_LEVEL=6	PROCESSOR_REVISION=1e05	ProgramData=C:\ProgramData	ProgramFiles=C:\Program Files (x86)	ProgramFiles(x86)=C:\Program Files (x86)	ProgramW6432=C:\Program Files	PROMPT=$P$G	PSModulePath=C:\Windows\system32\WindowsPowerShell\v1.0\Modules\	PUBLIC=C:\Users\Public	SESSIONNAME=Console	SystemDrive=C:	SystemRoot=C:\Windows	TEMP=C:\Users\rsi\AppData\Local\Temp	TMP=C:\Users\rsi\AppData\Local\Temp	USERDOMAIN=PC-ThPf-old	USERNAME=rsi	USERPROFILE=C:\Users\rsi	windir=C:\Windows	windows_tracing_flags=3	windows_tracing_logfile=C:\BVTBin\Tests\installpackage\csilogfile.log
TSQLLog 1.18 2014-07-01T09:18:36

20140701 09183603 cust1 820>E030000013080820
20140701 09192811 cust1 820>[820] (1) File
20140701 09200453 cust1 820>[820] (2) PropertyChanged
20140701 09200458 EXC   EWinHTTP ("winhttp.dll error 12002 ()") at 002A9F79 SynCrtSock.RaiseLastModuleError (1787)  stack trace 00005A52 System.@GetMem (4356) 000091D0 System.@NewAnsiString (24002) 00009433 System.@LStrFromPCharLen (24750) 00009BCE System.@LStrCatN (27273) 001917B7 mORMot.TSQLRestClientURI.ExecuteList (24212) 00189DE6 mORMot.TSQLModelRecordProperties.SQLFromSelectWhere (22004) 0018D381 mORMot.TSQLRest.Retrieve (22910) 0018D769 mORMot.TSQLRest.Retrieve (23006) 00005A6E System.@FreeMem (4404) 002AE02B PcmClient.TPcmClient.GetNextAction (70) 002AE0DD PcmClient.TPcmClient.Execute (94) 002B5B6A PcmClients.PcmClients$6083$ActRec.$0$Body (39) 00217857 OtlParallel.Parallel.Async$5257$ActRec.$0$Body (1635) 001FCA0A OtlTaskControl.TOmniTaskExecutor.Asy_Execute (1632) 001FBD8B OtlTaskControl.TOmniTask.InternalExecute (1356) 0000A9DD System.@FinalizeRecord (31190) 000076AB System.TObject.GetInterface (15953) 0000CE30 System.TInterfacedObject.QueryInterface (36456) 
20140701 09200558 EXC   EWinHTTP ("winhttp.dll error 12002 ()") at 002A9F79 SynCrtSock.RaiseLastModuleError (1787)  stack trace 00005A52 System.@GetMem (4356) 000091D0 System.@NewAnsiString (24002) 00009433 System.@LStrFromPCharLen (24750) 00009BCE System.@LStrCatN (27273) 001917B7 mORMot.TSQLRestClientURI.ExecuteList (24212) 00189DE6 mORMot.TSQLModelRecordProperties.SQLFromSelectWhere (22004) 0018D381 mORMot.TSQLRest.Retrieve (22910) 0018D769 mORMot.TSQLRest.Retrieve (23006) 002AE02B PcmClient.TPcmClient.GetNextAction (70) 002AE0DD PcmClient.TPcmClient.Execute (94) 002B5B6A PcmClients.PcmClients$6083$ActRec.$0$Body (39) 00217857 OtlParallel.Parallel.Async$5257$ActRec.$0$Body (1635) 001FCA0A OtlTaskControl.TOmniTaskExecutor.Asy_Execute (1632) 001FBD8B OtlTaskControl.TOmniTask.InternalExecute (1356) 0000A9DD System.@FinalizeRecord (31190) 000076AB System.TObject.GetInterface (15953) 0000CE30 System.TInterfacedObject.QueryInterface (36456) 0000CDC8 System.@IntfCast (35825) 001FBAF9 OtlTaskControl.TOmniTask.Execute (1277) 001F18F6 OtlThreadPool.TOTPWorkerThread.ExecuteWorkItem (662)

Any idea?

Offline

#5 2014-07-01 12:40:53

ab
Administrator
From: France
Registered: 2010-06-21
Posts: 14,659
Website

Re: Massive tests issue

And on the server side?

You may try to guess why the connection is broken between client and server..  Perhaps you reach windows limits about connection number..

Offline

#6 2014-07-01 15:16:25

Titou
Member
Registered: 2014-05-11
Posts: 12

Re: Massive tests issue

The server is on the same host.

Here is the log of the server.

C:\PcmClients\PcmClientsServer.exe 0.0.0.0 (2014-06-30 09:04:35)
Host=PC-THPF-OLD User=rsi CPU=8*9-6-7685 OS=13.1=6.1.7601 Wow64=1 Freq=2727587
Environment variables=ALLUSERSPROFILE=C:\ProgramData	APPDATA=C:\Users\rsi\AppData\Roaming	CommonProgramFiles=C:\Program Files (x86)\Common Files	CommonProgramFiles(x86)=C:\Program Files (x86)\Common Files	CommonProgramW6432=C:\Program Files\Common Files	COMPUTERNAME=PC-THPF-OLD	ComSpec=C:\Windows\system32\cmd.exe	FP_NO_HOST_CHECK=NO	HOMEDRIVE=C:	HOMEPATH=\Users\rsi	LOCALAPPDATA=C:\Users\rsi\AppData\Local	LOGONSERVER=\\PC-THPF-OLD	NUMBER_OF_PROCESSORS=8	OS=Windows_NT	Path=C:\Program Files (x86)\Embarcadero\RADStudio\12.0\bin;C:\Users\Public\Documents\RAD Studio\12.0\Bpl;C:\Program Files (x86)\Embarcadero\RADStudio\12.0\bin64;C:\Users\Public\Documents\RAD Studio\12.0\Bpl\Win64;C:\Program Files (x86)\Embarcadero\RAD Studio\12.0\bin;C:\Users\rsi\Documents\RAD Studio\12.0\Bpl;C:\Program Files (x86)\Embarcadero\RAD Studio\12.0\bin64;C:\Users\rsi\Documents\RAD Studio\12.0\Bpl\Win64;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Users\Public\Documents\RAD Studio\12.0\Bpl	PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC	PROCESSOR_ARCHITECTURE=x86	PROCESSOR_ARCHITEW6432=AMD64	PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 30 Stepping 5, GenuineIntel	PROCESSOR_LEVEL=6	PROCESSOR_REVISION=1e05	ProgramData=C:\ProgramData	ProgramFiles=C:\Program Files (x86)	ProgramFiles(x86)=C:\Program Files (x86)	ProgramW6432=C:\Program Files	PROMPT=$P$G	PSModulePath=C:\Windows\system32\WindowsPowerShell\v1.0\Modules\	PUBLIC=C:\Users\Public	SESSIONNAME=Console	SystemDrive=C:	SystemRoot=C:\Windows	TEMP=C:\Users\rsi\AppData\Local\Temp	TMP=C:\Users\rsi\AppData\Local\Temp	USERDOMAIN=PC-ThPf-old	USERNAME=rsi	USERPROFILE=C:\Users\rsi	windir=C:\Windows	windows_tracing_flags=3	windows_tracing_logfile=C:\BVTBin\Tests\installpackage\csilogfile.log	__COMPAT_LAYER=RunAsAdmin
TSQLLog 1.18 2014-07-01T15:25:10

20140701 15251046 EXC   EHttpApiServer ("HttpSendHttpResponse failed: Une opération a été tentée sur une connexion réseau qui n’existe pas (1229)") at 00223997 SynCrtSock.EHttpApiServer.RaiseOnError (4735)  stack trace 000BE6DC System.Classes.ThreadProc (14601) 00009BF6 System.ThreadWrapper (23707) 
20140701 15251208 EXC   EHttpApiServer ("HttpSendHttpResponse failed: Une opération a été tentée sur une connexion réseau qui n’existe pas (1229)") at 00223997 SynCrtSock.EHttpApiServer.RaiseOnError (4735)  stack trace 000BE6DC System.Classes.ThreadProc (14601) 00009BF6 System.ThreadWrapper (23707) 
20140701 15251211 EXC   EHttpApiServer ("HttpSendHttpResponse failed: Une opération a été tentée sur une connexion réseau qui n’existe pas (1229)") at 00223997 SynCrtSock.EHttpApiServer.RaiseOnError (4735)  stack trace 000BE6DC System.Classes.ThreadProc (14601) 00009BF6 System.ThreadWrapper (23707) 
20140701 15251328 EXC   EHttpApiServer ("HttpSendHttpResponse failed: Une opération a été tentée sur une connexion réseau qui n’existe pas (1229)") at 00223997 SynCrtSock.EHttpApiServer.RaiseOnError (4735)  stack trace 000BE6DC System.Classes.ThreadProc (14601) 00009BF6 System.ThreadWrapper (23707) 
20140701 15251345 EXC   EHttpApiServer ("HttpSendHttpResponse failed: Une opération a été tentée sur une connexion réseau qui n’existe pas (1229)") at 00223997 SynCrtSock.EHttpApiServer.RaiseOnError (4735)  stack trace 000BE6DC System.Classes.ThreadProc (14601) 00009BF6 System.ThreadWrapper (23707) 
20140701 15251355 EXC   EHttpApiServer ("HttpSendHttpResponse failed: Une opération a été tentée sur une connexion réseau qui n’existe pas (1229)") at 00223997

I also added these parameters in the registry:
[HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\services\Tcpip\Parameters]
"MaxUserPorts"=dword:0000ea60
"EnableConnectionRateLimiting"=dword:00000000

But this changes nothing.


I also installed the test onto another host (clients and server):
- Windows server 2008, R2
- Intel Xeon CPU E31230, 3,2GHz, 32 GB ram, 64 bits

The result is the same.

On this host, i'm sure the limitation of simultaneous TCP connections are greater than 20000, because I've made succesful tests with 20000 simultaneus TCP connexions (onto a server based on this IOCP framework http://www.serverframework.com/ )

Offline

#7 2014-07-01 17:34:01

ab
Administrator
From: France
Registered: 2010-06-21
Posts: 14,659
Website

Re: Massive tests issue

I guess that the error is on client side.
From the logs, it sounds like if the connection is broken between the http.sys server and the WinHTTP clients.
You may try to set higher timeout values on the client side.
You encountered ERROR_WINHTTP_TIMEOUT (=12002) errors.
You may also try to use plain socket clients - TSQLHttpClientWinSock.

Could you try to run several client instances, each with 500 clients each?
How many threads is creating the OTL library?
In practice, each client will have their own process...

Thanks for the serveframework.com link.
wink

Offline

#8 2014-07-02 11:53:03

Titou
Member
Registered: 2014-05-11
Posts: 12

Re: Massive tests issue

For information, the OTL library is limited to 64 threads.
In my usage :
- Each thread contain only one mORMont Client.
- Each application launches 50 threads
- I launch the application several times with different parameters to reach 1000 clients.

But...

Finally I have followed one of your suggestions. I manage several clients in one thread. And I launch several threads (I removed the OTL library because it was the first time I used it, so I'm not an expert. I will certainly give it another try, later).

At first glance, this solution works really better (no errors).
Thanks a lot.

Offline

Pages: 1

Board footer

Powered by FluxBB