mORMot Open Source

Another Update !

Already Solved all the Question's Above ! And just for curiosity because i think is awesome , Now Using Parallel Process and Threads, with Batch, We are Inserting 10.000.000 Millions Registers, in 6 SECONDS , with a 30.000 Kb/s Server in Memory, This Speed is just WOW and with this memory is Just WOWW , Thanks For the Help !

Quick Update, make some adaptions  in the perfomace project and now i'm using the Real server to make the tests and, i think i get rid of the leaks, Using ClearObject() in the SQLRecord, make a test with 12.000.000 of registers , Simultaneously, and All Okay!, and the Memory in the server don't go more than 100.000kb/s  for me this is a big WIN, i think this memory is a Buffer, i don't know if there is a way to ger rid of this, Thanks for the help macfly!
but taking advantage of the conversation, With the suggestion you make, i Can't make Simultaneously insertions , because of the

if  FServer.TransactionBegin(TSQLRecordSale) then
      begin
        .....
      end;
 

I search for some answers in the documentation, and is recommended to use BATCH, or use TransactionBegin on Client-side, but i don't really like to do this kind of Transaction Control in the Client, you got any suggestions how to do in the Server-Side?

  try
    .....
      try
      .......
      except
        ......
  finally
    ClearObject(aSale);
    aSale.Free; 

12.000.000 Registers

Thanks for the Help!

Already make these Changes!, And the Leaks Decreased significantly, but the main Leak still here , this test was made with 10 Sales with 10 itens each and The type was Variant.

Main Leak

And again i forgot to answer one , haha,
Why Shouldn't be ?
it's inside a TInjectableObjectRest Class Object, and have access to the info i need, or i mistaken ?

Sorry , i forgot to Answer that.

The others Objects appears because i'm testing the perfomace in a Local TSQLRestServerFullMemory  Server, so i'm not destroying the Connection as should be, because, i Can't destroy a server Connection after using only one service, so FastMM4 understand as Leak

Thanks For the Answer pvn0!

if i understand it right, it will work Like a CallBack ? that i have to a code like 

 Procedure IsWorking(const WorkID: Integer; Out Status :integer); 

that implements something like this

procedure IsWorking(WorkID : Integer; out Status: integer)
begin
if WorkId = 0 then
 break;
Status := Service.Work(workId); // Example 
end;

We are using ID to exemplify this , but How i get that ID or Name,and how i know is still Working? This part is a bit confusing for me, i understand i will have to create A Thread Pool, but how  Find the Same Work instance is what i don't know how

Sorry about fo the newbie questions and the Bad English
Best Regards
Shadownildo

Thank you For the Answer!

But ths not solve the problem , we are Studying the RegressionTests in dddInfraRepoUser, and thinking how manage the Memory... What happen is ,

We have a ClientDriven Service that >
Connect To the Server >
And Inside this Service, we Start Another Connection With the Own Server that Define and Call's Other Service .

function TVendaService.Include(const DadosVenda: TVenda): boolean; // This is the ClientDriven Service
var
  cmd: IDomSaleCommand;
  ffactory: TRepoSaleFactory;
begin
  ffactory := TDDDRepositoryRestFactory.Create(FServer); 
  FServer.ServiceContainer.InjectResolver([ffactory]);
  FServer.Services.Resolve(IDomSaleQuery, cmd); // This is the Inside Service that is a ICQRSService 

When we Free the ClientDriven Service, Clean the Client > Server Memory and it's OK, But, The Inside Service that is a ICQRSService ,Remains in the Memory, and Only gone if we Free the RestServer like is done in the RegressionTests in dddInfraRepoUser.pas, But in a real Scenario we can't Free the RestServer Connection after using one service .

A Update
Making some Tests, i find out that if i make a InitializeTable in the SQLRecord the Mongo Create the Table

class procedure TSQLTestTable.InitializeTable(Server: TSQLRestServer;
  const FieldName: RawUTF8; Options: TSQLInitializeTableOptions);
var
  Test : TSQLTESTtable;
begin
  inherited InitializeTable(Server, FieldName, Options);
 if FieldName='' then begin // new table -> create default
    Test := TSQLTestTable.Create;
    try
      Server.Add(Test,true);
    finally
      Auth.Free;
    end;
  end;
end;        

But i wonder if there is a way to do that without having to Create a Empty Document.

thanks for the answer ab,
Sorry about that, i know there is not a Create Table, but even if Empty Mongo Should Create the Collection right ? since AuthGroup and AuthUser don't have any item, only the indexes like , in AuthUser is created with _LogonName and _GroupRights and _id, and if i put some "Primary keys"

 Stored AS_UNIQUE 

in the SQLRecord,As I showed ealier, The collection is created, but in the exemple you asked me to run, it's created a Collection called mORMot, only with the _id Index, there is a way to accomplish that without add any item ? just creating a Collection with the default _id without any  Primary key from the table, or i really misunderstood ?

Sorry about the English
Best regards,
Shadownildo.

I Tried now, to do what you suggest to Call CreateMissingTables After Register The Mongo, but same results

constructor TDBInstance.Create(Root: string; MongoDB: TMongoDatabase);
begin
    aModel := DataModel(Root);
    inherited Create(aModel, SQLITE_MEMORY_DATABASE_NAME);
    StaticMongoDBRegisterAll(Self, MongoDB);
    Self.AcquireExecutionMode[execORMGet] := amBackgroundORMSharedThread;
    Self.AcquireExecutionMode[execORMWrite] := amBackgroundORMSharedThread;
    Self.DB.Synchronous := smOff;
    Self.DB.LockingMode := lmExclusive;
    Self.CreateMissingTables;
end;

Oh, i'm sorry about that, but the errors are

! ORM with acknowledge - Retrieve from SQL
! Exception EVariantInvalidOpError raised with Message :
! Invalid variant operation

Total Failed : 1 / 11.597 - ORM with acknowledge FAILED 6.87s

2.2. ORM without acknowledge

! ORM with acknowledge - Retrieve from SQL
! Exception EVariantInvalidOpError raised with Message :
! Invalid variant operation


Total Failed : 1 / 11.597 - ORM Without acknowledge FAILED 6.87s

About the Call CreateMissingTables is because the method is for a Generic Creation of a Rest Server DB, so i use for SQLite Native, SQLite Firedac, Firebird, Postgres, MYSQL and some of they use this call, and i know that has no impact on MongoDB, what you suggest ab ?

But i not change anything in the Service Interface, Not even a Single Line.... What happens is when Release a new Version, both are in the Same "Build", it Works, but when i Maintain the Mega Server version and change Others Units not Correlated with the Service in the Client Server Version, This error Appears...

We already try this, but in the end, When he updates, in the database he comes empty. We Try every single Command in the Documentation about Update, but don't work.

we already  found one solution but, it's change the TSQLRecord field  to a Integer and Relate the tables in the in the Create, but i don't think this is the best solution.