mORMot Open Source

Hi to all,

Sorry if this is a silly question but I was wondering what would be the preferred way to return the data from three TDatasets into one TDocVariant, something like :

///Pseudocode

initialize TDocVariant variable with somevalues ( Id, Name, etc)

Loop through TDataset1

ds.first;
while not ds.eof do 
Begin
  ¿ How to add the records to the TDocVariant ?  
I know how to retrieve the fieldname/value pair from the TDataset but I'm struggling to find the way to build the JSON contents using TDocVariant
  ds.Next;
End;

Loop through Tdataset2...
Loop through Tdataset2...

So the final result would look like:

{"Id":"34356", "Name":"John Doe", "savings":[{"accountID":"345678","accName":"Some text","accBalance":"1.00"}, {"accountID":"345679","accName":"Another text","accBalance":"9.00"}], "loans": [{"accountID":"555678","accName":"Some text","accBalance":"1.00"}, {"accountID":"555679","accName":"Another text","accBalance":"9.00"}]}

Don't know it the notation is right but I hope you get the idea.

Any hints?

Hi Azeredobr,

I think you already have the sample, look into :

..\mORMot\SQLite3\Samples

Regards

Indeed, but I thought some kind of default behavior was running behind the scenes, anyway that is just what I needed now.

I can't find any topic on the SAD comparing them, AFAICS the following comment on mORMot.pas is what can explain better what you are saying :

  TSQLRestServer = class;  // published methods = RESTful callbacks handlers

I think there should be a more prominent place describing the difference between method-based services vs interface-based services, or maybe I need better glasses

Regards

Not so fast ;-)

I understand I can disable authentication following this instructions :

Doesn't seem to work, I added :

      // register our ICalculator service on the server side
      aServer.ServiceRegister(TServiceCalculator,[TypeInfo(ICalculator)],sicShared);

      aServer.ServiceMethodByPassAuthentication('Calculator'); //   <------ THIS

But it doesn't seem to help with what I need, when I debug the call to ServiceMethodByPassAuthentication on mORMot.pas:

procedure TSQLRestServer.ServiceMethodByPassAuthentication(const aMethodName: RawUTF8);
var i: Integer;
begin
  if self=nil then
    exit;
  i :=  fPublishedMethods.FindHashed(aMethodName);
  if i>=0 then
    fPublishedMethod[i].ByPassAuthentication := true;
end;

fPublishedMethods.FindHashed always return a negative number and then then ByPassAuthentication is always false also used 'Add' as method without success

Any hint?

Thank you Alex for answering, unfortunately none of them gives the result, still getting 403 Forbidden, seems like it is some kind of permission is missing? or it was not intended to be used this way.

If I run the query on pgAdmin changing the case on the table name :

SELECT n.nspname,c.relname,a.attname,a.atttypid,a.attnotnull,a.atttypmod,a.attlen,a.attnum,pg_get_expr(def.adbin, def.adrelid) as adsrc,dsc.description  FROM pg_catalog.pg_namespace n  JOIN pg_catalog.pg_class c ON (c.relnamespace = n.oid)  JOIN pg_catalog.pg_attribute a ON (a.attrelid=c.oid)  LEFT JOIN pg_catalog.pg_attrdef def ON (a.attrelid=def.adrelid AND a.attnum = def.adnum) LEFT JOIN pg_catalog.pg_description dsc ON (c.oid=dsc.objoid AND a.attnum = dsc.objsubid)  LEFT JOIN pg_catalog.pg_class dc ON (dc.oid=dsc.classoid AND dc.relname='pg_class') LEFT JOIN pg_catalog.pg_namespace dn ON (dc.relnamespace=dn.oid AND dn.nspname='pg_catalog')  WHERE a.attnum > 0 AND NOT a.attisdropped AND n.nspname = E'public' AND c.relname = E'samplerecord'

This is changing: 'SampleRecord' to 'samplerecord'

The query runs successfully and returns the list of fields, note that the code creating the table is all from mORMot's sample, I'm only deleting the table before each run; I don't know it the table name should be on upper CamelCase or it should be on lowercase, and who determines that mORMot or ZEOS, but it seems the problem is there.

Thoughts?

I'm late to the party huh?

Arnaud, will this screenshot help you?

Regards

I'm not a big fan of ODBC, but in this case Would you say that it is worth?

Interested in :

Regards

Thank you MVP, I heard the same although this answer on stackoverflow makes me think the gap is closing: http://stackoverflow.com/questions/8368 … t-versions ,  may be in the future when mORMot will work fine in Lazarus and has an alternative to http.sys I can make the switch to Linux on server but by now I don't want to have the mORMot server(windows) and the database server(linux) on separate machines, perhaps worth the test but spending on two servers is another thing we would like to avoid.

What do you think of this numbers on Windows ?   

With: 

fUseCache := false; // caching is to be disabled - not found stable enough

{
    "Engine": "ZEOS",
    "CreateTableTime": "67.37ms",
    "NumberOfElements": 5000,
    "InsertTime": "4.48s",
    "InsertRate": 1115,
    "InsertBatchTime": "4.51s",
    "InsertBatchRate": 1107,
    "InsertTransactionTime": "3.47s",
    "InsertTransactionRate": 1438,
    "InsertBatchTransactionTime": "3.29s",
    "InsertBatchTransactionRate": 1517,
    "ReadOneByOneTime": "3.67s",
    "ReadOneByOneRate": 1358,
    "ReadAllVirtualTime": "76.52ms",
    "ReadAllVirtualRate": 65338,
    "ReadAllDirectTime": "56.28ms",
    "ReadAllDirectRate": 88836,
    "ClientCloseTime": "4.01ms"
}

With :
  fUseCache := true; // caching is to be disabled - not found stable enough

{
    "Engine": "ZEOS",
    "CreateTableTime": "58.21ms",
    "NumberOfElements": 5000,
    "InsertTime": "2.09s",
    "InsertRate": 2386,
    "InsertBatchTime": "1.97s",
    "InsertBatchRate": 2532,
    "InsertTransactionTime": "1.22s",
    "InsertTransactionRate": 4087,
    "InsertBatchTransactionTime": "1.23s",
    "InsertBatchTransactionRate": 4041,
    "ReadOneByOneTime": "1.27s",
    "ReadOneByOneRate": 3932,
    "ReadAllVirtualTime": "51.69ms",
    "ReadAllVirtualRate": 96728,
    "ReadAllDirectTime": "36.01ms",
    "ReadAllDirectRate": 138819,
    "ClientCloseTime": "4.06ms"
}

Remember this is on a Win64 VM with 2 GB de RAM(1600Mhz DDR3), 2.7 Ghz core i7  I know I could use bootcamp on my MBP but I don't want to do that.

Don't know if the comment about cache stability is still valid but I would like to know, may be tomorrow I will test against latest Unidac and can make some conclusions.

BTW had to comment the following lines from the tests :

    Test(nil,'','','','','SQLite3 (file full)',true,smFull);
    Test(nil,'','','','','SQLite3 (file off)',true,smOff);
    Test(nil,'','','','','SQLite3 (file off exc)',true,smOff,lmExclusive);

because was getting an AV on :

    if (aServerName='') and
       not PropsClass.InheritsFrom(TODBCConnectionProperties) then begin

Just FYI I was only interested in PG tests by now.

Regards

Thanks for the info Arnaud, I'm trying to run your benchmarks and I'm only testing Unidac and ZEOS, I saw on devart forums they are on v 5.1.3 I will see if I can test with the latest version.

I'm not able to provide any feedback yet because I'm starting with PostgreSQL, I have developed many applications using Firebird as database server with great success, some also targeting MSSQL Express, and now I have a new project which will be very data intensive (expecting a million records at least on our main table on the first month on production) and I'm very interested in some features out of the box of PostgreSQL like schemas, hstore, json and xml data type, replication among others, I was a little worried about choosing PG but I've heard nice things about it and the National Institute for Geography and Statistical here in Mexico is using PG so I think is a safe bet.

I'll keep you informed of my findings.

Hi Arnaud,

I'm not a mORMot user but a Delphi user, and I'm looking for excuses to make the switch to FPC/Lazarus so If you had a Lazarus mORMot version of the framework I would be tempted to try it on a new project I have on standby for a while.

Best regards,
Mocte