mORMot Open Source

For high-performance library such as mORMot, this might be interesting in future :
https://www.chromium.org/quic/

https://youtu.be/VONSx_ftkz8

Hi all,
SHORT:
Q1) Best server/client setup in mORMot2 for secure Server[Winx64]/Client[FMX Android].
Q2) How to wire-up 3rd party WebSocket client-component into mORMot2?

LONG:
Q1)I need to start a new multi-platform (Win/Android) Client app in Firemonkey, server running on Windows.
I've been trying to get WebSockets working with mORMot1 Android, installed Certificates and have bought latest scgWebsockets license for an Android WebSockets client.
Coming here for help, I discovered mORMot2! Congrats and thank you! So it makes me think if some new development might make a difference here.

The app's storage+network must be fully encrypted (preferably end-to-end for net) and async WebSockets would be ideal, with the usual mORMot TRest and InterfacedBasedServices.
All clients will be mORMot compiled for Win/Android/macOs.

What would be the recommended secure server/client setup be, especially for Android?
I've read before that one need to compile mORMot's WebSocket client in Larazus which can be used in Delphi FMX/Android? Is this still the case?

Q2) Alternatively; How can I 'wire-up' scgWebsocketClient in Android so the rest of my code work with a TRest mORMot class/intf as usual?

Thanks, hope it make sense.

Hi,
I have a data object as such:

type
  TIPAddress : Cardinal;
type
  TSQLTrafficItem=class(TSQLRecord)
  private
    FIP         : TIPAddress;
    FDate       : TDateTime;
    FUL         : Int64;
    FDL         : Int64;
  published
    property IP            : TIPAddress     read FIP        write FIP       ;
    property DateSlot   : TDateTime      read FDate      write FDate     ;
    property UL           : Int64          read FUL        write FUL       ;
    property DL           : Int64          read FDL        write FDL       ;
  end;

But in my app, each client can have many IPs, in fact some IPs might be subnets, containing multiple IPs.
So to get some aggregated data, I used to pass a dynamic array :

type TIPsPair= record
                     IP:String;
                     IP1,IP2:Cardinal;
                    end;
     TIPsPairArr = Array of TIPsPair;

where IP is the text subnet, e.g. "10.1.2.0/24" and IP1 will then hold calculated cardinal value of 10.1.2.0 and IP2 will hold the cardinal value of 10.1.2.255 to indicate the range.
So passing a client with say these IPs:
10.2.2.2/32  (10.2.2.2-10.2.2.2) call these cardinal values IPA1-IPA2
10.3.3.0/30 (10.3.3.0-10.3.3.3) call these cardinal values IPB1-IPB2
10.4.4.0/24 (10.4.4.0-10.4.4.255) call these cardinal values IPC1-IPC2
I had to built a SQL query like so:

select * from TRAFFIC where DateSlot>=:DateF and DateSlot<:DateT and 
(
((IP>=IPA1)and(IP<=IPA2))or
((IP>=IPB1)and(IP<=IPB2))or
((IP>=IPC1)and(IP<=IPC2))
)

OFC values IPA1, IPA2,etc replaced with cardinal numbers in real query.

Is there a better, more efficient way to do it in mORMot to harness cached prepared statements where I can maybe create a larger 'flat' array of the required IPs, e.g.

Var Arr : Array of Cardinal;
Arr[0]:=IPStrToCardinal(10.2.2.2);
Arr[1]:=IPStrToCardinal(10.3.3.0);
Arr[2]:=IPStrToCardinal(10.3.3.1);
Arr[3]:=IPStrToCardinal(10.3.3.2);
....

Then use something like:

aList:=Server.RetrieveList<TSQLTrafficItem>(' IP IN ? AND DATESLOT>= ? AND DATESLOT < ?',[Arr,DateF,DateT]);

Or some other advice to make this query as efficient/fast as possible?

Thanks
AntonE

Hi.
Looking at the MVC sample...

To segregate logical units of the app, can/should I create an IMVCApplication for each 'module' in the server? As one (not so good) example, in accounting app you can have billing, inventory, blog, etc. as separate logical 'modules'.
AntonE

Hello.
I need to create a TSQLTableJSON on the fly with custom columns, i.e. not tied to a TSQLRecord class.
(Actually it must be created from custom fields derived from TDocVariant within a TSQLRecord variant property)
Is it possible to create the TSQLTableJSON with column types, then add rows or it it read-only?

If it is read-only, what would be the best way to create a table like this?
1) Create the whole resultset as a JSON string by using TTextWriter
2) Create TSQLTableJSON.CreateWithColumnTypes (so that TSQLTableToGrid can display nicely)?

Or is there maybe some other mORMot-magic method to get same result?

Thanks
AntonE

Hello,
trying to add mORMot to an IntraWeb XIV app in Delphi XE4.
Just create simple stand-alone IW-app, add:

type
  TIWServerController = class(TIWServerControllerBase)
    procedure IWServerControllerBaseNewSession(ASession: TIWApplication);
    procedure IWServerControllerBaseConfig(Sender: TObject);
    procedure IWServerControllerBaseDestroy(Sender: TObject);

  private

  public
    Model       : TSQLModel;
    SQLDB       : TSQLRest;
  end;

procedure TIWServerController.IWServerControllerBaseConfig(Sender: TObject);
begin
  Model := TSQLModel.Create([TSQLWISPRouter,TSQLWISPClient,TSQLWISPSite,TSQLWISPEMailAcc,TSQLWISPVoIPAcc,TSQLIPTraffic]);
  SQLDB := TSQLRestServerDB.Create(Model,ChangeFileExt(paramstr(0),'.db3'));
  TSQLRestServerDB(SQLDB).CreateMissingTables(0);
end;

procedure TIWServerController.IWServerControllerBaseDestroy(Sender: TObject);
begin
 SQLDB.Free;
 Model.Free;
end;

Just run server and try close, it gives AV error in SynCommons line 43472 in TSynLogFamily.Create(aSynLog: TSynLogClass);
If I just create/close DB it's fine, but once IW app runs, then I can't close without AV.

Best regards
AntonE

Please see CSV2ORM : http://synopse.info/forum/viewtopic.php?id=1911

TrueORM
A high-level Delphi ORM/MVC(?) built on top of mORMot.

It is an idea spawn from CSV2ORM, to expand on that, not all as described below is working yet, but it's the idea that count.

"The idea" is an app that (will have) have 3 parts:

• Projects (Model| TSQLproject that contains Classes/Records)

• Templates (View| TSQLTemplate that contains Mustache templates)

• Scripts (Controller?| TSQLScript that contain Pascal/Javascript code)

You can have multiple projects. Each projects can contain a list of T_Class
"T_Class" each contain a list of T_Variable descendants, just like normal OOP.

A)Projects  (TSQLProject):
As a bare-bone start you create a new Project.
This project contain a list of T_Class that can be marked as either :
packed record
TObject
TSQLRecord

Classes (T_Class):
Classes contain a polymorphic ObjectList of T_Variables (properties/fields) descendants.

• T_Variable       (abstract)

• T_SimpleType     (abstract)

• T_Integer

• T_Float

• T_Currency

• T_Boolean

• T_DateTime

• T_String

• T_Collection  (abstract)

• T_Array

• T_ObjectList

• T_Class

The idea is to use only basic types, e.g. T_Integer but within T_Integer there are options to select if it's Int32/Int64, signed/unsigned, ENum, Set, etc.
Also e.g. there is only 1 DateTime type, but within it you set to use Date only, Time only or DateTime, Duration, high-precision, etc.
T_Array, T_ObjectList, T_Class variables let you select another T_Class from your project to created nested Classes.

USAGE: (Not all working yet, concept
As in CSV2ORM, import a text (csv) file like

User.csv:
UserName,String,Edit,50
Password,String,Edit,50

This will add a T_Class 'User' to you project. Mark it as a 'packed record'.

Now import Connection.csv:
FromIP,String,Edit,50
Started,DateTime,DateEdit

This will add a T_Class 'Connection' to you project. Mark it as a 'TObject'.

Now import Device.csv:
Name,String,Edit,50
Number,Integer,Edit
Users,Array:User,ListView
Connections,ObjectList:Connection,ListView

This will add a T_Class 'Connection' to you project. Mark it as a 'TSQLRecord'.

You have setup the model with nested DynArray/ObjectList. Alternatively you can greate quick/easy in the UI.

Each T_Variable can have a Control_Type associated to it. This is for UI generation, e.g. TEdit, TRadioGroup, etc. (Like in CSV2ORM)
This is still an 'not-good idea' as a UI mapping external to the model is needed, so you can have e.g. multiple forms where 'Device.Name' get TEdit or TLabel on one form, TCombobox on another, etc.

B)TEMPLATING (TSQLTemplate):
Similar to CSV2ORM, but more powerfull, using Mustache templates that can be edited in a JvHLEditor with syntax highlighting for many languages.
Here you will be able to setup multi-file templates (like in CSV2ORM) to create e.g.:

• mORMot Data units/classes

• Delphi units/forms

• SMS forms (?)

• HTML pages

• SQL-scripts

• Future idea: form creation, i.o.w. WYSIWIG

C)SCRIPTING (TSQLScript):
Also with HLEditor, able to create Pascal scripts (JvInterpreter) or Javascript (SpiderMonkey).
This code might be run in JvInterpreter or SpiderMonkey, but is intended to be able to create code snips that might be used in Templating.

Summary:
The notion of data, templates and scripting evolved naturally into a kind of model/view/controller concept, and the project's idea is still in 'alpha' phase.
I would like any ideas/comments if anyone find it interesting and have some insights that might be helpfull or thought-provoking.

I can see it possible to create a bare-bone client app that get only TSQLProject, TSQLTemplate, TSQLScript from server and can create it's own UI, scripts, etc. from that.
I.o.w. a client (and/or server) Delphi-app that is just a shell that generate UI-elements and can update without closing as forms/scripts is not compiled but sent from server via TSQLProject, TSQLTemplate, TSQLScript classes.

Regards
AntonE

PS: I should have part A (data modelling) finished in next day or two.

I just made a simple class/unit/form generator tool.
Simply you create a CSV (E.g. MyObj.csv) file like so:

Code,RawUTF8,Edit,30
Desc,RawUTF8,Edit,512
ItemType,RawUTF8,ComboBox,30
Cost,Currency,Edit
LastCostD,TDateTime,DateEdit
VatCat,Integer,RadioGroup
Active,Boolean,CheckBox

Format:<Property/Field Name>,<Type>,<Control>[,RawUTF8 size for CDS]
And it will create units:

• DataMyObj.pas (TSQLMyObj class)

• MyObjFormU.pas (TMyObjForm class)

• MyObjFormU.dfm

It will also make a TClientDataset on the form and add necessary fields to it, then create TDBxxxx versions of Controls specified (Edit=TDBEdit, etc) + code to get/set it from/to the TSQLMyObj class.
It is very immature and cannot handle Arrays, subobjects, etc. but it will at least create the bulk of your code and form.
Not intended to be full generator, just to create a skeleton of code/controls that you can copy to your project and edit normally from there on. Use RawUTF8 for unsupported types and just edit your code afterwards.

I'm not going to spend lots of more time on it soon, but I can see that in future:

• More options like combobox/RadioButton listitems, MaskEdit, break a SET up into multiple CheckBoxes, and so on.

• I might make the code generated 'template-able' so you can have different variations of forms that can be created (TObjectList-based instead of TClientdataset, HTML/JS/etc).

• change name to CSV2ORM.

Can be found here:
ftp://ftp.true.co.za/TrueORMconv.zip

Hello, trying to implement first method service:
Server side

type TSQLRestServerDBTW = class(TSQLRestServerDB)
                           published
                            procedure ContactSearch(var Ctxt: TSQLRestServerURIContext);
                          end;

procedure TSQLRestServerDBTW.ContactSearch(var Ctxt: TSQLRestServerURIContext);
var SQL : RawUTF8;
    zStr,
    zFld : RawUTF8;
begin
 zFld:='';
 zStr:='';

 if UrlDecodeNeedParameters(Ctxt.Parameters,'SearchStr,Fields')
     then begin
           while Ctxt.Parameters<>nil do
            begin
             UrlDecodeValue(Ctxt.Parameters,'SearchStr=',zStr);
             UrlDecodeValue(Ctxt.Parameters,'Fields=',zFld,@Ctxt.Parameters);
            end;
           SQL:='select '+zFld+' from Contact WHERE Name='''+zStr+''' ORDER BY Name;';
           Ctxt.Results([ServerForm.DB.DB.ExecuteJSON(SQL)]);
          end
     else Ctxt.Error('Missing Parameter');
end;

Client side

type TSQLHttpClientTW = class(TSQLHttpClient)
                        published
                         function ContactSearch(ASearchStr:String;AFields:RawUTF8):RawUTF8;
                        end;

function TSQLHttpClientTW.ContactSearch(ASearchStr, AFields: RawUTF8): RawUTF8;
var T : TSQLTableJSON;
begin
 Result:=self.CallBackGetResult('ContactSearch',['SearchStr',ASearchStr,'Fields',AFields],TSQLContact);
end;

But when I run code from client, I get to server method, but on first line breakpoint, I see no Ctxt.fInput (most Inaccesible value) and Parameters='' so UrlDecodeNeedParameters gives AV.

The samples in manual is little different for 1.17. so am I even using the correct classes (TSQLRestServerDB & TSQLHttpClient) and the rest is also a bit cloudy still. :)

Regards