mORMot Open Source

@ComingNine.

This is very good news ! Thank you for sharing your setup. Enjoy mORMot on Linux !!

One minor thing: you can try removing the -dPUREPASCAL.
mORMot should work without it on i386. It will speed up some parts of mORMot by using assembler.

@Ab.
Very (very) good ideas !!

But, IMHO, before we go the official way, we would have to include FPC projects in the samples.
E.g. make the samples 100% compatible with FPC.
And include an *.lpi for very easy FPC deployment.
I volunteer in making them ... ;-)

I have been in contact with Sternas (CodeTyphon CEO) before, for making CodeTyphon do ARMHF things.
If we have our FPC-samples ready, I am positive about inclusion in CodeTyphon.

However, mORMot runs also fine with FPC 2.6.4 (and Lazarus).

Alfred.

The lib directory on a Linux system contains a lot of links.
AFAIR Sftp Net Drive shows these links as files, but they are not.

First step:
Copy the lib-directory to your Windows system.
Check that all links are converted into real files !

Second step
crtbegin.o and crtend.so and libgcc.a can be found inside /lib/gcc
Copy these also.

And be sure that you link with 32bit library files ... as our mORMot is still 32bits.

Codetyphon offers complete i386 Linux libraries for download ... at my system this works 100%.

Success !

Glad to hear that dynamic works as expected !

Would you mind trying:

0): Running at least version 1.18.438 (see : http://synopse.info/fossil/info/8fd8f6f … 828c0288c6)
1): No succes: Disabling ---> Demo.MemoryMappedMB = 256; inside SynSelfTests (2-3 x)
2): No succes: Running as root.

Running on 8888 : replacing all 888 with 8888 inside SynSelfTests.

@Ab and @ComingNine,

Some progress to report !

Found out that this regression could be caused by a wrong use of packed record inside SynSQLite3Static.

TSQLFile = packed record ---------> change to ---------> TSQLFile = record
(remove the packed statement)

At my system, everything works as expected now, including WAL and Demo.MemoryMappedMB !

Testing reports welcome !!

Strange regression.
Few things you could try:

0)
At my system, the same happens when running the tests as non-root.
Could you try running the tests as root ?

1)
Inside SynCommons.
{$ifdef PUREPASCAL} <----------- change to {$ifdef FPC_OR_PUREPASCAL}
function Div100(Y: PtrUInt): TWordRec;

Inside Synopse.inc (last lines):

2) Did you use dynamic or static linking ?
{$define NOSQLITE3STATIC}

3) Did you enable encryption ?
{$define NOSQLITE3ENCRYPT}

Wow ... now you have to explain to me how you are building and using !!

1) what is the system you are compiling on ?
2) CodeTypon version ?
3) what is your target system ?

And any more details you care to share !

You are right !
Sorry about this ... sometimes I forget that I use my own compiler settings to get things running in my setup.

But, if you encounter this asm problem, you can solve it by adding the "assembler" statement to the declaration:
e.g. your line 315 SynLZO error:

function _lzo1x_1_do_compress(in_p: PAnsiChar; in_len: PtrInt;
  out_p: PAnsiChar; out out_len: integer): integer;
{$ifdef USEASM}
---------------> {$ifdef FPC} assembler;{$endif} <---------------

In FPC, pure assembler functions and procedures have to be defined by this "assembler" statement.
But if you set FPC into Delphi-mode, this is not necessary.

Hope this is clear.

Good result !! Glad to hear !!
However, I do not have detailed knowledge about compiling on Centos 64 bit.
But, looking at your self-test-results, you are ready to go ahaead with mORMot.

Testing mORMot is done by running the available self test : SynSelfTests.pas

And this is the LPR

program LinuxSynTestFPCLinuxi386;

{$IFDEF FPC}
  {$MODE Delphi}
{$ENDIF}

{$I Synopse.inc} // define HASINLINE USETYPEINFO CPU32 CPU64 OWNNORMTOUPPER

{$APPTYPE CONSOLE}

uses
  {$ifdef Linux}
  cthreads,
  // widestring manager for Linux !!
  // could also be put in another unit ... but doc states: as early as possible
  cwstring,
  {$endif}
  mORMotSelfTests;

begin
  SQLite3ConsoleTests;
end.

@warleyalex
Please help me by providing the most simple (console) program demonstration your problem !
And please add some info about the error: what do you expect errorfree / what is the error.

My FPC development setup is CodeTyphon 5.0 32 bit on Win 8.1 64 bit.
And Lazarus 1.2.4 / FPC 2.6.4 32 bit for checking backwards compatibility of some software.

My deployment setups are:

1)
Arch Linux i386 in a Oracle virtual box on my Win 8.1 pc (just for mORMot).
2)
Arch Linux on a BeagleBone Black (ARMV7).
3)
Arch Linux on a Raspberry Pi (ARMV6).

This is also the reason why I am interested in running mORMot on Linux:

I have many small ARM-clients for data acquisition. Running 24/7. Years.
Billions of numbers (long term battery test measurements).
These store data on a central server, also ARM.
All these running Arch. Most with GUI. Servers just command line.

mORMot allows for datastorage in a very structured and portable manner.

My first steps with mORMot, I used MongoDB, because I like the NoSQL way of storing data.
And MongoDB offers more or less JSON out of the box.
And data is available without any knowledge of relational maps. In most cases, there are no maps !!
All data is just there. At the cost of more storage size. But storage is cheap nowadays.
Everybody can read and understand the data due to this simple storage method.
(nested) fields and dynamic records and arrays can easily be added, removed, changed

But mORMot makes ORM very easy. So I am going to use mORMot for easy and simple ORM.
And mORMot forces me to think better about (structured) data storage.

I have only one (future) concern with mORMot: dynamic arrays.
Again, MongoDB makes dynamic arrays very easy and readable without any prior knowledge.
AFAIR, mORMot uses binary storage when storing dynamic arrays. I hope that, at one time it will be JSON.
But correct me if I am wrong (Ab) !!!

Greetings, Alfred.

For Linux, you need a few things more !

In your dpr-file:
uses
  {$ifdef Linux}
  // if you use threads in your application
  cthreads,
  // widestring manager for Linux, if needed !!
  // could also be put in another unit ... but doc states: as early as possible
  // cwstring,
  {$endif Linux}

Good luck !

Thank you for testing.
And sorry about this.

On Linux, access to port 888 is limited to root processes.
(and I did perform the tests as root ... so I forgot about it)

I have made another executable, that uses port 8888, that is also available for non-root users.

https://drive.google.com/file/d/0B96fg3 … sp=sharing

Please report ... ;-)

Greetings and good luck.

Thanks for your feedback !
Our very nice Linux mORMot needs sqlite3 installed on your system ....
This deadlock happens on systems without sqlite3 !

Hello,

You have to configure CodeTyphon to find the include file !

https://drive.google.com/file/d/0B96fg3 … sp=sharing

Add the path to mORMot (the path to synopse.inc) to the include files !!

And please give us a littlebit more time (few days) .... we are fighting with the last few bugs to enable full mORMot on Linux.
It's 99.99% ready now !!

Greetings, Alfred.

Have a look at this post: http://synopse.info/forum/viewtopic.php … 710#p12710

If tables are defined external, they are also defined as static.
Initialization (of fields) in createmissingtables is then skipped.

You have to do this manually (after CreateMissingTables):

if not aRestServer.TableHasRows(TSQLAuthGroup) then TSQLAuthGroup.InitializeTable(aRestServer,'',[itoNoIndex4ID, itoNoIndex4UniqueField, itoNoIndex4NestedRecord, itoNoIndex4RecordReference]);

This works for MongoDB (as opposed to MySQL, for the user who posted this solution)

Clear. Thanks !!

I will not make a refactoring ticket, before I have tried->tested->succeeded myself !

Thanks for the explanations.

About UTF8 under FPC: could you please state (enlighten) the problem with the help of the (CodeTyphon 4.92) code below ?

procedure TForm1.Button1Click(Sender: TObject);
var
  s,d: RawUTF8;
  e:unicodestring;
begin
  case RadioGroup1.ItemIndex of
    0: begin
         s := '∮ E⋅da = Q,  n → ∞, ∑ f(i) = ∏ g(i)'; // here s has UTF-8 encoding
       end;
    1: begin
         s := 'ᚻᛖ ᚳᚹᚫᚦ ᚦᚫᛏ ᚻᛖ ᛒᚢᛞᛖ ᚩᚾ ᚦᚫᛗ ᛚᚪᚾᛞᛖ ᚾᚩᚱᚦᚹᛖᚪᚱᛞᚢᛗ ᚹᛁᚦ ᚦᚪ ᚹᛖᛥᚫ'; // here s has UTF-8 encoding
       end;
    2: begin
         s := 'ሰማይ አይታረስ ንጉሥ አይከሰስ።'; // here s has UTF-8 encoding
       end;
  end;
  d := '"'+s+'"'; // now d is not UTF-8 but AnsiString with the Windows code page ??
  edit1.Text:=s;
  edit2.Text:=d;
  e:=UTF8Decode(s);
  edit3.Text:=e;
  Edit4.Text:=InttoStr(Length(s));
  Edit5.Text:=InttoStr(Length(d));
  Edit6.Text:=InttoStr(Length(e));
end;

Your code works for 100% on ARM !
I do not have Linux x86 at the moment. Waiting for the Minnowboard MAX.
(I used TrimRight in my code, because it is [much] cheaper under Delphi, and TSQLRestClientURI.ExecuteAdd works the location header from right to left, and the problems were on the right part of the string).

I did not want to compare Brook and mORMot. I have seen the previous discussions.
I just wanted to make the statement that it should be possible to have mORMot servers running under Linux.
And perhaps with not too much effort.

If I can help, please let me know ... I also do not have the money, but plenty of time !

ps: ARM hardware is very cheap.  And a Pi or BeagleBone Black runs very easy headless with Arch Linux (setup consumes few minutes). I can recommend it !

Yes. That's mORMot.

Just change something like

fMongoClient := TMongoClient.Create('SERVER_IP',27017);
fDB := fMongoClient.Database[DB_NAME];
fClient := TSQLRestClientDB.Create(fModel,nil,':memory:',TSQLRestServerDB);
StaticMongoDBRegister(TSQLORM,fClient.Server,fDB,'mORMot');

into

fClient := TSQLRestClientDB.Create(fModel,nil,DB_NAME,TSQLRestServerDB);

to go from remote MongoDB to local SQLite. All other coding remains the same !! A very very nice feature of mORMot.

See Sample 15 (External DB Performance) and Sample 24 (MongoDB)

Good luck.

The database itself (the fields) contained an array (name: 'Photos'), containing, among others, a string type with only 4 characters with name 'Picture'.
So not a binary datatype, but a string.

(I am using RoboMongo to view the database contents; I did not view the JSON contents).

However, I solved the problem by using:

Photo.Picture:=TSQLRawBlobToBlob(pic);

No UpdateBlob whatsoever is needed, while this 'Picture'-field is not saved or treated as a blob. It is a string.

I think this is the same method (or produces in the same result) as your suggestion !

Retrieving by using:

Photo.Picture:=BlobToTSQLRawBlob(pic);

For now, it works. And I am happy with it !

A single question remains:
Is it true that only simple types are allowed (or processed correctly) inside a dynamic array inside a SQLrecord ?

Edit:
I saw that a TDateTime inside a dynamic array is also converted into a string.
However, MongoDB allows for perfect sharding: every native datatype is allowed for nesting (arrays).
Could this be a future feature of the mORMot/MongoDB combination ?

Edit2:
I will try your update concerning Blobs !!
(sorry for missing your comments on this update)

Thanks.

ps: many thanks for adding MongoDB ... it allows for very nice and flexible database storage in combination with your very nice framework !!

Sorry about not being clear ... my bad ...

I was talking about the external mysql (mariadb) server being down !!
No errors are raised when that happens.
But more severe: when the mysql-server is up again, data update to the external mysql database is not resuming.

So once an external mysql server is down, the connection with this external mysql server is permanently broken.
My question: how to detect this and how to re-connect with the external server.

Thanks, Alfred.