#1 2014-12-31 10:49:45

ab
Administrator
From: France
Registered: 2010-06-21
Posts: 13,060
Website

The future of mORMot is BigData

Due to popular request of several users of mORMot, we identified and designed some feature requests dedicated to BigData process.

The following features are on the road map:

* Auto-Synch between mORMot servers (as cache or for branch office cache), and potentially mORMot clients (offline mode);
* Automated sharding for BigData storage;
* Monitoring of your farm of mORMot servers.

This is the forum thread of the following blog post:
http://blog.synopse.info/post/2014/12/3 … is-BigData

Offline

#2 2015-01-02 04:01:55

edwinsn
Member
Registered: 2010-07-02
Posts: 1,168

Re: The future of mORMot is BigData

My first time hearing about WiredTiger, from the github stars, it doesn't seem to be very popular, but you must choose it over others for some good reasons smile

And I thought similarly to the Monkey http server.

And happy new year!


Delphi XE4 Pro on Windows 7 64bit.
Lazarus trunk built with fpcupdelux on Windows with cross-compile for Linux 64bit.

Offline

#3 2015-01-02 09:31:49

ab
Administrator
From: France
Registered: 2010-06-21
Posts: 13,060
Website

Re: The future of mORMot is BigData

WiredTiger is just an awsome piece of code: take a look at the source, and who are behind it (the BerkeleyDB authors).
It has been acquired and chosen by MongoDB for their upcoming 2.8 version, with huge speed benefit - see http://www.zdnet.com/article/mongodb-ct … s-stripes/

About Monkey http server, it was the best project I found out, but it may be possible to find something better.
Any input is welcome!

Offline

#4 2015-01-02 12:25:01

jonjbar
Member
Registered: 2012-12-27
Posts: 23

Re: The future of mORMot is BigData

Auto-synch between servers and clients would be amazing!
This would be a potential alternative to the very popular and great Firebase recently purchased by Google: https://www.firebase.com/
Happy new year Arnaud and best wishes for you and your rodents smile

Offline

#5 2015-01-02 20:52:59

ab
Administrator
From: France
Registered: 2010-06-21
Posts: 13,060
Website

Re: The future of mORMot is BigData

About WiredTIger, sounds like if the license terms are exclusively GPL...
So the feature request has been deferred, since it is less appealing than previously identified!
sad

Offline

#6 2015-01-02 22:59:13

miab3
Member
From: Poland
Registered: 2014-10-01
Posts: 185

Re: The future of mORMot is BigData

With interesting from the world of databases:
http://blogs.enterprisedb.com/2014/09/2 … r-reality/

Michal

Offline

#7 2015-01-02 23:55:53

ab
Administrator
From: France
Registered: 2010-06-21
Posts: 13,060
Website

Re: The future of mORMot is BigData

WiredTiger addressed this particular case of bunch insert.

Offline

#8 2015-01-03 15:01:06

itSDS
Member
From: Germany
Registered: 2014-04-24
Posts: 414

Re: The future of mORMot is BigData

I looked at Firebird and i think this is only for the people who do not have any security problems and who don't care about google looking at their data.


Rad Studio 11.1

Offline

#9 2015-01-03 15:37:22

ab
Administrator
From: France
Registered: 2010-06-21
Posts: 13,060
Website

Re: The future of mORMot is BigData

Home hosting with mORMot is true freedom, where their clouds may forcast little rainy days on our privacy...
Free as a bird, I mean!

Offline

#10 2015-01-03 17:41:22

ttomas
Member
Registered: 2013-03-08
Posts: 74

Re: The future of mORMot is BigData

For http server investigate MS .Net server for Linux and Darwin https://github.com/aspnet/KestrelHttpServer
Based on libuv (core of node.js)
I look the code at https://github.com/aspnet/KestrelHttpSe … Networking
and try to port to pascal

Offline

#11 2015-01-03 20:36:07

ab
Administrator
From: France
Registered: 2010-06-21
Posts: 13,060
Website

Re: The future of mORMot is BigData

This code is a good start, but it is in fact a raw monothreaded implementation of a libuv server.
We investigated in direction of libuv since a lot of time - http://synopse.info/forum/viewtopic.php?pid=7896#p7896
But an event-based library is just a small part of one HTTP server itself.
For instance, we have an IOCP+WinSock based HTTP server within SynCrtSock, but it was less scaling that kernel http.sys in our tests.
This is why Monkey HTTP Server was appealing: it was designed and optimized for Linux, directly using low-level kernel tricks, and feature HTTP protocol. It sounds a better candidate than a general purpose asynch library as libuv.
But LibUv is worth considering for general asynchronous process, e.g. for http://synopse.info/fossil/tktview?name=aa230e5299

Offline

#12 2015-01-05 05:44:21

edwinsn
Member
Registered: 2010-07-02
Posts: 1,168

Re: The future of mORMot is BigData

Hi ab, this may sound like a dumb question, but is it possible to use WiredTiger in a way like using Sqlite - use it's binary and mORMot interface with it?


Delphi XE4 Pro on Windows 7 64bit.
Lazarus trunk built with fpcupdelux on Windows with cross-compile for Linux 64bit.

Offline

#13 2015-01-05 07:21:41

ab
Administrator
From: France
Registered: 2010-06-21
Posts: 13,060
Website

Re: The future of mORMot is BigData

This would still be viral for GPL.
Only LGPL may allow linking without viral.
See http://en.m.wikipedia.org/wiki/GNU_Less … ic_License

Offline

Board footer

Powered by FluxBB