tables/databases simultaneous updates & extended-stored-procedures

View: New views
5 Messages — Rating Filter:   Alert me  

tables/databases simultaneous updates & extended-stored-procedures

by SOL ZADEH :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Some parts of this message have been removed. Learn more about Nabble's security policy.

Hi

 

I have a couple of questions and really appreciate if any one could answer them or instruct me to the relevant forum topics:

 

1-     what is the limitations (speed, threshold etc)  on simultaneous tables /databases update  i.e. via multiple odbc connection lets say  (also any other faster API to interface with the MonetDB ?)

 

2-     Is there a way to have the triggers to generate real-world (non-db) events i.e. similar to the Extended Stored Procedure in SqlServer or the way Oracle allows you to run Java code inside the stored procedures.

Thanks

 




-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Monetdb-developers mailing list
Monetdb-developers@...
https://lists.sourceforge.net/lists/listinfo/monetdb-developers

Re: tables/databases simultaneous updates & extended-stored-procedures

by Niels Nes :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

On Fri, Jul 18, 2008 at 05:13:54PM -0700, SOL ZADEH wrote:

>    Hi
>
>
>    I have a couple of questions and really appreciate if any one
>    could answer them or instruct me to the relevant forum topics:
>
>
>    1-     what is the limitations (speed, threshold etc)  on
>    simultaneous tables /databases update  i.e. via multiple odbc
>    connection lets say  (also any other faster API to interface
>    with the MonetDB ?)
MonetDB research concentrated mostly in low update/high query loads. The
update implementation is still quite capable, but no reall performance
experiments on updates have been conducted. Next to odbc we have
mapi and jdbc APIs available.
>
>
>    2-     Is there a way to have the triggers to generate
>    real-world (non-db) events i.e. similar to the Extended Stored
>    Procedure in SqlServer or the way Oracle allows you to run Java
>    code inside the stored procedures.
MonetDB can be extended using C-code and that code could be run within
the triggers.

Niels
>
>    Thanks

> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> Monetdb-developers mailing list
> Monetdb-developers@...
> https://lists.sourceforge.net/lists/listinfo/monetdb-developers


--

Niels Nes, Centre for Mathematics and Computer Science (CWI)
Kruislaan 413, 1098 SJ Amsterdam, The Netherlands
room C0.02,  phone ++31 20 592-4098, fax ++31 20 592-4312
url: http://www.cwi.nl/~niels   e-mail: Niels.Nes@...

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Monetdb-developers mailing list
Monetdb-developers@...
https://lists.sourceforge.net/lists/listinfo/monetdb-developers

Parent Message unknown Re: tables/databases simultaneous updates & extended-stored-procedures

by SOL ZADEH :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Some parts of this message have been removed. Learn more about Nabble's security policy.

Thanks Neils for your prompt reply.

Is there a quantified limitation on "insertions" on scenarios I mentioned below (multiple tables/database)?
I.e. Does very frequent insertions on 2 or more tables (on same database or other database on the same server)
in any way effect the performance of the other queries (select,insert,update) on the "same"
or "other" tables (i.e. is parallel processing possible & locking performance etc).
Regards


----- Original Message ----
From: Niels Nes <Niels.Nes@...>
To: SOL ZADEH <solzadeh@...>
Cc: monetdb-developers@...
Sent: Saturday, July 19, 2008 8:49:55 AM
Subject: Re: [Monetdb-developers] tables/databases simultaneous updates & extended-stored-procedures

On Fri, Jul 18, 2008 at 05:13:54PM -0700, SOL ZADEH wrote:

>    Hi
>
>
>    I have a couple of questions and really appreciate if any one
>    could answer them or instruct me to the relevant forum topics:
>
>
>    1-    what is the limitations (speed, threshold etc)  on
>    simultaneous tables /databases update  i.e. via multiple odbc
>    connection lets say  (also any other faster API to interface
>    with the MonetDB ?)
MonetDB research concentrated mostly in low update/high query loads. The
update implementation is still quite capable, but no reall performance
experiments on updates have been conducted. Next to odbc we have
mapi and jdbc APIs available.
>
>
>    2-    Is there a way to have the triggers to generate
>    real-world (non-db) events i.e. similar to the Extended Stored
>    Procedure in SqlServer or the way Oracle allows you to run Java
>    code inside the stored procedures.
MonetDB can be extended using C-code and that code could be run within
the triggers.

Niels
>
>    Thanks

> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> Monetdb-developers mailing list
> Monetdb-developers@...
> https://lists.sourceforge.net/lists/listinfo/monetdb-developers


--

Niels Nes, Centre for Mathematics and Computer Science (CWI)
Kruislaan 413, 1098 SJ Amsterdam, The Netherlands
room C0.02,  phone ++31 20 592-4098, fax ++31 20 592-4312
url: http://www.cwi.nl/~niels  e-mail: Niels.Nes@...


-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Monetdb-developers mailing list
Monetdb-developers@...
https://lists.sourceforge.net/lists/listinfo/monetdb-developers

Re: tables/databases simultaneous updates & extended-stored-procedures

by Martin Kersten :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

SOL ZADEH wrote:

>
> Thanks Neils for your prompt reply.
>
> Is there a quantified limitation on "insertions" on scenarios I
> mentioned below (multiple tables/database)?
> I.e. Does very frequent insertions on 2 or more tables (on same
> database or other database on the same server)
> in any way effect the performance of the other queries
> (select,insert,update) on the "same"
> or "other" tables (i.e. is parallel processing possible & locking
> performance etc).
> Regards
Trying to interpret you question what it means.
MonetDB does not lock tables or databases during update. Concurrent
transactions can
freely read a consistent copy of the database.
All interference comes from sharing the same CPU, memory and IO channels.

>
> ----- Original Message ----
> From: Niels Nes <Niels.Nes@...>
> To: SOL ZADEH <solzadeh@...>
> Cc: monetdb-developers@...
> Sent: Saturday, July 19, 2008 8:49:55 AM
> Subject: Re: [Monetdb-developers] tables/databases simultaneous
> updates & extended-stored-procedures
>
> On Fri, Jul 18, 2008 at 05:13:54PM -0700, SOL ZADEH wrote:
> >    Hi
> >
> >
> >    I have a couple of questions and really appreciate if any one
> >    could answer them or instruct me to the relevant forum topics:
> >
> >
> >    1-    what is the limitations (speed, threshold etc)  on
> >    simultaneous tables /databases update  i.e. via multiple odbc
> >    connection lets say  (also any other faster API to interface
> >    with the MonetDB ?)
> MonetDB research concentrated mostly in low update/high query loads. The
> update implementation is still quite capable, but no reall performance
> experiments on updates have been conducted. Next to odbc we have
> mapi and jdbc APIs available.
> >
> >
> >    2-    Is there a way to have the triggers to generate
> >    real-world (non-db) events i.e. similar to the Extended Stored
> >    Procedure in SqlServer or the way Oracle allows you to run Java
> >    code inside the stored procedures.
> MonetDB can be extended using C-code and that code could be run within
> the triggers.
>
> Niels
> >
> >    Thanks
>
> >
> -------------------------------------------------------------------------
> > This SF.Net email is sponsored by the Moblin Your Move Developer's
> challenge
> > Build the coolest Linux based applications with Moblin SDK & win
> great prizes
> > Grand prize is a trip for two to an Open Source event anywhere in
> the world
> > http://moblin-contest.org/redirect.php?banner_id=100&url=/ 
> <http://moblin-contest.org/redirect.php?banner_id=100&url=/>
> > _______________________________________________
> > Monetdb-developers mailing list
> > Monetdb-developers@...
> <mailto:Monetdb-developers@...>
> > https://lists.sourceforge.net/lists/listinfo/monetdb-developers
>
>
> --
>
> Niels Nes, Centre for Mathematics and Computer Science (CWI)
> Kruislaan 413, 1098 SJ Amsterdam, The Netherlands
> room C0.02,  phone ++31 20 592-4098, fax ++31 20 592-4312
> url: http://www.cwi.nl/~niels <http://www.cwi.nl/%7Eniels>  e-mail:
> Niels.Nes@... <mailto:Niels.Nes@...>
>
> ------------------------------------------------------------------------
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> ------------------------------------------------------------------------
>
> _______________________________________________
> Monetdb-developers mailing list
> Monetdb-developers@...
> https://lists.sourceforge.net/lists/listinfo/monetdb-developers
>  


-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Monetdb-developers mailing list
Monetdb-developers@...
https://lists.sourceforge.net/lists/listinfo/monetdb-developers

Parent Message unknown Re: tables/databases simultaneous updates & extended-stored-procedures

by SOL ZADEH :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Some parts of this message have been removed. Learn more about Nabble's security policy.

Thanks Martin; let me explain better:

if table update are too costly (slow etc) then could try insertion instead (having/including the timestamps as an index)
providing the server can cope with very frequent table insertions.

Is there any benchmark tests in relation to table insertions? 

Regarding :
>> Concurrent transactions can freely read a consistent copy of the database.
does this mean "dirty reads" ?
Regards



----- Original Message ----
From: Martin Kersten <Martin.Kersten@...>
To: SOL ZADEH <solzadeh@...>
Cc: Niels Nes <Niels.Nes@...>; monetdb-developers@...
Sent: Saturday, July 19, 2008 2:22:16 PM
Subject: Re: [Monetdb-developers] tables/databases simultaneous updates & extended-stored-procedures

SOL ZADEH wrote:

>
> Thanks Neils for your prompt reply.
>
> Is there a quantified limitation on "insertions" on scenarios I
> mentioned below (multiple tables/database)?
> I.e. Does very frequent insertions on 2 or more tables (on same
> database or other database on the same server)
> in any way effect the performance of the other queries
> (select,insert,update) on the "same"
> or "other" tables (i.e. is parallel processing possible & locking
> performance etc).
> Regards
Trying to interpret you question what it means.
MonetDB does not lock tables or databases during update. Concurrent
transactions can
freely read a consistent copy of the database.
All interference comes from sharing the same CPU, memory and IO channels.

>
> ----- Original Message ----
> From: Niels Nes <Niels.Nes@...>
> To: SOL ZADEH <solzadeh@...>
> Cc: monetdb-developers@...
> Sent: Saturday, July 19, 2008 8:49:55 AM
> Subject: Re: [Monetdb-developers] tables/databases simultaneous
> updates & extended-stored-procedures
>
> On Fri, Jul 18, 2008 at 05:13:54PM -0700, SOL ZADEH wrote:
> >    Hi
> >
> >
> >    I have a couple of questions and really appreciate if any one
> >    could answer them or instruct me to the relevant forum topics:
> >
> >
> >    1-    what is the limitations (speed, threshold etc)  on
> >    simultaneous tables /databases update  i.e. via multiple odbc
> >    connection lets say  (also any other faster API to interface
> >    with the MonetDB ?)
> MonetDB research concentrated mostly in low update/high query loads. The
> update implementation is still quite capable, but no reall performance
> experiments on updates have been conducted. Next to odbc we have
> mapi and jdbc APIs available.
> >
> >
> >    2-    Is there a way to have the triggers to generate
> >    real-world (non-db) events i.e. similar to the Extended Stored
> >    Procedure in SqlServer or the way Oracle allows you to run Java
> >    code inside the stored procedures.
> MonetDB can be extended using C-code and that code could be run within
> the triggers.
>
> Niels
> >
> >    Thanks
>
> >
> -------------------------------------------------------------------------
> > This SF.Net email is sponsored by the Moblin Your Move Developer's
> challenge
> > Build the coolest Linux based applications with Moblin SDK & win
> great prizes
> > Grand prize is a trip for two to an Open Source event anywhere in
> the world
> > http://moblin-contest.org/redirect.php?banner_id=100&url=/
> <http://moblin-contest.org/redirect.php?banner_id=100&url=/>
> > _______________________________________________
> > Monetdb-developers mailing list
> > Monetdb-developers@...
> <mailto:Monetdb-developers@...>
> > https://lists.sourceforge.net/lists/listinfo/monetdb-developers
>
>
> --
>
> Niels Nes, Centre for Mathematics and Computer Science (CWI)
> Kruislaan 413, 1098 SJ Amsterdam, The Netherlands
> room C0.02,  phone ++31 20 592-4098, fax ++31 20 592-4312
> url: http://www.cwi.nl/~niels <http://www.cwi.nl/%7Eniels>  e-mail:
> Niels.Nes@... <mailto:Niels.Nes@...>
>
> ------------------------------------------------------------------------
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> ------------------------------------------------------------------------
>
> _______________________________________________
> Monetdb-developers mailing list
> Monetdb-developers@...
> https://lists.sourceforge.net/lists/listinfo/monetdb-developers



-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Monetdb-developers mailing list
Monetdb-developers@...
https://lists.sourceforge.net/lists/listinfo/monetdb-developers
LightInTheBox - Buy quality products at wholesale price