Nabble - exist-open

Re: Installing on a hosted server

2008-10-10T14:31:13Z

On 10 Oct 2008, at 20:19 , Fraser Hore wrote:

> I've been using exist and tomcat locally for some time with no
> problems. What I don't understand very well is how to install
> remotely on a hosted server.

did you use the manager interface onyour local server?

http://tomcat.apache.org/tomcat-5.5-doc/manager-howto.html

Kind regards

Dannes

--
eXist-db Open Source Native XML Database
http://exist-db.org

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

smime.p7s (2K) Download Attachment

Re: Installing on a hosted server

2008-10-10T14:29:05Z

On 10 Oct 2008, at 21:59 , Aaron Anderson wrote:

> I would hazard to guess that since eXist reads and writes to the
> file system the hosting provider has restricted that priviledge in
> the JVM SecurityManager. Unless they allow you to disable the
> SecurityManager or use a custom policy file I don't think you will
> be able to get it to work.

good point. But in all cases the tomcat/catalina logs files and/or the
exist log files -if any- should give some clues. SinceFraser says he
has to extract the war into the filesystem, at least the tomcat files
should be there.

I really suggest to contact the hoster for details

Kind regards

Dannes

--
eXist-db Open Source Native XML Database
http://exist-db.org

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

smime.p7s (2K) Download Attachment

Re: Installing on a hosted server

2008-10-10T12:59:04Z

I would hazard to guess that since eXist reads and writes to the file system the hosting provider has restricted that priviledge in the JVM SecurityManager. Unless they allow you to disable the SecurityManager or use a custom policy file I don't think you will be able to get it to work.

Aaron

--- On Fri, 10/10/08, Fraser Hore <fraser.hore@...> wrote:

From: Fraser Hore <fraser.hore@...>
Subject: Re: [Exist-open] Installing on a hosted server
To: "Dannes Wessels" <dizzzz@...>
Cc: exist-open@...
Date: Friday, October 10, 2008, 1:19 PM

Hi thanks for the response. Apologies for not providing more detail but not sure what info is relevant.

I've been using exist and tomcat locally for some time with no problems. What I don't understand very well is how to install remotely on a hosted server.

I've set up an account on a shared server. According to the providers instructions I just unzip my war file in the httpdocs folder, restart Tomcat and it should work. But it doesn't. I chose Tomcat 6.0 and I used the latest version of the exist war. Do I have to somehow start exist?

The logs folder in WEB-INF has only the .DO_NOT_DELETE file.

Thanks for any ideas what I might be doing wrong.

Cheers,

Fraser

On Fri, Oct 10, 2008 at 7:56 PM, Dannes Wessels <dizzzz@...> wrote:

Hi,

On 10 Oct 2008, at 18:54 , Fraser Hore wrote:

Could someone please explain how to install eXist on a hosted server.

login to tomcat's admin application, rename war file, upload war file, ready.

I am trying to install on a Tomcat virtualhost and can't get it working.

Do you have access to tomcat logs? does the app deploy at all? if so, wat do the exist logs say?

you don't really provide information to us [tomcat version, exist version, log files, error messages], so please contact your hoster for questions. To start with you could try to install tomcat on your own PC and check how it works...

Kind regards

Dannes

--
eXist-db Open Source Native XML Database
http://exist-db.org
-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's
challenge
Build the coolest Linux based applications with Moblin SDK & win great
prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: Installing on a hosted server

2008-10-10T11:19:36Z

Hi thanks for the response. Apologies for not providing more detail but not sure what info is relevant.

I've been using exist and tomcat locally for some time with no problems. What I don't understand very well is how to install remotely on a hosted server.

I've set up an account on a shared server. According to the providers instructions I just unzip my war file in the httpdocs folder, restart Tomcat and it should work. But it doesn't. I chose Tomcat 6.0 and I used the latest version of the exist war. Do I have to somehow start exist?

The logs folder in WEB-INF has only the .DO_NOT_DELETE file.

Thanks for any ideas what I might be doing wrong.

Cheers,

Fraser

On Fri, Oct 10, 2008 at 7:56 PM, Dannes Wessels <dizzzz@...> wrote:

Hi,

On 10 Oct 2008, at 18:54 , Fraser Hore wrote:

Could someone please explain how to install eXist on a hosted server.

login to tomcat's admin application, rename war file, upload war file, ready.

I am trying to install on a Tomcat virtualhost and can't get it working.

Do you have access to tomcat logs? does the app deploy at all? if so, wat do the exist logs say?

you don't really provide information to us [tomcat version, exist version, log files, error messages], so please contact your hoster for questions. To start with you could try to install tomcat on your own PC and check how it works...

Kind regards

Dannes

--
eXist-db Open Source Native XML Database
http://exist-db.org

Re: Installing on a hosted server

2008-10-10T10:56:58Z

Hi,

On 10 Oct 2008, at 18:54 , Fraser Hore wrote:
> Could someone please explain how to install eXist on a hosted server.

login to tomcat's admin application, rename war file, upload war file,
ready.

> I am trying to install on a Tomcat virtualhost and can't get it
> working.

Do you have access to tomcat logs? does the app deploy at all? if so,
wat do the exist logs say?

you don't really provide information to us [tomcat version, exist
version, log files, error messages], so please contact your hoster for
questions. To start with you could try to install tomcat on your own
PC and check how it works...

Kind regards

Dannes

--
eXist-db Open Source Native XML Database
http://exist-db.org

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

smime.p7s (2K) Download Attachment

Installing on a hosted server

2008-10-10T09:54:31Z

Could someone please explain how to install eXist on a hosted server.

I am trying to install on a Tomcat virtualhost and can't get it working.

I'd also be interested if there is an ISP that offers or will support an exist application. The one I'm trying right now is http://www.hostjava.net/ but it's just a trial account so I can change it.

Thanks very much!!

Fraser

Re: Any way to see running xqueries?

2008-10-10T08:08:23Z

Wolfgang wrote:

> Sure, it makes sense to monitor those things via JMX. I think it's not a
> problem to have both, a set of XQuery functions and a JMX interface.

+1

I'll work on the XQuery functions shortly! Might even extend the Admin web page to include some XQuery monitoring and
control once the functions are in place.

--
Andrzej Taramina
Chaeron Corporation: Enterprise System Solutions
http://www.chaeron.com

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: Any way to see running xqueries?

2008-10-10T08:07:35Z

Wolfgang wrote:

> Sure, it makes sense to monitor those things via JMX. I think it's not a
> problem to have both, a set of XQuery functions and a JMX interface.

+1

I'll work on the XQuery functions shortly!

--
Andrzej Taramina
Chaeron Corporation: Enterprise System Solutions
http://www.chaeron.com

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: Any way to see running xqueries?

2008-10-10T01:49:13Z

> Access to these threads using JMX management extensions still would
> make sense, right?

Sure, it makes sense to monitor those things via JMX. I think it's not a
problem to have both, a set of XQuery functions and a JMX interface.

Wolfgang

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: Any way to see running xqueries?

2008-10-10T00:21:19Z

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

- ----- Ursprungligt meddelande -----
@A@ skrev @D@:
> On Thu, Oct 9, 2008 at 11:07 PM, Wolfgang Meier <wolfgang@...> wrote:
>> which means that in a for loop, context.proceed is called once for
>> every iteration, thus giving the watchdog a chance to terminate the
>> query (by throwing a TerminatedException). This approach basically
>> works, though I guess we could add some more calls to proceed() in the
>> various other expression classes.
>
> Access to these threads using JMX management extensions still would
> make sense, right?

Just to make the picture somewhat bigger. I am working on the debugging
api based on this too.

Leif-Jöran
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org

iD8DBQFI7wJuhcIn5aVXOPIRAhzVAKC017u72o4q1xQFj4fmBO9+wz7PpQCcC7+k
VMokQFvzapiuKPTfEMvCC60=
=9SZH
-----END PGP SIGNATURE-----

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: Any way to see running xqueries?

2008-10-09T23:28:55Z

On Thu, Oct 9, 2008 at 11:07 PM, Wolfgang Meier <wolfgang@...> wrote:
> which means that in a for loop, context.proceed is called once for
> every iteration, thus giving the watchdog a chance to terminate the
> query (by throwing a TerminatedException). This approach basically
> works, though I guess we could add some more calls to proceed() in the
> various other expression classes.

Access to these threads using JMX management extensions still would
make sense, right?

regards

Dannes

--
eXist-db Native XML Database
http://exist-db.org

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: Any way to see running xqueries?

2008-10-09T14:07:21Z

> Not sure what you mean by this. What are you referring to when you say "query expressions"? What expressions currently
> respect this? Does it apply to xquery function implementations as well?

The internal representation of an XQuery in eXist is a tree of
org.exist.xquery.Expression objects. All XQuery expressions map to a
subclass of Expression.

> I'm thinking more of an XQuery that might be processing a long list of entries and doing a lot of heavy lifting for each
> one. It might be useful to kill such a process if it was started at the wrong time or is impacting something else.

Yes, exactly. If you look into e.g. ForExpr, you'll see code such as:

// Loop through each variable binding
p = 0;
for (SequenceIterator i = in.iterate(); i.hasNext(); p++) {
context.proceed(this);
...
}

which means that in a for loop, context.proceed is called once for
every iteration, thus giving the watchdog a chance to terminate the
query (by throwing a TerminatedException). This approach basically
works, though I guess we could add some more calls to proceed() in the
various other expression classes.

> Then there is a the question of database integrity. Any chance that if a query is killed at the wrong time, it could
> damage indexes or such, if it happened during an insert or update?

That's why I decided not to kill the running thread, but instead give
the query a chance to terminate properly. The expression object should
be aware that it might be killed whenever it calls proceed(). We
cannot kill the query in the middle of a node update operation.

Wolfgang

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: Any way to see running xqueries?

2008-10-09T13:27:06Z

Wolfgang:

> There are some classes which could be used: first of all,
> org.exist.storage.XQueryMonitor keeps track of all running XQueries in
> the database. Whenever a new query starts, XQueryMonitor receives an
> instance of XQueryWatchdog, which has a kill() method. Currently this
> is only used during db shutdown though.

That sounds like it could be wrapped into a few XQuery function extensions pretty easily.
I'll take a run at that, if you think it's OK.

> XQueryWatchdog depends on the query expressions to cooperate: they
> should call XQueryWatchdog.proceed before they start a potentially
> long running process. Right now, not all expressions respect this, but
> they could be changed easily.

Not sure what you mean by this. What are you referring to when you say "query expressions"? What expressions currently
respect this? Does it apply to xquery function implementations as well?

I'm thinking more of an XQuery that might be processing a long list of entries and doing a lot of heavy lifting for each
one. It might be useful to kill such a process if it was started at the wrong time or is impacting something else.

Then there is a the question of database integrity. Any chance that if a query is killed at the wrong time, it could
damage indexes or such, if it happened during an insert or update?

Thx!

--
Andrzej Taramina
Chaeron Corporation: Enterprise System Solutions
http://www.chaeron.com

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: Collection/Document name rules?

2008-10-09T13:17:03Z

> Is it documented anywhere what names for collection and/or document names are valid ones?

All collection and resource names should be valid URIs, so the general
rules for URI encoding apply. Since we had some problems with this in
the past, most interfaces try to transparently encode/decode
non-compliant collection/resource paths on the fly. Parts of this code
are a bit messy though, so I would not rely on non-valid URIs to still
be accepted in the future.

Wolfgang

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: Any way to see running xqueries?

2008-10-09T13:11:31Z

> There is nothing in place yet, but I had my thoughts on it previously. I
> think it would be best to couple JMX-extensions to the brokerpool and
> related classes, so we'll have a generic way to control and monitor these
> threads.

There are some classes which could be used: first of all,
org.exist.storage.XQueryMonitor keeps track of all running XQueries in
the database. Whenever a new query starts, XQueryMonitor receives an
instance of XQueryWatchdog, which has a kill() method. Currently this
is only used during db shutdown though.

XQueryWatchdog depends on the query expressions to cooperate: they
should call XQueryWatchdog.proceed before they start a potentially
long running process. Right now, not all expressions respect this, but
they could be changed easily.

Wolfgang

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: Any way to see running xqueries?

2008-10-09T12:50:56Z

Hi,
On 9 Oct 2008, at 21:29 , Andrzej Jan Taramina wrote:

> Are there any functions that would allow us to see what xqueries are
> running, and maybe terminate ones as well?
>
> Be useful to have a few such functions available to XQueries.
>
> If not, any plans to add these?

There is nothing in place yet, but I had my thoughts on it previously.
I think it would be best to couple JMX-extensions to the brokerpool
and related classes, so we'll have a generic way to control and
monitor these threads.

Possibly there are better alternatives....

Kind regards

Dannes

--
eXist-db Open Source Native XML Database
http://exist-db.org

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

smime.p7s (2K) Download Attachment

Any way to see running xqueries?

2008-10-09T12:29:02Z

Are there any functions that would allow us to see what xqueries are running, and maybe terminate ones as well?

I haven't found any such function calls.

Be useful to have a few such functions available to XQueries.

If not, any plans to add these?

--
Andrzej Taramina
Chaeron Corporation: Enterprise System Solutions
http://www.chaeron.com

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: .log file under WEB-INF/data is very large

2008-10-09T09:59:22Z

Awesome. I learn something everyday =) Thank you.

Dannes Wessels-2 wrote:

hi,

On 9 Oct 2008, at 17:24 , mountainbiker wrote:

> Since writing, the .log has doubled in it size from about 50MB to
> 100MB.
>
> If all this sounds reasonable and within limits, I will leave the db
> up and
> just keep an eye on it.

Yes, the maximum size is configured on 100MB; the file(s) will
actually grow to that size before it is 'emptied'.

Kind regards

Dannes

--
eXist-db Open Source Native XML Database
http://exist-db.org

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

Collection/Document name rules?

2008-10-09T09:21:43Z

Is it documented anywhere what names for collection and/or document names are valid ones?

That is, what characters are allowed in a col/doc name and which one's aren't, when creating such in the database?

Thanks!

--
Andrzej Taramina
Chaeron Corporation: Enterprise System Solutions
http://www.chaeron.com

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: .log file under WEB-INF/data is very large

2008-10-09T09:01:08Z

hi,

On 9 Oct 2008, at 17:24 , mountainbiker wrote:

Since writing, the .log has doubled in it size from about 50MB to 100MB.

If all this sounds reasonable and within limits, I will leave the db up and
just keep an eye on it.

Yes, the maximum size is configured on 100MB; the file(s) will actually grow to that size before it is 'emptied'.

Kind regards

Dannes

eXist-db Open Source Native XML Database

http://exist-db.org

smime.p7s (2K) Download Attachment

Re: .log file under WEB-INF/data is very large

2008-10-09T08:24:03Z

Dannes/Wolfgang-

Thank you always for the super fast responses.

Since writing, the .log has doubled in it size from about 50MB to 100MB. There has been a few minor inserts today to the db, there has not been any collection removals, but we do receive a large volume of XQueries against the db.

If all this sounds reasonable and within limits, I will leave the db up and just keep an eye on it.

Wolfgang Meier-2 wrote:

> We noticed that the .log file under WEB-INF/data is very large. (The
> timestamp on the file is today.) We have not been doing anything to the db
> today other than a few minor inserts and xqueries. Does anything need to be
> done, or will it clear/address its self?

It should be cleared with the next transaction or after restarting the
db. If not, please report again. Usually, there are two reasons for
getting a large .log file: 1) a large collection was removed, 2) a lot
of temporary doc fragments were generated by XQueries and were removed
afterwards.

> We noticed in an earlier post, the question was asked:
> Under .../webapp/WEB-INF/data -- what .ndx, .log, .lck files can be safely
> deleted and recreated with a reindex?
>
> ... and Wolfgang responded:
> You can delete all files except dom.dbx, symbols.dbx, collections.dbx,
> but only while the database is offline.
>
> If a large .log were to be deleted, the db reindexed -- would there be data
> lost?

No. You do not even need to reindex or delete the .log manually. It
should be cleared if you restart the db.

Wolfgang

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: .log file under WEB-INF/data is very large

2008-10-09T06:20:55Z

Hi,

On Thu, Oct 9, 2008 at 3:10 PM, mountainbiker
<mailing.list.traffic@...> wrote:
> We noticed that the .log file under WEB-INF/data is very large.

What is large here? .log transaction logs can grow up to 100 MB each,
but will be removed automagically.

regards

Dannes

--
eXist-db Native XML Database
http://exist-db.org

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: .log file under WEB-INF/data is very large

2008-10-09T06:20:19Z

> We noticed that the .log file under WEB-INF/data is very large. (The
> timestamp on the file is today.) We have not been doing anything to the db
> today other than a few minor inserts and xqueries. Does anything need to be
> done, or will it clear/address its self?

It should be cleared with the next transaction or after restarting the
db. If not, please report again. Usually, there are two reasons for
getting a large .log file: 1) a large collection was removed, 2) a lot
of temporary doc fragments were generated by XQueries and were removed
afterwards.

> We noticed in an earlier post, the question was asked:
> Under .../webapp/WEB-INF/data -- what .ndx, .log, .lck files can be safely
> deleted and recreated with a reindex?
>
> ... and Wolfgang responded:
> You can delete all files except dom.dbx, symbols.dbx, collections.dbx,
> but only while the database is offline.
>
> If a large .log were to be deleted, the db reindexed -- would there be data
> lost?

No. You do not even need to reindex or delete the .log manually. It
should be cleared if you restart the db.

Wolfgang

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

.log file under WEB-INF/data is very large

2008-10-09T06:10:45Z

We noticed that the .log file under WEB-INF/data is very large. (The timestamp on the file is today.) We have not been doing anything to the db today other than a few minor inserts and xqueries. Does anything need to be done, or will it clear/address its self?

We noticed in an earlier post, the question was asked:
Under .../webapp/WEB-INF/data -- what .ndx, .log, .lck files can be safely deleted and recreated with a reindex?

... and Wolfgang responded:
You can delete all files except dom.dbx, symbols.dbx, collections.dbx,
but only while the database is offline.

If a large .log were to be deleted, the db reindexed -- would there be data lost?

-ouri parameter problem for command line backup

2008-10-08T17:52:04Z

Just a heads up....I had thought that the problem in handling the -ouri=xmldb:exist://localhost/xmlrpc parameter on a
command line initiated backup was due to the older avalon excalibur cli libraries.

I was incorrect. The problem was much simpler than that, but it's taken hours to get to the root of it and figure out
the actual cause.

When you issue the following on a Windoze system:

backup -u admin -p xxxxxx -b /db -d d:/temp/exist -ouri=xmldb:exist://localhost/xmlrpc

what windows does when this gets passed into the batch script (.bat file) is split the final parameter, so what the
script sees internally is:

backup -u admin -p xxxxxx -b /db -d d:/temp/exist -ouri xmldb:exist://localhost/xmlrpc

which would be fine, since the avalon excalibur cli can handle this situation just fine. I discovered this by looking at
the Ant source code, which handles this special case in their own parameter parsing code.

The problem was that the backup.bat file was written to only be able to handle 9 command line parameters! If you count
'em, you'll see that the xmldb:exist://localhost/xmlrpc is number 10, and thus was never passed into the actual java
code that does the backup, and so the correct uri for the database was never set correctly.

All our windoze scripts (.bat files) in the exist /bin directory have been corrected so that they pass an unlimited
quantity of command line parameters through. Checked into SVN trunk a few minutes ago.

Some days I just hate windoze.....long live Ubuntu (and other Linux variants) that never saw this issue! Sure wish I
could dump my last few windoze boxes...but till Adobe's tools all run on Linux, I'm kinda stuck keeping my main machine
using the crappy OS from Redmond. <sigh>

Anyway....that's what the final problem was that was keeping me from doing command line based backups.

--
Andrzej Taramina
Chaeron Corporation: Enterprise System Solutions
http://www.chaeron.com

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: Denying directory access

2008-10-08T13:55:23Z

hi,

On Wed, Oct 8, 2008 at 5:09 PM, Vanya, Scott
<Scott.Vanya@...> wrote:
> Can someone please tell me the simplest way to prevent this or what I am
> doing wrong with the webdefault.xml config?

the servlet config does not look ok to me. What about consulting the
jetty support site?

regards

Dannes

--
eXist-db Native XML Database
http://exist-db.org

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

External Binaries Branch

2008-10-08T11:00:58Z

Just to assure people about this change as it is somewhat a major
departure from storing everything in the .dbx file this code does
work well. I've been using the branch in production for quite awhile
with the benefit of other trunk changes. It has been very stable.

Now, that doesn't mean that we didn't introduce bugs when we
merged the branch. We choose to perform diffs on the changes
rather than do a formal merged due to the fact that it had been
so long and also because the changes are localized to
certain areas of the code.

A big thanks should go to Dizzz for doing the hard work of integrating
this change into the trunk and testing it.

There are a couple of good bits now that this code as been
merged:

1. The DBBroker API changed so that you can now deal
with binary resources as streams:

public abstract void storeBinaryResource(
Txn transaction,
BinaryDocument blob,
InputStream is)
throws IOException;

public abstract void readBinaryResource(
BinaryDocument blob,
OutputStream os)
throws IOException;

public abstract InputStream getBinaryResource(BinaryDocument blob)
throws IOException;

public abstract long getBinaryResourceSize(BinaryDocument blob)
throws IOException;

2. The concurrency of the database should improve. Previously, the
whole .dbx file was locked for any operation. That means any read
or write of a binary locks the .dbx file. As a result, large binaries
(e.g. video) cause concurrency problems.

Now that we have binaries as files, we do not need locks for reads
of binaries.

3. Certain operations should use less memory on binaries because you
can now use streams internally.

4. You can now use file system caches and tuning to improve the
performance of serving up binaries.

5. Keep in mind that XQuery is a binary resource. :)

I think a few good next steps would be to allow use of NIO with binaries
so that web serving binaries from the database would be faster.

--Alex Milowski

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: When restoring a database from scratch....are user specified indexes restored/rebuilt as well?

2008-10-08T10:23:18Z

> Quick question:

Quick answer: yes. /db/system is always restored first.

> When you restore a db from scratch, does the process restore your index settings (in collection.xconf files) first and
> then rebuild the indexes as it does the restore?
>
> Just curious....I'm assuming it does.

Wolfgang

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

When restoring a database from scratch....are user specified indexes restored/rebuilt as well?

2008-10-08T09:45:52Z

Quick question:

When you restore a db from scratch, does the process restore your index settings (in collection.xconf files) first and
then rebuild the indexes as it does the restore?

Just curious....I'm assuming it does.

Thx!

--
Andrzej Taramina
Chaeron Corporation: Enterprise System Solutions
http://www.chaeron.com

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: What's going on with the latest build from SVN!?!?!

2008-10-08T08:16:41Z

Wolfgang:

> Alex announced his plan to externalize binary resources back in Dec.
> 2007, along with a link to the branch he created. He also described his
> motivation (with which I agreed). The changes have been around for
> months (in their own branch!) and have been extensively tested by Alex
> and others. And since they do fix a few serious issues, DiZzZz finally
> spent a number of days to integrate the changes into trunk.

And all the work on the part of Dizzz and Alex is much appreciated.

> I don't see how else we should get important changes into the codebase
> if not by 1) creating a branch, 2) testing it, 3) merging it if no
> issues are reported by the testers?

The real problem was breaking the backwards compatibility without any notice, relatively speaking. Just wasn't a
pleasant surprise at midnight last night is all, since the trunk is usually very stable and compatible and has been for
quite some time. Some of us have grown to count on this. ;-)

> Also, please notice how many patches are listed on the corresponding
> sourceforge page. Someone has to review them, integrate them, test them.
> In the past, this work has mainly be done by DiZzZz. We have to thank
> him, not blame him.

Don't get me wrong....the work is very much appreciated! Seems to run a lot faster too. And as a result, I've found a
few small bugs in other areas that will get fixed soon (eg. commmand line parameter handling). So bonus all around.

Just would have been nice to have a week's notice or so before breaking compatibility of the database structures, so
that we could have planned to do the conversions in a more orderly manner is all.

I might have appeared more harsh in my emails than I intended to be...it was well past midnight and with all the backup
issues I ran into, it just wasn't a pleasant process. Apologies to Dizzz....didn't mean to make offense....

--
Andrzej Taramina
Chaeron Corporation: Enterprise System Solutions
http://www.chaeron.com

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Denying directory access

2008-10-08T08:09:23Z

I am trying to configure the Jetty/Exist web app so users can enter
directories and see the files. Had thought it was at: C:\Program
Files\eXist\tools\jetty\etc\webdefault.xml :

<servlet>
<init-param>
<param-name>dirAllowed</param-name>
<param-value>false</param-value>
</init-param>
<servlet>

But have set it to false and can still enter:
http://localhost:8080/exist/admin/ and get the directory listing?

Can someone please tell me the simplest way to prevent this or what I am
doing wrong with the webdefault.xml config?

Thanks!

Cheers!

Scott Vanya

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Réf. : Configuration: How to change which extension modules are included in the build

2008-10-08T06:07:19Z

Hi,

>How can I change which extension modules are included in the build by>default?
Read what is in extensions/modules/build.properties and act accordingly.
Cheers,
p.b.
-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: Configuration: How to change which extension modules are included in the build

2008-10-08T05:11:48Z

I would like to include some of the modules I use, to be part of my
default build instead of running manually the modules' build and
change conf.xml after I install every code update (created by running
"build installer" )

Thomas

What are the property files I need to change in order

2008/10/8 Dannes Wessels <dizzzz@...>:

> Hi,
>
> On Wed, Oct 8, 2008 at 1:07 PM, Thomas White <thomas.0007@...> wrote:
>> How can I change which extension modules are included in the build by
>> default?
>
> What is your exact question, what is your goal?
>
> It is only possible to leave out the modules in the extensions
> directory by modifying a properties file. The other modules are always
> compiled and jarred into exist.jar. You'll need to edit the build
> files if you want to leave out specific (sets of) classes.
>
> regards
>
> Dannes
>
> --
> eXist-db Native XML Database
> http://exist-db.org
>

--
Thomas White

51 Glebewood
Bracknell
Berks RG12 9SD
Mobile:+44 7711 922 966
Skype: thomaswhite
gTalk: thomas.0007
jaxtr: http://www.jaxtr.com/t.white
Linked-In:http://www.linkedin.com/in/thomaswhite0007

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: Configuration: How to change which extension modules are included in the build

2008-10-08T04:43:18Z

Hi,

On Wed, Oct 8, 2008 at 1:07 PM, Thomas White <thomas.0007@...> wrote:
> How can I change which extension modules are included in the build by
> default?

What is your exact question, what is your goal?

It is only possible to leave out the modules in the extensions
directory by modifying a properties file. The other modules are always
compiled and jarred into exist.jar. You'll need to edit the build
files if you want to leave out specific (sets of) classes.

regards

Dannes

--
eXist-db Native XML Database
http://exist-db.org

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

Configuration: How to change which extension modules are included in the build

2008-10-08T04:07:18Z

Dear all,

How can I change which extension modules are included in the build by
default?

Regards,
Thomas

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open