Preview: eXist-db 1.3.0dev

[Dannes Wessels-2]

All,

A few moments ago I have uploaded a new preview of our current trunk
(snapshot of development code) to http://www.exist-db.nl/files/ . This
release provides some significant changes compared to the 1.2.x
releases. The main solved issue is the "temporary fragment" thingy.

This snapshot contains a few significant performance improvements,
which are also part of the upcoming 1.2.4 release

for more details check the changelog.

As it is bleeding edge stuff, bugs and instabilities can be expected
(the disclaimer :-) ). You can help us to improve the release by
reporting issues (and success stories) on this MailingList.

On behalf of the development team

Dannes Wessels
dizzzz@...
http://exist-db.org

-------------------------------------------------------------------------
Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW!
Studies have shown that voting for your favorite open source project,
along with a healthy diet, reduces your potential for chronic lameness
and boredom. Vote Now at http://www.sourceforge.net/community/cca08
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

[Gary Larsen]

Hi Dannes,

> releases. The main solved issue is the "temporary fragment" thingy.

My understanding is that this fix was also ported back to version 1.2.3.  Is
that correct?

Thanks,
Gary



-------------------------------------------------------------------------
Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW!
Studies have shown that voting for your favorite open source project,
along with a healthy diet, reduces your potential for chronic lameness
and boredom. Vote Now at http://www.sourceforge.net/community/cca08
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

[Wolfgang Meier-2]

>> releases. The main solved issue is the "temporary fragment" thingy.
>
> My understanding is that this fix was also ported back to version 1.2.3.  Is
> that correct?

No, the temporary fragment issues required more than a fix, rather a
redesign. I had to change the way in which the query engine handles
in-memory XML nodes (for more info see:
http://atomic.exist-db.org/blogs/eXist/InMemoryFragments).

Porting those changes back to 1.2.3 would be possible, but still quite a
lot of work. I think we should rather put this work into testing and
stabilizing 1.3.

Wolfgang

-------------------------------------------------------------------------
Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW!
Studies have shown that voting for your favorite open source project,
along with a healthy diet, reduces your potential for chronic lameness
and boredom. Vote Now at http://www.sourceforge.net/community/cca08
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

[Gary Larsen]

Hi,

> No, the temporary fragment issues required more than a fix, rather a
> redesign. I had to change the way in which the query engine handles
> in-memory XML nodes (for more info see:
> http://atomic.exist-db.org/blogs/eXist/InMemoryFragments).

Is this the same as what I saw in the 1.2 changelog, or something different?

7885 by wolfgang_m  at 2008-06-19T15:10:48.345+01:00

[performance] reduce memory consumption of in-memory documents constructed
during a query. If you have a query which constructs thousands of small
temporary XML fragments, each of those fragments will have its own document
context...

In any case, for XQuery performance benchmarking would you recommend I use
the latest snapshot (1.3.0dev)?

Thanks!  Sorry for my confusion.
gary




-------------------------------------------------------------------------
Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW!
Studies have shown that voting for your favorite open source project,
along with a healthy diet, reduces your potential for chronic lameness
and boredom. Vote Now at http://www.sourceforge.net/community/cca08
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

[Gary Larsen]

> Is this the same as what I saw in the 1.2 changelog, or something
> different?
>
> 7885 by wolfgang_m  at 2008-06-19T15:10:48.345+01:00

After reading the changelog for 1.3 I see the there has been additional work
after 7885.

Sorry for the noise.
gary



-------------------------------------------------------------------------
Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW!
Studies have shown that voting for your favorite open source project,
along with a healthy diet, reduces your potential for chronic lameness
and boredom. Vote Now at http://www.sourceforge.net/community/cca08
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

[Wolfgang Meier-2]

> Is this the same as what I saw in the 1.2 changelog, or something different?
>
> 7885 by wolfgang_m  at 2008-06-19T15:10:48.345+01:00
>
> [performance] reduce memory consumption of in-memory documents constructed
> during a query. If you have a query which constructs thousands of small
> temporary XML fragments, each of those fragments will have its own document
> context...

No, that's not the same. The revision above was indeed ported back to
the eXist-stable-1.2 branch. It will be part of 1.2.4 (not 1.2.3). In
the meantime, you can check out the code from the branch, which is the
basis for all 1.2 releases:

http://exist.svn.sourceforge.net/viewvc/exist/branches/eXist-stable-1.2/

> In any case, for XQuery performance benchmarking would you recommend I use
> the latest snapshot (1.3.0dev)?

If you are querying in-memory XML fragments, then you should test with
1.3. Just watch out for log messages like:

02 Jul 2008 21:18:22,649 [main] DEBUG (XQueryContext.java
[storeTemporaryDoc]:2192) - Stored: 174299:
/db/system/temp/08bbc50be05426c6cdf0a7deba8dba03.xml

If you see those, switching to 1.3 will give you performance benefits.

Wolfgang

-------------------------------------------------------------------------
Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW!
Studies have shown that voting for your favorite open source project,
along with a healthy diet, reduces your potential for chronic lameness
and boredom. Vote Now at http://www.sourceforge.net/community/cca08
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open

[Chris Wallace]

We have switched both the test version of our application and the version supporting the XQuery Wikibook

http://en.wikibooks.org/wiki/XQuery

to 1.3dev.  Performance is good and apart from a couple of bugs logged, it is working very well. The fix for temporary document fragments is particularly beneficial for scripts which are transforming and mashing data from other web pages or services, or perform two-pass analysis of data.

We have skipped 1.2 so this version is also fixing problems with function calls in modules. For me, the main work in the changeover has been caused by closer adherence to the XQuery standard, so that some previously implicit type conversions must now be explicit and type checking in function calls is more stringent.

One odd bug logged yesterday is that sessions appear not to be working - everything else can be worked around but that's a bit of a show-stopper.

Chris

[Chris Wallace]

>
> One odd bug logged yesterday is that sessions appear not to be working -
> everything else can be worked around but that's a bit of a show-stopper.
>

Sorry, my bad - here's no problem with eXist, we had problems with mod-rewrite
and cookie re-writing though the firewall. Apologies for the false alert.

Chris



-------------------------------------------------------------------------
Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW!
Studies have shown that voting for your favorite open source project,
along with a healthy diet, reduces your potential for chronic lameness
and boredom. Vote Now at http://www.sourceforge.net/community/cca08
_______________________________________________
Exist-open mailing list
Exist-open@...
https://lists.sourceforge.net/lists/listinfo/exist-open