Nabble - Jackrabbit - Users

RE: JackRabbit Caching: BundleCache vs ItemManager vs CacheManager

2008-07-24T04:26:52Z

Hi Stefan et al,

"DefaultISMLocking is used by SISM, i.e. at the bottom layer. SISM maintains
a workspace-global cache of ItemState instances read from the persistence
layer. this cache is not affected by session lifetime since it's shared
among all sessions."

OK that makes sense.
To summarise what we're seeing, potential bottlenecks we think we're seeing
and how we worked around them. Please note I'm not 100% familiar with the
JackRabbit design so some conclusions may be wrong:

1) application uses Session to read a Node Property
2) SessionImpl delegates to ItemManager
3) ItemManager synch on a itemCache (Contention Point 1: Session Wide)
4) On cache miss, ItemManager ultimately delegates to an SISM
5) SISM synchs on ISMLocking (Contention Point 2: Global or per item
depending on DefaultISM or FineGrainedISM implementation)
6) On cache miss, SISM delegates to persistence manager
7) AbstractBundlePersistenceManager synchs on itself (Contention Point 3:
On persistence Manager)

In some cases our web application will read 2,000 or 3,000 Node properties
to deliver a single page request.

Initially we saw 7) as a bottleneck:
- can JackRabbit leverage multiple database connections if its synched on a
single persistence manager?
- we resolved this by configuring a large BundleCache

We then saw 5) as a bottleneck:
- it seems as each node property is an item every property read contends on
ISMLocking. Is that correct? Is there scope for reading properties/lazy
loading in bulk for item?
- we partly resolved this by moving from an "pooled session per view"
pattern to a "shared session per view" pattern

We now see contention occasionally on 3).

It feels like there is scope for improving the concurrency in a few places -
plus consolidate the caching configuration which is currently different for
BundleCache vs SISM etc.

Regards,
Shaun

-----Original Message-----
From: stefan.guggisberg@... [mailto:stefan.guggisberg@...] On
Behalf Of Stefan Guggisberg
Sent: 21 July 2008 11:04
To: users@...
Subject: Re: JackRabbit Caching: BundleCache vs ItemManager vs CacheManager

hi shaun

On Sun, Jul 20, 2008 at 2:13 PM, sbarriba <sbarriba@...> wrote:
> Hi Stefan,
> So the intention is that once the session is no longer used then the
> ItemImpl instances are cleared up?

yes, unless ItemImpl instances are still being externally refertenced
by client code.

> That makes sense except that when
> investigating the lock contention issues we found that the creation of
> ItemImpl can become expensive as they queue up on DefaultISMLocking.

i don't think so. i guess there's a misunderstanding and you're confusing
ItemImpl and ItemState instances.

let me try to clear things up.

ItemImpl (i.e. NodeImpl and PropertyImpl) instances implement the JCR
interfaces javax.jcr.Node and javax.jcr.Property. they're dealt with at
the top-most layer in jackrabbit and they're managed by
o.a.j.core.ItemManager. there's one ItemManager per session.
ItemImpl instance creation per se should never be expensive since they
only encapsulate/wrap an Itemstate instance.

ItemState instances OTOH represent the core 'data' of a node/property.
they're managed on 3 separate layers:
- transient (session local, SessionItemStateManager SISM)
- local (tx local, LocalItemStateManager LISM)
- shared (global, SharedItemStateManager SISM)

DefaultISMLocking is used by SISM, i.e. at the bottom layer.
SISM maintains a workspace-global cache of ItemState instances
read from the persistence layer. this cache is not affected
by session lifetime since it's shared among all sessions.

cheers
stefan

>
> When relying on sessions to cache some item data (with a shared session
per
> request model) via the ItemManager we found that this significantly
reduced
> contention as clients using sessions with some ItemImpls didn't hit
> DefaultISMLocking. By choosing a suitable X request per 1 session ratio we
> could spread the locking to increase throughput.
>
> With a pooled session per view model (where each request exclusively has
> access to one session) we found no benefit from the ItemManger cache due
to

> the Weak Referenced data being cleared up after each request.
>
> Are the LocalItemStateManager and SharedItemStateManager intended to help
> reduce the load on DefaultISMLocking?
>
> Regards,
> Shaun
>
>
>
> -----Original Message-----
> From: stefan.guggisberg@... [mailto:stefan.guggisberg@...] On
> Behalf Of Stefan Guggisberg
> Sent: 16 July 2008 13:25
> To: users@...
> Subject: Re: JackRabbit Caching: BundleCache vs ItemManager vs

CacheManager
>
> hi sean
>
> On Tue, Jul 1, 2008 at 7:11 PM, sbarriba <sbarriba@...> wrote:
>> Hi Marcel et al,
>> 3 suggestions come to mind from this (perhaps for the develop list):
>>
>> 1) the ItemManager should be using Soft References rather than Weak
>> References otherwise a PooledSessionInView pattern is not really
effective

>> as, pooled (but unused) sessions have their caches cleared immediately by
>> the GC (using weak references).
>
> ItemManager cashes ItemImpl instances. the 'cache' guarantees that there's
> no more than 1 ItemImpl instance per item id and session. weak references
> are ideal for this task. ItemManager is not meant to be a 'cache'
> since ItemImpl
> instance creation is IMO not performance critical. i remember that i once
> experimented with soft references but they tended to fill the heap pretty
> fast
> since soft references are typically cleared only when you're near an
> OOM error...
>
> ItemState caches are a different matter. LocalItemStateManager and
> SharedItemStateManager do cache ItemState instances for performance
> reasons. please take a look at the javadoc which should explain
> why they're using weak references internally instead of soft references:
>
>

http://jackrabbit.apache.org/api/1.4/org/apache/jackrabbit/core/state/ItemSt

> ateReferenceCache.html
>
> cheers
> stefan
>
>>
>> 2) the CacheManager config needs to be externalised so it can be changed
>> within the XML config, not programmatically.
>>
>> 3) its worth considering using a caching library (e.g. ehcahe) for the
>> BundleCache at least? As a case study we've got multi-GB of binaries in
>> BLOBs in the database and the BundleCache (at 100MB+) spends 2 hours
> after
>> each restart filling /tmp. It would be great to use a caching library
> which
>> supported a persistent cache etc. Obviously externalBlobs helps here.
>>
>> Regards,
>> Shaun
>>
>> -----Original Message-----
>> From: Marcel Reutegger [mailto:marcel.reutegger@...]
>> Sent: 01 July 2008 09:47
>> To: users@...
>> Subject: Re: JackRabbit Caching: BundleCache vs ItemManager vs
> CacheManager
>>
>> Hi,
>>
>> sbarriba wrote:
>>> .. PersistenceManager Cache:
>>>
>>> o The "bundleCacheSize" determines how many nodes the
> PersistenceManager
>>> will cache. As this determines the lifetime of the references to the
>>> temporary BLOB cache if its not large enough BLOBs will be continually
>> read
>>> from the database (if using externalBlobs=false).
>>>
>>> o Configurable in <PersistenceManager> XML block
>>>
>>> o Default size 8MB
>>>
>>> o This cache is shared by all sessions.
>>>
>>> o Synchronised access using the ISMLocking stategy e.g. Default or
>>> FineGrained
>>
>> correct, but there's additional synchronization in the persistence

manager

>> using
>> conventional synchronized methods. e.g. see
>> AbstractBundlePersistenceManager.load(NodeId)
>>
>>> .. Session ItemManager Cache:
>>>
>>> o Items are cached from the underlying persistence manager on a per
>>> session basis.
>>>
>>> o Limit cannot be set.
>>
>> not sure, but I think this cache is also managed (at least partially) by
> the
>>
>> CacheManager.
>>
>>> o Uses a ReferenceMap which can be emptied by the JVM GC as required
>>
>> that's the 'other part' that manages the cache ;)
>>
>> items that are still referenced in the application will force the
> reference
>> map
>> to keep the respective ItemState instances (using weak references).
>>
>>> o Synchronised access using the itemCache object
>>>
>>> .. CacheManager Cache:
>>>
>>> o Limit can only be set programmatically via the Workspace

cacheManager

>>>
>>> o http://wiki.apache.org/jackrabbit/CacheManager
>>>
>>> o Defaults to 16MB
>>>
>>> o Its not clear as yet how the CacheManager relates, if at all, to the
>>> ItemManager cache
>>
>> this only happens indirectly. see above.
>>
>>> 2 questions:
>>>
>>> .. What is the purpose of the CacheManager and which caches does
> it
>>> actually control?
>>
>> It controls *all* the caches that contain ItemState instances.
>>
>>> .. For example, for a workspace with 100,000 nodes what is an
>>> appropriate setting for the Cache Manager?
>>
>> I guess that depends on your JVM heap settings and the usage pattern. if
> you
>>
>> have a lot of random reads over nearly all 100k nodes and performance is
>> critical you may consider caching all of them. have a look a
>> ItemState.calculateMemoryFootprint() for a formula on how the memory
>> consumption
>> is calculated.
>>
>> regards
>> marcel
>>
>>
>>
>
>
>

Re: what does NodeTypeRegistry.reregisterNodeType() do?

2008-07-24T02:21:30Z

hi betty

On Thu, Jul 24, 2008 at 1:22 AM, Betty Chang <bchang@...> wrote:

> Hi -
>
> I've been able to add custom node types within the jackrabbit server app.
>
> However, is it possible to add new properties to a node type that is already registered?
>
> I first call isRegistered() to see if a nodeTypeName is registered, and if it is, I call
> reregisterNodeType() in the hopes that it would re-register the node type with the new properties I have
> added.
>
> However, new properties do not seem to get registered.

you can only register 'trivial' node type changes, i.e. changes that
do not affect existing content.

a trivial change would e.g. be adding a non-mandatory property.

a non-trivial (and thus non-supported change) would e.g. be adding a
mandatory property
or adding a value constraint to an existing property definition.

what exactly are you trying to change?

>
> What does reregisterNodeType() actually do?

reregisterNodeType() allows to modify the definition of
an existing, already registered node type. only trivial
changes are currently supported.

for more details see:
http://jackrabbit.apache.org/api-1/org/apache/jackrabbit/core/nodetype/NodeTypeDefDiff.html
http://issues.apache.org/jira/browse/JCR-322.

cheers
stefan

>
> Betty
>
>

Re: Need hint to run jsp from repository on tomcat

2008-07-24T02:15:35Z

On 24 Jul 2008, at 19:09, Aleksei Lukin wrote:

> Could please anyone point me to docs or code or tell some hints how
> to do that?

This is quite hard. I'd recommend using a framework that allows this,
eg sling. These frameworks work by calling the jsp compiler directly,
not by using the servlet containers built in mechanisms.

Alternatively, if you can use something like freemarker or velocity
instead of JSPs this would be quite easy to do.

--
Torgeir Veimo
torgeir@...

Need hint to run jsp from repository on tomcat

2008-07-24T02:09:49Z

Hi, All!

I need to save jsp pages in JackRabbit repository and then feed it to tomcat 6 to process.
I use model 2 deploymet, my tomcat loads repository available for all applications deployed.

Could please anyone point me to docs or code or tell some hints how to do that?

Tnks.
--
SY, Alex Lukin
RIPE NIC HDL: LEXA1-RIPE

Re: JackRabbit Caching: BundleCache vs ItemManager vs CacheManager

2008-07-24T01:32:56Z

On Wed, Jul 23, 2008 at 11:21 PM, Thomas Müller <thomas.mueller@...> wrote:
> Hi,
>
>>> So the intention is that once the session is no longer used then the
>>> ItemImpl instances are cleared up?
>
> Unfortunately sessions are kept in a list currently, so you need to
> close them manually. See also

what list are you refering to?

the only place i know where active sessions are kept is in
RepositoryImpl:

/**
* active sessions (weak references)
*/
private final ReferenceMap activeSessions =
new ReferenceMap(ReferenceMap.WEAK, ReferenceMap.WEAK);

cheers
stefan

> https://issues.apache.org/jira/browse/JCR-1216 "Unreferenced sessions
> should get garbage collected".
>
> Regards,
> Thomas
>

RE: search speed

2008-07-23T19:31:05Z

Hi Ard Schrijvers-3,

I tried your way ,query speed the four seconds faster than before.
However, full-text search, retrieve version information
the full-text search Statements:
//*[@jcr:uuid='a2e5266f-9f2f-4683-993f-b73f34ba94a7' or @jcr:uuid='5fbc094f-e6c6-48b3-908349fe18a27c4a']//element(*,nt:base)[jcr:contains(.,'superman OR *superman*') and @stateCode=1 and @directory=false()] order by @lastModified ascending

Ard Schrijvers-3 wrote:

Hello gongtao,

I do not get this sentence 'Why the increase as the result set, for
speed will slow ? ' though you might want to take a look at [1]

A little strange perhapes, but if you replace

'//nko:workspace/*' with //* (you are testing for a uuid anyway) you
might gain a lot of speed. Hierarchy information in a query is costly,
certainly for the first hit. So also, your performance numbers do nto
tell me very much, because there is a huge difference between first run
queries and consecutive queries where caches, and then mainly the
hierchical caches, are warmed up.

Anyway, if you read [1] you should be able to understand a lot more
about the queries you are doing,

-Ard

[1]
http://www.nabble.com/Explanation-and-solutions-of-some-Jackrabbit-queri
es-regarding-performance-td15028655.html

>
>
> there are 300,000 records in the repository.
>
> Why the increase as the result set, for speed will slow ? I
> set up to offset
> 15 limit 100
>
> Statements:
> //nko:workspace/*[@jcr:uuid='a2e5266f-9f2f-4683-993f-b73f34ba9
4a7' or @jcr:uuid='5fbc094f->
e6c6-48b3-9083-49fe18a27c4a']//element(*,nt:unstructured)[@tem
> plateName='4137345d-3acd-4fc6-befe-6367a3c8f842'
> and @stateCode=1 and @directory=false()] order by @name ascending
>
> results:30,000 time:5703ms
> results:300,000 time:30406ms
>
>
>
> Full Text Search more slowly
> Statements:
> /jcr:root/nko:root/nko:workspace/*[@jcr:uuid='a2e5266f-9f2f-46
83-993f-b73f34ba94a7'
> or
> @jcr:uuid='5fbc094f-e6c6-48b3-9083-49fe18a27c4a']//element(*,n
t:base)[jcr:contains(.,'superman
> OR *superman*') and @stateCode=1 and @directory=false()]
> order by @lastModified ascending
>
> results:30,000 time:14360ms
> --
> View this message in context:
> http://www.nabble.com/search-speed-tp18583171p18583171.html
> Sent from the Jackrabbit - Users mailing list archive at Nabble.com.
>
>

what does NodeTypeRegistry.reregisterNodeType() do?

2008-07-23T16:22:33Z

Hi -

I've been able to add custom node types within the jackrabbit server app.

However, is it possible to add new properties to a node type that is already registered?

I first call isRegistered() to see if a nodeTypeName is registered, and if it is, I call
reregisterNodeType() in the hopes that it would re-register the node type with the new properties I have
added.

However, new properties do not seem to get registered.

What does reregisterNodeType() actually do?

Betty

Re: JackRabbit Caching: BundleCache vs ItemManager vs CacheManager

2008-07-23T14:21:48Z

Hi,

>> So the intention is that once the session is no longer used then the
>> ItemImpl instances are cleared up?

Unfortunately sessions are kept in a list currently, so you need to
close them manually. See also
https://issues.apache.org/jira/browse/JCR-1216 "Unreferenced sessions
should get garbage collected".

Regards,
Thomas

JBoss, RAR and Deploy Model 1

2008-07-23T13:45:45Z

Do I need the jackrabbit-jca.rar in JBoss if I use the Deploy Model 1 ?

Re: Inheritance does not work

2008-07-23T12:47:16Z

Could you post the code snippets you use to "get the property"?

Regards,
Alex

On Wed, Jul 23, 2008 at 6:52 PM, Danilo Rosetto Muñoz
<munozdanilo@...> wrote:

> Hi!
>
> I'm having problems using jackrabbit + inheritance.
>
> For sample, I have the following CND file:
> <nt = 'http://www.jcp.org/jcr/nt/1.0'>
> <mix = 'http://www.jcp.org/jcr/mix/1.0'>
> <tst = 'http://mycompany.com/jcr/2008/tst'>
> [tst:superType] > nt:hierarchyNode, mix:referenceable
> - tst:someFile (binary)
>
> [tst:person] > tst:superType
> - tst:someText (string) mandatory
>
> So, when I try to get the property "tst:someFile", it doesn't work. If I try
> to evaluate the node using debug I can't see this property.
>
> Thank you.
>
> Danilo Rosetto Muñoz
> http://munozdanilo.googlepages.com
>

--
Alexander Klimetschek
alexander.klimetschek@...

Re: paths

2008-07-23T12:39:30Z

That should be correct. I wrote mine the way I did so I know which node is
the first node it *doesn't* have, since I don't believe there is a way to
create 'nested' nodes (say dir2 as missing, you couldn't call
root.addNode('dir1/dir2')) at least I dont think you can! :)

On Wed, Jul 23, 2008 at 3:29 PM, Michael Harris <michael.e.harris@...>
wrote:

> So if I have
>
> path = "dir1/dir2";
> rootNode.hasPath(dir);
>
> the method returns true if and only if off root there exists a node named
> dir1, and off dir1 there exists a node named dir2.
>
>
> On Wed, Jul 23, 2008 at 3:25 PM, Michael Harris <
> michael.e.harris@...>
> wrote:
>
> > Ah, missed that.
> >
> > thanx.
> >
> >
> > On Wed, Jul 23, 2008 at 3:21 PM, Alexander Klimetschek <aklimets@...
> >
> > wrote:
> >
> >> On Wed, Jul 23, 2008 at 9:14 PM, Michael Harris
> >> <michael.e.harris@...> wrote:
> >> > Can someone confirm or deny the following: That when a programmer
> users
> >> >
> >> > getNode(somePath);
> >> >
> >> > that path has to exist or an exception is thrown. If I want
> >> functionality
> >> > that gets or creates if the path doesn't exist I have to implement it
> >> > myself?
> >>
> >> Yes. You can use Session.getRootNode().hasNode(somePath) to check for
> >> the existence of a node.
> >>
> >> Regards,
> >> Alex
> >>
> >> --
> >> Alexander Klimetschek
> >> alexander.klimetschek@...
> >>
> >
> >
> >
> > --
> > ---------------------
> > Michael Harris
> >
>
>
>
> --
> ---------------------
> Michael Harris
>

Re: paths

2008-07-23T12:30:42Z

Nick

Im in the process of writing that method now... ;)

On Wed, Jul 23, 2008 at 3:24 PM, Nick Stuart <nstuart@...>
wrote:

> Hi Mike, I believe that is true, and I use the hasNode function to do the
> functionality you want, and its actually a PathNotFoundException that gets
> thrown. I use something like this to check for full paths and create them
> if
> needed:
>
> private Node createFolders(Node parent, String[] folders, int startIndex)
> throws Exception {
> checkLocked(parent);
> for (; startIndex < folders.length; startIndex++) {
> String folderName = folders[startIndex];
> parent = parent.addNode(folderName, FOLDER_TYPE);
> }
> return parent;
> }
>
> private Node getFolderNodeForPath(String folderPath, Node objectNode)
> throws Exception {
> String[] folders = folderPath.split("/");
> Node folderNode = objectNode;
> for (int i = 0; i < folders.length; i++) {
> String folderName = folders[i];
> if (StringUtils.isEmpty(folderName)) {
> break;
> }
> if (folderNode.hasNode(folderName)) {
> folderNode = folderNode.getNode(folderName);
> } else {
> folderNode = createFolders(folderNode, folders, i);
> break;
> }
> }
>
> return folderNode;
> }
>
>
>
> On Wed, Jul 23, 2008 at 3:14 PM, Michael Harris <
> michael.e.harris@...>
> wrote:
>
> > Hello
> >
> > Can someone confirm or deny the following: That when a programmer users
> >
> > getNode(somePath);
> >
> > that path has to exist or an exception is thrown. If I want
> functionality
> > that gets or creates if the path doesn't exist I have to implement it
> > myself?
> >
> > thanx
> >
> > --
> > ---------------------
> > Michael Harris
> >
>

--
---------------------
Michael Harris

Re: paths

2008-07-23T12:29:48Z

So if I have

path = "dir1/dir2";
rootNode.hasPath(dir);

the method returns true if and only if off root there exists a node named
dir1, and off dir1 there exists a node named dir2.

On Wed, Jul 23, 2008 at 3:25 PM, Michael Harris <michael.e.harris@...>
wrote:

> Ah, missed that.
>
> thanx.
>
>
> On Wed, Jul 23, 2008 at 3:21 PM, Alexander Klimetschek <aklimets@...>
> wrote:
>
>> On Wed, Jul 23, 2008 at 9:14 PM, Michael Harris
>> <michael.e.harris@...> wrote:
>> > Can someone confirm or deny the following: That when a programmer users
>> >
>> > getNode(somePath);
>> >
>> > that path has to exist or an exception is thrown. If I want
>> functionality
>> > that gets or creates if the path doesn't exist I have to implement it
>> > myself?
>>
>> Yes. You can use Session.getRootNode().hasNode(somePath) to check for
>> the existence of a node.
>>
>> Regards,
>> Alex
>>
>> --
>> Alexander Klimetschek
>> alexander.klimetschek@...
>>
>
>
>
> --
> ---------------------
> Michael Harris
>

--
---------------------
Michael Harris

Re: paths

2008-07-23T12:25:33Z

Ah, missed that.

thanx.

On Wed, Jul 23, 2008 at 3:21 PM, Alexander Klimetschek <aklimets@...>
wrote:

> On Wed, Jul 23, 2008 at 9:14 PM, Michael Harris
> <michael.e.harris@...> wrote:
> > Can someone confirm or deny the following: That when a programmer users
> >
> > getNode(somePath);
> >
> > that path has to exist or an exception is thrown. If I want
> functionality
> > that gets or creates if the path doesn't exist I have to implement it
> > myself?
>
> Yes. You can use Session.getRootNode().hasNode(somePath) to check for
> the existence of a node.
>
> Regards,
> Alex
>
> --
> Alexander Klimetschek
> alexander.klimetschek@...
>

--
---------------------
Michael Harris

Re: paths

2008-07-23T12:24:48Z

Hi Mike, I believe that is true, and I use the hasNode function to do the
functionality you want, and its actually a PathNotFoundException that gets
thrown. I use something like this to check for full paths and create them if
needed:

private Node createFolders(Node parent, String[] folders, int startIndex)
throws Exception {
checkLocked(parent);
for (; startIndex < folders.length; startIndex++) {
String folderName = folders[startIndex];
parent = parent.addNode(folderName, FOLDER_TYPE);
}
return parent;
}

private Node getFolderNodeForPath(String folderPath, Node objectNode)
throws Exception {
String[] folders = folderPath.split("/");
Node folderNode = objectNode;
for (int i = 0; i < folders.length; i++) {
String folderName = folders[i];
if (StringUtils.isEmpty(folderName)) {
break;
}
if (folderNode.hasNode(folderName)) {
folderNode = folderNode.getNode(folderName);
} else {
folderNode = createFolders(folderNode, folders, i);
break;
}
}

return folderNode;
}

On Wed, Jul 23, 2008 at 3:14 PM, Michael Harris <michael.e.harris@...>
wrote:

> Hello
>
> Can someone confirm or deny the following: That when a programmer users
>
> getNode(somePath);
>
> that path has to exist or an exception is thrown. If I want functionality
> that gets or creates if the path doesn't exist I have to implement it
> myself?
>
> thanx
>
> --
> ---------------------
> Michael Harris
>

Re: paths

2008-07-23T12:21:54Z

On Wed, Jul 23, 2008 at 9:14 PM, Michael Harris
<michael.e.harris@...> wrote:
> Can someone confirm or deny the following: That when a programmer users
>
> getNode(somePath);
>
> that path has to exist or an exception is thrown. If I want functionality
> that gets or creates if the path doesn't exist I have to implement it
> myself?

Yes. You can use Session.getRootNode().hasNode(somePath) to check for
the existence of a node.

Regards,
Alex

--
Alexander Klimetschek
alexander.klimetschek@...

paths

2008-07-23T12:14:04Z

Hello

Can someone confirm or deny the following: That when a programmer users

getNode(somePath);

that path has to exist or an exception is thrown. If I want functionality
that gets or creates if the path doesn't exist I have to implement it
myself?

thanx

--
---------------------
Michael Harris

Deploy model on JBoss (Wiki)

2008-07-23T11:24:03Z

Anyone knows if the steps in
http://wiki.apache.org/jackrabbit/JackrabbitOnJBoss are related to Deploy
Model 1, 2 or 3?

Inheritance does not work

2008-07-23T09:52:59Z

Hi!

I'm having problems using jackrabbit + inheritance.

For sample, I have the following CND file:
<nt = 'http://www.jcp.org/jcr/nt/1.0'>
<mix = 'http://www.jcp.org/jcr/mix/1.0'>
<tst = 'http://mycompany.com/jcr/2008/tst'>
[tst:superType] > nt:hierarchyNode, mix:referenceable
- tst:someFile (binary)

[tst:person] > tst:superType
- tst:someText (string) mandatory

So, when I try to get the property "tst:someFile", it doesn't work. If I try
to evaluate the node using debug I can't see this property.

Thank you.

Danilo Rosetto Muñoz
http://munozdanilo.googlepages.com

Re: saving files

2008-07-23T08:31:46Z

Hmm, wouldn't think the parent node type would have any effect on the
subnodes at all, but I do put all my files in folder nodes so never had this
case. A bit strange, but there might be a valid reason for it. *shrug*

On Wed, Jul 23, 2008 at 11:29 AM, Michael Harris <michael.e.harris@...>
wrote:

> yep
>
> On Wed, Jul 23, 2008 at 11:27 AM, Michael Harris <
> michael.e.harris@...>
> wrote:
>
> > Im using a TransientRepository.
> >
> > I wonder if its because Im putting the nt:file in the root node and not
> in
> > a node of type folder.
> >
> >
> > On Wed, Jul 23, 2008 at 11:22 AM, Nick Stuart <
> nstuart@...>
> > wrote:
> >
> >> Hm, that is odd. Are you using a file DataStore or is everything being
> >> saved
> >> in the database?
> >>
> >> I have a simple DataStore element in my repo config like this:
> >> <DataStore class="org.apache.jackrabbit.core.data.FileDataStore">
> >> <param name="path" value="${rep.home}/repository/datastore"/>
> >> <param name="minRecordLength" value="100"/>
> >> </DataStore>
> >>
> >> (syntax might be different for 1.4, cant remember)
> >>
> >> Again, this shouldn't matter as it worked before when saving to
> database.
> >> The other thing to look at if you do have a file DataStore is the
> >> directory
> >> itself. It should have some folders and files in there, all with weird
> >> names, but you should be able to find what you added to the repo. And
> >> changing it to the FileDataStore lets you test this out too, where I'm
> not
> >> quite sure where to look if things are in the DB.
> >>
> >> On Wed, Jul 23, 2008 at 11:05 AM, Michael Harris <
> >> michael.e.harris@...>
> >> wrote:
> >>
> >> > yeah tried that and no dice. wierd eh. I confirmed that the testFile
> >> has
> >> > content in it....
> >> >
> >> > On Wed, Jul 23, 2008 at 11:01 AM, Nick Stuart <
> >> nstuart@...
> >> > >
> >> > wrote:
> >> >
> >> > > Well the only thats really different between that and my code is
> >> setting
> >> > > mimeType and encoding to empty. I don't touch the encoding at all,
> and
> >> > > always set the mimeType to something even if it is just text/plain.
> >> Other
> >> > > then that it looks about the same. Try hardcoding at least mimeType
> to
> >> > > 'text/plain' and remove the encoding bit and see if you get better
> >> > results.
> >> > > That may be screwing up the retrieval bit, not sure why it would
> >> though.
> >> > >
> >> > > -Nick
> >> > >
> >> > > On Wed, Jul 23, 2008 at 10:56 AM, Michael Harris <
> >> > > michael.e.harris@...>
> >> > > wrote:
> >> > >
> >> > > > yeah man I tried writing the retrieved stream to a file, it is
> >> empty.
> >> > > The
> >> > > > file that I save definitely has content (confirmed by less).
> >> > > >
> >> > > > Perhaps you can take a look see (the code isn't complicated);
> having
> >> > more
> >> > > > experience than me you could identify obvious problems pretty
> >> quickly.
> >> > > >
> >> > > > here is the save code
> >> > > >
> >> > > > public void saveFile(File file, Session session) throws
> Exception
> >> {
> >> > > > // create the file node - see section 6.7.22.6 of the spec
> >> > > >
> >> > > > Node folderNode = session.getRootNode();
> >> > > > Node fileNode = folderNode.addNode(file.getName(),
> >> "nt:file");
> >> > > >
> >> > > > // create the mandatory child node - jcr:content
> >> > > > Node resNode = fileNode.addNode("jcr:content",
> >> "nt:resource");
> >> > > > resNode.setProperty("jcr:mimeType", "");
> >> > > > resNode.setProperty("jcr:encoding", "");
> >> > > > FileInputStream fileInputStream = new
> FileInputStream(file);
> >> > > > resNode.setProperty("jcr:data", fileInputStream);
> >> > > > Calendar lastModified = Calendar.getInstance();
> >> > > > lastModified.setTimeInMillis(file.lastModified());
> >> > > > resNode.setProperty("jcr:lastModified", lastModified);
> >> > > >
> >> > > > session.save();
> >> > > > }
> >> > > >
> >> > > > and here is the test code
> >> > > >
> >> > > > protected void setUp() throws Exception {
> >> > > > super.setUp();
> >> > > > String testFileName = "/tmp/" + getName() + ".txt";
> >> > > > FileWriter fw = new FileWriter(testFileName);
> >> > > > fw.write("some content");
> >> > > > fw.flush();
> >> > > > testFile = new File(testFileName);
> >> > > > }
> >> > > >
> >> > > >
> >> > > > public void testSaveFile() throws Exception {
> >> > > > Session session = getSession();
> >> > > > dao.saveFile(testFile, session);
> >> > > >
> >> > > > Node root = session.getRootNode();
> >> > > > Node fileNode = root.getNode(testFile.getName());
> >> > > > Node fileDetails = fileNode.getNode("jcr:content");
> >> > > >
> >> > > > Property fileProp = fileDetails.getProperty("jcr:data");
> >> > > > InputStream retrievedStream = fileProp.getStream();
> >> > > >
> >> > > > FileOutputStream fos = new
> >> > > > FileOutputStream("/tmp/retrievedFile.txt");
> >> > > > byte[] buf = new byte[256];
> >> > > > int read = 0;
> >> > > > while ((read = retrievedStream.read(buf)) > 0) {
> >> > > > fos.write(buf, 0, read);
> >> > > > fos.flush();
> >> > > > }
> >> > > >
> >> > > >
> >> > > > }
> >> > > >
> >> > > > On Wed, Jul 23, 2008 at 10:38 AM, Nick Stuart <
> >> > > nstuart@...
> >> > > > >
> >> > > > wrote:
> >> > > >
> >> > > > > I know that works as I've used it extensively. I am on a 1.5
> >> build,
> >> > but
> >> > > > it
> >> > > > > was working with the 1.4.x build I started with. Have you looked
> >> at
> >> > the
> >> > > > > stream going in to make sure something is actually being saved?
> >> You
> >> > > > > obviously have the node and property there or otherwise you
> would
> >> be
> >> > > > > getting
> >> > > > > a RepositoryException.
> >> > > > >
> >> > > > > I would check to make sure you are saving everything you think
> you
> >> > are.
> >> > > > > Also, try just using the stream and ignore the debugger (it
> might
> >> be
> >> > > > lying
> >> > > > > to you, who knows). But it looks like everything is in order.
> >> > > > >
> >> > > > > On Wed, Jul 23, 2008 at 10:35 AM, Michael Harris <
> >> > > > > michael.e.harris@...>
> >> > > > > wrote:
> >> > > > >
> >> > > > > > Nick
> >> > > > > >
> >> > > > > > thanx for the reply. when I do that and inspect the returned
> >> > stream
> >> > > in
> >> > > > > the
> >> > > > > > eclipse debugger there is nothing in it.
> >> > > > > >
> >> > > > > > michael.
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > > On Wed, Jul 23, 2008 at 10:22 AM, Nick Stuart <
> >> > > > > nstuart@...
> >> > > > > > >
> >> > > > > > wrote:
> >> > > > > >
> >> > > > > > > All you can really do is retrieve the InputStream for said
> >> file.
> >> > > > Which
> >> > > > > > > should be enough, and the nodes hold the rest of the info if
> >> you
> >> > > need
> >> > > > > it
> >> > > > > > > obviously (file name, type, etc).
> >> > > > > > >
> >> > > > > > > Something like:
> >> > > > > > >
> >> > > > > > > Node resNode = fileNode.getNode("jcr:content");
> >> > > > > > > resNode.getProperty("jcr:data").getStream();
> >> > > > > > >
> >> > > > > > > Where fileNode is the jcr:file node type. You wont be able
> to
> >> > > > actually
> >> > > > > > get
> >> > > > > > > a
> >> > > > > > > File object becuase thats part of JCR, that it extracts that
> >> > stuff
> >> > > > away
> >> > > > > > > from
> >> > > > > > > you, and you just deal with the contents and info.
> >> > > > > > >
> >> > > > > > > -Nick
> >> > > > > > >
> >> > > > > > > On Wed, Jul 23, 2008 at 10:16 AM, Michael Harris <
> >> > > > > > > michael.e.harris@...>
> >> > > > > > > wrote:
> >> > > > > > >
> >> > > > > > > > ladies and gentlemen
> >> > > > > > > >
> >> > > > > > > > its still not obvious to me how to retrieve the saved
> file.
> >> > Can
> >> > > > > > someone
> >> > > > > > > > please illuminate the situation?
> >> > > > > > > >
> >> > > > > > > > thanx in advance.
> >> > > > > > > >
> >> > > > > > > > On Tue, Jul 22, 2008 at 3:05 PM, Michael Harris <
> >> > > > > > > > michael.e.harris@...>
> >> > > > > > > > wrote:
> >> > > > > > > >
> >> > > > > > > > > comments inline below. Thank you for the response.
> >> > > > > > > > >
> >> > > > > > > > > On Tue, Jul 22, 2008 at 2:20 PM, Julian Reschke <
> >> > > > > > julian.reschke@...
> >> > > > > > > >
> >> > > > > > > > > wrote:
> >> > > > > > > > >
> >> > > > > > > > >> Michael Harris wrote:
> >> > > > > > > > >>
> >> > > > > > > > >>> hey all,
> >> > > > > > > > >>>
> >> > > > > > > > >>> more newb questions here.
> >> > > > > > > > >>> Want to save a file in the repository. found this on
> >> the
> >> > > wiki
> >> > > > > > > > >>>
> >> > > > > > > > >>> Node folderNode = session.getRootNode();
> >> > > > > > > > >>> Node fileNode =
> >> folderNode.addNode(file.getName(),
> >> > > > > > "nt:file");
> >> > > > > > > > >>>
> >> > > > > > > > >>> // create the mandatory child node -
> jcr:content
> >> > > > > > > > >>> Node resNode = fileNode.addNode("jcr:content",
> >> > > > > > "nt:resource");
> >> > > > > > > > >>> resNode.setProperty("jcr:mimeType", "");
> >> > > > > > > > >>> resNode.setProperty("jcr:encoding", "");
> >> > > > > > > > >>>
> >> > > > > > > > >> > ...
> >> > > > > > > > >>
> >> > > > > > > > >> That is very bad advice. If you don't know mimeType or
> >> > > encoding,
> >> > > > > do
> >> > > > > > > not
> >> > > > > > > > >> set it.
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > >> Where did you find that?
> >> > > > > > > > >>
> >> > > > > > > > >
> >> > > > > > > > > I got the code from the wiki. It had the mimetype and
> the
> >> > > > encoding
> >> > > > > > > type.
> >> > > > > > > > > I modified the code and just put empty strings in for
> now.
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > >>
> >> > > > > > > > >> resNode.setProperty("jcr:data", new
> >> > > > > FileInputStream(file));
> >> > > > > > > > >>> Calendar lastModified = Calendar.getInstance();
> >> > > > > > > > >>>
> >> lastModified.setTimeInMillis(file.lastModified());
> >> > > > > > > > >>> resNode.setProperty("jcr:lastModified",
> >> > lastModified);
> >> > > > > > > > >>>
> >> > > > > > > > >>> Is the file itself being put in the repository
> >> (jcr.data)
> >> > or
> >> > > > just
> >> > > > > > the
> >> > > > > > > > >>> content?
> >> > > > > > > > >>>
> >> > > > > > > > >>
> >> > > > > > > > >> The contents.
> >> > > > > > > > >>
> >> > > > > > > > >> Do I even need the resNode? Can I just save the file
> >> into
> >> > > the
> >> > > > > > > > fileNode?
> >> > > > > > > > >>>
> >> > > > > > > > >>
> >> > > > > > > > >> Not unless you use a different node type.
> >> > > > > > > > >>
> >> > > > > > > > >
> >> > > > > > > > > So does it mean anything to say "Can I save the file
> >> itself?"
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > > so the above code I put into a DAO method saveFile(File,
> >> > > > Session).
> >> > > > > > In
> >> > > > > > > > the
> >> > > > > > > > > test for that method, i have
> >> > > > > > > > >
> >> > > > > > > > > Node root = session.getRootNode();
> >> > > > > > > > > // testFile is the file in the Dao
> >> > > > > > > > > Node fileNode =
> root.getNode(testFile.getName());
> >> > > > > > > > > Node fileDetails =
> >> fileNode.getNode("jcr:content");
> >> > > > > > > > >
> >> > > > > > > > > Property fileProp =
> >> > > fileDetails.getProperty("jcr:data");
> >> > > > > > > > >
> >> > > > > > > > > I am trying to get at the file contents, which is just a
> >> > string
> >> > > > > "some
> >> > > > > > > > > content".
> >> > > > > > > > >
> >> > > > > > > > > on the property retrieved I dont see the file content
> (Im
> >> in
> >> > > > > > eclipse's
> >> > > > > > > > > debugger). How do I retrieve the file. What would a
> >> > > > > > > > > loadFile(Session, filename) method look like?
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > >> Finally, we are going to need to lock the file (which
> is
> >> > why
> >> > > we
> >> > > > > are
> >> > > > > > > > using
> >> > > > > > > > >>> jcr). Is it possible to attach info (like who owns
> the
> >> > lock)
> >> > > > to
> >> > > > > > the
> >> > > > > > > > >>> locked
> >> > > > > > > > >>> file?
> >> > > > > > > > >>>
> >> > > > > > > > >>
> >> > > > > > > > >> To some extent, that's part of the JCR locking model
> (it
> >> > > > remembers
> >> > > > > > who
> >> > > > > > > > >> owns the lock, and exposes the information both in the
> >> API
> >> > and
> >> > > > on
> >> > > > > > > > properties
> >> > > > > > > > >> defined in mix:lockable).
> >> > > > > > > > >>
> >> > > > > > > > >> Thanx. This community has been quite helpful.
> >> > > > > > > > >>>
> >> > > > > > > > >>
> >> > > > > > > > >> BR, Julian
> >> > > > > > > > >>
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > > --
> >> > > > > > > > > ---------------------
> >> > > > > > > > > Michael Harris
> >> > > > > > > > >
> >> > > > > > > >
> >> > > > > > > >
> >> > > > > > > >
> >> > > > > > > > --
> >> > > > > > > > ---------------------
> >> > > > > > > > Michael Harris
> >> > > > > > > >
> >> > > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > > --
> >> > > > > > ---------------------
> >> > > > > > Michael Harris
> >> > > > > >
> >> > > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > > --
> >> > > > ---------------------
> >> > > > Michael Harris
> >> > > >
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > ---------------------
> >> > Michael Harris
> >> >
> >>
> >
> >
> >
> > --
> > ---------------------
> > Michael Harris
> >
>
>
>
> --
> ---------------------
> Michael Harris
>