hadoop file system browser

[Cam Bazz]

hello
is there any utility to browse hadoop fs?
Best Regards,
-C.B.

[Miles Osborne]

hadoop dfs -ls DIR

(etc) allows you to see the file system

Miles

On 21/01/2008, Cam Bazz <cambazz@...> wrote:
>
> hello
> is there any utility to browse hadoop fs?
> Best Regards,
> -C.B.
>

[Cam Bazz]

Hello,
I meant like a gui. I found out this is possible tru the web interface
however.
thanks.

On Jan 21, 2008 3:17 PM, Miles Osborne <miles@...> wrote:

> hadoop dfs -ls DIR
>
> (etc) allows you to see the file system
>
> Miles
>
> On 21/01/2008, Cam Bazz <cambazz@...> wrote:
> >
> > hello
> > is there any utility to browse hadoop fs?
> > Best Regards,
> > -C.B.
> >
>

I posted something like this a while ago. See here.

https://issues.apache.org/jira/browse/HADOOP-2534

Works well for me, read the docs -- you'll need to update JARs (and re-sign
them) if you work with the HEAD.

Dawid

[Johannes Zillmann-3]

Also the dfs should be browsable over web-ui
http://<namenode>:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F

Johannes

Dawid Weiss wrote:

>
> I posted something like this a while ago. See here.
>
> https://issues.apache.org/jira/browse/HADOOP-2534
>
> Works well for me, read the docs -- you'll need to update JARs (and
> re-sign them) if you work with the HEAD.
>
> Dawid
>

--
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
101tec GmbH

Halle (Saale), Saxony-Anhalt, Germany
http://www.101tec.com

[Christophe Taton-4]

The Eclipse plug-in also features a DFS browser.

Johannes Zillmann wrote:

> Also the dfs should be browsable over web-ui
> http://<namenode>:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F
>
>
> Johannes
>
> Dawid Weiss wrote:
>>
>> I posted something like this a while ago. See here.
>>
>> https://issues.apache.org/jira/browse/HADOOP-2534
>>
>> Works well for me, read the docs -- you'll need to update JARs (and
>> re-sign them) if you work with the HEAD.
>>
>> Dawid
>>
>
>

> The Eclipse plug-in also features a DFS browser.

Yep. That's all true, I don't mean to self-promote, because there really isn't
that much to advertise ;) I was just quite attached to file manager-like user
interface; the mucommander clone I posted served me as a browser, but also for
rudimentary file operations (copying to/from, deleting folders etc.). In my
experience it's been quite handy.

It would be probably a good idea to implement a commons-vfs plugin for Hadoop so
that HDFS filesystem is transparent to use for other apps.

Dawid

[Ted Dunning-3]

There has been significant work on building a web-DAV interface for HDFS.  I
haven't heard any news for some time, however.


On 1/21/08 11:32 AM, "Dawid Weiss" <dawid.weiss@...> wrote:

>
>> The Eclipse plug-in also features a DFS browser.
>
> Yep. That's all true, I don't mean to self-promote, because there really isn't
> that much to advertise ;) I was just quite attached to file manager-like user
> interface; the mucommander clone I posted served me as a browser, but also for
> rudimentary file operations (copying to/from, deleting folders etc.). In my
> experience it's been quite handy.
>
> It would be probably a good idea to implement a commons-vfs plugin for Hadoop
> so
> that HDFS filesystem is transparent to use for other apps.
>
> Dawid

[Enis Soztutar]

Webdav interface for hadoop works as it is, but it needs a major
redesign to be scalable, however it is still useful. It has even been
used with windows explorer defining the webdav server as a remote service.

Ted Dunning wrote:

> There has been significant work on building a web-DAV interface for HDFS.  I
> haven't heard any news for some time, however.
>
>
> On 1/21/08 11:32 AM, "Dawid Weiss" <dawid.weiss@...> wrote:
>
>  
>>> The Eclipse plug-in also features a DFS browser.
>>>      
>> Yep. That's all true, I don't mean to self-promote, because there really isn't
>> that much to advertise ;) I was just quite attached to file manager-like user
>> interface; the mucommander clone I posted served me as a browser, but also for
>> rudimentary file operations (copying to/from, deleting folders etc.). In my
>> experience it's been quite handy.
>>
>> It would be probably a good idea to implement a commons-vfs plugin for Hadoop
>> so
>> that HDFS filesystem is transparent to use for other apps.
>>
>> Dawid
>>    
>
>
>