Nabble - MDB Tools - Dev

Re: Java version of mdblib

2008-12-09T00:07:07Z

Hi Calvin,

Thanks for your response. I understand the strategy you chose to implement the Java version of mdbtools. Also thanks for the pointer
to Jackcess, a project I somehow overlooked when I was searching for mdb libraries. I am currently testing both Jackcess and mdbtools-java.

Best regards,

Jan.

2008/12/5 Calvin Smith <calvinrsmith@...>

I wrote the current Java port and it worked well, if a little dated since I have not followed the changes.
This Java port is in the CVS repository for your use, although the website does not mention it.
My approach was to convert the C code to Java code thus making the Java port 100% pure Java and runnable on any platform Java supports. I also added a very small JDBC driver so you can use it for basic functions without needing to know anything about mdbtools itslef.
It should not take much effort to get it going with the latest release. Contact me off-list if you would like to contract me to do this.
Another project you could look at is: jackcess.sourceforge.net

Calvin

Date: Fri, 5 Dec 2008 10:20:15 +0100
From: janvanmansum@...
To: mdbtools-dev@...
Subject: [mdb-dev] Java version of mdblib

Hello list,

Two questions.

First of all, is any development being done on this project? From the sourceforge
CVS and this mailing list I get the impression that mdbtools is not being developed
since three years or so.

Second question, is anybody interested in developing mdbtools further? I am currently
involved in a project that needs to read and write mdb files from Java. My interest
is therefore primarily to get a good Java version of libmdb.

Thanks,
best regards,

--
Jan van Mansum

Send e-mail faster without improving your typing skills. Get your Hotmail® account.

--
Jan van Mansum

------------------------------------------------------------------------------
SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada.
The future of the web can't happen without you. Join us at MIX09 to help
pave the way to the Next Web now. Learn more and register at
http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Re: Java version of mdblib

2008-12-05T09:16:18Z

I am not a dev nor admin either, but just want to echo a concern that
the project may not be very active but is yet still a very very
critical tool that needs development.

Stating the obvious, but ....

I'm coming from the GeoSpatial realm where conversion of ESRI
'Geodatabases' to other formats via the mdbtools based driver [1]
within the GDAL project is of critical importance to many users
switching from the windows platform to unix.

But currently the package is challenging be used successfully: http://trac.osgeo.org/gdal/wiki/mdbtools

Dane

[1] http://www.gdal.org/ogr/drv_pgeo.html

On Dec 5, 2008, at 5:36 AM, Jan van Mansum wrote:

> Hi Murray,
>
>
> I'm guessing a little but my feeling is that most of us use mdbtools
> to simply retrieve information from an mdb file - the data is simply
> extracted into a CSV file.
>
> You are probably right. However, some other database writers might
> want to support writing to mdb, to promote adoption of their own
> product. (Similar to Open Office supporting "save as ..." MS Word
> file.)
>
> There was a recent version that provided some basic update functions
> on an mdb file, however I got the impression that this was not
> complete - as you can imagine there are lots of conditions a
> database needs to handle in order to maintain integrity etc.
>
> I am afraid you are right again :) That's why I was hoping to find
> other people who want to write mdb files, so we could get it to work
> as an open source effort.
>
>
>
> Were you planning on using JNI? I assume there is no way for you to
> use JDBC and leave the mdb on a windows server?
>
> JNI could be an option, however I would prefer to stay independent
> of particular OS and native libraries. When building mdbtools I
> found I needed glib, for instance.
>
> We were entertaining the idea of using a Windows Server. If the
> "mdbtools4j" option proves impractical, we will probably opt for that.
>
> Thanks and regards,
>
> Jan.
> ------------------------------------------------------------------------------
> SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas,
> Nevada.
> The future of the web can't happen without you. Join us at MIX09 to
> help
> pave the way to the Next Web now. Learn more and register at
> http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/_______________________________________________
> mdbtools-dev mailing list
> mdbtools-dev@...
> https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

------------------------------------------------------------------------------
SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada.
The future of the web can't happen without you. Join us at MIX09 to help
pave the way to the Next Web now. Learn more and register at
http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Re: Java version of mdblib

2008-12-05T09:08:54Z

I wrote the current Java port and it worked well, if a little dated since I have not followed the changes.
This Java port is in the CVS repository for your use, although the website does not mention it.
My approach was to convert the C code to Java code thus making the Java port 100% pure Java and runnable on any platform Java supports. I also added a very small JDBC driver so you can use it for basic functions without needing to know anything about mdbtools itslef.
It should not take much effort to get it going with the latest release. Contact me off-list if you would like to contract me to do this.
Another project you could look at is: jackcess.sourceforge.net

Calvin

Date: Fri, 5 Dec 2008 10:20:15 +0100
From: janvanmansum@...
To: mdbtools-dev@...
Subject: [mdb-dev] Java version of mdblib

Hello list,

Two questions.

First of all, is any development being done on this project? From the sourceforge
CVS and this mailing list I get the impression that mdbtools is not being developed
since three years or so.

Second question, is anybody interested in developing mdbtools further? I am currently
involved in a project that needs to read and write mdb files from Java. My interest
is therefore primarily to get a good Java version of libmdb.

Thanks,
best regards,

--
Jan van Mansum

Send e-mail faster without improving your typing skills. Get your Hotmail® account.
------------------------------------------------------------------------------
SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada.
The future of the web can't happen without you. Join us at MIX09 to help
pave the way to the Next Web now. Learn more and register at
http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Re: Java version of mdblib

2008-12-05T05:36:05Z

Hi Murray,

I'm guessing a little but my feeling is that most of us use mdbtools to simply retrieve information from an mdb file - the data is simply extracted into a CSV file.

You are probably right. However, some other database writers might want to support writing to mdb, to promote adoption of their own product. (Similar to Open Office supporting "save as ..." MS Word file.)

There was a recent version that provided some basic update functions on an mdb file, however I got the impression that this was not complete - as you can imagine there are lots of conditions a database needs to handle in order to maintain integrity etc.

I am afraid you are right again :) That's why I was hoping to find other people who want to write mdb files, so we could get it to work as an open source effort.

Were you planning on using JNI? I assume there is no way for you to use JDBC and leave the mdb on a windows server?

JNI could be an option, however I would prefer to stay independent of particular OS and native libraries. When building mdbtools I found I needed glib, for instance.

We were entertaining the idea of using a Windows Server. If the "mdbtools4j" option proves impractical, we will probably opt for that.

Thanks and regards,

Jan.

------------------------------------------------------------------------------
SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada.
The future of the web can't happen without you. Join us at MIX09 to help
pave the way to the Next Web now. Learn more and register at
http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Fw: Java version of mdblib

2008-12-05T05:06:07Z

Peter,
I am not an admin for the project, but I do have developer privileges.
I may be able to help in getting some changes upstreamed.

-- Jeff Smith

From: Peter Benjamin Volk <peter@...>
To: Jan van Mansum <janvanmansum@...>
Cc: mdbtools-dev@...
Sent: Friday, December 5, 2008 3:28:07 AM
Subject: Re: [mdb-dev] Java version of mdblib

Hi Jan,

we are currently working on the C part of the mdbtools. Not within the sourceforge project but within our own project. We are using it to read the table data an plug it into a MySQL extension. I have already contacted the original admin of the SF project but have not gotten any response so far. So the SF project seems to be in coma. Currently we are upgrading the bibs so it can read the more current JET engines.

Cheers,
Peter

Re: Java version of mdblib

2008-12-05T03:20:44Z

Hi Jan

There is not a lot of activity here, however there are many like myself who continue to use this library.

I'm guessing a little but my feeling is that most of us use mdbtools to simply retrieve information from an mdb file - the data is simply extracted into a CSV file.

There was a recent version that provided some basic update functions on an mdb file, however I got the impression that this was not complete - as you can imagine there are lots of conditions a database needs to handle in order to maintain integrity etc.

Were you planning on using JNI? I assume there is no way for you to use JDBC and leave the mdb on a windows server?

Cheers
mc

2008/12/5 Jan van Mansum <janvanmansum@...>

Hello list,

Two questions.

First of all, is any development being done on this project? From the sourceforge
CVS and this mailing list I get the impression that mdbtools is not being developed
since three years or so.

Second question, is anybody interested in developing mdbtools further? I am currently
involved in a project that needs to read and write mdb files from Java. My interest
is therefore primarily to get a good Java version of libmdb.

Thanks,
best regards,

--
Jan van Mansum

------------------------------------------------------------------------------
SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada.
The future of the web can't happen without you. Join us at MIX09 to help
pave the way to the Next Web now. Learn more and register at
http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

--
Murray Collingwood
Focus Computing
p +61 415 24 26 24
http://www.focus-computing.com.au

------------------------------------------------------------------------------
SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada.
The future of the web can't happen without you. Join us at MIX09 to help
pave the way to the Next Web now. Learn more and register at
http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Re: Java version of mdblib

2008-12-05T01:28:07Z

Hi Jan,

we are currently working on the C part of the mdbtools. Not within the sourceforge project but within our own project. We are using it to read the table data an plug it into a MySQL extension. I have already contacted the original admin of the SF project but have not gotten any response so far. So the SF project seems to be in coma. Currently we are upgrading the bibs so it can read the more current JET engines.

Cheers,
Peter

Jan van Mansum schrieb:

Hello list,

Two questions.

First of all, is any development being done on this project? From the sourceforge
CVS and this mailing list I get the impression that mdbtools is not being developed
since three years or so.

Second question, is anybody interested in developing mdbtools further? I am currently
involved in a project that needs to read and write mdb files from Java. My interest
is therefore primarily to get a good Java version of libmdb.

Thanks,
best regards,

--
Jan van Mansum
------------------------------------------------------------------------------
SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada.
The future of the web can't happen without you.  Join us at MIX09 to help
pave the way to the Next Web now. Learn more and register at
http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev
  

-- 
Peter Benjamin Volk
Project Head DDEngine

Java version of mdblib

2008-12-05T01:20:15Z

Hello list,

Two questions.

First of all, is any development being done on this project? From the sourceforge
CVS and this mailing list I get the impression that mdbtools is not being developed
since three years or so.

Second question, is anybody interested in developing mdbtools further? I am currently
involved in a project that needs to read and write mdb files from Java. My interest
is therefore primarily to get a good Java version of libmdb.

Thanks,
best regards,

--
Jan van Mansum

------------------------------------------------------------------------------
SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada.
The future of the web can't happen without you. Join us at MIX09 to help
pave the way to the Next Web now. Learn more and register at
http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Project Status

2008-09-19T01:49:43Z

Hi all,

is there a project status to the MDB tools? Is there one of the project
owners still on the list? I am insterested in using this technology for
a larger scale project and would like to have a chat with the project owner.

Cheers,
Peter

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Re: Segfault on long memo fields

2008-07-24T16:27:13Z

On Thu, Jul 24, 2008 at 8:14 AM, Brett Hutley <brett@...> wrote:
> I've attached a patch for data.c that should fix the problem. It increases
> the size of the "text" buffer if the memo is larger than MDB_BIND_SIZE
> bytes. I was wondering why the function always seems to allocate
> MDB_BIND_SIZE bytes though? It seems as though a little later in the
> function we actually read the size of the memo field, and we can then just
> allocate the right number of bytes directly. (Although I guess there is
> potentially a bit mask encoded in the length, which you'd need to mask out
> in order to get the actual length).

Sweet this patch also happens to fix this segfault I was getting (not
related to memo fields just a text column).

Thanks a lot Brett!

*** glibc detected *** mdb-export: munmap_chunk(): invalid pointer:
0x0000000000883f00 ***
======= Backtrace: =========
/lib/libc.so.6[0x7ffd8e87bff8]
/usr/local/lib/libmdb.so.1(mdb_col_to_string+0x201)[0x7ffd8ee25521]
/usr/local/lib/libmdb.so.1[0x7ffd8ee25bd8]
/usr/local/lib/libmdb.so.1(mdb_read_row+0x1cb)[0x7ffd8ee25eab]
/usr/local/lib/libmdb.so.1(mdb_fetch_row+0x81)[0x7ffd8ee25f81]
mdb-export[0x401538]
/lib/libc.so.6(__libc_start_main+0xe6)[0x7ffd8e8263f6]
mdb-export[0x400dd9]

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Re: mdb-tables no output

2008-07-24T09:03:18Z

Yup, see this page:

https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Cheers, Brett

On 24 Jul 2008, at 16:52, Daniel wrote:

I've tried to unsubscribe from this distribution list, but evidently it's not working. Anyone have any ideas on how I can get removed from the mdbtools email distribution list?

- Daniel

Brett Hutley [Head of Product Development, Stimuli Limited]

[b] brett@... http://www.stimuli.org/

[h] brett@... http://hutley.net/brett/

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Re: mdb-tables no output

2008-07-24T08:52:21Z

I've tried to unsubscribe from this distribution list, but evidently it's not working. Anyone have any ideas on how I can get removed from the mdbtools email distribution list?

- Daniel

On Thu, Jul 24, 2008 at 9:12 AM, Brett Hutley <brett@...> wrote:

Sorry it would probably help if I actually attached the patch file rather than the modified source:

On 24 Jul 2008, at 15:37, Brett Hutley wrote:

There seems to be a general problem in mdb-tables when specifying the command-line option "-t any" or "-t all", in that it won't report anything. Attached is a small patch to fix this issue.

Regards, Brett

<mdb-tables.c>

On 24 Jul 2008, at 14:09, gareth@ wrote:

Hi

I'm currently trying to use mdb-tables on an up to date gentoo system.

alas the command is giving me no output apart from a single blank line.

I know the database is OK as this works fine on a Ubuntu system.

Are there any pointers on how I may track is this problem down?

cheers g

-------------------------------------------------------------------------

This SF.Net email is sponsored by the Moblin Your Move Developer's challenge

Build the coolest Linux based applications with Moblin SDK & win great prizes

Grand prize is a trip for two to an Open Source event anywhere in the world

http://moblin-contest.org/redirect.php?banner_id=100&url=/

_______________________________________________

mdbtools-dev mailing list

mdbtools-dev@...

https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

--

Brett Hutley [Head of Product Development, Stimuli Limited]

[b] brett@... http://www.stimuli.org/
[h] brett@... http://hutley.net/brett/

-------------------------------------------------------------------------

This SF.Net email is sponsored by the Moblin Your Move Developer's challenge

Build the coolest Linux based applications with Moblin SDK & win great prizes

Grand prize is a trip for two to an Open Source event anywhere in the world

http://moblin-contest.org/redirect.php?banner_id=100&url=/_______________________________________________

mdbtools-dev mailing list

mdbtools-dev@...

https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

--

Brett Hutley [Head of Product Development, Stimuli Limited]

[b] brett@... http://www.stimuli.org/
[h] brett@... http://hutley.net/brett/

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Re: mdb-tables no output

2008-07-24T08:12:37Z

Sorry it would probably help if I actually attached the patch file rather than the modified source:

On 24 Jul 2008, at 15:37, Brett Hutley wrote:

There seems to be a general problem in mdb-tables when specifying the command-line option "-t any" or "-t all", in that it won't report anything. Attached is a small patch to fix this issue.

Regards, Brett

<mdb-tables.c>

On 24 Jul 2008, at 14:09, gareth@ wrote:

Hi

I'm currently trying to use mdb-tables on an up to date gentoo system.

alas the command is giving me no output apart from a single blank line.

I know the database is OK as this works fine on a Ubuntu system.

Are there any pointers on how I may track is this problem down?

cheers g

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

--
Brett Hutley [Head of Product Development, Stimuli Limited]
[b] brett@... http://www.stimuli.org/
[h] brett@... http://hutley.net/brett/

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Brett Hutley [Head of Product Development, Stimuli Limited]

[b] brett@... http://www.stimuli.org/

[h] brett@... http://hutley.net/brett/

mdb-tables.c.patch (606 bytes) Download Attachment

Re: mdb-tables no output

2008-07-24T07:37:19Z

There seems to be a general problem in mdb-tables when specifying the command-line option "-t any" or "-t all", in that it won't report anything. Attached is a small patch to fix this issue.

Regards, Brett

On 24 Jul 2008, at 14:09, gareth@ wrote:

Hi

I'm currently trying to use mdb-tables on an up to date gentoo system.

alas the command is giving me no output apart from a single blank line.

I know the database is OK as this works fine on a Ubuntu system.

Are there any pointers on how I may track is this problem down?

cheers g

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Brett Hutley [Head of Product Development, Stimuli Limited]

[b] brett@... http://www.stimuli.org/

[h] brett@... http://hutley.net/brett/

mdb-tables.c (3K) Download Attachment

Re: Segfault on long memo fields

2008-07-24T07:14:51Z

OK, the problem seems to be if the memo field is longer than MDB_BIND_SIZE bytes in length (defined in mdbtools.h and currently 16384), then the mdb_memo_to_string function in data.c fails. Specifically the function mdb_unicode2ascii in iconv.c does a copy from the source buffer to the dest buffer using the source length instead of the minimum of the source length & the dest buffer length (in case the destination buffer is too small).

I've attached a patch for data.c that should fix the problem. It increases the size of the "text" buffer if the memo is larger than MDB_BIND_SIZE bytes. I was wondering why the function always seems to allocate MDB_BIND_SIZE bytes though? It seems as though a little later in the function we actually read the size of the memo field, and we can then just allocate the right number of bytes directly. (Although I guess there is potentially a bit mask encoded in the length, which you'd need to mask out in order to get the actual length).

The fix to mdb_memo_to_string in iconv.c seems to be worth doing purely in terms of stopping buffer overflow issues, but it might be easier if the function is refactored a bit. Basically code like the following only addresses the problem in one place in the function, whereas it also exists in the else block of code following this, and I haven't checked the block of code dealing with compressed Unicode strings, or the #ifdef HAVE_ICONV block:

(Basically we strncpy the minimum of len_in and dlen):

--- iconv.c 7 Sep 2005 23:27:43 -0000 1.15

+++ iconv.c 24 Jul 2008 14:04:24 -0000

@@ -82,8 +82,11 @@

dlen -= len_out;

#else

if (IS_JET3(mdb)) {

- strncpy(out_ptr, in_ptr, len_in);

- dlen = len_in;

+ size_t copy_len = len_in;

+ if (copy_len > dlen)

+ copy_len = dlen;

+ strncpy(out_ptr, in_ptr, copy_len);

+ dlen = copy_len;

} else {

/* rough UCS-2LE to ISO-8859-1 conversion */

unsigned int i;

Regards, Brett

On 23 Jul 2008, at 01:25, Nigel Kendrick wrote:

I have one table where the user has pasted some notes from another
application into a 'comments' field of type 'memo' and mdb-export segfaults
when it gets to these notes - they are quite long and contain tabs.

I am not sure whether it's the length of the data or that it includes
non-ascii characters, but I just wondered if anyone had any ideas tracking
down the problem - I have had a look at the source code for mdb-export but I
don't know C very well so I'm not getting very far. I get the feeling it's a
buffer overflow or character (tab?) handling issue somewhere?

Any thoughts on where to look?

Thanks

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Brett Hutley [Head of Product Development, Stimuli Limited]

[b] brett@... http://www.stimuli.org/

[h] brett@... http://hutley.net/brett/

data.c.patch (1K) Download Attachment

Re: Segfault on long memo fields

2008-07-23T03:19:15Z

Hi Nigel,

If it isn't sensitive data, can you upload a copy of the database somewhere? I can run it under the debugger, and see what's causing the segfault. It does sound like a buffer overflow problem to me too.

Alternatively, try building a debug version of mdb-tools and running it under gdb. That will show you where it is crashing.

Regards, Brett

On 23 Jul 2008, at 01:25, Nigel Kendrick wrote:

I have one table where the user has pasted some notes from another
application into a 'comments' field of type 'memo' and mdb-export segfaults
when it gets to these notes - they are quite long and contain tabs.

I am not sure whether it's the length of the data or that it includes
non-ascii characters, but I just wondered if anyone had any ideas tracking
down the problem - I have had a look at the source code for mdb-export but I
don't know C very well so I'm not getting very far. I get the feeling it's a
buffer overflow or character (tab?) handling issue somewhere?

Any thoughts on where to look?

Thanks

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Brett Hutley [Head of Product Development, Stimuli Limited]

[b] brett@... http://www.stimuli.org/

[h] brett@... http://hutley.net/brett/

Segfault on long memo fields

2008-07-22T17:25:31Z

I have one table where the user has pasted some notes from another
application into a 'comments' field of type 'memo' and mdb-export segfaults
when it gets to these notes - they are quite long and contain tabs.

I am not sure whether it's the length of the data or that it includes
non-ascii characters, but I just wondered if anyone had any ideas tracking
down the problem - I have had a look at the source code for mdb-export but I
don't know C very well so I'm not getting very far. I get the feeling it's a
buffer overflow or character (tab?) handling issue somewhere?

Any thoughts on where to look?

Thanks

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Re: FW: New user of mdbtools

2008-06-26T01:42:46Z

> I cannot see any problems in the Access table that could cause some kind
of
> error condition but the export stops at exactly the same record every time
> and suspiciously close to when it creates a 100MB csv file (104140795) so
> could I be hitting a memory allocation limit or am I totally off-the-mark?

>
>Could be... Hard to tell, but I don't think so...
>
>I have looked at you patch...
>
>You do know that your "-L" is only active when you do not also specify
"-Q",

>right?
>
>I cannot see any obvious errors in your code.
>
>It's time for debugging: valgrind, gdb.
>
>Anyway: I think it is a much cleaner solution to post-process your
>generated SQL (using awk) to produce the output needed; thereby
>seperating the two responsibilities: DB conversion and Data manipulation.
>
>Jarl

Thanks for the feedback - the export runs if I remove two rows/records in
the database so it looks like there is a small corruption which I can easily
fix. Not sure if its worth the time to find out what's tripping the export
and make sure its trapped as the problem only occurs with 1 table out of 25
I am exporting.

Thanks also for the comments on my first ever 'c' coding!

Nigel

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

Re: FW: New user of mdbtools

2008-06-25T06:41:45Z

"Nigel Kendrick" <support-lists@...> writes:

> Glad there's some life here!!
>
> I'll submit the code and see what happens.
>
> Things have been working fine until I tried to generate a csv file from a
> large table containing a lot of text fields - mdb-export crashes out with:
>
> *** glibc detected *** /usr/local/bin/.libs/lt-mdb-export: double free or
> corruption (out): 0x08f0dcb0 ***
>
> I cannot see any problems in the Access table that could cause some kind of
> error condition but the export stops at exactly the same record every time
> and suspiciously close to when it creates a 100MB csv file (104140795) so
> could I be hitting a memory allocation limit or am I totally off-the-mark?

Could be... Hard to tell, but I don't think so...

I have looked at you patch...

You do know that your "-L" is only active when you do not also specify "-Q",
right?

I cannot see any obvious errors in your code.

It's time for debugging: valgrind, gdb.

Anyway: I think it is a much cleaner solution to post-process your
generated SQL (using awk) to produce the output needed; thereby
seperating the two responsibilities: DB conversion and Data manipulation.

Jarl

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

FW: New user of mdbtools

2008-06-23T07:46:00Z

-----Original Message-----
From: Jarl Friis [mailto:jarl@...]
Sent: Monday, June 23, 2008 12:09 PM
To: Nigel Kendrick
Cc: mdbtools-dev@...
Subject: Re: [mdb-dev] New user of mdbtools

[Snip]

I will suggest that you do like the rest of us...
Submit a patch on
http://sourceforge.net/tracker/?group_id=2294&atid=302294

I can reccomend
Patch for UTF-8
Patch for export to SQLite

:-)

When you have done that, you can post a mail here on the list.

Jarl

Hi Jarl,

Glad there's some life here!!

I'll submit the code and see what happens.

Things have been working fine until I tried to generate a csv file from a
large table containing a lot of text fields - mdb-export crashes out with:

*** glibc detected *** /usr/local/bin/.libs/lt-mdb-export: double free or
corruption (out): 0x08f0dcb0 ***

I cannot see any problems in the Access table that could cause some kind of
error condition but the export stops at exactly the same record every time
and suspiciously close to when it creates a 100MB csv file (104140795) so
could I be hitting a memory allocation limit or am I totally off-the-mark?

I'm afraid I am only 2-days 'into' c programming so I wouldn't know where to
start looking!?

Thanks

Nigel

EDIT:

Apologies to Jarl - my first reply went direct and not to the list.

Scrap the idea of the 100MB limit as one of my exports to csv makes it to
177MB without any problems.

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

New user of mdbtools

2008-06-22T16:46:02Z

Hello Everyone,

After a bit of fiddling and patience I have finally managed to checkout the cvs version of mdbtools and compile it on a system running CentOS5.

As far as I can see the tools have been around for some time and ongoing activity (development, forum/mailing list posts etc.) is fairly minimal, but I am glad to have found the tools as they are helping greatly with a project to import access 97 data into a MySQL database on a nightly basis.

One thing I did note, and found some comments on the 'net' about, was the fact that the current/latest mdb-export tool does nothing about CR, LF or CR/LF codes within data fields and this was a problem for me so I have approached it in two ways:

1) Using an awk command to post-process the generated csv files:

awk -v RS="\r\n" -v ORS=" " {print} infile.csv > outfile.csv

2) I also had a look at the source code for mdb-export.c and modified it to include an '-L' switch to replace CR and LF codes in data fields with spaces. I am not sure if the code I have added is the most elegant way to achieve the desired result (This was my first ever work in c and my last real major programming work was in the 1990s in pascal!), but if anyone wants the code - or there is a proper way to submit it to the project - just let me know.

All the best

Nigel Kendrick

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

write functionality

2008-06-09T06:52:21Z

Hi, apologies if this has already been covered in a previous post.

What is the status of write functionality in the 0.6 prerelease? My intended use is as following:

1. Copy Access 97 data to PostgreSQL db (schema created ok using mdbtools version 0.5.99.0.6pre1.0.20051109-4)
2. Modify PostgreSQL data using web application.
3. Copy updated data to Access 97 mdb file.

The schema for the mdb is extremely basic with no relationships. It is used as a datafile for a communications utility which is only available in Windows and can only use mdb files. (I hope to change this eventually!)

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
mdbtools-dev mailing list
mdbtools-dev@...
https://lists.sourceforge.net/lists/listinfo/mdbtools-dev

mdb-export problem

2008-05-13T04:39:11Z

I'm trying to import an Access JET 4 version table into .csv format. However, i find that the numeric fields are wrongly exported. Case in point fields with decimal points are truncated, i.e 234.45 becomes 234 etc. Also regarding negative values the .csv file shows that the '-' sign is not there, i.e -234.45 becomes 234.

Please i need some help, it is urgent.