Advice on speeding up map generation
|
View:
New views
12 Messages
—
Rating Filter:
Alert me
|
 |
Advice on speeding up map generation
by Josh Marcus-2
::
Rate this Message:
Hey there,
I'm looking for some advice about how to speed up responses to WMS requests for a map I'm generating. The map consists of 800k points, stored in Postgres (with a spatial index and clustered), and at this point I'm displaying it with the default point SLD. It can take as long as 45 seconds to render. I've played with the various renderer configurations ... but I'm not sure how to profile or improve the performance at this stage. Any advice? Any additional information I can provide? Thanks so much, --j ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Geoserver-users mailing list Geoserver-users@... https://lists.sourceforge.net/lists/listinfo/geoserver-users |
|
|
Re: Advice on speeding up map generation
by David Winslow-5
::
Rate this Message:
Probably the easiest (and most effective) way to improve WMS performance
is to set up a tile cache for your WMS. GeoWebCache and TileCache are two fairly easy options. GeoWebCache even has a plugin available for GeoServer. http://geowebcache.org/ http://tilecache.org/ Hope this helps, -David Winslow Josh Marcus wrote: > Hey there, > > I'm looking for some advice about how to speed up responses to WMS > requests for a map I'm generating. The map consists of 800k points, > stored in Postgres (with a spatial index and clustered), and at this > point I'm displaying it with the default point SLD. It can take as > long as 45 seconds to render. I've played with the various renderer > configurations ... but I'm not sure how to profile or improve the > performance at this stage. Any advice? Any additional information I > can provide? > > Thanks so much, --j > !DSPAM:4040,4880f67155391637810514! > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > > !DSPAM:4040,4880f67155391637810514! > > ------------------------------------------------------------------------ > > _______________________________________________ > Geoserver-users mailing list > Geoserver-users@... > https://lists.sourceforge.net/lists/listinfo/geoserver-users > > > !DSPAM:4040,4880f67155391637810514! > ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Geoserver-users mailing list Geoserver-users@... https://lists.sourceforge.net/lists/listinfo/geoserver-users |
|
|
Re: Advice on speeding up map generation
by Josh Marcus-2
::
Rate this Message:
David,
Thanks for the advice! However, I need to apply dynamic SLDs -- so I will need to actually optimize the speed of the map generation. Mapserver can generate the same maps almost an order of magnitude faster. --j On Fri, Jul 18, 2008 at 4:05 PM, David Winslow <dwinslow@...> wrote: Probably the easiest (and most effective) way to improve WMS performance is to set up a tile cache for your WMS. GeoWebCache and TileCache are two fairly easy options. GeoWebCache even has a plugin available for GeoServer. ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Geoserver-users mailing list Geoserver-users@... https://lists.sourceforge.net/lists/listinfo/geoserver-users |
|
|
Re: Advice on speeding up map generation
by Chris Holmes-4
::
Rate this Message:
What version of GeoServer are you using? It should be just as fast as
MapServer for most all renderings with 1.6.x. One thing may be to install java advanced imaging, though I think we don't depend on that for speed as much as we used to. And be sure that your jdk is 1.6, 1.4 is half as slow. http://geoserver.org/display/GEOSDOC/2.6+GeoServer+in+Production+Environment has more hints on running in a production environment, and may have some more tips. Chris Josh Marcus wrote: > David, > > Thanks for the advice! However, I need to apply dynamic SLDs -- so I > will need to actually optimize the speed of the map generation. > Mapserver can generate the same maps almost an order of magnitude faster. > > --j > > On Fri, Jul 18, 2008 at 4:05 PM, David Winslow <dwinslow@... > <mailto:dwinslow@...>> wrote: > > Probably the easiest (and most effective) way to improve WMS > performance is to set up a tile cache for your WMS. GeoWebCache and > TileCache are two fairly easy options. GeoWebCache even has a > plugin available for GeoServer. > > http://geowebcache.org/ > http://tilecache.org/ > > Hope this helps, > -David Winslow > > Josh Marcus wrote: > > Hey there, > > I'm looking for some advice about how to speed up responses to > WMS requests for a map I'm generating. The map consists of 800k > points, stored in Postgres (with a spatial index and clustered), > and at this point I'm displaying it with the default point SLD. > It can take as long as 45 seconds to render. I've played with > the various renderer configurations ... but I'm not sure how to > profile or improve the performance at this stage. Any advice? > Any additional information I can provide? > > Thanks so much, --j > > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move > Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win > great prizes > Grand prize is a trip for two to an Open Source event anywhere > in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/> > > !DSPAM:4040,4880f67155391637810514! > ------------------------------------------------------------------------ > > _______________________________________________ > Geoserver-users mailing list > Geoserver-users@... > <mailto:Geoserver-users@...> > https://lists.sourceforge.net/lists/listinfo/geoserver-users > > > !DSPAM:4040,4880f67155391637810514! > > > > > !DSPAM:4005,488101b977873327367457! > > > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > > !DSPAM:4005,488101b977873327367457! > > > ------------------------------------------------------------------------ > > _______________________________________________ > Geoserver-users mailing list > Geoserver-users@... > https://lists.sourceforge.net/lists/listinfo/geoserver-users > > > !DSPAM:4005,488101b977873327367457! [cholmes.vcf] begin:vcard fn:Chris Holmes n:Holmes;Chris org:The Open Planning Project adr:;;349 W. 12th Street, #3;New York;NY;10014;USA email;internet:cholmes@... title:Managing Director, Strategic Development x-mozilla-html:FALSE url:http://topp.openplans.org version:2.1 end:vcard ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Geoserver-users mailing list Geoserver-users@... https://lists.sourceforge.net/lists/listinfo/geoserver-users |
|
|
Re: Advice on speeding up map generation
by Josh Marcus-2
::
Rate this Message:
Hey there,
I'm using 1.7.x and my jdk is 1.6, and I've isolated that my issue is postgis related, as I dumped my postgis data into a shapefile -- and that renders quite quickly. --j On Fri, Jul 18, 2008 at 5:31 PM, Chris Holmes <cholmes@...> wrote: What version of GeoServer are you using? It should be just as fast as MapServer for most all renderings with 1.6.x. One thing may be to install java advanced imaging, though I think we don't depend on that for speed as much as we used to. And be sure that your jdk is 1.6, 1.4 is half as slow. http://geoserver.org/display/GEOSDOC/2.6+GeoServer+in+Production+Environment has more hints on running in a production environment, and may have some more tips. ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Geoserver-users mailing list Geoserver-users@... https://lists.sourceforge.net/lists/listinfo/geoserver-users |
|
|
Re: Advice on speeding up map generation
by Chris Holmes-4
::
Rate this Message:
Are you using nightlies? Or beta-1? We know that performance dropped
for 1.7.x, and made recent efforts to fix it. Though maybe only shapefile got better. Could you try it with 1.6.x and see if that's fast? And then if you are on the latest nightlies it sounds like we should get our profiler out and see if we have the same issues with postgis. A lot changed with 1.7.x, so it's quite possible it's slower. Thanks a ton for bringing up the issue. best regards, Chris Josh Marcus wrote: > Hey there, > > I'm using 1.7.x and my jdk is 1.6, and I've isolated that my issue is > postgis related, as I dumped my postgis data into a shapefile -- and > that renders quite quickly. > > --j > > On Fri, Jul 18, 2008 at 5:31 PM, Chris Holmes <cholmes@... > <mailto:cholmes@...>> wrote: > > What version of GeoServer are you using? It should be just as fast > as MapServer for most all renderings with 1.6.x. One thing may be > to install java advanced imaging, though I think we don't depend on > that for speed as much as we used to. And be sure that your jdk is > 1.6, 1.4 is half as slow. > http://geoserver.org/display/GEOSDOC/2.6+GeoServer+in+Production+Environment > has more hints on running in a production environment, and may have > some more tips. > > Chris > > Josh Marcus wrote: > > David, > > Thanks for the advice! However, I need to apply dynamic SLDs > -- so I will need to actually optimize the speed of the map > generation. Mapserver can generate the same maps almost an > order of magnitude faster. > > --j > > On Fri, Jul 18, 2008 at 4:05 PM, David Winslow > <dwinslow@... <mailto:dwinslow@...> > <mailto:dwinslow@... <mailto:dwinslow@...>>> wrote: > > Probably the easiest (and most effective) way to improve WMS > performance is to set up a tile cache for your WMS. > GeoWebCache and > TileCache are two fairly easy options. GeoWebCache even has a > plugin available for GeoServer. > > http://geowebcache.org/ > http://tilecache.org/ > > Hope this helps, > -David Winslow > > Josh Marcus wrote: > > Hey there, > > I'm looking for some advice about how to speed up > responses to > WMS requests for a map I'm generating. The map consists > of 800k > points, stored in Postgres (with a spatial index and > clustered), > and at this point I'm displaying it with the default > point SLD. > It can take as long as 45 seconds to render. I've > played with > the various renderer configurations ... but I'm not sure > how to > profile or improve the performance at this stage. Any > advice? > Any additional information I can provide? > > Thanks so much, --j > > > ------------------------------------------------------------------------ > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move > Developer's challenge > Build the coolest Linux based applications with Moblin > SDK & win > great prizes > Grand prize is a trip for two to an Open Source event > anywhere > in the world > > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/> > > <http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/>> > > > > ------------------------------------------------------------------------ > > _______________________________________________ > Geoserver-users mailing list > Geoserver-users@... > <mailto:Geoserver-users@...> > <mailto:Geoserver-users@... > <mailto:Geoserver-users@...>> > > https://lists.sourceforge.net/lists/listinfo/geoserver-users > > > !DSPAM:4040,4880f67155391637810514! > > > > !DSPAM:4005,488101b977873327367457! > > > > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move > Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win > great prizes > Grand prize is a trip for two to an Open Source event anywhere > in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/> > > !DSPAM:4005,488101b977873327367457! > > > > ------------------------------------------------------------------------ > > _______________________________________________ > Geoserver-users mailing list > Geoserver-users@... > <mailto:Geoserver-users@...> > https://lists.sourceforge.net/lists/listinfo/geoserver-users > > > !DSPAM:4005,488101b977873327367457! > > > !DSPAM:4005,48810dce98281012714783! [cholmes.vcf] begin:vcard fn:Chris Holmes n:Holmes;Chris org:The Open Planning Project adr:;;349 W. 12th Street, #3;New York;NY;10014;USA email;internet:cholmes@... title:Managing Director, Strategic Development x-mozilla-html:FALSE url:http://topp.openplans.org version:2.1 end:vcard ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Geoserver-users mailing list Geoserver-users@... https://lists.sourceforge.net/lists/listinfo/geoserver-users |
|
|
Re: Advice on speeding up map generation
by Josh Marcus-2
::
Rate this Message:
Chris,
Thanks for the help! I've tried it with 1.6.x and the performance seems pretty similar. I exported my postgis data into a shapefile, and the performance with the shapefile is quite good (I haven't tried filtering yet). So it seems like an issue with Postgis or Postgis/Geoserver interaction. If I put a filter on the points that reduces the number of points to under 50k, the performance is much better. Maybe it's an issue with the way I set up my postgis table? I added a spatial index and clustered based on the spatial index... Any additional advice would be greatly appreciated. Again, let me know if there is information I can share that would be helpful for diagnosis. --j On Fri, Jul 18, 2008 at 6:10 PM, Chris Holmes <cholmes@...> wrote: Are you using nightlies? Or beta-1? We know that performance dropped for 1.7.x, and made recent efforts to fix it. Though maybe only shapefile got better. ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Geoserver-users mailing list Geoserver-users@... https://lists.sourceforge.net/lists/listinfo/geoserver-users |
|
|
Re: Advice on speeding up map generation
by Chris Holmes-4
::
Rate this Message:
With MapServer you're connecting to the exact same postgis database?
And it's an order of magnitude faster? Shapefiles should be a bit faster than PostGIS, but not that much. And the differences should be about the same between GeoServer and MapServer, see http://www.foss4g2007.org/presentations/view.php?abstract_id=120 Chris Josh Marcus wrote: > Chris, > > Thanks for the help! > > I've tried it with 1.6.x and the performance seems pretty similar. > > I exported my postgis data into a shapefile, and the performance with > the shapefile is quite good (I haven't tried filtering yet). So it > seems like an issue with Postgis or Postgis/Geoserver interaction. If I > put a filter on the points that reduces the number of points to under > 50k, the performance is much better. > > Maybe it's an issue with the way I set up my postgis table? I added a > spatial index and clustered based on the spatial index... > > Any additional advice would be greatly appreciated. Again, let me know > if there is information I can share that would be helpful for diagnosis. > > --j > > On Fri, Jul 18, 2008 at 6:10 PM, Chris Holmes <cholmes@... > <mailto:cholmes@...>> wrote: > > Are you using nightlies? Or beta-1? We know that performance > dropped for 1.7.x, and made recent efforts to fix it. Though maybe > only shapefile got better. > > Could you try it with 1.6.x and see if that's fast? And then if you > are on the latest nightlies it sounds like we should get our > profiler out and see if we have the same issues with postgis. A lot > changed with 1.7.x, so it's quite possible it's slower. Thanks a > ton for bringing up the issue. > > best regards, > > Chris > > Josh Marcus wrote: > > Hey there, > > I'm using 1.7.x and my jdk is 1.6, and I've isolated that my > issue is postgis related, as I dumped my postgis data into a > shapefile -- and that renders quite quickly. > --j > > On Fri, Jul 18, 2008 at 5:31 PM, Chris Holmes > <cholmes@... <mailto:cholmes@...> > <mailto:cholmes@... <mailto:cholmes@...>>> wrote: > > What version of GeoServer are you using? It should be just > as fast > as MapServer for most all renderings with 1.6.x. One thing > may be > to install java advanced imaging, though I think we don't > depend on > that for speed as much as we used to. And be sure that your > jdk is > 1.6, 1.4 is half as slow. > > http://geoserver.org/display/GEOSDOC/2.6+GeoServer+in+Production+Environment > has more hints on running in a production environment, and > may have > some more tips. > > Chris > > Josh Marcus wrote: > > David, > > Thanks for the advice! However, I need to apply dynamic > SLDs > -- so I will need to actually optimize the speed of the map > generation. Mapserver can generate the same maps almost an > order of magnitude faster. > > --j > > On Fri, Jul 18, 2008 at 4:05 PM, David Winslow > <dwinslow@... <mailto:dwinslow@...> > <mailto:dwinslow@... <mailto:dwinslow@...>> > <mailto:dwinslow@... > <mailto:dwinslow@...> <mailto:dwinslow@... > <mailto:dwinslow@...>>>> wrote: > > Probably the easiest (and most effective) way to > improve WMS > performance is to set up a tile cache for your WMS. > GeoWebCache and > TileCache are two fairly easy options. GeoWebCache > even has a > plugin available for GeoServer. > > http://geowebcache.org/ > http://tilecache.org/ > > Hope this helps, > -David Winslow > > Josh Marcus wrote: > > Hey there, > > I'm looking for some advice about how to speed up > responses to > WMS requests for a map I'm generating. The map > consists > of 800k > points, stored in Postgres (with a spatial index and > clustered), > and at this point I'm displaying it with the default > point SLD. > It can take as long as 45 seconds to render. I've > played with > the various renderer configurations ... but I'm > not sure > how to > profile or improve the performance at this stage. Any > advice? > Any additional information I can provide? > > Thanks so much, --j > > > ------------------------------------------------------------------------ > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move > Developer's challenge > Build the coolest Linux based applications with Moblin > SDK & win > great prizes > Grand prize is a trip for two to an Open Source event > anywhere > in the world > > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/> > > <http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/>> > > <http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/> > > <http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/>>> > > > ------------------------------------------------------------------------ > > _______________________________________________ > Geoserver-users mailing list > Geoserver-users@... > <mailto:Geoserver-users@...> > <mailto:Geoserver-users@... > <mailto:Geoserver-users@...>> > <mailto:Geoserver-users@... > <mailto:Geoserver-users@...> > <mailto:Geoserver-users@... > <mailto:Geoserver-users@...>>> > > > https://lists.sourceforge.net/lists/listinfo/geoserver-users > > > > > > !DSPAM:4005,488101b977873327367457! > > > > > ------------------------------------------------------------------------ > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move > Developer's challenge > Build the coolest Linux based applications with Moblin > SDK & win > great prizes > Grand prize is a trip for two to an Open Source event > anywhere > in the world > > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/> > > <http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/>> > > !DSPAM:4005,488101b977873327367457! > > > > > ------------------------------------------------------------------------ > > _______________________________________________ > Geoserver-users mailing list > Geoserver-users@... > <mailto:Geoserver-users@...> > <mailto:Geoserver-users@... > <mailto:Geoserver-users@...>> > https://lists.sourceforge.net/lists/listinfo/geoserver-users > > > !DSPAM:4005,488101b977873327367457! > > > !DSPAM:4005,48810dce98281012714783! > > > !DSPAM:4005,4884ad62169228992556831! [cholmes.vcf] begin:vcard fn:Chris Holmes n:Holmes;Chris org:The Open Planning Project adr:;;349 W. 12th Street, #3;New York;NY;10014;USA email;internet:cholmes@... title:Managing Director, Strategic Development x-mozilla-html:FALSE url:http://topp.openplans.org version:2.1 end:vcard ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Geoserver-users mailing list Geoserver-users@... https://lists.sourceforge.net/lists/listinfo/geoserver-users |
|
|
Re: Advice on speeding up map generation
by Josh Marcus-2
::
Rate this Message:
Hey folks, Yeah -- I'm connecting to the same exact postgis database with mapserver, and generating the map is an order of magnitude faster. I may have to switch over to mapserver, but I would very much prefer not to. Is there a benchmark test that involved rendering ~800k points? My points heavily overlap, which could be a factor -- my map is all geonames features in Africa. --j On Mon, Jul 21, 2008 at 11:53 AM, Chris Holmes <cholmes@...> wrote: With MapServer you're connecting to the exact same postgis database? And it's an order of magnitude faster? |
