Welcome, Guest
Username: Password: Remember me

TOPIC: out of memory errors

out of memory errors 3 years 1 month ago #13162

  • darrellmccauley
  • darrellmccauley's Avatar
  • Offline
I received "out of memory" errors from Reefmaster:
There is insufficient memory to generate map project ABCD at the specified size and resolution. Try generating a smaller map or using a higher grid-cell size.
This dataset has 30 million points and my Windows 11 machine has 54 GB of memory. No other applications are open.

I don't need a smaller map or want a different grid-cell size. I can add memory.

How much memory is required to process 30 million points? How may I compute memory requirements?

Thanks,
Darrell
The administrator has disabled public write access.

out of memory errors 3 years 1 month ago #13164

  • fjordfisher
  • fjordfisher's Avatar
  • Offline
You absolutely don't need more memory. I've created much bigger projekts with a smaller maschine.
Split up the datas. Create a first small project an copy it. Than use the old borderline from one or two pagelines for the new project part. The result can be created without interruption from projectpart to other projectpart if you work correct.

You also can translate this small manual for more details:

www.tacklefever.de/index.php?topic=6457.0

You also can create separate projects and than export a lot of projets together by marking and processing.

Last Edit: 3 years 1 month ago by fjordfisher.
The administrator has disabled public write access.

out of memory errors 3 years 1 month ago #13165

  • darrellmccauley
  • darrellmccauley's Avatar
  • Offline
Thank you for the pointers. In addition to the memory errors, I have run into the endless loop mentioned in that other post.

Does the company monitor this forum? I was hoping for input on my memory questions (e.g., a rough formula).

Is there some other mechanism to report bugs like that endless loop?

I need to create bathymetry maps (contours and isobaths, not raster maps) weekly or monthly for several areas, some on the order of 8000 km^2 with 30 million points, and I was hoping to avoid several manual steps like the tacklefever post. Is Reefmaster the right product for this sort of work?
The administrator has disabled public write access.

out of memory errors 3 years 1 month ago #13169

  • fjordfisher
  • fjordfisher's Avatar
  • Offline
1. RM has a very good interpolation algorithm. And yes, i'ts sure not primerely for high professionel data volumes. But if you have ready projects, you can substitute tracks with newer dats from the same region.

2. In dependance from the desired solution of your projects you can check other commercial seachart software. But you must ask users or companies of these products.

3. If i would be her (but i don't know exactly your project details) i would use ArcGIS Pro (ESRI) with datas in a GDB and an interpolation with e. g. "natural neighbor". If you use the modelbuilder you also can programm all steps. But ESRI also has a bathymetric tool (I don't know it in detail) you must self inform about.
The administrator has disabled public write access.

out of memory errors 3 years 2 weeks ago #13181

  • Matt
  • Matt's Avatar
  • Offline
darrellmccauley wrote:
Thank you for the pointers. In addition to the memory errors, I have run into the endless loop mentioned in that other post.

Does the company monitor this forum? I was hoping for input on my memory questions (e.g., a rough formula).

Is there some other mechanism to report bugs like that endless loop?

I need to create bathymetry maps (contours and isobaths, not raster maps) weekly or monthly for several areas, some on the order of 8000 km^2 with 30 million points, and I was hoping to avoid several manual steps like the tacklefever post. Is Reefmaster the right product for this sort of work?

Hi and sorry for late reply. The answer to your last question is no, ReefMaster really isn't designed for building maps of this sort of size. The focus has always been on producing small, high resolution maps using data collected by the user themselves - 8000km2 is a very large map area in this context and way beyond anything that we test internally. Although there are ways of getting around this size limitation, as mentioned in this thread and others, I would probably suggest using something more professionally targeted such as GlobalMapper or ARCGis.
As far as memory use is concerned, RM is much more sensitive to the overall map size than the number of data points. Unfortunately due to the current implementation it doesn't matter how much PC memory you have above a certain theshold, as the limitation is the number of data points within the map grid that can be addressed using 32 bit values (even if the application itself is running in 64 bit). That is unlikely to change in the short term.
The administrator has disabled public write access.
SCROLL TO TOP