Hey there!

While time goes by, my projects are getting bigger and bigger.
One of my projects reached the size of 1,5 TB of sonar files.

How do you handle your data? Do you keep it all or convert it?
I'm thinking about exporting the non in a mosaic used files as a csv file. But sometimes I have to correct deeps in not often scanned areas.

Best regards Patrick

We are certainly only discussing pure depth maps.

I would definitely always save the originals on hard drives, if possible on two separate ones.

For use in RM, however, I would export all data from a very large project as a csv, because then changes after editing are also included. I use this csv as a template to add new data and save everything again as a csv. The next, new RM project with the newer csv data will then certainly perform better.

In order not to keep adding new log data to the same data, I use GIS programs (and the aforementioned csv in them). By buffering the existing points and comparing this geometry with the new points, I can specifically select only the newer points and add them later.

For large amounts of raw data, for example when exchanging data with other users, I also use the IMC's sonar mode if the other users do not have RM.

Yes, we are just talking pure depth maps.

At this moment my working data is on an 2TB M2 SSD, backuped on a Raid 1 on my Computer and synced on a Raid 5 NAS.

Sounds like beside my original problem I could have solved the problem of my big Projects beeing "slow".

I will defenetly try the csv export.

The IMC sonar mode sounds interesting, but I always import all logs to have a look at interesting objects/structures on sidescan.

Would you recommend to use a seperate Projekt for the mosaiks?

"Would you recommend to use a separate project for the mosaics?"

Yes, definitely.
However, the next step depends on what you want to do with the mosaic and what the result should be.

For vector data, a large project would be recommended.

For raster data, consider the result, which is much larger in terms of file size and sometimes takes a long time to process. In this case, it will be more useful to output smaller sub-projects as rasters.

I'll consider using a seperate projekt for mosaic.

At the moment I do export smaler areas as PNG files and use the IMC to generate a raster map of a larger region with multiple small "area folders".

This works out fine and since using the imc beta with multicore usage it's quite fast.