MarsSILike each year, we brought some love and updates to #MarsSI today!
1. First, if you have requested data in the past 3 months, you must have observed that we are quite overwhelmed. It's not the real solution, but member of the #OCEANID #ERC project that use #MarsSI a lot have now a dedicated sub-cluster, so they'll leave the regular one available for the community ;)
2. We also have done some statistic about the various data processing and found we should be able to better predict the duration of, for example, DEM generation. This will mean some jobs should almost never fail because the job ran out of time, and more efficient time will please the scheduler and provide quite accurate start/finish time. A future update will try to show this info!
For now, we use this only for CTX and HiRISE DEMs generation.
3. Copy jobs: we realized that between #MarsSI and our #OAR batch scheduler features, it would be quite easy to make so that copy jobs look if a processing job is queued/running regarding the data requested.
Meaning you can now quickly request a CTX DEM generation, before waiting for completion sending the copy request and the copy will be done when the DEM generation is finished!