Coastal Vulnerability model hangs with excessive gdal warnings

Nomsy · February 8, 2023, 11:21am

Hi,
I ran the coastal vulnerability model, and I was able to get some results and not some, one of the results I didn’t see was the coastal exposure. Was hoping I could discuss with anyone on the team about the results I got and the ones I couldn’t get.

Looking forward to hearing from someone.

swolny · February 8, 2023, 3:39pm

Hi @Nomsy -

Where are you looking for the exposure output and not finding it? Inside of the output coastal_exposure.gpkg there should be the layer main.coastal_exposure (if you’re using ArcGIS, otherwise the layer will be called coastal_exposure in QGIS), and the attribute table for main.coastal_exposure should include the field exposure (among others). Is this field not present in the output gpkg layer? Or is the field present but has no values?

~ Stacie

Nomsy · February 8, 2023, 4:00pm

Hi @Stacie,

Yes, the field is not present in the output gpkg layer.

Nomsy

Nomsy · February 8, 2023, 4:01pm

Chinomnso C. Onwubiko
PhD Candidate, World Bank Africa Centre of Excellence in Coastal Resilience(ACECoR)
+2347061162130

swolny · February 8, 2023, 4:15pm

Can you post the log file related to that model run? There might be messages that indicate what’s going wrong.

~ Stacie

Nomsy · February 8, 2023, 5:20pm

Y
Output_05022023.zip (6.5 MB)
Yes, I can

dcdenu4 · February 9, 2023, 8:07pm

Hi @Nomsy,

It’s hard to see anything from the logfile you shared, unfortunately. It also looks like the logfile is incomplete… Is it possible you could share you data so we can try to reproduce what you’re seeing? A filing sharing service like Google Drive or Dropbox usually works well. You could post a link to share the data here or email to ddenu@stanford.edu.

Thanks!

Doug

Nomsy · February 10, 2023, 5:10pm

Hi @dcdenu4,

Please see the link below

Nomsy · February 10, 2023, 5:18pm

Hi @dcdenu4,

I also sent to your email. I’m sorry I sent them in bits.

dave · February 13, 2023, 8:36pm

Hi @Nomsy , I looked at your logfile as well and it appears the model just isn’t finished. That being said, there are a lot of warnings related to the geometry of the habitat layers. You might be able to speed things up considerably by fixing those issues.

It’s often the case that vector layers that were “vectorized” from a raster have these problems. If you happen to have rasters representing these habitats instead of vectors, you can use them directly in the model.

If you only have the vector layers, then you could try to “simplify” and/or “fix” their geometries using a GIS tool.

I would also recommend increasing the model_resolution to a much larger number while you troubleshoot these issues. Once you have those issues resolved, you can decrease the model_resolution again as needed.

Good luck!

Nomsy · February 14, 2023, 10:59am

Hi @dave

Thanks for responding.

So I noticed the model kinda runs “endlessly”, sometimes more than 5 or 6 hours and I have to shut down my laptop just to end it. Could it be the reason why it isn’t finished?

For the layers, I can’t input a raster layer into a vector layer, the model wouldn’t run. what do I do?

dave · February 14, 2023, 1:49pm

Oh interesting. It is hard to know why it is behaving this way, but I would start by dealing with the warnings coming from the habitat layers.

Starting in version 3.10, this model accepts raster for the habitat layers. You may enter the path to the raster in the Habitats CSV Table. http://releases.naturalcapitalproject.org/invest-userguide/latest/coastal_vulnerability.html#data-needs

If that is not working, please update us with a new logfile or the error from the user-interface so we can see what goes wrong!

Also, for whatever you try next,

Nomsy · February 14, 2023, 5:49pm

So am currently running the model, I increased the model resolution and it’s been running for a little over 6 hours now, when it’s done, I will check out the habitat layers again and the warnings.

Nomsy · February 15, 2023, 11:34am

Hi @dave,

So, the model ran all through the night and when I checked the results, it was still the same as before.

| dave
February 14 |

| - |

Nomsy:

So I noticed the model kinda runs “endlessly”, sometimes more than 5 or 6 hours and I have to shut down my laptop just to end it. Could it be the reason why it isn’t finished?

Oh interesting. It is hard to know why it is behaving this way, but I would start by dealing with the warnings coming from the habitat layers.

Nomsy:

For the layers, I can’t input a raster layer into a vector layer, the model wouldn’t run. what do I do?

Starting in version 3.10, this model accepts raster for the habitat layers. You may enter the path to the raster in the Habitats CSV Table. Coastal Vulnerability Model — InVEST documentation

If that is not working, please update us with a new logfile or the error from the user-interface so we can see what goes wrong!

Also, for whatever you try next,

dave · February 16, 2023, 5:11pm

Did you try anything new with the habitats?

Nomsy · February 17, 2023, 11:03am

Yes, I did.

I removed every other habitat except for mangroves and wetlands.

Nomsy · February 17, 2023, 12:09pm

Yes, I did.

I removed all the other habitats except mangrove and wetland habitat.

dave · February 17, 2023, 2:20pm

That’s a good idea. Are you able to try either of the below options for the those habitat layers?

If not, you may share the offending habitat layers with me and I can take a look at them, but cannot guarantee that I can fix them. (Please zip all the component parts of the shapefile together and share a link to one zip file, thank you).

Nomsy · February 18, 2023, 12:40pm

I didn’t have to convert from raster to vector. The data was downloaded from the European Satellite Agency (ESA) website.

I don’t know how to “simplify” and/or “fix” their geometries using a GIS tool.

Okay, I will zip and share a link to one zip file with you.

| dave
February 17 |

| - |

Nomsy:

I removed all the other habitats except mangrove and wetland habitat.

That’s a good idea. Are you able to try either of the below options for the those habitat layers?

dave:

It’s often the case that vector layers that were “vectorized” from a raster have these problems. If you happen to have rasters representing these habitats instead of vectors, you can use them directly in the model.

If you only have the vector layers, then you could try to “simplify” and/or “fix” their geometries using a GIS tool.

If not, you may share the offending habitat layers with me and I can take a look at them, but cannot guarantee that I can fix them. (Please zip all the component parts of the shapefile together and share a link to one zip file, thank you).

Nomsy · February 18, 2023, 2:56pm

Hi Dave,

Kindly see the link to the habitats attached below, I named it “zipped”:

https://drive.google.com/drive/folders/1Akfm4tLv-pwDsk8gTf748EYy9-1GPFIo?usp=sharing

I didn’t have to convert from raster to vector. The data was downloaded from the European Satellite Agency (ESA) website.

I don’t know how to “simplify” and/or “fix” their geometries using a GIS tool.

Okay, I will zip and share a link to one zip file with you.

| dave
February 17 |

| - |

Nomsy:

I removed all the other habitats except mangrove and wetland habitat.

That’s a good idea. Are you able to try either of the below options for the those habitat layers?

dave:

It’s often the case that vector layers that were “vectorized” from a raster have these problems. If you happen to have rasters representing these habitats instead of vectors, you can use them directly in the model.

If you only have the vector layers, then you could try to “simplify” and/or “fix” their geometries using a GIS tool.

If not, you may share the offending habitat layers with me and I can take a look at them, but cannot guarantee that I can fix them. (Please zip all the component parts of the shapefile together and share a link to one zip file, thank you).

Topic		Replies	Views
Coastal Vulnerability: csv output looks good - gpkg output does not open in ArcGIS Software Support coastal-vulnerability	11	1062	July 7, 2021
Coastal Vulnerability Model - ArcGIS gpkg add data error Software Support coastal-vulnerability	7	551	September 15, 2021
Coastal Vulnerability model stuck at wind exposure Software Support coastal-vulnerability	8	663	July 22, 2020
How to interpret results of Coastal Vulnerability model Science, Research & Data coastal-vulnerability	5	440	March 10, 2023
Coastal Vulnerability KeyError: 'Illegal field requested in GetField()' Software Support coastal-vulnerability	11	1363	January 5, 2022

Coastal Vulnerability model hangs with excessive gdal warnings

Related topics