You have large holes in your data. But your data is not well defined by the convex hull of your data. So you have this long concave edge that seems to roughly define one boundary of the data. There are also some moderately scattered data points, which are scattered away from the mass of the rest of your data. Are those holes ok to fill in?
So it is apparently ok to fill in some large holes, but not others. Computers are not very good at understanding subtle differences like that. How big must a concavity be to be no longer acceptable to interpolate over?
A solution is to use an alpha shape to determine an acceptable triangulation. The result will be a triangulation, but less than a complete convex hull. That Markus was unable to deal with a triangulation does not mean computations (like gradients) are impossible to build, merely that Markus did not know how that might be done.