Get the specified layer's mask if it exists.
This procedure returns the specified layer's mask, or -1 if none exists.
The layer.
The layer mask.