While your image is displayed in the Gallery, click on the link
Edit Image that is in the Additional Info section under the image.
On the next screen, tick the box marked:
If you want to delete this image completely, check this box
Click
Submit Changes and your image will be deleted.