You can delete a Blog post by clicking on the icon in the "Manage Blog Posts" section of the Toolbar by clicking "Manage Website" then "Blog".
A confirmation box will appear and you will be asked if you are sure you would like to remove the post before it can be deleted.