From the main menu through Layer → Delete Layers.

From the Layers Dialog, you can access it through the Delete Layers command of its context menu, by clicking on the icon button on the bottom of that dialog, or by dragging and dropping the selected layers on top of that button.