GameObject in Hierarchy could not be deleted with "Delete" button on a keyboard

Steps:

1. Create a new project
2. Add GameObject to the Hierarchy
3. Select it and press "Delete" button on a keyboard

Expected: Selected GameObject is deleted

Actual: Nothing happens