If the folder is empty, then select "Properties" from its context-menu and in the "Remove" tab, select the "Remove folder" checkbox. Select the Component whose removal will also trigger the folder removal.
If the folder is not empty, then you need to use a Custom Action.
FOLLOW US