Right click the group that you want to rename or delete, and then select "Rename Group" or "Delete Group":
Please note: only group without any contacts can be deleted. "Ungrouped" can not be renamed nor deleted.