When you delete a forum all its topics and replies will be deleted too. To delete the forum click on button "delete". You will see a notice about the number of topics and replies in the forum and should confirm the deletion.