Yes, you can! Just make sure your group or organization is empty by moving your kids to another group or simply removing them.
Check out this article to learn how to move kids to another group: How can I move kids to another group?
Once your Group or Subgroup has no kids, go to the group or subgroup's page, click on the Info tab, and scroll down to see the Delete button
Click OK on the pop-up confirmation message: