It's a state park; you can hike, bike, or just stand there. That's pretty much it.
If you're planning on staying in the area, Hershey Park and the Gettysburg battlefields are within an hour's drive of Carlisle. If you want to spend the weekend in a hotel down here and have a little more fun in the area, those are two classic options.