Well, maybe it's not such a secret, but upstairs at the Harley Davidson Pavillion there's a great place if you are at Summerfest with kids.
There are lots of tables upstairs, clean bathrooms, a great view of the grounds and the Harley Stage. You can bring your own food and drink upstairs during the day and it's a great place to wind down & recharge.