It'll do fine. I drove with all my panels off for about 10 miles (no traffic as I live VERY rural so brake lights weren't needed and I also had the headlights pulled). FWIW - if you drive with panels off make sure your side marker lights are taped up out of the way. They will bounce on the tires if left down.
Your center grille fits into the grille surround so you'll be missing both pieces. You should be OK as long as no rocks or anything fly into that open mouth.