At first, VoLTE will be used to deliver "Rich Communications Services" (which look like something similar to what Voice over IP/Video over IP outfits offer today) rather than completely replacing narrowband voice. It will be awhile before Verizon is willing to commit to that, due in part to LTE outages in late 2011.
On the flip side is MetroPC, which has pushed VoLTE as hard as it could.
Then there's Sprint, which will stick to voice over 1x for the foreseeable future, but routes Direct Connect over IP. Sprint's latest DC incarnation seems quite similar to one facet of RCS over LTE.
It would cause massive interference and wouldn't work unless you had a buffer area with no b41. Or if they had an unused set of earfcns, they could potentially use those just at the stadium with a different TDD timing config.