Should I get a track bike? Should I race on the track?

I admit that racing without brakes seemed CRAZY two years ago. But since then, I've learned more about fixed gear bikes and I'd like to try riding one. And everyone says that track racing really improves your pack skills.

There's no downside to this, right?