If you keep following the path of "Well it isn't that much more" you'll soon find yourself with a new Ducati Panigale.
I haven't ridden an SV, but after a dozen trackdays on the RC51, I just did a trackday on my '98 ninja 250 and it was the most fun I've had at the track. Yeah, I got passed a ton, but every time I was able to pass a bike on the outside of the corner it was great. Of course they are going to pass me on the straights. I'm lucky if I have 25hp vs a 180hp literbike. Passing a Hayabusa was the highlight of my day.
If you are thinking of getting into the track, I would suggest either the 250 or the 650. Both are going to be much cheaper for initial costs. The sv650 has a huge following on the track, so there is plenty of knowledge and used parts floating around. The RC had a good following, but aftermarket parts are getting harder to come by and will be expensive when they do. People are selling used Ohlins forks forks for 75-80% of what they cost new, same thing goes for Sato exhausts. If you went with a 250, get the '08 or newer. They have 17 inch wheels stock, and much more support from the aftermarket, and the stock suspension is much better. If you get into racing, you'll also be on the better platform vs. the older 250. I can't speak too much about the 650, but I will tell you that the 250 will feel pretty damn slow compared to your magna. I would try and ride one first to see if you'll be completely bored before you plunk down the cash.
All in all, you are entering the best time of year to buy a bike. So remember that it will be a buyers market until around early spring. Be patient and you'll be able to find whatever you want.