When he isn't doing his countryside alliance thing (mind you he's pretty critical of their management) Charlie has a tradition of using his silly little column to politicise racing. Not sure how he got that job, it's as if he knows someone in the media somewhere.
The slightly amusing thing is that Charlie is all for free market economics and the survival of the fittest, until it comes to training race horses, where he seems to think a subsidy is necessary. As Norman Tebbit would say, trainers can always get on their bikes (or the ferry to Deauville) now if they wanted.
The bottom line is that racing is a web of inter-connected interests, all of whom would be a diminished force were a single one removed. Sadly, the industry itself often makes the mistake of thinking they're the linchpin. They're important, of course they are, they're essential, but hey're also a wheel in a clcokwork mechanism. You can start with any point in the chain and speculate what happens if X was removed. No bookmakers = no punters = no sponsors = no prize money = less owners = no horses
Most scenarios end up with point to point hobby racing or very rich privateers settling personal match wagers
As it happens, the most significant recent advances made in the bookmaking industry in terms of deregulation have occurred under Labour govenment's. The conservatives have been pretty poor in comparsion. Charlie has omitted to mention the 'Portas Report' for example which recommended that bookmakers be removed from the high street and slung down back street alleys. Blair and Brown by contrast introduced the gambling act which allowed them to use clear class windows, advertise using PoS, advertise on television, and they abolished the 9p betting duty. It was a Labour government that tried to build the super casino (defeated by a combination of Teresa May, the Tories, and a small group of Labour MP's centred around Diane Abbott).
It was the conseravtives of course who first tried to sell the Tote in 1989, until Michael Howard (he of Folkestone racecourse) stopped it in 1995. The Labour government tried to sell it again, but stalled on two separate occasions (largely due to market conditions rather than any point of principle admitttedly) Ultimately is was sold in 2011 by David Cameron, but I think you could argue that either party would have sold it, just so happened they were on watch
Anyway, if Charlie wants to go to France, let him. It would serve the French right if we could send a few back there (we just know that he won't though), but racing has no more to fear from Labour as it does from the Tories. The idea that Miliband is going to close down Royal Ascot is just silly. We've had Labour government's before and non of them have tried to close Ascot to my recollection