It works just fine in rugby league with the referee signalling when to start and stop the clock. It would mean an alteration to the laws of the game (the ref would no longer be the "sole arbitor of time" but I wouldn't have an issue with that.
On a slightly related note, the difference between players attitudes to refs on football and rugby is huge, footballers could learn a lot about respect!