Unfortunately you are not allowed to do - it is not like Rugby where the referee uses judgement it just does not happen in football.
Of course refs do not make errors but most of his decisions were correct.
The tone of the match changed directly James got involved when he should not have and got booked