I would have protested your protest.
Why?
If an umpire has made the wrong call (and calling an out on an appeal play WITHOUT the appeal is the wrong call) then I have every right to protest.
And for the record, unless this was the very last play and was the winning run, then no it did not lose the game.