"He literally smiled after throwing him to his death".
Yeah, I know, but all we have on him are speculations about what he did or could have done, which I don't think it is enough to point out him as a villain. Also, the characters did not need to be evil to put everyone in danger during the glass bridge game, anyone who was scared could have ended up stalling.