In "The Scarlet Letter," a stranger who appears while Hester stands on the scaffold, and in what way is he is slightly deformed?

The man, we come to find out, is Roger Chillingworth, Hester's husband.  It is said that he has the look of an intellectual about him--of someone who spent more time tending to intellectual pursuits than developing himself physically.  The narrator states that the stanger is small in stature and has one shoulder that is lower than the other.