I've always gotten the impression that he's skinnier than he should be because he forgets to eat, so he looks more gaunt than elfin, if that makes sense. If we go by Mark, his 'natural' build would be more stocky, like his father (for all Miles daydreams of looking like Ivan sans the solitixin.)