Falling at first hurdle??

I have started a pair of norwegian mitts tonight using the pattern in knitting around. However I seem to have a problem. I cast on the 56 sts and began by using the cuff pattern in the book and simply repeating it four times, however where the round meets the pattern doesnt meet up.

here is the error
















and here is how I expected it to look (this is at the halfway point of the round)

















I am not eniterly sure how to fix this so could anybody who has any advice or has made these please help? Its the winter spruce mitts.

Cairi