I agree with your assessment. Not having taken any pure maths course, the book seems to have several gears: Part 1 is in 1st gear, part 2 is in 2nd gear and Part 3 goes into 5th gear. Nevertheless, the book is probably the best attempt available to make category theory accessible to non-pure mathematicians.