R6 CB550 Front end swap question

Hey all. I have the R6 front end, hardware from All Balls, but feel that I'm missing something critical. I went to slide a washer on the lower stem and it was held up at the same spot the bearing would be held before pressing it down. Is this natural, or should I seek out a washer with a slightly larger diameter to slide down freely? Or do I not put a washer on? The R6 diagram shows no lower washer and just a bearing.

Thanks for the help as I try to untwist my mind from what I believe is the correct way.

If I missed a search please point me in the right direction.