Thanks for the replies everybody! I also spoke to a dealer and he suggested checking for a missing baffle on my deck as well.
Does anybody have any pictures of what that would look like? I'm going to remove the deck on my mower after I go home and take some pictures of my deck so you guys can see what I have.
@bhayden - Do you have a picture of what piece you are talking about? I notice that my bagger gets a lot of clippings right behind where the bags slide onto the metal brackets.
Also, I've tried going slow... very, very slow and sometimes it works decent, but often it seems like the deck is acting like a fan blowing 75% of the leafs outside the deck. I've borrowed some neighbors riding mowers with baggers and they work quite well, so I really do think something is wrong with mine (or maybe I'm missing a baffle like suggested?)