I had to move a lot more than that when I built my garage---all the dirt excavated for the floor slab and foundation walls had to be put back after the foundation & slab were poured....I used my GMC 4x4 plow truck to move the bulk of it,with the fisher plow,after getting discouraged at how slow and hard it was shoveling it by hand....I said to myself "I wish I had a bulldozer!"....then looked at my plow ,and went "DUH--I DO!"...it worked a lot better than I thought it would too,it took some learning though--dirt isn't as easy to move as snow is,and you have to take small bites,not a full pass,then back-dragging it levels it off nicely....
I had a Ford 600 tractor with a pipe framed loader then too,but found it too cumbersome to manuver with a full bucket and no power steering,so I figured I'd try the truck,it was a lot faster and easier....I used my Bush-Hog tractor that had a snowplow to backfill the dirt inside the garage too,before the slab was poured..it would have been a few weeks of hard labor,if I'd done it by hand--not sure I'd have lived to see the garage get built if I did it alone...its amazing what you can do with even a small tractor,with the right attachments..