From experience, a digger will not shift muck very easily, it tends to tip back over the front of the bucket.
A decent sized bucket with plenty of long teeth would help, but seems like just the wrong tool for the job.
And yes, a loader tractor is a very good alround tool and you will learn on the job. 2 years ago i hadn't done much engine work, now i've repaired starter motors, replaced water pumps, alternators and sensors, rewired the digger (admittedly i've done electrics before), replaced ran seals, started to rebuild a loader that is missing important parts