I am trying to train my nine week old pup to go toilet outside but keeps trying to eat the gravel!?

he is a shih tzu and we have a completely graveled and slab paved garden with no gr. any ideas what i can do to stop him from doing this? i am scared he will swallow some. i have to prize it out of his mouth all the time.