You can arrange delivery fees for each product by simply scrolling down to the bottom of your page. Ensure that "Offer Shipping Option" and "Charge for Shipping?" are enabled.
Note that items being shipped with delivery are costed per product purchased at this time. It would be advised that you take note of when to charge accordingly for shipping.