In some baking I use smaller portions than specified in the recipe of milk or yogurt. When I eat foods containing small amounts of dairy I take a lactase enzyme.
Regarding the sorbitol I think you will have to experiment and see if you can handle peaches.
-------------------- STABLE: ♂, IBS-D 50+ years - Science of IBS