In many cases, yes. Removing the old roof allows for a thorough inspection of the roof deck and ensures proper installation of the new roofing material. However, some building codes may allow for re-roofing over the existing layer under certain conditions.