The invention relates to a golf ball comprising a core, an intermediate layer disposing around the core, and a cover including at least one layer that includes a polyurethane or polyurea polymer. The intermediate layer is preferably rigid and has a durometer hardness of greater than at least 80 Shore C or at least 55 Shore D. The intermediate layer preferably includes a diene polymer. Alternatively, the intermediate layer includes a cast or RIM thermoset polyurethane, polyurea, polyurethane-ionomer, epoxy or blends thereof.