Joel worries friends and family with his pointed threats