Building setbacks are established by the zoning district (e.g. R1-7,000, R1-12,000, etc) your residence is located. You can determine what district your property is located in by looking at the zoning map (PDF). After determining the zoning district, refer to Title 18 - Zoning of the Municipal Code for setbacks (find the chapter for the specific zoning district the residence is located and setback standards listed under “Site Development Standards” section of the zoning district). The listed setbacks apply to the dwellings.
There are separate setback standards for accessory structures (arbors, detached garages, storage sheds, decks, etc.).
For more information, contact the Planning Division at 408-778-6480.