Frost ..of any magnitude, is rare in S.F. That said, If you look at the area's overall climatology, S.F. is also one of the coolest ( ...or coming in at least within the top 10-15 places globally ) zone 10 areas on the planet.. While it may be 100 / 100+F in a hotter part of town in San Jose on a " hot " day in July, Aug, or September, ..More often than not, it is only in the 70s- 80s -at most- during a " heat wave " out there, 95% of the time, at the same time in S.F.
Lows up there often cool off into the 50s / lowest 60s at night on " hot " days as well, and humidity levels are rarely all that low, due in part to the persistent influence of the Marine layer that rolls into town almost nightly a fair amount of time during the warmer months.
There's a local / regional, weather- related saying that .." When you spend a day up there, ..or at many of the beaches nearby, it might be ' Shorts and T-shirt weather ' during the day.. But, once you start to see the fog roll in, you better have a Sweatshirt ( ..and / or a pair of Pants ) with you ..You'll regret not bringing one. Even if you'll be taking it off once halfway home ( if " Home " is some place like San Jose, or a city further inland from S.F. Bay, away from the local, " Cool Ocean " - influenced weather ) "
Temps exceeding the upper 90s / over 100 are about as rare as anything below 32F ..though they're becoming a touch more common -slowly- overtime as even San Francisco warms a bit in a warming climate.
Great place for anything tender that enjoys a moderate climate, but tougher for plants that like heat. In some cases, some of the plants that are grown there can suffer damage if it gets too hot.
Ironically, S.F. ..and some nearby areas across the Bay / south along the coast, ..and in parts of S. Cal, closer to the coast, are great for Some of the " Tropical " Rhododendrons, AKA those in the Vireya group. Fantastic place for growing Fuchsias. Tougher further inland ( Too hot / dry )