National Climatic Data Center
This site, from the National Oceanic and Atmospheric Administration (NOAA), bills itself as the "World's largest collection of climatic data." The free data includes comparative climatic data, wind data, storm data. You can download monthly climate statistics for all stations in California. Some fee-based information, such as climate maps, is low-cost.