There are many openly available data sources for GIS data on the web. This section of the GIS guide contains a variety of databases for finding GIS data. It is not exhaustive.
Below are some general databases for finding GIS data. In general, when searching for data on Google you may want to search for what kind of data you are looking for, raster or vector (shapefile) data to help your search.