The bite is a result of good levels of acidity (especially in young wines). It is considered the "raciness" in wine.
Bitterness is perceived by many to be unpleasant, sharp, or disagreeable. A bitter taste can be the result of heavy metal (copper, bronze, etc.) contamination in a wine.