A proper apostrophe should look more or less like a superscript comma. See Quotes and Accents and Smart Quotes for Smart People for how to get them right.
See also straight quotes ("), rotated/flipped apostrophe (‘), apostrophe (’).
Contributed by Quentin Schmerber
Contributed by Best Studio
Contributed by Lewis McGuffie
Contributed by Peiran Tan
Contributed by Alex Slobzheninov
Contributed by Eliott Grunewald
Contributed by Robyn Mays
Contributed by 205TF
Contributed by Love Lagerkvist
Contributed by Patch Hofweber
Contributed by Matthijs Sluiter
Contributed by Stephen Coles