Neanderthals lost genetic diversity around 110,000 years ago. Researchers confirmed this by studying fossilized inner ears.