They were probably descended from people who learned that if you look too hard at anyone on horseback you receive a sharp stinging sensation such as might be obtained by a stick around the ear. Not looking up at people on horseback had become hereditary. People who stared at people on horseback in what was considered to be a funny way never survived long enough to breed