SF Novel, Early-Mid 1980s, Man "Haunted" By Entity That Ends Up Being A Projection of a Bunch of His Future Clones
There is also a female character introduced partway through who was rumored to have had sex with an ape of some sort, possibly an orangutan, to entertain a group of powerful people (generals?).