Is there such a thing then as a “virginal vision” of art? Can we ever see the world or a painting in pure sensory terms without being influenced by external factors of the moment or cultural factors or some internal biological factor that precludes that simple pure vision?

I don't think there's such a thing, not even the everyday vision of an infant is likely to be a purely sensory affair..The reasons behind the “impure” vision are so deeply embedded in the way our minds are biologically structured and how they typically operate, that in spite of individual variations, the reality of impure vision imposes itself.

"It is well known that in the wake of the Romantic era, Cézanne and a host of other artists dreamed of restoring a sense of innocence and purity to our senses—the naiveté of the artist and the innocence of the viewer. Is there such a thing as pure vision? When we are confronted with a painting, is it possible for us to see the object in pure visual terms without being influenced by a host of factors such as one’s prior history of seeing art or one’s acquaintance with art history?"

The Case for Impure Vision By Antonio Damasio