In the diagram below, three diverging rays hit the eye. What are you seeing?
With the information given, there is no way to be sure whether the rays actually are coming from an object, or is just being perceived by our brain to have come from a point (which is the definition of an image!). The eyes just sense the direction of the rays when they hit the eye, there is no way to know the history of the rays for the eyes, is there? Ergo, there is no way for the brain to tell whether the rays are coming from an object or an image!
Not clear? Recall: we make out where and object is by extrapolating, or extending backwards, the rays which hit our eyes. So, there is no way for us to tell whether the light is actually coming from an object, or an image.