The classical understanding of the difference between observation and inference is difficult to maintain. One may be able to make some type of general distinction by using loose, emphasis-based categorization.
The difference between observation and inference becomes difficult to detect because the process is not linear; it is cyclic. The process of observing involves some form of inference. If the mind moves, the mind infers.