If you use a rolling shutter sensor, you can synchronize the display update with the readout of the rolling shutter sensor. In this case, the latency can be very low since the imaged line is immediately transmitted and displayed. Even you put some processing in the pipeline, you still can have a very slow latency.