calibration of IR sensors with OPAMP is a common issue in line follower projects. try setting a low reference voltage to OPAMP and make sure output from IR sensor is greater than reference voltage if opamp is configured in non-inverting fashion…can also try a transitor amplifier to boost signal from IR sensors