Digital world has developed tremendously. Initially textual information associated with images is used to do image based search. From user's perspective the final result contains both relevant as well irrelevant images. The expected yield from such a system is to get pertinent result. Satisfaction of the client will be enhanced if re-ranking is used as critical parameter. Images are displayed based on the category selected and re-ranked ac-cording to the query image opted by user. Image re-ranking based on user log technique is used to overcome the issues and to achieve efficient result. Expanding the keyword and clustering is done at offline mode which is al-so important parameters for the performance of the system. The performance of re-ranked image retrieval is improved with a reduction of time in seconds as compared to existing re-ranking method. The maintained user log helps to produce the relevant search results. The proposed user log system reduces the image retrieval and re-ranking duration from 17 seconds to 4 seconds.