Easy tool for evaluation of images datasets, where recall isn’t an option

01 Jun 2012 . category: . Comments

Often when doing image dataset evaluation you want a quick easy way to either see how different descriptors perform or just get an evaluation measure for your system. Well I have created a tool to be able to do the former. This is a simple tool so you can select images, if that image appears in another descriptors results it is auto-magically highlighted to avoid bias or mistake. As you scroll the query image stays with you and finally you can upload a relevance result for each descriptor to the server.

image_descriptor_evaluation_tool <p> </p> <p>Of course to use this requires you being able to ping against my server so isn’t for public use, but is quite fun to play around with javascript and see how easy although painful it can be to create GUI’s for distributed use.</p>
Stuart James  …

Stuart James

Assistant Professor in Visual Computing at Durham University. Stuart's research focus is on Visual Reasoning to understand the layout of visual content from Iconography (e.g. Sketches) to 3D Scene understanding and their implications on methods of interaction. He is currently a co-I on the RePAIR EU FET, DCitizens EU Twinning, and BoSS EU Lighthouse. He was a co-I on the MEMEX RIA EU H2020 project coordinated at IIT for increasing social inclusion with Cultural Heritage. Stuart has previously held a Researcher & PostDoc positions at IIT as well as PostDocs at University College London (UCL), and the University of Surrey. Also, at the University of Surrey, Stuart was awarded his PhD on visual information retrieval for sketches. Stuart holds an External Scientist at IIT, Honorary roles UCL and UCL Digital Humanities, and an international collaborator of ITI/LARSyS. He also regularly organises Vision for Art (VISART) workshop and Humanities-orientated tutorials and was Program Chair at British Machine Conference (BMVC) 2021.