The purpose of this paper is to assess the performance of an online benchmarkign tool developed for logistics service users and providers to provide alternative service option in Europe - First, conduct desktop research including but not limited to academic literature reviews on benchmarking, performance measurement and previous and current examples of online benchmarking tools in order to determine issues in the field; second, report the development process and functionalities of a benchmarking tool; third, examine the benchmarking tool through structured interviews with the users of the tool; and finally, draw conclusion as to whether the tool is effective or needs changes to make it more effective. - Six Key Performance Indicators were identified: Transport cost, Transport time, Flexibility, Reliability, Quality, Sustainability. The functionality of an online transport chain benchmarking e-tool is detailed. The evaluation of the tool found that it is a strategic decision making tool; cost is most often selected as the most important indicator; the majority would not use the tool for daily planning purposes. Future needs of development were identified, including using the tool for procurement decisions, and it’s utility in supporting corporate social responsibility and sustainability. - The benchmarking e-tool is developed for the 27 EU countries plus Norway and Switzerland. Thus the research findings are primarily applicable for these countries and may not be applicable for other countries. - The online tool has been used by multiple commercial companies actively involved, as a service provider or user, in the freight transport chain to plan their transport chains. - The paper meets a research need to evaluate a newly developed online benchmarking tool, as well as detailing the e-tool, and setting it within the practice and policy in this field.