01 · Evaluation
Methodology Principles
Unified Methodology The scoring process is based on a clear and unified methodology for each category, ensuring, as far as possible, fairness and objective comparison between participants. Category-Specific Criteria Evaluation criteria and their weights may differ between sectors and categories according to the nature of the activity and the service or product being evaluated. Announcement of Criteria Participants are informed of the main evaluation criteria before the evaluation process begins, while the committee retains the operational details that must remain confidential to protect the integrity of the process.
02 · Evaluation
Total Score and Weights
Total Score Each participant's final score is determined by the sum of the points or percentages resulting from the evaluation elements approved for the category. Weights A relative weight is assigned to each criterion according to its importance in the category, and the approved weights for the final result total 100%.
03 · Evaluation
Evaluation Components
Technical Evaluation A proportion of the score may be allocated to the technical and professional evaluation carried out by specialist evaluators and experts. Product or Service Quality A weight may be allocated to the quality of the product or service, its consistency and its fulfilment of the standards relevant to the category. Customer Experience Customer experience may be included in the final result through approved measurement tools, including customer ratings, surveys or customer satisfaction indicators. Field Visits A proportion of the result may be allocated to field visits and direct evaluation where the nature of the category is suited to this. Mystery Shopper The mystery shopper's result may be counted in the final evaluation in sectors where the actual customer experience is a core element. Official Data Official data and information available from Qatar Tourism or other governmental and official bodies may be used, where relevant to the category and permitted for use. Innovation and Development A weight may be allocated to innovation and development, the use of technologies, or the provision of new solutions that raise the quality of the product or service or the customer experience. Value for Money The value the customer receives in return for the price may be evaluated in categories where this criterion is appropriate. Sustainability and Responsibility Sustainability, social responsibility and environmental practices may be included among the criteria of certain categories according to the nature of the activity. Digital Evaluation The establishment's experience may be evaluated through its website, application, booking or ordering systems, or digital communication, where this forms part of the customer experience. Reputation and Public Experience Reliable indicators relating to public experience or general reputation may be used, with procedures applied to verify the quality and credibility of the data.
04 · Evaluation
Reliability of Scores
No Reliance on a Single Source In categories that use several evaluation tools, the final result does not rely on a single source only, wherever it is possible to use a range of evidence and indicators to arrive at a more comprehensive evaluation. Score Standardisation Statistical or mathematical processes may be used to standardise scores where the measurement tools or evaluation scales used differ. Evaluation by Multiple Evaluators Where there is more than one evaluator, the average or weighted average of their scores may be calculated in accordance with the approved methodology. Abnormal Scores Any score that differs substantially from the establishment's other evaluations may be reviewed to ensure there is no error in entry or application. Supporting Evidence Additional evidence may be requested to verify information that materially affects the final score.
05 · Evaluation
Minimum Qualifying Threshold
Minimum Qualifying Threshold A minimum score is set which the establishment must achieve in order to be eligible for inclusion in the list of winners. Ten Winners Not Guaranteed The name of the award does not imply that there must be ten winners in every category. If ten participants do not achieve the approved minimum, only the qualifying establishments are selected and ranked. Exceeding the Minimum Does Not Guarantee a Position Achieving the minimum qualifying threshold does not guarantee the establishment a place among the top ten positions if the number of qualifying establishments exceeds ten.
06 · Evaluation
Ranking of Participants
Ranking of Participants Qualifying establishments are ranked from highest to lowest according to the approved final score. First Place The holder of the highest approved final score in the category obtains first place, provided that all eligibility requirements are met and there is no impediment to approving the result. Remaining Positions Subsequent positions are determined in sequence according to the approved final scores. Decimal Fractions Scores may be calculated using decimal fractions to the level necessary to achieve an accurate ranking. Rounding of Scores If scores are displayed to the public in rounded form, the ranking is based on the original calculated score before rounding.
07 · Evaluation
Ties and Tie-Breaking
Tied Cases If two or more participants obtain the same final score, the predetermined tie-breaking rules are applied. Breaking a Tie A tie may be broken on the basis of the result of a specified main criterion for the category, followed by a second criterion if the tie persists, according to the sequence approved before the results are approved. Persisting Ties If the tie persists after the tie-breaking criteria have been applied, the Joint Committee may take the action specified in the category methodology, including reviewing the evidence or conducting an equal additional evaluation of the tied participants.
08 · Evaluation
The Joint Committee
Role of the Joint Committee The Joint Committee of Qatar Top Ten and Qatar Tourism reviews the soundness of the application of the methodology, scores and results before the final recommendations are approved. Chairmanship of the Committee The Chief Executive Officer of Qatar Top Ten chairs the Joint Committee, in adherence to the principle that technical scores are not to be changed unilaterally and that there is no interference in evaluation results outside the approved procedures. Qatar Tourism Representatives Representatives of Qatar Tourism take part in the work of the Joint Committee in accordance with the approved cooperation framework, including reviewing aspects related to the relevant sectors and categories.
09 · Evaluation
Verification and Correction of Errors
Verification Before Approval A final review of the eligibility of the top-ranked participants and of the accuracy of material information may be conducted before the results are approved. Discovery of a Calculation Error If a calculation or technical error is discovered before the results are announced, it is corrected and the ranking is recalculated. Discovery of an Error After Announcement If a material error is discovered after the results are announced, it is reviewed in accordance with the policies on corrections, objections, and the withdrawal or amendment of results.
10 · Evaluation
Integrity, Confidentiality and Records
No Commercial Adjustment of Scores No participant's score may be increased or decreased because of sponsorship, advertising, subscription to paid services or any commercial relationship with the platform. Confidentiality of Technical Details Certain technical details relating to manipulation-detection algorithms, the mystery shopper or verification mechanisms may be kept confidential if their publication could harm the integrity of the evaluation process. Documentation of Results A record is kept of the final scores, the method of their calculation and the material reviews made to them, in accordance with the records retention policy. Development of the Methodology The weights, criteria and scoring methodology may be reviewed and developed for future cycles, provided that any amendments are approved before being applied to the new cycle.
