Google told how assessors influence the implementation of changes in search
Google spoke in detail about the role of expert assessors in evaluating the quality of search. An article about this appeared on the company's blog.
Thousands of changes are made to Google's search algorithms every year. But before you implement the changes, you need to understand whether the updates will be useful for users. Google attracts assessors and ordinary people to the assessment.
Google research team communicates with users around the world. Google also conducts field research to study how different people access information on the Internet.
Google has rules for evaluating search results for assessors. This document is 160 pages long, but if the recommendations for assessors could be narrowed down to one phrase, then it would sound like this:
Google's algorithms can recognize many signals, but when it comes to relevance and reliability, human judgment is required. Google has over 10,000 people around the world who are called "search quality raters." They help you gauge how people perceive search results.
Before getting started, appraisers should review Google's recommendations for assessors.
How assessors work
Google provides the group of experts with a set of queries and shows two versions of the results for these queries. One set of results is taken from the current version of the search, the second is a version of the SERP with improvements that the search engine plans to implement.
Assessors evaluate each page, check if the results match the query. To assess Expertise, Authority, and Authenticity (E-A-T), experts are encouraged to conduct a reputation survey of sources, and then assign a quality score for each page. These scores are not used directly for ranking.
Google notes that assessor scores are data that measure how well algorithms are performing and whether they are delivering content that meets quality requirements.
In 2019, Google conducted more than 383,605 tests to assess the quality of search and 62,937 parallel experiments with assessors. As a result, 3,600 improvements were implemented in the algorithms.
We will remind, earlier Google said that it does not use Google Analytics data to rank sites.
Source: Google Blog