Saturday, March 15, 2014

Misuse of normative tests by some online dating sites

Please remember: Ipsative tests are based on forced choice questions and responses. Each choice is scored. These scores can only represent the relative strengths of the person being tested and cannot be compared to any other individuals. Such tests can typically be identified in the marketplace by the test asking the person to ‘describe themselves’.
Unfortunately, all ipsative tests (self-descriptive questionnaires) like Myers-Briggs Type Indicator (MBTI) or DISC (Dominance, Inducement, Submission, and Compliance) or the Swiss 16PT are obsolete.

Normative tests measure quantifiable characteristics on individual scales. These scales can vary independently. Also the scores can measure the characteristics of an individual against confirmed patters of normality (e.g. normal distribution or Gaussian distribution). Normative testing allows people to be compared to particular groups, populations, or jobs.
Normative testing generally has a higher validity than ipsative.

All normative tests like Big Five, HEXACO, 16PF5 to assess/measure personality should be used with the correct norm. e.g:
* English for the United Kingdom and the Norm for the United Kingdom (sample of individuals with the same demographic characteristics of the United Kingdom).
* English for Ireland and the Norm for Ireland (sample of individuals with the same demographic characteristics of Ireland).
* English for Australia and the Norm for Australia (sample of individuals with the same demographic characteristics of Australia).
* English for New Zealand and the Norm for New Zealand (sample of individuals with the same demographic characteristics of New Zealand)
* English for Canada and the Norm for Canada (sample of individuals with the same demographic characteristics of Canada).
* English for South Africa and the Norm for South Africa (sample of individuals with the same demographic characteristics of South Africa).
* English for United States and the Norm for United States (sample of individuals with the same demographic characteristics of United States)
* French for France and the Norm for France (sample of individuals with the same demographic characteristics of France).
* French for Canada and the Norm for Canada (sample of individuals with the same demographic characteristics of Canada).
* German for Germany and the Norm for Germany (sample of individuals with the same demographic characteristics of Germany).
* Spanish for Spain and the Norm for Spain (sample of individuals with the same demographic characteristics of Spain).
* Italian for Italy and the Norm for Italy (sample of individuals with the same demographic characteristics of Italy).
* Portuguese for Portugal and the Norm for Portugal (sample of individuals with the same demographic characteristics of Portugal).
* Portuguese for Brazil and the Norm for Brazil (sample of individuals with the same demographic characteristics of Brazil).
etc, etc

To clarify better that situation (a comparison with drivers):
Suppose you are citizen of country “A” where speed limit is 70 mph and the population drives at 65 mph average with 2 mph standard deviation (some persons always surpass the speed limit) in a normal distribution,
and you are tested driving at 67 mph so you are OVER the average in 1 standard deviation, you are at 84.1344% over the whole population.
You will score 8 or 9 in a sten scale depending on how it was constructed. (stens = standardized tens)
You will be seen as VERY HIGH in that scale.

If you drive in country “B” where speed limit is 75 mph and the population drives at
71 mph average with 2 mph standard deviation (some persons always surpass the speed limit) in a normal distribution,
and you are tested again driving at 67 mph, you are UNDER the average in 2 standard deviation, you are at 02.2751% under the whole population.
You will score 1 in a sten scale.
You will be seen as VERY LOW in that scale.


That is why normative tests can not simply be translated, because they need the norm for that test, and that norm is actualized each and every time Census Figures are released and the cost of doing that is in the range of USD100,000 per language and norm.

Personality Based Recommender Systems are the next generation of recommender systems because they perform far better than Behavioural ones (past actions and pattern of personal preferences)

That is the only way to improve recommender systems, to include the personality traits of their users. They need to calculate personality similarity between users but there are different formulas to calculate similarity; recommender systems are morphing to compatibility matching engines, as the same used in the Online Dating Industry since years, with low success rates until now because they mostly use the Big Five to assess personality and the Pearson correlation coefficient to calculate similarity.
The Big Five normative personality test is obsolete. The HEXACO (a.k.a. Big Six) is another oversimplification. Online Dating sites offering compatibility formulas between daters have very big databases, in the range of 20,000,000 (twenty million) profiles, so the Big Five model or the HEXACO model are not enough for predictive purposes. That is why I suggest the 16PF5 test instead, and of course, to not give more attention to Big Five or HEXACO tests.
http://onlinedatingsoundbarrier.blogspot.com.ar/2013/12/the-8-tips-to-innovate-in-online-dating.html

Because the Big Five groups the more specific primary-level factors, feedback organized around the five Global Factor scales is more easily understood. For detailed feedback or predictive purposes, one should assess the more specific primary factors. Research has shown that more specific factors like the primary scales of the 16PF Questionnaire predict actual behavior better than the  Big Five Global Factors. For example, one extravert (a bold, fearless, high-energy type) may differ considerably from another (a sweet, warm, sensitive type), depending on the extraversion-related primary scale score patterns, so deeper analysis is typically warranted.” Extracted from the 16PF5 Manual

The only way to revolutionize the Online Dating Industry is using the 16PF5 normative personality test, available in different languages to assess personality of members, or a proprietary test with exactly the same traits of the 16PF5 and expressing compatibility with eight decimals (needs a quantized pattern comparison method, part of pattern recognition by cross-correlation, to calculate similarity between prospective mates.)
High precision in matching algorithms is precisely the key to open the door and leave the infancy of compatibility testing.
It is all about achieving the eighth decimal!
With 8 decimals, you have more precision than any person could achieve by searching on one's own, but the only way to achieve the eighth decimal is using analysis and correlation with quantized patterns.

Without offering the NORMATIVE16PF5 (or similar test measuring exactly the 16 personality factors) for serious dating, it will be impossible to innovate and revolutionize the Online Dating Industry All other proposals are NOISE and perform as placebo.

No comments:

Post a Comment