If you’ve already seen our breakdown of how we test and score dating apps, you’ve got a base understanding of our methodology. But, when it comes to matchmaking services, the data points, tests, and analysis have to be different.
Why? Because matchmaking services and dating apps may have the same end goal, but they are two different means of getting there.
In the next few sections, we’ll detail out our matchmaking service testing process, the data points that we look at, and how we calculate our overall scores through our proprietary testing algorithm.
Overall Scoring Factors
The total ranking score we give to matchmaking services is based on six individually tested categories that represent the most important factors that can influence your outcomes. While no matchmaking service can guarantee outcomes, our proprietary ranking system should help you better choose which option may give you the best opportunities for success.
| Factor | Weighted Average |
|---|---|
| Safety and Security | 25% |
| Popularity and Network | 20% |
| Process Evaluation | 20% |
| Pricing | 15% |
| Support Resources | 10% |
| External Reviews | 10% |
In the coming sections, we’ll detail our exact matchmaking service testing procedures for each of these categories. Final scores are on a scale of 0 – 10, rounded to the nearest second decimal. 10 is the highest (best) and 1 is the lowest (worst). Overall ranking and testing scores are determined by averaging the individual category scores based on the weighted average formula outlined above.
Exogenous Factors
At times, there are additional factors outside of our algorithm that may affect our view on the potential success outcome opportunities with a matchmaking service. When these are spotted, they may be used to adjust the overall score to better reflect the more accurate testing message. When this happens with a matchmaking review, our team will share what factors were considered and how they affected the overall final outcome.
Proprietary Matchmaking Score Factors – Methodology
To better understand how we test matchmaking services, here is a breakdown of each factor that goes into our overall review rankings and scores.
Safety and Security (25%)
As is the same with dating apps, safety and security is the most important category we test with matchmaking services. Each dating app is put through our 6-point safety and security checklist.
| Factor | Scoring System | Weight |
|---|---|---|
| Discretion | Scored 0-100 | 20% |
| Match Vetting | Scored 0-100 | 20% |
| Non Negotiables | Scored 0-100 | 20% |
| Privacy Policy Protections | Scored 0-100 | 15% |
| Matchmaker Conduct | Scored 0-100 | 15% |
| Third-Party Data Usage | 100, 50, or 0 | 10% |
- Testing factors marked ‘100, 50, or 0’ have three quality levels – High Quality (pass) is 100 points, Mediocre Quality (pass) is 50 points, and Low Quality (pass) or Fail is 0 points.
- Testing factors marked ‘0-100’ earn a quality or effectiveness score based on the level of quality or effectiveness.
Here is a brief look at each of the data points and what factors are measured and analyzed with each, but not limited to:
- Privacy Policy Protections – How clear is the privacy policy? Does it discuss protections that are in place for clients? There are additional tenets we look for when reviewing privacy policy documents during testing.
- Third-Party Data Usage – Does the company utilize your data in any ways other than providing you service? Is your information ever sold or shared with third parties?
- Discretion – As matchmaking is often used by affluent individuals, the need for discretion can be a matter of safety and security. We test the processes the matchmaking services use to connect people while still keeping important details discreet.
- Match Vetting – Are matches vetted by matchmakers? Is there a systematic onboarding process? Are background checks conducted?
- Non Negotiables – Often, a client’s non-negotiables are critical to safety and security. Are these non-negotiable requests honored by the provider? What checks are in place to ensure they are?
- Matchmaker Conduct – How are matchmakers both expected to conduct themselves, and how have they historically conducted themselves? Is there extensive training in pace to facilitate a safe and secure experience? Are there hiring practices that also protect clients?
Popularity and Network (20%) – Matchmaking Service Network Analysis Testing
While a successful outcome is meeting the one right person, the popularity, size, and quality of a matchmaking service’s network offers some of the best insights into the likelihood of a successful outcome. Here are the factors that we test and analyze when assessing these factors for a matchmaking service:
| Factor | Testing Description |
|---|---|
| Overall Size | Public, self-declared, and private data sources are analyzed |
| Quality | Proprietary testing to determine the overall quality trends of the network |
| Press Coverage | Determining volume and quality of press coverage |
| Marketing | Analysis of target clientele in marketing for network and clients |
| Search Trends | Volume and trends (Ahrefs, Moz, Semrush, Google Trends, KWP, etc.) |
| Internal Data | Leverage internal data on traffic and conversions to gauge quality and size |
Process Evaluation (20%)
The two biggest keys to a successful outcome worth testing with a matchmaking service are the network size and quality and the process used to create matches. The bulk of the time we spend reviewing professional matchmakers is spent analyzing the process for creating matches.
Here are the weighted factors we consider.
| Factor | Weighted Average |
|---|---|
| Systematic Process | 25% |
| Process Quality | 20% |
| Track Record (Results) | 20% |
| Attention to Detail | 20% |
| Flexibility | 15% |
Our team acknowledges that the process evaluation testing is considerably subjective. We do our best to be fair, thorough, and balanced when it comes to evaluating the quality and effectiveness of the process.
Pricing (15%)
Evaluating pricing for matchmaking services can be challenging due to a wide range of services, subjective quality offerings, and flexible packages. Additionally, there can be a temptation to evaluate solely on the basis of absolute price, which does not take into account value.
To approach this, we’ve developed a systematic proprietary algorithm to calculate what we call Matchmaking Price Value per Dollar (MVPD). MVPD allows our team to compare, rank, and categorize matchmaking services across a wide range of price points.
Here’s how the testing of MVPD works when we’re looking at matchmaking services:
- Our team has identified 19 key features and service considerations that come with matchmaking services.
- Each key feature has been assigned a total possible number of points based on importance.
- Matchmaking services are tested against all 19 key features.
- If the service does not have a feature, it receives 0 points.
- If the service does have the feature, it can earn anywhere from 0 points up to the maximum for that feature based on the quality of the feature.
- The total number of points is added up for all 19 features and divided by the cost of service for 1 month.
- The resulting number is our MVPD. The higher the MVPD, the better the value you’re receiving.
For example, let’s say that a matchmaking service scores 430 points based on the 19 features involved in the test. If the service costs $2,000 for 6 months ($333 per month), the MVPD would be 430/$333 = 1.29. If a service of the same quality were only $1,500 for 6 months ($250 per month), the MVPD for that service would be 430/$251 = 1.72. As you can see, the second service provides more value for the price.
Support Resources (10%)
In addition to the core services of a matchmaker (finding you matches), many services offer additional support resources to help you succeed. Examples of these resources we may test for include:
- Dating coaching
- Style consultants
- Professional photos
- Personal branding
- Date planning assistance
External Reviews (10%)
External reviews can be tricky when it comes to matchmaking services or anything in the dating vertical. Typically, reviews are only given from highly polarized experiences — users who had a great experience or had an overly negative experience. Still, our team finds value in these external reviews when processed properly.
Exogenous Factors Applied After Scoring
As mentioned, we sometimes have additional information or data that does no fit into our model, but is still impactful when determining the potential success outcomes of a matchmaking service. When these are observed, they are manually factored into the equation and all review readers are notified.
Some examples of these exogenous factors include:
- Lawsuits against matchmaking services
- Personal interactions during our testing
- Industry-specific knowledge that may affect outcomes
Errors and Corrections
Data, features, and companies change rapidly. Additionally, our proprietary matchmaking service test algorithm is complex. These two points together do create an environment for the possibility of an error or outdated information. While we do our best to be as accurate and up to date as possible, we acknowledge that mistakes and oversights can happen.
If you do find an error, please reach out to our team to let us know.