Methodology

SolutionMap helps you compare solution provider capabilities based on your organizational needs across the procurement and supply chain spectrum. Here’s how the rankings are created:

  1. Every SolutionMap has a dedicated lead analyst supported by the greater analyst team of 12 plus operational support staff
  2. The lead analyst develops the RFI in collaboration with the internal analyst team, customers and consultants to ensure requirements are comprehensive and relevant to practitioners following a set methodology
    1. Capabilities definitions, personas and rating weights defaults are determined ‘up front’ before issuing the RFI
  3. During the RFI process, providers need to:
    1. Provide detailed company and customer demographics
    2. Self-score solution requirements (with detailed specifications )
    3. Describe all solution related services available to customers
    4. Provide customer references
    5. Supply documentation regarding:
      1. Revenue models
      2. Buyer and supplier fees
      3. New vs. replacement customers
      4. Customer TCO, ROI and success metrics
      5. Case studies
  4. Customer references complete a detailed survey focused on key provider differentiators, delivery against expectations/requirements, strengths, promoter score, collaborativeness, improvement areas, problem solving skills, features/capabilities improvement needs, shortcomings and more (making up 50% of the score)
    1. Individual customer inputs are never shared with the provider community
    2. Customer identities are known to the core Spend Matters project team only
    3. Customer inputs are aggregated to form the basis of the customer value ratings
  5. Analysts participate in a 90-minute technology demo (per module) for each RFI participant to validate the self-scoring and adjust the scores up and down based on the technology demonstrations
  6. Analysts rate providers against strict functional / solution definition requirements after reviewing providers’ self-scoring RFI inputs and demonstrations
    1. Demonstration notes and documentation may also be reviewed and extra spot checks may be performed
    2. Solution draft scoring is finalized for each provider
  7. Providers are invited to fact check their scores on a granular level against the average and request clarification
    1. Providers have the option to appeal individual functional scores at a granular level via a defined process involving additional written documentation, calls and demonstrations
    2. SolutionMap placements are never shared prior to final publications with providers
  8. Final SolutionMap rankings are created and produced in due course based on finalized data and previously defined criteria, weightings and inputs

The following assessment elements are taken into account:

  • All elements of a technology*
  • Integrations
  • Supplier experience
  • Front end users and administrators’ user experience

* The technology elements are very detailed and vary by the technology being ranked