Skip to main content
Skip to main content

Assessment Methodology

How ThirdProof investigates and rates third-party vendors

Version 3.4.0 · Effective October 3, 2026

What We Assess

ThirdProof assesses organizational entities — companies, business units, and registered organizations — for the purpose of third-party vendor risk evaluation. Assessments are designed exclusively for business-to-business due diligence.

What ThirdProof assesses
  • ✓Organizational cyber risk posture
  • ✓Sanctions and regulatory exposure
  • ✓Business registration and corporate legitimacy
  • ✓Adverse media signals (regulatory, financial, security, legal)
  • ✓Domain health, SSL configuration, and web infrastructure
  • ✓Compliance certification claims (SOC 2, ISO 27001, HITRUST, PCI-DSS)
  • ✓Vendor AI data practices (training policies, provider disclosure, opt-out mechanisms)
What ThirdProof does not assess
  • ✗Natural persons, individuals, or sole proprietors for consumer purposes
  • ✗Employment suitability, creditworthiness, or character
  • ✗Any attribute regulated under the Fair Credit Reporting Act (15 U.S.C. Section 1681 et seq.)

Assessments are point-in-time snapshots reflecting conditions as of the assessment date. ThirdProof does not currently offer continuous monitoring. Customers are responsible for determining appropriate re-assessment frequency.

Data Source Categories

ThirdProof queries multiple independent public data sources simultaneously for each assessment. Sources are organized into the following categories:

CategoryWhat It Provides
3.4.0October 3, 2026Adverse media articles about a different organisation, person, place or thing that shares the vendor's name are now set aside before classification, judged against the vendor's own homepage description; the earlier relevance rules still apply to everything else. AI policies that apply different training rules to different models or plans are rated by the rule that gives customers the least control, with that rule quoted as evidence. Tier assignment remains deterministic.
3.3.0October 3, 2026Several judgements that keyword patterns used to make are now made by a classification model, with the earlier rules kept as the fallback whenever the model is not confident: how a certification is mentioned on a vendor's trust page (held, inherited from a hosting or payment provider, in progress, not held, or not a claim at all), what a vendor's AI policy commits to about training on customer data, quoted from the policy itself, and which security controls a trust page describes for questionnaire answers. Generic privacy-notice language about improving services is no longer read as AI training. Certifications are inferred only from their verified status, never from the wording of a finding, and an AI policy is accepted only from the vendor's own domains. Adverse media findings whose narrative identifies a different organisation sharing the vendor's name are removed from the findings list. Tier assignment remains deterministic.
3.2.0August 28, 2026Adverse media consolidated into a single definition across all three media sources. One classifier now decides whether an article is adverse, whether the vendor or one of its customers was the affected party, and whether the publisher is independent of the vendor; there is no keyword path to a finding, and a scan that cannot be validated reports itself as such rather than as clean. Independent coverage of one event is grouped into a single finding with its corroborating sources as evidence, unacknowledged claims are rated below acknowledged events, and finding titles come from a fixed vocabulary rather than from model prose. Undated articles are treated as historical rather than as published today.
3.1.1August 25, 2026Adverse media matching corrected. Historical media queries required the vendor name to appear directly adjacent to a risk keyword, which excluded most real headlines; queries now match the vendor name together with any risk term, with AI subject classification unchanged as the precision control.
3.1.0April 17, 2026Tier threshold and confidence scoring corrections. Document extraction and research agent refinements.
3.0.1April 15, 2026Autonomous research agent introduced as a universal fallback for evidence gaps left by the fixed sources. Advisory only — it does not set tier.
3.0.0April 9, 2026Security questionnaire system integrated into the assessment. Questionnaire coverage contributes to the confidence score; tier assignment remains deterministic.
2.4.0March 5, 2026Source migration for threat and transport-security inputs: Google Web Risk, URLhaus, and TLS expiry checks.
2.3.0March 4, 2026Rule engine revision accompanying the billing and onboarding release.
2.1.0February 26, 2026Adverse media accuracy improvements.
2.0.0February 19, 2026Initial published methodology. Five-tier risk framework, deterministic rule engine, confidence scoring.

The specific number and identity of individual data sources may change over time as ThirdProof adds, replaces, or retires sources to improve coverage. Source changes do not constitute a material modification of the Terms of Service. The current source list is available upon request at support@thirdproof.ai.

Data limitations

No external data source provides complete coverage. Individual sources may be temporarily unavailable, may return incomplete data, or may contain inaccuracies attributable to the source provider. Reports indicate where sources were unavailable or returned incomplete results. The confidence score (described below) reflects data availability.

Entity verification

Many data sources return results based on name matching, which can produce false positives when different entities share similar names. ThirdProof applies entity verification logic to sanctions screening, business registry lookups, regulatory filing searches, and bank registry checks. When a match cannot be confirmed as the investigated entity, findings are flagged for manual verification and severity is reduced. Reports clearly distinguish between verified matches and unconfirmed name-based matches.

Risk Tier Assignment

Every assessment concludes with a risk tier assignment from Tier 1 (Critical Risk) through Tier 5 (Minimal Risk). Tiers are assigned by a deterministic rule engine — explicit, threshold-based logic applied to source evidence. The tier is determined before any AI-generated narrative is written. AI describes the findings; rules drive the decision.

Tier 1Critical Risk

Assigned when evidence includes confirmed sanctions matches, active data breaches in recent history, domains flagged as malicious by threat intelligence sources, or active regulatory enforcement actions. If any single Critical condition is present, the overall tier is Critical regardless of other signals.

Tier 2High Risk

Assigned when evidence includes unresolved regulatory inquiries, cyber risk scores significantly below industry thresholds, adverse media showing fraud allegations or major lawsuits within recent months, or unverifiable business registration. If any single High condition is present and no Critical conditions exist, the overall tier is High.

Tier 3Medium Risk

Assigned when evidence includes moderate cyber risk scores, adverse media that is older or resolved, limited business history, claimed certifications that cannot be independently verified, or partial data availability reducing confidence significantly.

Tier 4Low Risk

Assigned when evidence shows acceptable cyber risk scores, clean sanctions screening, clean or minimal adverse media, verified business registration with established history, and minor gaps that do not indicate systemic risk.

Tier 5Minimal Risk

Assigned when evidence shows strong cyber risk scores, independently verifiable SOC 2 Type II or equivalent certification, established company history, clean sanctions and adverse media, and strong domain health. Minimal Risk requires positive evidence across multiple dimensions — absence of negative signals alone is not sufficient.

Escalation rule

Critical conditions always override. If any single Tier 1 trigger is present, the overall tier is Tier 1 regardless of all other signals. If any single Tier 2 trigger is present and no Tier 1 conditions exist, the overall tier is Tier 2. This ensures that a single severe risk signal is never diluted by otherwise positive indicators.

Confidence Scoring

Every report includes a confidence score from 0–100 reflecting the completeness and consistency of available source data. The confidence score is computed by the rule engine, not inferred by AI.

How confidence is calculated
  • ›The score starts at 100
  • ›Points are deducted when individual data sources return errors, are unavailable, or return incomplete data
  • ›Points are deducted when data coverage is thin (e.g., limited adverse media results may indicate coverage gaps rather than absence of risk)
  • ›Points are deducted when key data points are estimated rather than confirmed

A confidence score below 60 triggers a visible Data Coverage Warning on the report. A confidence score below 40 escalates the minimum tier to Tier 3 regardless of other signals, ensuring that insufficient data does not produce a misleadingly favorable rating.

Confidence scores reflect data availability, not factual accuracy. A high confidence score means ThirdProof had good data coverage — it does not guarantee that every underlying data source is correct.

The Role of AI

ThirdProof uses AI (large language model technology) to generate executive summaries, risk narratives, compliance framework context, and analytical conclusions within reports. Here is how responsibility is divided:

Rules engine decides
  • ›Risk tier assignment (Tier 1–5)
  • ›Confidence score calculation
  • ›Finding severity classification
  • ›Escalation logic
  • ›Compliance framework flag triggers
AI describes
  • ›Executive summary prose
  • ›Finding descriptions and context
  • ›Compliance framework narrative
  • ›Recommended action language
  • ›Data limitation explanations

Risk tier assignments are deterministic and reproducible. Given identical source evidence and the same methodology version, the rule engine produces the same tier. AI-generated narrative content may vary slightly in wording between assessments but does not influence the tier.

AI-assisted synthesis may produce outputs containing errors, omissions, or inaccuracies not present in underlying source data. Reports include source citations, confidence scores, and evidence chains to enable independent verification. Customers are responsible for verifying AI-generated narrative content before relying on it for material business decisions.

Independence

ThirdProof maintains structural independence from all investigated vendors and entities. This independence is not a policy — it is an architectural constraint.

  • •ThirdProof does not accept payment, compensation, data, or other consideration from investigated vendors in connection with the generation of reports
  • •Investigated vendors cannot influence, modify, suppress, or remove report findings through any commercial arrangement
  • •The deterministic rule engine assigns tiers based on rules applied to raw evidence; there is no pathway by which vendor commercial status can influence that output
Buyer-pays model

ThirdProof’s revenue comes from customers (compliance officers, security teams) who pay to run assessments — not from the vendors being assessed.

How We Calculate Time Saved

ThirdProof sells verified evidence, so a number we quote about ourselves should be as checkable as one we quote about a vendor. Four different quantities appear across this site and they are not interchangeable. This is what each one means and where it comes from.

Assessment processing timeMeasured

Wall-clock time from the start of the investigation to the completed assessment, recorded per run. Time an assessment spends queued before the pipeline picks it up is excluded, so this is the pipeline's own time. "Under 10 minutes" is a ceiling, not an average — the median is well below it.

Manual effort comparisonEstimate

An estimate of the analyst hours comparable research, verification, questionnaire preparation and documentation would take by hand. We could not find an independent benchmark for this. The figures in circulation come from third-party-risk vendors' own published material and span 10–40 hours per vendor, so we quote them as estimates, attribute them, and lead with the low end. Your own figure is better than ours.

Questionnaire waitElapsed time

Separate from analyst effort, and not anybody's labour. It is the calendar time that passes when diligence cannot proceed until a vendor replies — 1–2 weeks for a medium-risk vendor review and several weeks for high-risk (Ramp, December 2025). Treating this as hours worked would overstate the saving considerably, so we do not.

Cost estimateYour assumptions

Only ever shown with the labour rate and the arithmetic disclosed. The in-product calculator uses your organisation's own hours and hourly rate, which you can change; where this site quotes a figure it uses roughly $46/hour, the median base pay for a US third-party-risk analyst across ZipRecruiter, Glassdoor and Salary.com, checked 2026-09. An assumed rate is never presented as observed data.

Why the speed is not a shortcut

ThirdProof is faster because the independent research is automated and the sources are queried in parallel rather than one after another — not because any step is skipped. Independent evidence reduces how much you need to ask the vendor; it does not make private evidence public. What the evidence cannot settle is listed as an open question rather than assumed, and the decision remains yours.

Disputes & Corrections

ThirdProof provides a good-faith correction process for factual errors. This process protects both the accuracy of reports and the rights of investigated entities.

Who can submit a correction request

Customers who believe a report contains a material factual error attributable to ThirdProof’s data processing (rather than inaccuracies in underlying third-party source data) may submit a written correction request to support@thirdproof.ai within 90 days of the assessment date.

Investigated vendors who believe a report contains factually inaccurate information may contact ThirdProof directly. ThirdProof may, in its sole discretion, review the dispute and issue a corrected report if warranted.

What the process covers

  • •Evidence that a data source returned inaccurate information (e.g., a news article about a different company with a similar name)
  • •Entity identity confusion where assessment results were attributed to the wrong organization
  • •Data source errors where the underlying source has since been corrected

What the process does not cover

  • •Requests to change a risk tier because the vendor disagrees with the rating outcome
  • •Requests to suppress findings that are accurately sourced
  • •Requests to remove reports from the platform

ThirdProof reviews correction requests within 10 business days. If the error is confirmed, a corrected report is issued. Submission of a correction request, ThirdProof’s review, and issuance of a corrected report do not constitute an admission that the original report was inaccurate, negligent, or defamatory. Every correction is logged with the reason and the methodology version under which the correction was made.

Regulatory Framework Alignment

ThirdProof assessments map to recognized third-party risk management (TPRM) frameworks and regulatory guidance. The table below shows how each stage of the ThirdProof workflow corresponds to standard framework requirements.

FrameworkRequirementThirdProof Coverage
OCC 2023-17Third-Party Due Diligence (Stage 2)27+ parallel data sources covering sanctions, cyber risk, business legitimacy, adverse media, and compliance certifications
NIST SP 800-161r1Supply Chain Risk AssessmentSubprocessor discovery with sanctions screening, technology dependency detection, and supply chain threat intelligence
ISO 27036A.15.2.1 — Supplier Service MonitoringRe-assessment capability enables periodic re-assessment; API integration enables automated monitoring triggers
SOC 2CC9.2 — Risk Assessment ProcessDocumented methodology, deterministic rule engine with published thresholds, full evidence chain, and confidence score decomposition
SIG / SIG LiteRisk Domain CoverageMaps to Information Security, Privacy, Business Continuity, Compliance & Legal, and Cybersecurity domains through specialized data sources
GDPR Art. 28Processor Due DiligenceSubprocessor discovery scans vendor pages; GLEIF corporate verification; sanctions screening; trust page certification checks
Force multiplier, not replacement

ThirdProof automates the investigative core of TPRM (OSINT gathering, risk scoring, report generation) in under 10 minutes per vendor. Done manually, a medium-risk vendor review takes 1–2 weeks to get through and a high-risk one several weeks(Ramp, December 2025) — most of it spent waiting rather than working. The analyst labour inside that window is harder to source: the available estimates run from 10 to 40 hours per vendor and come from TPRM vendors themselves rather than from independent research, so treat them as estimates. What ThirdProof changes is the investigative work, not the judgement: analysts review a structured, evidence-backed report instead of building one from scratch, and human judgment is preserved through the reviewer approval workflow.

Analyst work and waiting are counted separately. The per-step hours are illustrative rather than measured — the sourced estimate is the 10–40 hour range above, and no step below implies an analyst is working during the waiting.

TPRM Workflow StepAnalyst workWaiting on the vendorThirdProof
Intake & scoping30 – 60 min—2 min (vendor name + category + data access)
OSINT gathering1 – 3 hours—~30 sec (27+ sources in parallel)
Vendor questionnaire—2 – 6 weeksN/A — outside-in by design
Evidence review1 – 2 hours1 – 2 weeks for the report~5 sec (trust page scan + registry check)
Risk analysis2 – 4 hours—~1 sec (30+ deterministic rules)
Report writing2 – 4 hours—~15 sec (AI synthesis + PDF)
Review & approval—1 – 3 daysSame (reviewer workflow preserved)

Version History

Every report generated by ThirdProof identifies the methodology version in effect at the time of assessment. Assessments conducted under different methodology versions may produce different results for the same entity. Material methodology updates are communicated to active customers with at least 30 days written notice before taking effect.

VersionEffective DateSummary
1.0February 22, 2026Initial published methodology. 5-tier risk framework, deterministic rule engine, confidence scoring.
1.1February 25, 2026Added compliance verification, supply chain analysis, and regulatory filing source categories. Introduced entity name verification across sanctions, business registry, regulatory, and bank registry sources. Aspirational certification language detection for trust page scanning.
1.2March 14, 2026Added AI Data Practices source category. Automatic discovery and extraction of vendor AI data usage policies including training commitments, third-party model provider disclosure, data retention periods, and opt-out mechanisms. AI compliance reference detection (ISO 42001, NIST AI RMF, EU AI Act).

Revisions 1.0 through 1.2, published between February and March 2026, were earlier numbering of this document and predate its alignment with the rule engine version cited in reports. The version shown on a report always corresponds to a row in the table above.

Reports generated by ThirdProof constitute automated analytical opinions based on publicly available data and this published methodology. Reports are not certifications, guarantees, audit determinations, or legal advice. ThirdProof is not an auditor, certifying body, consumer reporting agency, regulatory authority, or legal advisor. Reports are one input into a broader vendor risk management program and are not a substitute for independent due diligence, professional judgment, or legal counsel. For questions about this methodology, contact legal@thirdproof.ai.