NIST AI RMF companion profileReviewed September 30, 2026

NIST AI 600-1: confabulation, 12 generative-AI risks, and how to operationalize the profile.

NIST AI 600-1 is the Generative Artificial Intelligence Profile for the NIST AI Risk Management Framework. NIST published it on July 26, 2024. It organizes generative-AI risk into twelve categories and connects those risks to suggested actions that can be integrated into AI RMF governance, mapping, measurement, and management work.

This guide corrects a common timeline mistake: a later NIST webpage update or a later Zeph Tech review date is not a new 2026 release of NIST AI 600-1. The publication itself is dated July 26, 2024. NIST currently states that AI RMF 1.0 is being revised, so implementation teams should use this profile together with the current NIST AI RMF and AI Resource Center.

Get the timeline right

NIST AI 600-1 was published in July 2024; it is not a new 2026 publication.

NIST's publication record identifies Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile as NIST AI 600-1 and gives a publication date of July 26, 2024. The profile was produced as a cross-sector companion resource for AI RMF 1.0. Its purpose is not to create a separate compliance framework for generative AI. Instead, it adds generative-AI-specific considerations and suggested actions that organizations can integrate into an existing AI risk-management program.

This distinction matters operationally. A team that treats the profile as a newly issued 2026 rule may invent a false deadline or describe mature guidance as brand new. A team that treats it as obsolete because it was published in 2024 can make the opposite error. The useful approach is version-aware: preserve the 2024 publication date, record the date your organization reviewed it, and separately track NIST's current AI RMF revision work.

NIST states on its AI RMF page that AI RMF 1.0 is being revised. That means an implementation register should distinguish the stable source being mapped today from anticipated future changes. Controls, evaluations, risk records, and contracts should identify which NIST source and version they rely on so later updates can be assessed deliberately instead of silently changing the meaning of an existing control.

Risk taxonomy

The twelve NIST generative-AI risk categories give teams a common review vocabulary.

The categories are not a scoring system and they do not imply that every generative-AI system has equal exposure to every risk. Use them as a structured prompt for identifying credible harms, affected parties, dependencies, and evidence requirements for the specific system.

1. CBRN information or capabilities

NIST considers the possibility that generative systems can lower barriers to harmful chemical, biological, radiological, or nuclear knowledge or capabilities. Risk treatment should account for the model, access model, user population, domain, safeguards, monitoring, and the consequence of assistance being wrong as well as the consequence of it being useful to a malicious actor.

2. Confabulation

Generative systems can produce false or erroneous content with a form and tone that appears credible. The risk becomes more serious when users cannot independently verify the output, when generated content enters an automated workflow, or when a mistake can affect health, safety, rights, money, security, or an official record.

3. Dangerous, violent, or hateful content

Outputs can facilitate, normalize, or amplify harmful content. Evaluation should examine realistic prompts, transformations, multilingual behavior, multimodal inputs, contextual exceptions, and the possibility that controls designed for direct requests may fail when a harmful goal is expressed indirectly.

4. Data privacy

Privacy risk spans training data, retrieval sources, prompts, logs, fine-tuning data, embeddings, generated content, and operator access. Teams should map personal and sensitive data flows, establish purpose and retention rules, test for inappropriate disclosure, and understand which parties can access prompt or output telemetry.

5. Environmental impacts

Generative-AI systems can consume significant compute, power, cooling, and supporting infrastructure. Organizations should avoid treating environmental impact as a model-size slogan; measure the resources tied to the actual workload, deployment pattern, utilization, and lifecycle decisions they control.

6. Human-AI configuration

Risk depends on how people interpret, trust, challenge, and act on AI output. Interface design, automation level, role authority, warnings, escalation, training, accessibility, and workload all affect whether a human reviewer is a meaningful control or merely a nominal approval step.

7. Harmful bias and homogenization

Generative systems can reproduce or amplify patterns that disadvantage groups, and widespread use of similar models can make outputs more homogeneous. Testing should use relevant populations and contexts, examine downstream decisions, and consider whether the system narrows viewpoints or systematically erases uncommon but valid cases.

8. Information security

Generative AI expands security boundaries through model endpoints, plugins and tools, retrieval systems, training and evaluation pipelines, credentials, prompts, artifacts, and third-party components. Threat modeling should cover both attacks against the AI system and ways the AI system can increase risk to surrounding applications and data.

9. Information integrity

Generated content can complicate the ability to determine origin, authenticity, and trustworthiness. Provenance, labeling, source traceability, change records, and validation become especially important when generated material is distributed publicly or enters business, legal, scientific, or government decision processes.

10. Intellectual property

IP risk can arise from training inputs, retrieved material, generated output, third-party rights, licensing, and reuse. Organizations should establish rules for source ingestion, ownership, review, attribution where needed, and escalation when generated material appears to reproduce protected or contract-restricted content.

11. Obscene, degrading, or abusive content

Systems can produce or transform sexual, degrading, harassing, or abusive material. Controls need to reflect the use case: a general workplace assistant, a safety-analysis system, and a content-moderation research environment have different legitimate operating boundaries and different exposure to users and reviewers.

12. Value-chain and component integration

Modern AI systems often combine models, datasets, hosting, retrieval, orchestration, safety layers, plugins, APIs, and application code from different parties. Failures can be difficult to attribute. Maintain component inventories, contractual responsibilities, version records, security expectations, test evidence, and change triggers across the chain.

Measured search demand

Confabulation is the operational form of the “hallucination” problem teams need to control.

Searchers often use the word hallucination. NIST AI 600-1 uses confabulation as a risk category. The useful distinction is not terminology for its own sake; it is whether the organization can detect and contain confidently presented false content before it becomes an action, record, recommendation, or externally distributed statement.

A generic accuracy benchmark is rarely enough. Confabulation risk is contextual. A brainstorming assistant can tolerate uncertainty that would be unacceptable in medication guidance, a benefits decision, a cybersecurity remediation instruction, a financial calculation, a legal notice, or a government case record. Define the consequence of a wrong answer first, then set evaluation thresholds and human-review requirements accordingly.

Build a confabulation test set from real work

Collect representative questions, documents, retrieval conditions, edge cases, ambiguous requests, outdated facts, adversarial phrasing, and situations where the correct response should be uncertainty or refusal. Preserve expected answers and source evidence. If the system uses retrieval-augmented generation, test both strong and weak retrieval cases because a model can produce a polished response even when the retrieved evidence is missing, conflicting, or stale.

Measure claims, not just whole-response quality

Break important answers into verifiable claims. Track unsupported assertions, contradictions with authoritative sources, citation mismatch, omitted uncertainty, and failures to distinguish current facts from historical ones. For consequential workflows, define a failure budget that reflects severity rather than averaging a dangerous error together with harmless wording differences.

Design the workflow so verification can succeed

Human review is only useful when reviewers have time, authority, and source access. Show provenance where possible, separate generated text from source records, make uncertainty visible, and prevent downstream automation from treating generated prose as validated data unless a defined verification step has occurred. High-consequence outputs may need dual review, deterministic checks, or a rule that the AI can summarize but cannot make the final decision.

Monitor after deployment

Production prompts change, source corpora change, model versions change, vendors alter system behavior, and users discover new workflows. Capture quality incidents, user corrections, overrides, complaints, retrieval failures, and material model changes. Feed those events back into the evaluation set so the control improves from observed failures rather than remaining frozen at pilot time.

AI RMF integration

Use the profile through Govern, Map, Measure, and Manage rather than as a standalone checklist.

Govern: establish ownership and policy

Define who owns the AI use case, model or service, risk acceptance, evaluation, security, privacy, records, complaints, incidents, vendors, and retirement. Establish policies for data, acceptable use, human oversight, third-party components, source provenance, change control, and exceptions. Governance should specify evidence and decision rights, not merely principles.

Map: understand context and affected parties

Document the intended purpose, users, affected people, decision authority, data sources, system boundaries, integrations, dependencies, model and retrieval components, plausible misuse, and failure consequences. Map where generated output becomes input to another system, because those transitions often determine whether an error stays visible or becomes automated.

Measure: test risk with evidence

Define scenario-based evaluations for the risk categories that matter to the use case. Measure confabulation, security behavior, privacy leakage, harmful bias, content safety, provenance, robustness, accessibility, and operational reliability where relevant. Record datasets, prompts, model versions, configuration, scoring methods, reviewers, exceptions, and uncertainty so results can be reproduced.

Manage: prioritize, respond, and monitor

Translate findings into treatment decisions: mitigate, constrain the use case, add human review, change architecture, accept a documented residual risk, replace a component, or stop the deployment. Define monitoring signals and escalation thresholds before launch. Re-evaluate after material model, data, retrieval, policy, integration, or workflow changes.

Implementation sequence

Turn NIST AI 600-1 into a working control system.

  1. Inventory the system. Record model provider and version, hosting, retrieval sources, fine-tuning or adapters, tools and agents, APIs, data stores, identities, logging, safety services, evaluation tooling, and downstream systems.
  2. Select applicable risk categories. Review all twelve, document why each is material or not material, and identify affected parties and credible harms. “Not applicable” should be a reasoned decision, not an empty checkbox.
  3. Assign risk owners. Give each material risk an accountable owner who can obtain evidence and make or escalate treatment decisions. Separate technical operators from the person authorized to accept residual risk when governance requires it.
  4. Define acceptance evidence. Specify scenario tests, thresholds, source requirements, security tests, privacy checks, human-review criteria, red-team cases, performance constraints, and operational monitoring before a vendor demo or pilot can redefine success.
  5. Test the integrated system. Evaluate the model together with prompts, retrieval, tools, policies, interfaces, identities, and downstream automation. Model-only benchmarks do not capture many integration and human-configuration risks.
  6. Record treatment decisions. Link each material finding to mitigation, acceptance, transfer, avoidance, or additional testing. Preserve approver, date, rationale, due date, and evidence.
  7. Gate production. Require closure or explicit acceptance of release-blocking risks. Verify logging, incident response, rollback or kill-switch behavior, fallback workflows, support ownership, and vendor escalation.
  8. Monitor material changes. Trigger re-evaluation when the model, provider, system prompt, retrieval corpus, tool permissions, data classification, user population, decision consequence, or regulatory context materially changes.

Do not convert the profile into 200 disconnected tickets

NIST's suggested actions are a resource for selecting practices that fit context; they are not a universal list where every organization should implement every action identically. Group actions around the risks, AI RMF outcomes, systems, and owners that matter to the use case. This produces a smaller set of auditable controls with traceable evidence instead of a giant checklist that is technically complete but operationally unused.

Auditability

Evidence should let another reviewer reconstruct the decision.

A mature AI risk program can show what was evaluated, which version was tested, what failed, who decided, and what changed after deployment.

System and dependency record

Maintain architecture diagrams, model and component versions, data classifications, retrieval sources, tool permissions, vendor dependencies, deployment regions, identities, trust boundaries, and material configuration. This directly supports value-chain and integration risk analysis.

Evaluation record

Preserve test cases, expected outcomes, prompts, datasets, scoring logic, evaluator identity, model parameters, retrieval state, results, exceptions, and retest evidence. For confabulation, keep the authoritative source used to judge each consequential factual claim.

Decision and exception record

Record release approval, rejected risks, accepted residual risks, compensating controls, accountable owners, review dates, and expiration or re-review triggers. An exception without an owner and end condition tends to become permanent technical debt.

Operational record

Capture incidents, user reports, human overrides, blocked requests, security events, quality drift, vendor changes, model upgrades, retrieval failures, and control changes. Use those records to determine when the original evaluation no longer represents production.

Suggested evidence register fields

Current-source guardrail

Use the 2024 profile with the current NIST AI RMF revision status.

NIST AI 600-1 remains an official NIST Generative AI Profile, but NIST currently states that AI RMF 1.0 is being revised. Do not silently rewrite a 2024 control mapping when NIST publishes later framework material. Maintain a source register, monitor NIST's AI RMF page and AI Resource Center, perform a change assessment, and update controls through normal governance.

The practical objective is durable risk management rather than version chasing. A clear inventory, accountable ownership, representative testing, traceable evidence, controlled change, and monitoring remain useful even when specific framework language evolves. The profile is most valuable when those mechanics are connected to the actual generative-AI system rather than copied into policy without operational ownership.

Primary sources

Reviewed September 30, 2026. This is implementation guidance, not a claim that every NIST suggested action is mandatory for every system. Re-check NIST's current framework and publication pages before using this guide for consequential governance decisions.

Continue learning

Related guides after NIST AI 600-1 Generative AI Profile

Follow the next implementation topic without returning to search.

Put this guide to work

Turn NIST AI 600-1 Generative AI Profile: Confabulation, 12 Risks & AI RMF Actions | Zeph Tech into a decision-ready next step.

Use the source-backed research to pressure-test assumptions, then build a reusable evaluation brief before you compare products, scope implementation, or request a fit review.