1Status of this document
Draft for comment
This is Version 0.9 of the Neural Data Preservation Framework, released on 22 September 2026 as a preliminary draft. It is not yet binding on Departmental programs. The public comment period closes on 15 December 2026. Comments may be submitted through the process described on the Department’s Contact page. The handling of comments is described in the section on review and revision.
Pending issue of Version 1.0, Neural Continuity Research Program (NCRP) projects are asked to apply the requirements of this draft on a provisional basis and to record any requirement they cannot meet. Those records will inform the final text.
2Purpose and scope
The NCRP produces data that cannot be regenerated. Synaptic-resolution imaging destroys the tissue it records, so a lost raw dataset is lost permanently. Reconstruction products embody years of human proofreading. Model parameter sets may be the only record of how a given result was obtained. The NDPF exists to ensure that these data remain intact, interpretable, attributable and appropriately controlled for periods measured in decades, and in some cases for a century or longer.
The Framework applies to all data created, received or held under the NCRP, at any Departmental facility or at any partner institution operating under an NCRP agreement. It applies to non-human and human-derived data alike, with additional requirements for the latter. It does not govern data held solely for administrative purposes, and it does not authorize any acquisition, experiment or computational model. Authorization of research remains with the program review process and, for any protocol involving human tissue, with the Research Ethics Review Board (RERB).
The NDPF builds on three Departmental documents: the assessment of archival media in DSC-TR-2026-005, the data-volume and pipeline requirements in DSC-TR-2026-009, and the discussion of identity and consent in DSC-WP-2026-006.1 It does not restate their content.
Conformance language
Requirements are numbered NDPF-R-01 to NDPF-R-42. The word SHALL denotes a mandatory requirement. SHOULD denotes a recommendation from which a project may depart with documented justification approved by the NDPF Technical Committee. MAY denotes a permitted option. A project conforms to the Framework when it meets every SHALL requirement applicable to the data classes it holds.2
3Definitions
- Data object
- The smallest unit of data managed under the Framework, carrying its own persistent identifier and fixity value. A data object may be a single file or a defined, versioned set of files.
- Preservation copy
- A complete, verified copy of a data object held for long-term retention under the replication requirements of this Framework. Working copies used for active processing are not preservation copies.
- Fixity
- The property of a data object being unchanged from a recorded reference state, demonstrated by recomputing a cryptographic hash and comparing it with the stored value.
- Offline copy
- A preservation copy held on media that are not connected to any network or powered system, and that cannot be altered or deleted by any remote action.
- Provenance
- The documented history of a data object: its origin, the processes and agents that produced or altered it, and its inputs.
- Custody
- Responsibility for the safekeeping and controlled use of a data object. Under this Framework the Department holds human-derived data as custodian on behalf of donors and the public, not as owner.
- Human-derived data
- Any data object produced, in whole or in part, from human tissue or from data about an identifiable human donor.
- Specimen
- A discrete piece of tissue, with a single origin, from which data are acquired.
- Emulation Fidelity Level (EFL)
- The NCRP classification of computational models by the level of biological detail represented, from EFL-0 (statistical or behavioral model) to EFL-6 (validated individual-equivalent, hypothetical).
- Retention class
- An approved category that determines how long a data object is kept, how many preservation copies are required and whether lossy reduction is permitted.
4Data classes
Every data object belongs to one of four classes. The classes differ in volume, in whether they can be regenerated, and in sensitivity. These differences determine replication, format and access requirements.
| Class | Name | Content | Typical volume per project | Regenerable? | Default retention |
|---|---|---|---|---|---|
| D1 | Raw acquisition | Instrument image data and instrument logs, before alignment | 10 TB – 1 EB | No (tissue consumed) | Permanent, or reduced under an approved retention class |
| D2 | Reconstruction | Alignments, segmentations, synapse tables, connectivity graphs, annotations, proofreading histories | 1 TB – 100 PB | Partly; manual edits are not | Permanent |
| D3 | Model parameters | Parameter sets, initial conditions, checkpoints and model code for computational models derived from D1 or D2 | 1 GB – 10 PB | Partly, given D2 and code | Permanent for published or reviewed models; 10 years otherwise |
| D4 | Provenance and custody | Specimen records, consent references, chain-of-custody events, processing logs, fixity records | < 1 TB | No | Permanent |
| Ref. | Requirement |
|---|---|
| NDPF-R-01 | Each data object SHALL be assigned to exactly one data class (D1–D4) and one access tier (A0–A3) at the time of its creation. |
| NDPF-R-02 | Each data object SHALL carry a persistent identifier that is unique across the NCRP and is never reassigned, including after the object is destroyed. |
| NDPF-R-03 | Specimen identifiers for human-derived data SHALL be pseudonymous. The key linking a pseudonymous identifier to donor records SHALL be held separately, at access tier A3. |
| NDPF-R-04 | A reduction of D1 data below the default retention SHALL require an approved retention class, documented justification, and verification that all D2 products derived from the affected data have been preserved. |
5Metadata and provenance
A preserved dataset that cannot be interpreted has little more value than a lost one. Connectomic data are especially dependent on context: the meaning of a gray value depends on staining and instrument settings, and the meaning of a segmentation depends on the software and parameters that produced it. Provenance must therefore be captured at the moment each object is created, not reconstructed afterward.
| Ref. | Requirement |
|---|---|
| NDPF-R-05 | Each D1 object SHALL be accompanied by acquisition metadata including specimen identifier, preparation protocol and version, instrument identifier, voxel dimensions, acquisition parameters, timestamps and operator role. |
| NDPF-R-06 | Each D2 object SHALL record the identifiers of all input objects, the name and version of all software applied, and parameter values sufficient to reproduce the object from its inputs. |
| NDPF-R-07 | Manual edits to reconstructions SHALL be recorded in an append-only log, each edit attributed to a pseudonymous annotator identifier and timestamp. |
| NDPF-R-08 | Each D3 object SHALL record the Emulation Fidelity Level that the model is designed to represent, its D2 inputs, its code version, and the validation evidence available for it, or a statement that none is available. |
| NDPF-R-09 | Descriptive metadata for a D3 object SHALL identify it as a model derived from a specimen (for example, “model derived from specimen H-0042”) and SHALL NOT describe it as being, representing or continuing any individual person. |
| NDPF-R-10 | Provenance records SHALL be machine-readable, SHALL be preserved as D4 objects, and SHALL reference objects only by persistent identifier. |
| NDPF-R-11 | Metadata SHOULD use controlled vocabularies and schemas maintained by the NDPF Technical Committee and published with each Framework version. |
NDPF-R-09 is a terminological requirement with a substantive purpose. The question of whether any computational model could stand in a relation of identity to a person is unresolved, and metadata that presumes an answer would outlast the documents that qualify it.3
6Integrity and fixity
Storage media degrade silently. Studies of long-term digital storage show that undetected corruption, operator error and correlated failures across supposedly independent copies are more common than device specifications suggest. The Framework therefore treats fixity checking as continuous work rather than an occasional audit.
| Copy type | Verification scope | Maximum interval | Action on failure |
|---|---|---|---|
| Online preservation copy (disk) | Full | 12 months | Repair from verified copy within 30 days |
| Nearline preservation copy (tape library) | Full | 24 months | Repair within 30 days; inspect cartridge and drive |
| Offline copy (tape, optical, silica glass) | ≥ 1% sample per media unit; full at migration | 5 years | Full verification of affected unit; repair or replace within 180 days |
| Any copy, on transfer between systems or facilities | Full, per object transferred | Every transfer | Reject transfer; log event |
| Ref. | Requirement |
|---|---|
| NDPF-R-12 | Fixity values SHALL be computed using SHA-256 or a successor function approved by the NDPF Technical Committee. For D1 objects, fixity SHALL be computed at the instrument, before first transfer. |
| NDPF-R-13 | Fixity SHALL be verified on every transfer between systems or facilities. A transfer that fails verification SHALL be rejected and the event recorded in D4. |
| NDPF-R-14 | Preservation copies SHALL be verified at no greater than the intervals in Table 4. |
| NDPF-R-15 | A fixity failure SHALL be repaired from another verified preservation copy within the period in Table 4 and reported in the annual integrity report. |
| NDPF-R-16 | Fixity records SHALL be stored separately from the objects they describe and SHALL be replicated as D4 objects. |
| NDPF-R-17 | D4 objects SHOULD carry fixity values from two independent hash functions, to guard against future weakening of either. |
| NDPF-R-18 | CIA-DSC SHALL publish an annual integrity report summarizing verification coverage, failures detected, repairs and unresolved losses, by facility and data class. |
7Format requirements
A preservation format must remain readable after the software that wrote it is gone. The Framework does not mandate specific file formats in Version 0.9. It sets properties that preserved formats must have, and the Technical Committee will publish a list of conforming formats with Version 1.0.
| Ref. | Requirement |
|---|---|
| NDPF-R-19 | Preservation copies SHALL be stored in formats with complete, publicly available specifications whose reading does not depend on proprietary software or licensed components. |
| NDPF-R-20 | Volumetric image data SHALL be stored in chunked, self-describing array formats. D1 data SHALL be compressed only losslessly unless an approved retention class under NDPF-R-04 permits otherwise. |
| NDPF-R-21 | A human-readable description of each preserved format SHALL be preserved with the data, including on offline media. |
| NDPF-R-22 | Software needed to interpret D2 and D3 objects SHOULD be preserved as source code with build documentation. Executable environments MAY be preserved in addition but SHALL NOT be the sole means of interpretation. |
| NDPF-R-23 | Each D3 parameter set SHALL be accompanied by a mathematical description of the model sufficient for independent reimplementation without the original code. |
| NDPF-R-24 | Preserved formats SHALL be reviewed for obsolescence risk at least every five years, and a migration plan SHALL exist for any format assessed as at risk. |
8Replication and geographic distribution
The Framework requires at least three preservation copies, on at least two media types, at no fewer than two facilities, with at least one copy offline. The reference configuration places preservation copies at Continuity Research Facility Bravo, in the Colorado Front Range, and Continuity Research Facility Charlie, in interior Alaska. The two sites differ in geology, climate, utility supply and hazard profile, which reduces the likelihood that a single event affects both. Working data at Facility Alpha, where most NCRP processing takes place, are not preservation copies.4
| Copy | Facility | Media | Status | Role |
|---|---|---|---|---|
| Working | Alpha (southern Nevada) | Parallel disk; tape archive | Online | Processing and analysis; not counted toward preservation |
| P1 | Bravo, Archive Level 1 | LTO-class magnetic tape | Nearline | Primary preservation copy; source for repair and access |
| P2 | Charlie, pilot vault (main vault from 2028) | LTO-class magnetic tape | Nearline (active copy) | Second site; source for repair |
| P3 | Charlie | Silica glass optical media (pilot) or M-DISC-class optical; microfilm for D4 | Offline | Protection against systemic and network-borne loss; long-duration retention |
| Ref. | Requirement |
|---|---|
| NDPF-R-25 | At least three preservation copies of every D2, D3 and D4 object, and of every D1 object not subject to a reduced retention class, SHALL exist. |
| NDPF-R-26 | Preservation copies SHALL be held on at least two distinct media types. |
| NDPF-R-27 | Preservation copies SHALL be held at no fewer than two geographically separate facilities. Working copies SHALL NOT be counted toward this requirement. |
| NDPF-R-28 | At least one preservation copy SHALL be held offline at Facility Charlie. |
| NDPF-R-29 | Replication of new objects to all required copies SHALL be completed within 90 days of creation for D1 objects and 30 days for D2, D3 and D4 objects. |
| NDPF-R-30 | Media SHALL be migrated before the end of their assessed service life or when measured error rates exceed thresholds set by CIA-DSC, whichever is sooner. |
| NDPF-R-31 | D4 objects SHALL additionally be preserved in a human-readable analog form, such as archival microfilm, at Facility Charlie. |
Capacity is the principal constraint on NDPF-R-25 for D1. Bravo Archive Level 1 holds approximately 120 PB, and the Charlie pilot vault 1.5 PB pending completion of the main vault, with a 60 PB long-duration target, in 2028. A whole-mouse-brain acquisition in Phase II would produce on the order of 1 EB of raw data. Three full copies of that volume cannot be held within currently planned capacity. Version 1.0 will therefore need to define retention classes for D1 that balance the irreproducibility of raw data against physical limits. Comment is specifically invited on this question.
9Consent and custody
Human tissue enters the NCRP only post-mortem, through donation programs operating under RERB-approved protocols. The Framework does not regulate those programs; it governs what may be done with the data afterward. Six principles apply.
- Scope limitation. Data are used only within the scope of the consent under which the tissue was donated.
- No representation of survival. Neither consent materials nor any Departmental communication may state or imply that preservation of data constitutes or enables the survival or continuation of the donor.
- Custodianship. The Department holds human-derived data as custodian. Custody confers obligations, not ownership.
- Separation of preservation from use. Consent to preservation is not consent to every future use, and in particular is not consent to the construction of models of increasing fidelity.
- Withdrawal. Withdrawal by an authorized representative is honored to the extent technically possible, and the limits of that possibility are disclosed before donation.
- Non-commercialization. Human-derived data are not sold, licensed for commercial gain or transferred to commercial custody.
| Ref. | Requirement |
|---|---|
| NDPF-R-32 | Human-derived data SHALL be accepted for preservation only where documented consent covers preservation and research use under an RERB-approved protocol. |
| NDPF-R-33 | Construction of any computational model at EFL-3 or above from human-derived data SHALL require specific provision in the consent and separate RERB review, regardless of the consent’s general research terms. |
| NDPF-R-34 | Consent materials and public descriptions SHALL NOT state or imply that preservation of data constitutes or enables the survival or continuation of a donor. |
| NDPF-R-35 | Human-derived D1, D2 and D3 objects SHALL be encrypted with keys unique to each donor, so that withdrawal can be effected across all copies, including offline copies, by verified destruction of those keys. Keys SHALL be held under split control and themselves preserved under NDPF-R-25 to NDPF-R-28. |
| NDPF-R-36 | Every change of custody, transfer between facilities, and access to A3 objects SHALL be recorded as a chain-of-custody event in D4. |
| NDPF-R-37 | Human-derived data SHALL NOT leave Departmental custody except under an agreement approved by the Chief Ethics and Research Integrity Officer that imposes requirements no less stringent than this Framework. |
NDPF-R-35 resolves one difficulty and creates another. Write-once offline media cannot be selectively erased; destruction of a donor-specific key makes the corresponding data unreadable without altering the media. But the same mechanism means that loss of a key is loss of data, and the keys must therefore themselves meet century-scale preservation requirements. The Technical Committee regards this as the least settled requirement in the draft.
10Access control
| Tier | Name | Typical content | Who may access | Authorization |
|---|---|---|---|---|
| A0 | Public | Published non-human D2 products; documentation; format descriptions | Anyone | None |
| A1 | Registered research | Non-human D1 and D3; pre-publication non-human D2 | Registered researchers under a data use agreement | Program approval |
| A2 | Controlled | Human-derived D1 and D2 (pseudonymized) | Named researchers on an RERB-approved protocol | Program and RERB approval |
| A3 | Restricted | Human-derived D3; pseudonym linkage keys; donor-specific encryption keys | Named custodial staff and specifically approved researchers | Two-person authorization |
| Ref. | Requirement |
|---|---|
| NDPF-R-38 | Access to A2 and A3 objects SHALL be logged, and logs SHALL be preserved as D4 objects and made available for audit by the Office of the Inspector General. |
| NDPF-R-39 | Access to A3 objects, and deletion of any preservation copy of any class, SHALL require authorization by two individuals, one from DNC and one from CIA-DSC. |
| NDPF-R-40 | Non-human D1 and D2 data SHOULD be released at tier A0 or A1 no later than 24 months after acquisition, unless a documented scientific or security reason applies. |
11Review and revision
The NDPF is maintained by a Technical Committee chaired by DNC, with members from CIA-DSC, the Long-Duration Information Preservation Program and the Office of the Chief Ethics and Research Integrity Officer. The Committee is responsible for interpretation of the Framework, approval of departures from SHOULD requirements, and maintenance of controlled vocabularies and the list of conforming formats.
| Ref. | Requirement |
|---|---|
| NDPF-R-41 | The Framework SHALL be reviewed at least every two years following issue of Version 1.0, and on any material change in NCRP scope, facility capacity or media technology. |
| NDPF-R-42 | Each NCRP project SHALL submit an annual conformance statement identifying any SHALL requirement not met and the plan to meet it. |
Handling of public comments
Comments on this draft are invited from researchers, archivists, ethicists, tissue donation organizations and members of the public, and should be submitted by 15 December 2026 through the process described on the Department’s Contact page. Comments are most useful when they cite the requirement number to which they refer and, where they propose a change, include suggested text.
- Each comment will be logged and assigned to one or more requirements or sections.
- The Technical Committee will adjudicate each comment as accepted, accepted in part, or not accepted, with a stated reason.
- A disposition summary will be published with Version 1.0. Commenters will not be identified by name without their permission, and personal information will not be published.
- Comments received after 15 December 2026 will be held for consideration in the first biennial review.
Version 1.0 is planned for issue during fiscal year 2027. Until then, Version 0.9 applies provisionally as described under the status of this document.
Appendix A. Questions on which comment is specifically invited
- What retention classes for D1 raw acquisition data would balance irreproducibility against physical capacity, and what evidence should be required before raw data are reduced (NDPF-R-04, NDPF-R-25)?
- Is per-donor encryption (NDPF-R-35) an acceptable mechanism for honoring withdrawal on write-once offline media, given the risk of key loss over long periods? What alternatives exist?
- Is EFL-3 the appropriate threshold for the specific consent and review requirement in NDPF-R-33, or should a lower threshold apply?
- Are the fixity intervals in Table 4 appropriate for offline silica glass media, for which long-term field data are limited?
- Should D3 model checkpoints that are neither published nor reviewed be preserved permanently, or is a 10-year default adequate?
- Are there format properties beyond those in NDPF-R-19 to NDPF-R-24 that the Framework should require?
Appendix B. Requirement count by section
| Section | Requirements | SHALL | SHOULD | Total |
|---|---|---|---|---|
| Classification and identification | NDPF-R-01 to R-04 | 4 | 0 | 4 |
| Metadata and provenance | NDPF-R-05 to R-11 | 6 | 1 | 7 |
| Integrity | NDPF-R-12 to R-18 | 6 | 1 | 7 |
| Formats | NDPF-R-19 to R-24 | 5 | 1 | 6 |
| Replication | NDPF-R-25 to R-31 | 7 | 0 | 7 |
| Consent and custody | NDPF-R-32 to R-37 | 6 | 0 | 6 |
| Access | NDPF-R-38 to R-40 | 2 | 1 | 3 |
| Review | NDPF-R-41 to R-42 | 2 | 0 | 2 |
| Total | 38 | 4 | 42 |
Notes
- 1.DSC-TR-2026-005, Archival Media Longevity Assessment (26 May 2026); DSC-TR-2026-009, Connectomic Data Acquisition (20 August 2026); DSC-WP-2026-006, Criteria for Identity Continuity in Emulated Cognitive Systems (23 June 2026). ↩
- 2.The SHALL / SHOULD / MAY convention follows common practice in technical standards. Departures from SHOULD requirements are recorded in the project’s annual conformance statement under NDPF-R-42. ↩
- 3.DSC-WP-2026-006 recommends that Departmental documents describe computational models by their derivation rather than by reference to persons. NDPF-R-09 adopts that recommendation for metadata. ↩
- 4.Facility specifications as at September 2026. On 1 September 2026 the Continuity Infrastructure Initiative was expanded to Facilities Bravo and Charlie, which provides the operational basis for the reference configuration in Table 7. Media characteristics are assessed in DSC-TR-2026-005. ↩
Background literature (real-world works)
The following published works are real. They are cited for general scientific and historical context only. They do not support the fictional findings of this document, and their authors are not associated with this project.
- Rosenthal, D. S. H., et al. (2005). A Fresh Look at the Reliability of Long-term Digital Storage. Proceedings of EuroSys 2006 (arXiv:cs/0508130).
- Sandberg, A., and Bostrom, N. (2008). Whole Brain Emulation: A Roadmap. Technical Report 2008-3, Future of Humanity Institute, University of Oxford.
