Hermes Labs

Research document

Research questions

A source record supporting Project Fiction. Read the original account alongside its scope, dates, and limitations.

Research status
unresolved
Updated
In this record

Scientific record

Current research question

How can innovative transformation of already-available representations, without materially new external information, be operationalized in humans; can its events or dimensions be assessed independently; and do observable signals generalize across domains within one modality after alternative explanations are controlled?

The later question is whether the capability can be reproduced or encouraged in AI models, with runtime and reward branches tested independently. Retrieval is a substrate of transformation. The contrast is mere reuse/reproduction versus innovative transformation, not construction versus retrieval.

Highest-priority register

All entries remain open. Links to hypotheses identify dependencies, not validated answers.

IDOpen questionWhy it matters · next evidenceRelated claim
FQ-01What exactly counts as an innovation event? Is innovation categorical, dimensional, gradual, or multistage?Define observable criteria and a temporal unit before labeling or detection.FH-01, FH-02
FQ-02What is fixed in a fixed information state? How do prior knowledge, internal retrieval, derived information, tools, hints, and feedback enter the boundary?Specify external access and document preparation; do not claim that cognition freezes internally.FH-01
FQ-03Novel relative to what, and what makes a representation actionable?Separate personal/task/reference-set novelty, meaningfulness, usefulness, and demonstrated action.FH-01
FQ-04How do we distinguish genuine innovation from random variation, paraphrase, novelty of wording, or superficial recombination?Test matched negative cases and product/process assessments.FH-01, FH-03
FQ-05How do difficulty, uncertainty, hesitation, controlled retrieval effort, and cognitive load differ from the target?Include demanding non-innovation comparisons and nuisance-only prediction.FH-03
FQ-06Can independent raters reliably identify transformation or events, and are their judgments valid?Reliability is insufficient; test origin, transformation, novelty, and utility judgments separately.FH-02
FQ-07What evidence should raters see? Can output-only judgments support a process label?Predefine evidence access; keep detector features and condition cues out where possible.FH-02
FQ-08What controls show a signal tracks innovation rather than difficulty or expression novelty?Compare recalled-original, effortful retrieval, load, length, prompt, and participant baselines.FH-03
FQ-09What counts as true domain generalization while modality remains constant?Define domain difference, lock the model, prevent participant/item/session leakage, and protect the test domain.FH-04
FQ-10Which cognitive-science findings constrain the hypothesis; what is known science versus a distinctive claim?Use the baseline and focused event-detector prior-art searches; priority claims remain unestablished.FH-01 to FH-04
FQ-11How much directional evidence warrants a confirmatory study?Fix continuation/failure rules before data; power a later study for a meaningful effect with participant clustering.FH-02 to FH-04
FQ-12Would a narrower classifier improve runtime decisions and model outcomes?Independent intervention comparison; human-to-model transfer is separate.FH-05, FH-07
FQ-13Can a detector-derived reward improve the target without gaming, noise, proxy optimization, or shift?Separate reward tests with an independent outcome measure; no accuracy-to-RL inference.FH-06

Resolution discipline

No event definition, label rubric, actionability criterion, numeric gate, sample size, modality, domain pair, or complete protocol is adopted. The baseline review constrains the inquiry; the pilot redesign is a NEW PROPOSAL. Record any resolution, source, alternatives, and consequences in the hypothesis history and research log.

Complementary existing-AI capability register

NEW PROPOSAL: Fiction-CWR asks whether a scoped valid-synthesis deficit remains when supplied primitive knowledge is demonstrated and evidence for composition familiarity is controlled. This narrow behavioral question complements the current human question; it does not resolve FQ-01/FQ-06/FQ-07.

IDOpen questionRequired next evidenceRelated claim
FQ-14Do pinned frontier models show a substantive withheld-versus-familiar composition loss despite primitive competence?Frozen P/F/C protocol; all-model and qualified estimates; independent confirmationFH-08, FH-07
FQ-15Can every accepted solution's necessary withheld motif be certified, and F/C evidence be matched?Independent enumeration/certificates, copy audits, exposure and difficulty manifestsFH-08, FQ-02/FQ-03
FQ-16Is an apparent loss explained by state load, output burden, prompt/representation or budget?P/R/E, higher-budget and representation arms; family sensitivityFH-08, FQ-05
FQ-17Do synthetic compositions predict useful constrained workflows or human-relative behavior?Separate domain/practical/human comparison studies; no inference from solver successFH-01, FH-07
FQ-18What independent task count, mastery rule and effect threshold support confirmation?Prospective simulation/precision design and frozen criterion rationaleFH-08, FQ-11

All remain unresolved. Candidate δ=0.20/τ=0.90 belong to EXP-0002's proposed design, not adopted human gates.

IDOpen questionRequired next evidenceRelated claim
FQ-19Could workflow organization partly explain an apparent withheld-composition loss at comparable cumulative resources?Certified F/C × SD/SW on one pinned model; equal iteration/history/evidence/permissions; actual usage; positive withheld gain as well as gap shrink; separate cost interpretationFH-09, FH-08, FQ-16

EXP-0003 prepares a finite directional diagnostic for FQ-19. It records no model result and resolves no human construct or label question. Numeric continuation/qualification/resource tolerances and execution remain unresolved.

2026-10-23 — Construct-validity questions retained

The current research question above is unchanged. The source integration adds explicit questions to FQ-01–FQ-04/FQ-17:

All remain UNRESOLVED. The missing Cycle 2/3 report bodies and CV-001 materials limit reconciliation; their absence is not evidence that the work never occurred.

Source History & Provenance

Publication and source

Public record
Selected public export · Scientific maturity is recorded separately.
Repository source
projects/fiction/research-question.md
Website snapshot
2026-10-25 (UTC)
Source date
2026-10-11 (Updated)
Version
No explicit version field is recorded in the source.

Download original file

The downloadable file preserves the selected source bytes.

Byte integrity

Download SHA-256: 53950015dafb902f4131247e5b5e042a701391c6303c5541e8284fa4ba240517

The checksum covers the exact downloadable bytes, not the rendered HTML. It supports byte comparison; it is not a signature or an independent validation of the research.

Historical statements retain their original scope and dates. A source discussion or internal decision does not establish an empirical result. Unselected or restricted records remain unavailable in this export.