Independent · non-commercial · publishes on a quarterly cycle|Current cycle 2026 Q3
Compound Evidence InstituteEvidence synthesis · established 2023Graded assessments of compounds, trials, methods and supply
Document set current to 30 July 2026
Public comment period · §3

Draft corrections and versioning policy — disposition

The disposition of every submission and the amendments that resulted.

Document identifier
CEI-CP-022/3
Series
Public comment period
Version
1.0
Published
06 Sep 2024
Last reviewed
06 Sep 2024
Next review
06 Sep 2025
Identifier
10.71829/cei.cp.22
Certainty
Not rated
Cycle
2024 Q3
Window
16 Jul 2024 – 13 Aug 2024
Status
Closed
Submissions
19

§3Disposition and amendments

§3.1Disposition table

Table 1. Every submission with its disposition. Each row links to the submission in full.

ReferenceRespondentPoint raisedDisposition
DRAFT-CORRECTIONS-/001Anselm MountstephenThe threshold between a correction and a new version is drawn too highAccepted in part
DRAFT-CORRECTIONS-/002Dr Ludmila TollemacheWhere a document is generated rather than authored, the reader should be toldAccepted
DRAFT-CORRECTIONS-/003Dr Quentin Gwynne-SarpongNo term limit applies to membership of the assessment committeeAccepted
DRAFT-CORRECTIONS-/004Dr Quentin EnthovenThe materiality threshold for a declarable holding is set too highAccepted in part
DRAFT-CORRECTIONS-/005Quentin Whitmarsh-ObiNothing states what happens to the document set if the Institute ceases to operateAccepted
DRAFT-CORRECTIONS-/006Dr Evander Whitmarsh-ObiQuantitative claims are reproduced without the method that produced themAccepted
DRAFT-CORRECTIONS-/007Georgiana ZimmerthalDeclared interests should appear on the document rather than on a separate pageNoted, no amendment
DRAFT-CORRECTIONS-/008Dr Rurik Haverkamp-DialloA party that is assessed and also sponsors should be disclosed on its own assessmentAccepted
DRAFT-CORRECTIONS-/009Dr Vasilisa Sandringham-AduAn industry submission should be identifiable without reading the declared interestAccepted
DRAFT-CORRECTIONS-/010Wilhelmina Oppenheimer-AdeThe policy does not say who may make a submissionAccepted
DRAFT-CORRECTIONS-/011Vittoria YlönenA declared interest is published without being testedAccepted
DRAFT-CORRECTIONS-/012Professor Bartolomeu Nkosi-LindegaardThe standards applying to advertising placement are not publishedAccepted in part
DRAFT-CORRECTIONS-/013Eamon Sandringham-AduThe terms on which the documents may be reused are not statedAccepted
DRAFT-CORRECTIONS-/014Kolawole Jankowiak-OseiThe position of a contributor who withdraws consent is not statedAccepted
DRAFT-CORRECTIONS-/015Stellan Cholmondeley-AdeThe search date is not on the face of the documentAccepted
DRAFT-CORRECTIONS-/016Dr Jozef Brandvold-AchterbergDisagreement within the assessment committee is not visibleAccepted
DRAFT-CORRECTIONS-/017Dr Perpetua Haverkamp-Diallo industryThe disclosure requirements exceed those of comparable bodiesNoted, no amendment
DRAFT-CORRECTIONS-/018Dr Jerome PetrossianNo period is stated within which a submission will be answeredAccepted
DRAFT-CORRECTIONS-/019Dr Vasilisa ImmelmannA party criticised in an assessment should have a right of replyAccepted in part
19 submissions in total.

§3.2Summary by disposition

Table 2. Counts by disposition, with the meaning of each.

DispositionCountMeaning
Accepted13The submission is accepted and the draft is amended as proposed. The amendment is recorded in the amendment log of the document it changed and is traceable to the numbered submission.
Accepted in part4Part of the submission is accepted and part is not. The secretariat response states which part is which and on what ground the remainder was declined.
Noted, no amendment2The submission raises a point the Institute accepts but that does not require a change to the draft, most often because the draft already states it elsewhere. The location is given in the response.
Not accepted0The submission is not accepted. The secretariat response gives the reason. A submission that is not accepted remains published in full; the Institute does not remove a submission because it disagrees with it.

§3.3Resulting amendments

  1. The threshold between a correction and a new version is drawn too high — arising from DRAFT-CORRECTIONS-/001. The versioning threshold is now stated by category: a change to a certainty rating, an effect estimate or a conclusion produces a new version at a new address, and every other change is a logged correction that states the previous wording.
  2. Where a document is generated rather than authored, the reader should be told — arising from DRAFT-CORRECTIONS-/002. Every generated record now carries a notice stating that its prose frame is templated and that its included studies, summary of findings and certainty rating are computed from the underlying records, so that the reader can see which parts were authored and…
  3. No term limit applies to membership of the assessment committee — arising from DRAFT-CORRECTIONS-/003. Members are appointed for a four-year term renewable once. Appointment and expiry dates are published in the register of members.
  4. The materiality threshold for a declarable holding is set too high — arising from DRAFT-CORRECTIONS-/004. The materiality threshold is lowered and is now expressed as a proportion of the declarer's holdings as well as an absolute figure, so that a holding material to the person is declarable whether or not it is large in absolute terms.
  5. Nothing states what happens to the document set if the Institute ceases to operate — arising from DRAFT-CORRECTIONS-/005. The governance document now records that the document set is licensed for reuse and mirroring, and names the deposit arrangement under which it would be preserved.
  6. Quantitative claims are reproduced without the method that produced them — arising from DRAFT-CORRECTIONS-/006. Every quantitative claim now carries the determination that produced it at the point of use, and figures obtained by non-comparable methods are no longer presented in the same row or sentence.
  7. A party that is assessed and also sponsors should be disclosed on its own assessment — arising from DRAFT-CORRECTIONS-/008. The disclosure now appears as a numbered section on the dossier of any assessed party that sponsors the site, as well as on the funding page.
  8. An industry submission should be identifiable without reading the declared interest — arising from DRAFT-CORRECTIONS-/009. A submission made on behalf of a company is now identified as an industry submission on its face, at the head of the submission and in the disposition table, in addition to the declared interest published in full beneath it.
  9. The policy does not say who may make a submission — arising from DRAFT-CORRECTIONS-/010. The policy now states that any person may make a submission, that no affiliation is required, and that the declaration requirement applies identically to every respondent.
  10. A declared interest is published without being tested — arising from DRAFT-CORRECTIONS-/011. The policy now states that declarations are published as made, that the Institute does not investigate them, and that where a declaration appears incomplete the respondent is asked to complete it before publication. That the Institute does not verify is now…
  11. The standards applying to advertising placement are not published — arising from DRAFT-CORRECTIONS-/012. The placement standards are now published: what a unit may claim, the labelling required, the separation from assessed content, and the grounds on which a placement is refused or withdrawn. Commercial terms are not published and the reason is stated.
  12. The terms on which the documents may be reused are not stated — arising from DRAFT-CORRECTIONS-/013. The reuse terms are now stated explicitly on the legal page and in the document footer, permitting quotation and reproduction with attribution and the document version, and requiring that any reproduction carry the certainty rating that accompanied the quoted…
  13. The position of a contributor who withdraws consent is not stated — arising from DRAFT-CORRECTIONS-/014. The policy now states that a contributor may withdraw from the register at any time and that the register entry is removed, while a signed submission already published remains published, because the consultation record is a record of what was said and by…
  14. The search date is not on the face of the document — arising from DRAFT-CORRECTIONS-/015. The search date is now printed adjacent to every certainty rating and is carried in the document metadata, so that the interval between the search and the reading is visible without reference to the methods section.
  15. Disagreement within the assessment committee is not visible — arising from DRAFT-CORRECTIONS-/016. A ratification record is now published with every document stating whether the assessment was unanimous, and a member may record a dissenting statement which is published with the document rather than in minutes.
  16. No period is stated within which a submission will be answered — arising from DRAFT-CORRECTIONS-/018. Receipt is acknowledged within five working days and a substantive response is published within eight weeks of the window closing. Where that period cannot be met the reason is published in its place.
  17. A party criticised in an assessment should have a right of reply — arising from DRAFT-CORRECTIONS-/019. A standing correction route is now published, corrections of fact are assessed and applied at any time with the change recorded in the amendment log, and a submission of substance received outside a window is held and published in the next comment period on…

References cited on this page

References are numbered in order of first citation in this document. Each superscript in the text links to its entry below.

  1. International Organization for Standardization. ISO/IEC 17025:2017 General Requirements for the Competence of Testing and Calibration Laboratories. ISO/IEC Standard 2017;3rd edition. identifier not held by the Institute

Identifiers are reproduced only where the Institute holds them. Where a digital object identifier or PubMed identifier is not shown, the Institute has recorded the journal and year and has not constructed an identifier.

Nothing published by the Institute is medical advice, a diagnosis, a prescription, a treatment recommendation or a purchasing recommendation. Compounds supplied for research use are not approved for human or veterinary use in any jurisdiction, and a favourable analytical assessment of a supplier is not a statement that any product is safe or effective. The Institute publishes certainty ratings and never recommendations. No telephone number, messaging handle or ordering channel appears anywhere on this site.