Materials Design Analysis Reporting (MDAR) Report
Materials, Design, Analysis, and Reporting (MDAR) is a multidisciplinary research framework aimed at helping authors, editors, and other interested parties increase reporting transparency within life science manuscripts. The MDAR checklist aims to serve as a generic, minimum reporting standard for life science studies, a complement to journal and community specific guidelines and initiatives. The checklist is organized into three different sections: Materials, Design, and Analysis. For more information on MDAR, please check out their research.

With every submission to our systems, SciScore returns an MDAR checklist (in addition to our other reports), which is partially completed automatically using information detected in your research. You will most likely need to fill in additional information depending on your research topic as SciScore is currently only trained to detect a limited number of criteria, shown below. In the checklist, we note missing information with a "Not detected" and information not currently checked with a "Not currently checked by SciScore". If SciScore makes substantial mistakes with your manuscript, please contact us to help us learn from our mistakes.
Materials:
The materials section contains expandable tables comprising information related to biological reagents and unique specimens (including some information regarding human participants if applicable). For key resources (e.g. antibodies, cell lines, and organisms), if no RRID is available, please submit your resource to its respective authority.
The items detected in this section of the MDAR report include the following:
- Antibodies:
- Cell Materials:
- Experimental Animals:
- Plants and microbes:
- Human research participants:
Design:
The design section contains expandable tables comprising information related to the experimental design of the study, including methodologies and statistics.
The items detected in this section of the MDAR report include the following:
- Study protocol:
- Laboratory protocol:
- Experimental study design: Please state if and how the below criteria were fulfilled, including instances where they were not completed.
- Sample definition and in-laboratory replication:
- Ethics: Please state details regarding the ethical approval of your research if applicable.
- Dual Use Research of Concern (DURC):
Analysis:
The analysis section contains expandable tables comprising information related to the statistical analysis, code, and data of your research.
The items detected in this section of the MDAR report include the following:
- Attrition:
- Statistics:
- Data availability:
- Code Availability:
- Adherence to community standards:
How to use this report:
- Ensure that each criterion that you expect is addressed in your manuscript; please check what is relevant in the criteria above. In general though, adding more criteria is better as it provides greater transparency, allowing outside stakeholders (other researchers, journal editors, and funders) to make better, more informed decisions on the reproducibility of your research.
- Pro Tip: If a journal expects that a criterion should be filled, but you do not believe that it is relevant, address it using a negative statement. Examples:
- No subjects were excluded from our study.
- We did not assess whether subjects were male or female because embryos were not genotyped.
- Experimental subjects were not randomized into groups because this was deemed irrelevant to this study.
- Experimenters were not blinded to the subject's genotype because knockout mice were visibly different from controls.
- We did not check for sample sizes using a power analysis because our study does not report statistics between groups or within group variables.
- No technical replication was completed because the Sasquatch was visible only once.
- Possible Problems: SciScore does not recognize my sentence as fulfilling a criterion. In some cases, this is because researchers use complex sentences with uncommon syntactic patterns. Please try to simplify your sentences where possible, but if this issue persists, please contact us.
General notes on interpretation of text mining results:
SciScore is a machine learning, text analysis tool and is therefore susceptible to making two types of errors: false positives and false negatives.
False negatives: The most common error occurs when our models fail to detect a sentence that contains a rigor criterion or a resource, such as an antibody. False negatives generally occur either because the sentence is complex or in a less common syntactic pattern. Generally, simple sentences in clear standard English are simpler to process and result in fewer false negatives. If a truly complex sentence structure is required to describe reagents, a table may help not only SciScore but also human readers. If an RRID is detected in a sentence, SciScore will be triggered to take a look at the sentence, which may have been skipped otherwise.
False positives: This type of error occurs when our models falsely detect criteria that is not present. We try to minimize these false positives using several strategies, however, they still occur in roughly 3-5% of cases. If this impacts your SciScore experience, please contact our team and include the sentence where SciScore made the error. SciScore is always trying to learn from its mistakes for improved performance next time around.
Known Issues:
As mentioned before, SciScore is not perfect. Below we have provided a list of problems we are working to fix. If you notice any other persistent problems, please contact us.
- Equations and figures, go figure. If you have been unable to get your SciScore report back or are noticing a significant number of errors, equations and figures can sometimes be the culprit. Try submitting without them.
- We are still trying to iron out all of the kinks in our new identifers sections (for protocols, code IDs and data IDs). Sometimes identifiers will still be shown in red even though they resolve (and therefore should be blue). By clicking on the links provided in your SciScore report, you can check this out for yourself to double check SciScore. If you are redirected to a specific data record, then the identifier resolves! If not, then there could be an issue with the identifer (typo, etc.), the network (i.e. we reach out to a database and it does not respond), or the identifer is so new that our records haven't been updated to match.
