research paper references

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, automatically generate references for free.

• Knowledge Base
• Referencing

A Quick Guide to Referencing | Cite Your Sources Correctly

Referencing means acknowledging the sources you have used in your writing. Including references helps you support your claims and ensures that you avoid plagiarism .

There are many referencing styles, but they usually consist of two things:

• A citation wherever you refer to a source in your text.
• A reference list or bibliography at the end listing full details of all your sources.

The most common method of referencing in UK universities is Harvard style , which uses author-date citations in the text. Our free Harvard Reference Generator automatically creates accurate references in this style.

Instantly correct all language mistakes in your text

Be assured that you'll submit flawless writing. Upload your document to correct all your mistakes.

Table of contents

Referencing styles, citing your sources with in-text citations, creating your reference list or bibliography, harvard referencing examples, frequently asked questions about referencing.

Each referencing style has different rules for presenting source information. For in-text citations, some use footnotes or endnotes , while others include the author’s surname and date of publication in brackets in the text.

The reference list or bibliography is presented differently in each style, with different rules for things like capitalisation, italics, and quotation marks in references.

Your university will usually tell you which referencing style to use; they may even have their own unique style. Always follow your university’s guidelines, and ask your tutor if you are unsure. The most common styles are summarised below.

Harvard referencing, the most commonly used style at UK universities, uses author–date in-text citations corresponding to an alphabetical bibliography or reference list at the end.

Harvard Referencing Guide

Vancouver referencing, used in biomedicine and other sciences, uses reference numbers in the text corresponding to a numbered reference list at the end.

Vancouver Referencing Guide

APA referencing, used in the social and behavioural sciences, uses author–date in-text citations corresponding to an alphabetical reference list at the end.

APA Referencing Guide APA Reference Generator

MHRA referencing, used in the humanities, uses footnotes in the text with source information, in addition to an alphabetised bibliography at the end.

MHRA Referencing Guide

OSCOLA referencing, used in law, uses footnotes in the text with source information, and an alphabetical bibliography at the end in longer texts.

OSCOLA Referencing Guide

Prevent plagiarism, run a free check.

In-text citations should be used whenever you quote, paraphrase, or refer to information from a source (e.g. a book, article, image, website, or video).

Quoting and paraphrasing

Quoting is when you directly copy some text from a source and enclose it in quotation marks to indicate that it is not your own writing.

Paraphrasing is when you rephrase the original source into your own words. In this case, you don’t use quotation marks, but you still need to include a citation.

In most referencing styles, page numbers are included when you’re quoting or paraphrasing a particular passage. If you are referring to the text as a whole, no page number is needed.

In-text citations

In-text citations are quick references to your sources. In Harvard referencing, you use the author’s surname and the date of publication in brackets.

Up to three authors are included in a Harvard in-text citation. If the source has more than three authors, include the first author followed by ‘ et al. ‘

The point of these citations is to direct your reader to the alphabetised reference list, where you give full information about each source. For example, to find the source cited above, the reader would look under ‘J’ in your reference list to find the title and publication details of the source.

Placement of in-text citations

In-text citations should be placed directly after the quotation or information they refer to, usually before a comma or full stop. If a sentence is supported by multiple sources, you can combine them in one set of brackets, separated by a semicolon.

If you mention the author’s name in the text already, you don’t include it in the citation, and you can place the citation immediately after the name.

• Another researcher warns that the results of this method are ‘inconsistent’ (Singh, 2018, p. 13) .
• Previous research has frequently illustrated the pitfalls of this method (Singh, 2018; Jones, 2016) .
• Singh (2018, p. 13) warns that the results of this method are ‘inconsistent’.

The terms ‘bibliography’ and ‘reference list’ are sometimes used interchangeably. Both refer to a list that contains full information on all the sources cited in your text. Sometimes ‘bibliography’ is used to mean a more extensive list, also containing sources that you consulted but did not cite in the text.

A reference list or bibliography is usually mandatory, since in-text citations typically don’t provide full source information. For styles that already include full source information in footnotes (e.g. OSCOLA and Chicago Style ), the bibliography is optional, although your university may still require you to include one.

Format of the reference list

Reference lists are usually alphabetised by authors’ last names. Each entry in the list appears on a new line, and a hanging indent is applied if an entry extends onto multiple lines.

Different source information is included for different source types. Each style provides detailed guidelines for exactly what information should be included and how it should be presented.

Below are some examples of reference list entries for common source types in Harvard style.

• Chapter of a book
• Journal article

The only proofreading tool specialized in correcting academic writing

The academic proofreading tool has been trained on 1000s of academic texts and by native English editors. Making it the most accurate and reliable proofreading tool for students.

Correct my document today

Your university should tell you which referencing style to follow. If you’re unsure, check with a supervisor. Commonly used styles include:

• Harvard referencing , the most commonly used style in UK universities.
• MHRA , used in humanities subjects.
• APA , used in the social sciences.
• Vancouver , used in biomedicine.
• OSCOLA , used in law.

Your university may have its own referencing style guide.

If you are allowed to choose which style to follow, we recommend Harvard referencing, as it is a straightforward and widely used style.

References should be included in your text whenever you use words, ideas, or information from a source. A source can be anything from a book or journal article to a website or YouTube video.

If you don’t acknowledge your sources, you can get in trouble for plagiarism .

To avoid plagiarism , always include a reference when you use words, ideas or information from a source. This shows that you are not trying to pass the work of others off as your own.

You must also properly quote or paraphrase the source. If you’re not sure whether you’ve done this correctly, you can use the Scribbr Plagiarism Checker to find and correct any mistakes.

Harvard referencing uses an author–date system. Sources are cited by the author’s last name and the publication year in brackets. Each Harvard in-text citation corresponds to an entry in the alphabetised reference list at the end of the paper.

Vancouver referencing uses a numerical system. Sources are cited by a number in parentheses or superscript. Each number corresponds to a full reference at the end of the paper.

Is this article helpful?

Other students also liked.

• A Quick Guide to Harvard Referencing | Citation Examples
• APA Referencing (7th Ed.) Quick Guide | In-text Citations & References

How to Avoid Plagiarism | Tips on Citing Sources

More interesting articles.

• A Quick Guide to OSCOLA Referencing | Rules & Examples
• Harvard In-Text Citation | A Complete Guide & Examples
• Harvard Referencing for Journal Articles | Templates & Examples
• Harvard Style Bibliography | Format & Examples
• MHRA Referencing | A Quick Guide & Citation Examples
• Reference a Website in Harvard Style | Templates & Examples
• Referencing Books in Harvard Style | Templates & Examples
• Vancouver Referencing | A Quick Guide & Reference Examples

Scribbr APA Citation Checker

An innovative new tool that checks your APA citations with AI software. Say goodbye to inaccurate citations!

Research Methodology and Scientific Writing pp 361–400 Cite as

References: How to Cite and List Correctly

• C. George Thomas 2  
• First Online: 25 February 2021

4352 Accesses

When we write an essay, research paper, thesis, or book, it is normal to include information from the work of others or support our arguments by reference to other published works. All such academic documents draw heavily on the ideas and findings of previous and current researchers available through various sources such as books, journals, theses, newspapers, magazines, government reports, or Internet sources. In all these cases, proper referencing is essential in order to ensure easy retrieval of information. Referencing is the name given to the method of showing and acknowledging the sources from which the author has obtained ideas or information.

Everything deep is also simple and can be reproduced simply as long as its reference to the whole truth is maintained. But what matters is not what is witty but what is true. Albert Schweitzer (1875–1965)

This is a preview of subscription content, log in via an institution .

Buying options

• Available as PDF
• Read on any device
• Instant download
• Own it forever
• Available as EPUB and PDF
• Compact, lightweight edition
• Dispatched in 3 to 5 business days
• Free shipping worldwide - see info
• Durable hardcover edition

Tax calculation will be finalised at checkout

Purchases are for personal use only

Bibliography

AMA [American Medical Association] 2007. AMA Manual of Style: A Guide for Authors and Editors (10 th Ed.). Oxford University Press, New York, 1024p.

Google Scholar  

APA [American Psychological Association] 2013. Publication Manual of the American Psychological Association (6 th Ed.). American Psychological Association, Washington DC, 272p.

Barrass, R. 2002. Scientists Must Write: A Guide to Better Writing for Scientists, Engineers and Students (2 nd Ed.). Routledge, London, 204p.

BSI [British Standards Institution] 1990. Recommendations for Citing and Referencing Published Material (2 nd Ed.). British Standards Institution (BS 5605:1990), 8p.

Cargill, M. and O’Connor, P. 2009. Writing Scientific Research Articles: Strategy and Steps. Wiley-Blackwell, 173p.

COA [Commonwealth of Australia] 2002. Style Manual for Authors, Editors and Printers (6 th Ed.). John Wiley & Sons, Brisbane, Australia, 550 p.

Cousens, R. 1987. Theory and reality of weed control thresholds. Plant Prot. Q. 2: 13–20

Craswell, G. 2004. Writing for Academic Success: A Postgraduate Guide. Sage Publications, London, 271p.

CSE [Council of Science Editors] 2014. Scientific Style and Format: The CSE Manual for Authors, Editors, and Publishers (8 th Ed.): The University of Chicago Press, 722p.

Davis, M. 2005. Scientific Papers and Presentations. Academic Press, Massachusetts, 356p.

Day, R.A. and Gastel, B. 2006. How to Write and Publish a Scientific Paper (6 th Ed.). Cambridge University Press, Cambridge, 320p.

Gustavii, B. 2008. How to Write and Illustrate a Scientific Paper (2 nd Ed.). Cambridge University press, Cambridge, 168p.

Hakansson, S. 1983. Competition and Production in Short-lived Crop Weed Stands: Density Effects. Report 127, Swedish University of Agricultural Sciences, Uppasala, 85p.

ISSN [International Standards Serial Number].2017. The List of title word abbreviations [on line]. Available: http://www.issn.org/services/onlineservices/access-to-the-ltwa/ [Accessed 06 May 2018].

Leggett, G., Mead, C.D., Kramer, M.G., and Beal, R.S. 1985. Handbook for Writers. Prentice- Hall, New Jersey, 558p.

Lester, J.D. and Lester, J.D. Jr. 2009. Writing Research Papers: A Complete Guide (13 th Ed.), Longman, 416p.

MLA [Modern Language Association of America] 2016. MLA Handbook for Writers of Research Papers (8 th Ed.) Modern Language Association of America, 146p

Neville, C. 2010. The Complete Guide to Referencing and Avoiding Plagiarism (2 nd Ed.). McGraw-Hill Education, 288 p.

Renu, S. and Thomas, C.G. 2000. Stale seedbed technique for the management of Sacciolepis interrupta in semi-dry rice. Indian J. Weed Sci. 32(3&4):146-149

Rubens, P. 2004. Science and Technical writing: A Manual of Style (2 nd Ed.). Routledge, New York, 427p.

Sheng, T.C. 1989. Soil Conservation for Small Farmers in the Humid Tropics. FAO Soils Bulletin No. 60. Food and Agriculture Organization of the United Nations, Rome, 104p

Thomas, C. G. 2008. Forage Crop Production in the Tropics. Kalyani Publishers, Ludhiana, 333p.

Thomas, C. G., Abraham, C. T., and Sreedevi, P. 1997. Weed flora and their relative dominance in semi-dry rice culture. J. Trop. Agric. 35:51–53.

Thomas, C. G. 2010. Land Husbandry and Watershed Management. Kalyani Publishers, Ludhiana, 716p.

Turabian, K.L. 2007. A Manual for Writers of Term Papers, Theses, and Dissertations (9 th Ed.). The University of Chicago Press, 461p.

UChicago [University of Chicago] 2017. Chicago Manual of Style [CMOS].

University of Chicago Press, 1144p.

AMA style- http://www.amamanualofstyle.com/oso/public/index.html .

APA style- https://www.apastyle.org/manual

BibSonomy- https://www.bibsonomy.org/

Bibus - http://www.sourceforage.net/projects/bibus-biblio

Bookends-www. sonnysoftware.com/

CAS Source index search tool- http://cassi.cas.org/search.jsp

Citavi- https://citavi.com/

CiteULike- http://www.citeulike.org

EndNote- https://www.endnote.com/

FAO [Food and Agriculture Organization of the United Nations]. 2018. The State of Food Security and Nutrition in the World 2018. Building Climate Resilience for Food Security and Nutrition. FAO, Rome, 181p. Available: http://www.fao.org/3/I9553EN/i9553en.pdf [Accessed 10 Oct. 2018].

Genamics JournalSeek- http://journalseek.net/

JabRef - http://jabref.sourceforge.net/

Journal database, NCBI- http://www.ncbi.nlm.nih.gov/nlmcatalog/journals ISSN, LTWA- http://www.issn.org/2-22661-LTWA-online.php .

Mendeley- https://www.mendeley.com

Papers- http://www.readcube.com/papers/

Qiqqa - http://www.qiqqa.com/

Refbase- http://www.refbase.net

RefWorks- https://www.proquest.com/

Scientific Style and Format (CSE) - https://www.scientificstyleandformat.org/Home.html

SciRef- http://sci-progs.com/

Web of Science journal abbreviations- https://images.webofknowledge.com/ images/help/WOS/A_abrvjt.html

Wikindx - https://sourceforge.net/ projects/wikindx/

Zotero- https://www.zotero.org/

Download references

Author information

Authors and affiliations.

Kerala Agricultural University, Thrissur, Kerala, India

C. George Thomas

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to C. George Thomas .

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s)

About this chapter

Cite this chapter.

Thomas, C.G. (2021). References: How to Cite and List Correctly. In: Research Methodology and Scientific Writing . Springer, Cham. https://doi.org/10.1007/978-3-030-64865-7_15

Download citation

DOI : https://doi.org/10.1007/978-3-030-64865-7_15

Published : 25 February 2021

Publisher Name : Springer, Cham

Print ISBN : 978-3-030-64864-0

Online ISBN : 978-3-030-64865-7

eBook Packages : Education Education (R0)

Share this chapter

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Publish with us

Policies and ethics

• Find a journal
• Track your research

How to Write References and Cite Sources in a Research Paper

Table of contents

• 1.1 Academic Integrity
• 1.2 Avoiding Plagiarism
• 1.3 Building Credibility
• 1.4 Facilitating Further Research
• 2.1 APA (American Psychological Association)
• 2.2 MLA (Modern Language Association)
• 2.3 Chicago Style
• 2.4 IEEE (Institute of Electrical and Electronics Engineers)
• 3.1 Author(s)
• 3.2 Title of the Source
• 3.3 Publication Date
• 3.4 Publisher
• 3.5 Page Numbers
• 3.6 DOI (Digital Object Identifier) or URL (Uniform Resource Locator)
• 4.1.3 Chicago
• 4.2.1 Citing Multiple Authors
• 4.2.4 Chicago
• 4.3 Page Numbers in In-Text Citations
• 5.1 Formatting and Organizing Your References
• 5.2 Alphabetizing Your References
• 5.3.2 Journal
• 5.3.3 Chapter
• 5.3.4 Conference Paper/Presentation
• 5.3.5 Online Sources
• 6.1 Verify Your Source
• 6.2 Follow the One Style Guide
• 6.3 Verify DOI and URLs
• 6.4 Online Citation Generators
• 6.5 Use University Libraries and Writing Centers
• 7 Leave No Stone Unturned!

Citation is necessary while writing your school essay, a publication, or a Master’s thesis. We all want our efforts to be acknowledged, right? The lack of references and citations can make the source think you are trying to steal their work. Hence, the question is how to go about making references.

Do you want to learn how to cite in a research paper? Then this article is for you, as it contains the details of how to reference when writing a research paper. There is a standard way to do this in educational journals and organizational publications.

Hence, a researcher must understand how to reference their writings or journals. It is another thing to write a journal properly, but crediting the sources is more crucial.

Follow this guide to learn:

• The importance of referencing and citations for your academic works;
• How to cite in APA, MLA, Chicago, IEEE, and ASA styles;
• Essential guidelines to follow for a published work.

Why Referencing and Citation Matter

Another important question is: What is the need for referencing and citation? The major reason for citations in research paper format is to serve as directional cues for the employed knowledge. When you cite, readers can know that some portions of your content belong to you. Hence, it is easier to identify how recent the information is.

Citation for your paper comes with several advantages. They include:

Academic Integrity

The citation affirms the integrity of your academic writing. In this information age, there are several details, and it can be difficult to authenticate. When you reference, it helps readers understand the necessity of the discussed topic. Referencing certain authors can give more authority to your papers.

Avoiding Plagiarism

Plagiarism refers to the mindless lifting of details from another material without acknowledging the details. For the source, they could believe you are stealing from them. In most countries, copyright infringement is a punishable crime and can make you lose your hard work.

Building Credibility

Credibility is the goal of every academic scholar. There is no better way to gain relevance than by citing sources from other credible ones.

Facilitating Further Research

For other researchers like you, providing citations can serve as other sources for more information. It helps them to know other philosophies about the subject.

Choosing the Right Citation Style

Now that the advantages have been established, the new worry is the choice of the right style. There are several styles with their respective peculiarities. For example, the MLA writing style is common in liberal scientific paper citations. Let’s delve more into MLA formatting for research papers and other styles.

APA (American Psychological Association)

The commonest style used by many scholars is APA formatting , especially if there is no stated style. This approach employs the use of in-text citations to explain the source. It’s the simplest form of citation.

Here is an in-text referencing example:

“Exercise is a good way to recover from ailments.” APA, n.d. (American Psychological Association).

The reference style includes:

• The author’s name;
• The author’s name is in parenthesis to follow the referenced excerpt;
• The publication date.

MLA (Modern Language Association)

MLA-style formation is concise and known for its scientific referencing format. The peculiarity of the MLA citation is its source citation, episode title, and document layout. You have to:

• Include the parenthetical citation;
• Create some spaces away from the left margin;
• Include the author’s or source’s name.

Ensure you capitalize every word when including the names. You can employ professional MLA Citation Generators to make the compilation easier. It is perfect for the citation format of scientific papers.

Chicago Style

Chicago’s style is famous for two things:

• The in-text citation within the paper;
• The reference list is at its end.

It is an author-date approach. Hence, the in-text citation for a research paper has the author’s or source name and publication year.

IEEE (Institute of Electrical and Electronics Engineers)

This employs the use of numbers. It is chronological as it arranges the citation based on the order of appearance. A click on it takes the reader to the full reference at the end of the paper. To make it easier, you can employ IEEE Citation Maker for a well-curated task. This way, you won’t have to worry about the manual compilation of the IEEE citation style.

This is similar to the author-date approach by Chicago Style. You can:

• Create the quotation;
• Include the parentheses for the author’s name and publication date;
• Add the page number using a colon.

Components of a Citation

Do you want to know how to complete a citation for your professional research paper writing service and research paper? Learn about its components.

The author is also regarded as the source. It is the original writer of the material you are referencing. Sometimes, there may be multiple authors. Do not miss out on anyone while citing a research paper.

Title of the Source

The title of the source is often the name given to the material by the author.

Publication Date

As the name implies, this refers to the date the source was published. Frequently, most writers include it at the start of their material. State the exact month and year of publication, separated with a comma. See example:

“(2016, March 7).”

Including the publisher’s details is only necessary for the full reference. It should be at the end of the paper. It can facilitate further research.

Page Numbers

The page number is necessary, as it helps to easily refer to different sections of the paper.

DOI (Digital Object Identifier) or URL (Uniform Resource Locator)

A DOI is a link to a resource on the internet. The resource can be a book or its chapter. On the other hand, a URL is an address that indicates where the resource can be found. It helps to locate the resource. The use of URLs and DOIs directs readers to the digital identifier of the source.

In-Text Citations

An in-text citation for a research paper is the brief form of the bibliography that you include in the body of the content. It contains the author’s family name and year of publication. It provides enough details to help users know the source in their reference list. Each citation format for research papers is unique.

See citation examples below.

How to Cite Direct Quotations for Each Citation Style

The general rule in referencing is that in-text citations must have a corresponding entry in your reference list. Let’s see how!

There are two types of APA in-text citations:

Parenthetical:

The researchers concluded, “Climate change poses significant challenges for coastal communities” (Johnson & Lee, 2021, p. 78).

In their study on the effects of exercise on mental health, Smith and Johnson (2019) found that regular physical activity was associated with a significant decrease in symptoms of anxiety and depression. According to their research, engaging in exercise three times a week for at least 30 minutes had a positive impact on participants’ overall well-being.

APA in-text citation style employs the source’s name and publication year. A direct quotation will include the page number. Remember, you can generate a citation in a research paper using the APA style via a citation generator.

MLA is known as the scientific style of citation. The uniqueness of MLA Style formatting is the use of a direct quote (in quotes), the Author’s name and page number (in parentheses).

In the novel “To Kill a Mockingbird,” Atticus Finch imparts wisdom to his children, saying, “You never really understand a person until you consider things from his point of view… until you climb into his skin and walk around in it” (Lee 30).

For Chicago, you are to include a parenthetical citation, the author’s name, the publication year, and the quote’s page number.

As Adams (2009) argues, “History is a vast early warning system” (53).

IEEE (Institute of Electrical and Electronics Engineers) style typically uses numerical citations in square brackets for in-text citations. It doesn’t rely heavily on direct quotations in the same way as some other citation styles, like APA or MLA. Instead, IEEE generally prefers paraphrasing and citing the source, but direct quotations can be used when necessary. Here’s an example of a direct quotation in IEEE style:

In-Text Citation:

As stated by Smith, “In most cases, the impedance of the transmission line remains relatively constant throughout its length” [1].

Corresponding Reference Entry:

[1] A. Smith, “Transmission Line Impedance Analysis,” IEEE Transactions on Electrical Engineering, vol. 45, no. 3, pp. 212-225, 2010.

ASA is different because it contains the author’s name, publication year, and even the page number.

According to Smith (2010), “Social institutions shape our behaviors and interactions in profound ways” (p. 45).

How to Cite Paraphrased Information

While writing a college paper, paraphrasing is important to achieve clarity, but it is ideal to cite the source of the paraphrased information. The proper way to cite paraphrased information is to include a parenthetical citation. The style of referencing for all citation styles doesn’t change, but they should be in parenthesis.

“Strength can be defined in terms of ability and acquired skills, according to (Jack et al. 2023).

Citing Multiple Authors

The technique is different when you are citing a source that has multiple authors. For the first-time citation, you should include the names of all the authors. The subsequent activities to generate a citation in APA should only include the first author’s surname and the proper use of ‘et al.’ However, you should include the surname and initials of all these authors in the full reference. Separate the authors with commas and ampersands before the final name.

Two Authors:

When a source has two authors, include both authors’ names in the in-text citation every time you reference the source. Use an ampersand (&) between the authors’ names, and include the year of publication in parentheses. For example:

(Smith & Johnson, 2020) found that…

Three to Five Authors:

When a source has three to five authors, list all authors in the first in-text citation. Use an ampersand (&) between the last two authors’ names. For subsequent citations of the same source, use only the first author’s name followed by “et al.” and the year. For example:

First citation: (Smith, Johnson, & Williams, 2018)…

Subsequent citations: (Smith et al., 2018)…

Six or More Authors:

When a source has six or more authors, you should use “et al.” in both the first and subsequent in-text citations, along with the year. For example:

(Smith et al., 2019) conducted a study on…

Group Authors:

When citing sources authored by a group, organization, or company, use the full name of the group or organization as the author in the in-text citation. If the abbreviation is well-known, you can use the abbreviation in subsequent citations. For example:

First citation: (American Psychological Association [APA], 2019)…

Subsequent citations: (APA, 2019)

When a source has two authors, include both authors’ names in the in-text citation, separated by the word “and.” For example:

(Smith and Johnson 45) found that…

Three or More Authors:

When a source has three or more authors, include only the first author’s name followed by “et al.” in the in-text citation. For example:

(Smith et al. 72) conducted a study on…

If a source has no identifiable author, use a shortened version of the title in the in-text citation. Enclose the title in double quotation marks or use italics if it’s a longer work (e.g., a book or film). For example:

(“Title of the Source” 28) argues that…

(American Psychological Association 62) states that…

Author-Date System:

In the Author-Date system, when a source has two authors, include both authors’ last names and the publication year in parentheses in the in-text citation, separated by an ampersand (&). For example:

(Smith & Johnson 2020) found that…

When a source has three or more authors, you can use “et al.” after the first author’s name in the in-text citation. For example:

(Smith et al. 2018) conducted a study on…

Notes and Bibliography System:

In the Notes and Bibliography system, when a source has two authors, include both authors’ full names in the note. For example:

John Smith and Jane Johnson, Title of the Work (Place of Publication: Publisher, Year), page number.

When a source has three or more authors, list the first author’s name followed by “et al.” in the note. For example:

John Smith et al., Title of the Work (Place of Publication: Publisher, Year), page number.

When a source has two authors, include both authors’ last names in the in-text citation, separated by the word “and.” For example:

(Smith and Johnson 2020) found that…

Three Authors:

When a source has three authors, include all three authors’ last names in the in-text citation, separated by commas. For example:

(Smith, Johnson, and Williams 2018) conducted a study on…

More than Three Authors:

When a source has more than three authors, you should use the first author’s last name followed by “et al.” in the in-text citation. For example:

(Smith et al. 2019) conducted a study on…

When a source has two authors, include both authors’ last names in the in-text citation, separated by “and.” For example:

[1] Smith and Johnson found that…

When a source has three or more authors, use the first author’s last name followed by “et al.” in the in-text citation. For example:

[2] Smith et al. conducted a study on…

Page Numbers in In-Text Citations

The use of page numbers in in-text citations is more peculiar to APA style. You can use paragraphs as indicated above if the source has no page, as seen in some e-books and websites.

Creating a Reference List or Bibliography

Creating a reference list is one of the most important tips for writing a research paper because it shows the general scheme of paper citation. This part of the content is a step-by-step process you can follow to create your reference list for your research paper.

Formatting and Organizing Your References

Formatting and organizing your references is the first step when you want to create your bibliography. You need to arrange all the full references to the in-text citation in the downward part of your paper. To avoid missing out on any, writing every full reference when you write the in-text citation is advisable.

Alphabetizing Your References

Alphabetizing your references ensures you create your bibliography in an orderly fashion for easy comprehension. Hence, you can do it numerically or alphabetically. The numerical order is dependent on the referencing system you are using, while the alphabetical order uses the author’s name to organize the reference.

Citations for Different Source Types

Different source types have their respective references, even for scientific papers. The commonest sources include books, journals, chapters, presentations, and online (to cite a website).

See how to cite an example for each source below:

Author, Initial. (Year). Book Title. City of publication, Country/State: Publisher.

“Social, M. (2023). The effect of the internet in this modern era . London, England: Ink.”

Author last name, First name. Book Title: Subtitle . Edition, Publisher, Year.

Donaldson, Bruce. Dutch: A Comprehensive Grammar . 3rd ed., Routledge, 2017..

Author last name, First name. Book Title: Subtitle . Edition. Place of publication: Publisher, Year. E-book format.

Donaldson, Bruce. Dutch: A Comprehensive Grammar . 3rd ed. Abingdon-on-Thames: Routledge, 2017.

• N. Last Name, Title , Edition. City: Publisher, 2000.
• Angelou, I Know Why the Caged Bird Sings , 1st ed. New York: Random House, 1969

Quote (Name Date)

Referencing is vital in research (Smith 2020).

Author, Initial. (Year). Article Title. Journal Title. The volume of the Journal (in italics), issue number of journal in round brackets, page range of articles, URL, and first time.

Social, M. (2023). The effect of the internet in this modern era . Digital Technology, 26(8), 22-24. (Insert URL).

Author. Journal title Date, Page. DOI

Ahmed, Sara. “What is Whiteness.” Feminist Theory , vol. 8, no. 2, Aug. 2007, pp. 149–168. https://doi.org/10.1177/1464700107078139.

Author’s Last Name, First Name. “Article Title.” Journal Name Volume, No. Issue (Month or Season Year): Page range. DOI or URL.

Pickard, Hanna. “What Is Personality Disorder?” Philosophy, Psychiatry, & Psychology 18, no. 3 (September 2011): 181–84. https://doi.org/10.1353/ppp.2011.0040.

Author Initial(s) and Surname, “Article title,” Journal Title , volume number, issue number, page range, month, and year of publication.

• Chesum, “Innovations in Catalyzation,” J Adhes Sci Technol , Vol. 7, No. 1., pp. 11–24, July-September 2012.

Author Surname, Author Forename. Year Published. ‘Title’. Publication Title Volume Number (Issue Number): Pages Used. Retrieved October 10, 2013 (http://Website URL).

Sandelowski, Margarete. 1994. ‘Focus On Qualitative Methods. Notes On Transcription’. Research in Nursing \& Health 17(4):312.

Chapter Author’s Last Name, First Initial. Second Initial. (Year). Chapter or article title. Editor First Initial. Second Initial. Editor’s Last Name (Ed.). Book title: Subtitle (edition number, if not the first pages of the chapter). Location of publication: Publisher.

Social, M.O., (2023). Coarctation. In D.S. Moodie (Ed.). Management of heart disease: Indulthood (pp. 142-170). Minneapolis, Minnesota: Cardiotext Publishing.

Name. Book title: Subtitle. Editors. Location of publication: publisher.

Schwartz, Paula. “Redefining Resistance: Women in France.” Behind the Lines: Two World Wars , edited by Margaret R. Higonnet et al., Yale UP, 1987, pp. 141–53.

Author’s Last Name, First Name. “Chapter Title.” In Book Title: Subtitle , edited by Editor first name Last name, Page range. Place of publication: Publisher, Year.

Nussbaum, Martha C. “Legal Reasoning.” In The Cambridge Law , edited by John Tasioulas, 59–77. Cambridge: Cambridge University Press, 2020.

Author(s), “Chapter title,” in Book Title, Editor(s), Ed(s). City, Country: Publisher, year, p(p). page(s).

• Saito, A. Jorio, and M. S. Dresselhaus, “Properties of nanographene,” in The Oxford Book of Technology, vol. 2, Materials , A. V. NarlikarEds. Oxford, U.K.: Oxford Univ. Press, 2010, pp. 1–30.

Author’s Last Name, First Name. Year of publication. “Title of Chapter.” Pp. Numbers in Title of Book (italicized), edited by F.I. MI. Last. Location of publisher, state or province postal code or name of country (if a foreign publisher): Publisher’s Name.

Rubin, Avi. 2015. “The Slave: A Drama from the Last Century.” Pp. 87-103 in Society, Culture in Asia: The Modernities , edited by E. R. Toledano: Walter De Gruyter Incorporated.

Conference Paper/Presentation

Last name, initial (Year). Conference paper title. Editor initial, last name (Ed.), Proceedings Book Title . Place of Publication: Publisher.

Winstone, N. & Boud, D. (2017). Supporting students’ engagement: the adoption of practices in the U.K. and Australia. A nnual Conference . Newport, South Wales

Surname, First Name. “Paper Title.” Proceedings Title, Conference Location and Date , edited by Editor Name(s), Publisher, Date of Publication.

Lewis, Jack. “Literature: The Consequences of Loss.” Library Proceedings Conference, Amsterdam, 13–14 June , edited by W. Oldham, LCP Publications, 2015.

Author First Name Last Name, “Title of the Paper” (paper presentation, Conference, Location, Date of conference).

Allison Cloyd, “An Examination of College Students” (paper presentation, EasyBib Conference, New York, NY, July 30, 2014) .

Author initials. Last name, Book Title . City, Country: Publisher, Year.

• P. Hailman, Coding: Man-Made Signals . Cambridge: Harvard Univ. Press, 2008.

Author Surname, Author Forename. Year Published. ‘Title’. P. Pages Used in Publication Title . City: Publisher. Retrieved October 10, 2013 (http://Website URL).

Vargas, Jose. 2014. ‘The End Of Liberty’. Pp. 40-42 in The end . Buenos Aires: Elsevier.

Online Sources

Last Name, Initials. (Year, Month Day). Article title . Site Name. URL

The countdown: A prophecy takedown . (2020, October 19). BBC News. https://www.bbc.com/news/election-us-2020-54596667

Author’s Last Name, First Name. Title of Book . Edition, Publisher, Year of publication.

Smith, Thomas. The Citation Manual for Students: A Guide . 2nd ed., Wiley, 2020.

Author First and Last Name, Title of Book (Place of publication: publisher, year), page number(s).

Albert Einstein, The Meaning of Relativity (Princeton: Princeton University Press, 1923), 44–45.

Author initials. Last Name, Book Title . City (and state if in the U.S.), Country: Publisher, Year.

• P. Hailman, Redundancy: Man-Made Signals . Cambridge, MA, USA: Harvard Univ. Press, 2008.

Last Name, First M. Year. “Title of article.” Title of Journal volume (issue): pages.

DOI/Retrieved Month Day, Year (URL)

Granello, Paul F. 1999. “College Students’ Wellness Due to Social Support.” Journal of Counseling 2(2):110-120.

Doi: 10.1002/j.2161-1882.1999.tb00149.x.

Tips for Accuracy

The goal of citing your paper is because of the advantages stated above. As such, you should not negotiate the accuracy of your citation. Here are the tips you can follow for accurate referencing:

Verify Your Source

Confirm if your source is credible or not. It is easier to verify books, journal articles, and chapters. You should check multiple links to confirm their authenticity.

Follow the One Style Guide

Maintain a single referencing style throughout your paper. It is improper to employ multiple referencing styles. If not specified, you can consider the APA style.

Verify DOI and URLs

DOI and URLs can be tricky and sensitive. A simple error with the punctuation can make them invalid. Hence, verifying every DOI and URL with a click is advisable. Discrediting your citation format for a scientific research paper reference based on an invalid URL is not worth it.

Online Citation Generators

Thanks to the digital age, you don’t have to worry about manually compiling your reference or generating its in-text citation. You can employ online generators to do the rough work for you. In turn, you will have more time to focus on the major content of your research work.

Use University Libraries and Writing Centers

Libraries and writing centers have extensive collections of cited sources. Since books, publications, and journals are more credible sources, university libraries remain a valid source to increase the credibility of your paper.

Leave No Stone Unturned!

Referencing and citation are the best way to preserve the relevance of your academic paper. It gives it the appropriate credibility for future use. That means another writer can refer to your work over many years, even when the level of advancement may be unmatched. A well-referenced work is evergreen.

One must note that well-oriented research paper citations have a proper format. The options include APA, MLA (citation style for science), Chicago, IEEE, and ASA. If not stated, it is advisable to follow the APA formatting style, as it is the most common. However, stick with formatting while compiling cited sources for a research paper.

Readers also enjoyed

WHY WAIT? PLACE AN ORDER RIGHT NOW!

Just fill out the form, press the button, and have no worries!

We use cookies to give you the best experience possible. By continuing we’ll assume you board with our cookie policy.

• Walden University
• Faculty Portal

Reference List: Common Reference List Examples

Article (with doi).

Alvarez, E., & Tippins, S. (2019). Socialization agents that Puerto Rican college students use to make financial decisions. Journal of Social Change , 11 (1), 75–85. https://doi.org/10.5590/JOSC.2019.11.1.07

Laplante, J. P., & Nolin, C. (2014). Consultas and socially responsible investing in Guatemala: A case study examining Maya perspectives on the Indigenous right to free, prior, and informed consent. Society & Natural Resources , 27 , 231–248. https://doi.org/10.1080/08941920.2013.861554

Use the DOI number for the source whenever one is available. DOI stands for "digital object identifier," a number specific to the article that can help others locate the source. In APA 7, format the DOI as a web address. Active hyperlinks for DOIs and URLs should be used for documents meant for screen reading. Present these hyperlinks in blue and underlined text (the default formatting in Microsoft Word), although plain black text is also acceptable. Be consistent in your formatting choice for DOIs and URLs throughout your reference list. Also see our Quick Answer FAQ, "Can I use the DOI format provided by library databases?"

Jerrentrup, A., Mueller, T., Glowalla, U., Herder, M., Henrichs, N., Neubauer, A., & Schaefer, J. R. (2018). Teaching medicine with the help of “Dr. House.” PLoS ONE , 13 (3), Article e0193972. https://doi.org/10.1371/journal.pone.0193972

For journal articles that are assigned article numbers rather than page ranges, include the article number in place of the page range.

For more on citing electronic resources, see  Electronic Sources References .

Article (Without DOI)

Found in a common academic research database or in print.

Casler , T. (2020). Improving the graduate nursing experience through support on a social media platform. MEDSURG Nursing , 29 (2), 83–87.

If an article does not have a DOI and you retrieved it from a common academic research database through the university library, there is no need to include any additional electronic retrieval information. The reference list entry looks like the entry for a print copy of the article. (This format differs from APA 6 guidelines that recommended including the URL of a journal's homepage when the DOI was not available.) Note that APA 7 has additional guidance on reference list entries for articles found only in specific databases or archives such as Cochrane Database of Systematic Reviews, UpToDate, ProQuest Dissertations and Theses Global, and university archives. See APA 7, Section 9.30 for more information.

Found on an Open Access Website

Eaton, T. V., & Akers, M. D. (2007). Whistleblowing and good governance. CPA Journal , 77 (6), 66–71. http://archives.cpajournal.com/2007/607/essentials/p58.htm

Provide the direct web address/URL to a journal article found on the open web, often on an open access journal's website. In APA 7, active hyperlinks for DOIs and URLs should be used for documents meant for screen reading. Present these hyperlinks in blue and underlined text (the default formatting in Microsoft Word), although plain black text is also acceptable. Be consistent in your formatting choice for DOIs and URLs throughout your reference list.

Weinstein, J. A. (2010).  Social change  (3rd ed.). Rowman & Littlefield.

If the book has an edition number, include it in parentheses after the title of the book. If the book does not list any edition information, do not include an edition number. The edition number is not italicized.

American Nurses Association. (2015). Nursing: Scope and standards of practice (3rd ed.).

If the author and publisher are the same, only include the author in its regular place and omit the publisher.

Lencioni, P. (2012). The advantage: Why organizational health trumps everything else in business . Jossey-Bass. https://amzn.to/343XPSJ

As a change from APA 6 to APA 7, it is no longer necessary to include the ebook format in the title. However, if you listened to an audiobook and the content differs from the text version (e.g., abridged content) or your discussion highlights elements of the audiobook (e.g., narrator's performance), then note that it is an audiobook in the title element in brackets. For ebooks and online audiobooks, also include the DOI number (if available) or nondatabase URL but leave out the electronic retrieval element if the ebook was found in a common academic research database, as with journal articles. APA 7 allows for the shortening of long DOIs and URLs, as shown in this example. See APA 7, Section 9.36 for more information.

Chapter in an Edited Book

Poe, M. (2017). Reframing race in teaching writing across the curriculum. In F. Condon & V. A. Young (Eds.), Performing antiracist pedagogy in rhetoric, writing, and communication (pp. 87–105). University Press of Colorado.

Include the page numbers of the chapter in parentheses after the book title.

Christensen, L. (2001). For my people: Celebrating community through poetry. In B. Bigelow, B. Harvey, S. Karp, & L. Miller (Eds.), Rethinking our classrooms: Teaching for equity and justice (Vol. 2, pp. 16–17). Rethinking Schools.

Also include the volume number or edition number in the parenthetical information after the book title when relevant.

Freud, S. (1961). The ego and the id. In J. Strachey (Ed.),  The standard edition of the complete psychological works of Sigmund Freud  (Vol. 19, pp. 3-66). Hogarth Press. (Original work published 1923)

When a text has been republished as part of an anthology collection, after the author’s name include the date of the version that was read. At the end of the entry, place the date of the original publication inside parenthesis along with the note “original work published.” For in-text citations of republished work, use both dates in the parenthetical citation, original date first with a slash separating the years, as in this example: Freud (1923/1961). For more information on reprinted or republished works, see APA 7, Sections 9.40-9.41.

Classroom Resources

Citing classroom resources.

If you need to cite content found in your online classroom, use the author (if there is one listed), the year of publication (if available), the title of the document, and the main URL of Walden classrooms. For example, you are citing study notes titled "Health Effects of Exposure to Forest Fires," but you do not know the author's name, your reference entry will look like this:

Health effects of exposure to forest fires [Lecture notes]. (2005). Walden University Canvas. https://waldenu.instructure.com

If you do know the author of the document, your reference will look like this:

Smith, A. (2005). Health effects of exposure to forest fires [PowerPoint slides]. Walden University Canvas. https://waldenu.instructure.com  

A few notes on citing course materials:

• [Lecture notes]
• [Course handout]
• [Study notes]
• It can be difficult to determine authorship of classroom documents. If an author is listed on the document, use that. If the resource is clearly a product of Walden (such as the course-based videos), use Walden University as the author. If you are unsure or if no author is indicated, place the title in the author spot, as above.
• If you cannot determine a date of publication, you can use n.d. (for "no date") in place of the year.

Note:  The web location for Walden course materials is not directly retrievable without a password, and therefore, following APA guidelines, use the main URL for the class sites: https://class.waldenu.edu.

Citing Tempo Classroom Resources

Clear author: 

Smith, A. (2005). Health effects of exposure to forest fires [PowerPoint slides]. Walden University Brightspace. https://mytempo.waldenu.edu

Unclear author:

Health effects of exposure to forest fires [Lecture notes]. (2005). Walden University Brightspace. https://mytempo.waldenu.edu

Conference Sessions and Presentations

Feinman, Y. (2018, July 27). Alternative to proctoring in introductory statistics community college courses [Poster presentation]. Walden University Research Symposium, Minneapolis, MN, United States. https://scholarworks.waldenu.edu/symposium2018/23/

Torgerson, K., Parrill, J., & Haas, A. (2019, April 5-9). Tutoring strategies for online students [Conference session]. The Higher Learning Commission Annual Conference, Chicago, IL, United States. http://onlinewritingcenters.org/scholarship/torgerson-parrill-haas-2019/

Dictionary Entry

Merriam-Webster. (n.d.). Leadership. In Merriam-Webster.com dictionary . Retrieved May 28, 2020, from https://www.merriam-webster.com/dictionary/leadership

When constructing a reference for an entry in a dictionary or other reference work that has no byline (i.e., no named individual authors), use the name of the group—the institution, company, or organization—as author (e.g., Merriam Webster, American Psychological Association, etc.). The name of the entry goes in the title position, followed by "In" and the italicized name of the reference work (e.g., Merriam-Webster.com dictionary , APA dictionary of psychology ). In this instance, APA 7 recommends including a retrieval date as well for this online source since the contents of the page change over time. End the reference entry with the specific URL for the defined word.

Discussion Board Post

Osborne, C. S. (2010, June 29). Re: Environmental responsibility [Discussion post]. Walden University Canvas.  https://waldenu.instructure.com  

Dissertations or Theses

Retrieved From a Database

Nalumango, K. (2019). Perceptions about the asylum-seeking process in the United States after 9/11 (Publication No. 13879844) [Doctoral dissertation, Walden University]. ProQuest Dissertations and Theses.

Retrieved From an Institutional or Personal Website

Evener. J. (2018). Organizational learning in libraries at for-profit colleges and universities [Doctoral dissertation, Walden University]. ScholarWorks. https://scholarworks.waldenu.edu/cgi/viewcontent.cgi?article=6606&context=dissertations

Unpublished Dissertation or Thesis

Kirwan, J. G. (2005). An experimental study of the effects of small-group, face-to-face facilitated dialogues on the development of self-actualization levels: A movement towards fully functional persons [Unpublished doctoral dissertation]. Saybrook Graduate School and Research Center.

For further examples and information, see APA 7, Section 10.6.

Legal Material

For legal references, APA follows the recommendations of The Bluebook: A Uniform System of Citation , so if you have any questions beyond the examples provided in APA, seek out that resource as well.

Court Decisions

Reference format:

Name v. Name, Volume Reporter Page (Court Date). URL

Sample reference entry:

Brown v. Board of Education, 347 U.S. 483 (1954). https://www.oyez.org/cases/1940-1955/347us483

Sample citation:

In Brown v. Board of Education (1954), the Supreme Court ruled racial segregation in schools unconstitutional.

Note: Italicize the case name when it appears in the text of your paper.

Name of Act, Title Source § Section Number (Year). URL

Sample reference entry for a federal statute:

Individuals With Disabilities Education Act, 20 U.S.C. § 1400 et seq. (2004). https://www.congress.gov/108/plaws/publ446/PLAW-108publ446.pdf

Sample reference entry for a state statute:

Minnesota Nurse Practice Act, Minn. Stat. §§ 148.171 et seq. (2019). https://www.revisor.mn.gov/statutes/cite/148.171

Sample citation: Minnesota nurses must maintain current registration in order to practice (Minnesota Nurse Practice Act, 2010).

Note: The § symbol stands for "section." Use §§ for sections (plural). To find this symbol in Microsoft Word, go to "Insert" and click on Symbol." Look in the Latin 1-Supplement subset. Note: U.S.C. stands for "United States Code." Note: The Latin abbreviation " et seq. " means "and what follows" and is used when the act includes the cited section and ones that follow. Note: List the chapter first followed by the section or range of sections.

Unenacted Bills and Resolutions

(Those that did not pass and become law)

Title [if there is one], bill or resolution number, xxx Cong. (year). URL

Sample reference entry for Senate bill:

Anti-Phishing Act, S. 472, 109th Cong. (2005). https://www.congress.gov/bill/109th-congress/senate-bill/472

Sample reference entry for House of Representatives resolution:

Anti-Phishing Act, H.R. 1099, 109th Cong. (2005). https://www.congress.gov/bill/109th-congress/house-bill/1099

The Anti-Phishing Act (2005) proposed up to 5 years prison time for people running Internet scams.

These are the three legal areas you may be most apt to cite in your scholarly work. For more examples and explanation, see APA 7, Chapter 11.

Magazine Article

Clay, R. (2008, June). Science vs. ideology: Psychologists fight back about the misuse of research. Monitor on Psychology , 39 (6). https://www.apa.org/monitor/2008/06/ideology

Note that for citations, include only the year: Clay (2008). For magazine articles retrieved from a common academic research database, leave out the URL. For magazine articles from an online news website that is not an online version of a print magazine, follow the format for a webpage reference list entry.

Newspaper Article (Retrieved Online)

Baker, A. (2014, May 7). Connecticut students show gains in national tests. New York Times . http://www.nytimes.com/2014/05/08/nyregion/national-assessment-of-educational-progress-results-in-Connecticut-and-New-Jersey.html

Include the full date in the format Year, Month Day. Do not include a retrieval date for periodical sources found on websites. Note that for citations, include only the year: Baker (2014). For newspaper articles retrieved from a common academic research database, leave out the URL. For newspaper articles from an online news website that is not an online version of a print newspaper, follow the format for a webpage reference list entry.

Online Video/Webcast

Walden University. (2013).  An overview of learning  [Video]. Walden University Canvas.  https://waldenu.instructure.com  

Use this format for online videos such as Walden videos in classrooms. Most of our classroom videos are produced by Walden University, which will be listed as the author in your reference and citation. Note: Some examples of audiovisual materials in the APA manual show the word “Producer” in parentheses after the producer/author area. In consultation with the editors of the APA manual, we have determined that parenthetical is not necessary for the videos in our courses. The manual itself is unclear on the matter, however, so either approach should be accepted. Note that the speaker in the video does not appear in the reference list entry, but you may want to mention that person in your text. For instance, if you are viewing a video where Tobias Ball is the speaker, you might write the following: Tobias Ball stated that APA guidelines ensure a consistent presentation of information in student papers (Walden University, 2013). For more information on citing the speaker in a video, see our page on Common Citation Errors .

Taylor, R. [taylorphd07]. (2014, February 27). Scales of measurement [Video]. YouTube. https://www.youtube.com/watch?v=PDsMUlexaMY

Walden University Academic Skills Center. (2020, April 15). One-way ANCOVA: Introduction [Video]. YouTube. https://youtu.be/_XnNDQ5CNW8

For videos from streaming sites, use the person or organization who uploaded the video in the author space to ensure retrievability, whether or not that person is the speaker in the video. A username can be provided in square brackets. As a change from APA 6 to APA 7, include the publisher after the title, and do not use "Retrieved from" before the URL. See APA 7, Section 10.12 for more information and examples.

See also reference list entry formats for TED Talks .

Technical and Research Reports

Edwards, C. (2015). Lighting levels for isolated intersections: Leading to safety improvements (Report No. MnDOT 2015-05). Center for Transportation Studies. http://www.cts.umn.edu/Publications/ResearchReports/reportdetail.html?id=2402

Technical and research reports by governmental agencies and other research institutions usually follow a different publication process than scholarly, peer-reviewed journals. However, they present original research and are often useful for research papers. Sometimes, researchers refer to these types of reports as gray literature , and white papers are a type of this literature. See APA 7, Section 10.4 for more information.

Reference list entires for TED Talks follow the usual guidelines for multimedia content found online. There are two common places to find TED talks online, with slightly different reference list entry formats for each.

TED Talk on the TED website

If you find the TED Talk on the TED website, follow the format for an online video on an organizational website:

Owusu-Kesse, K. (2020, June). 5 needs that any COVID-19 response should meet [Video]. TED Conferences. https://www.ted.com/talks/kwame_owusu_kesse_5_needs_that_any_covid_19_response_should_meet

The speaker is the author in the reference list entry if the video is posted on the TED website. For citations, use the speaker's surname.

TED Talk on YouTube

If you find the TED Talk on YouTube or another streaming video website, follow the usual format for streaming video sites:

TED. (2021, February 5). The shadow pandemic of domestic violence during COVID-19 | Kemi DaSilvalbru [Video]. YouTube. https://www.youtube.com/watch?v=PGdID_ICFII

TED is the author in the reference list entry if the video is posted on YouTube since it is the channel on which the video is posted. For citations, use TED as the author.

Walden University Course Catalog

To include the Walden course catalog in your reference list, use this format:

Walden University. (2020). 2019-2020 Walden University catalog . https://catalog.waldenu.edu/index.php

If you cite from a specific portion of the catalog in your paper, indicate the appropriate section and paragraph number in your text:

...which reflects the commitment to social change expressed in Walden University's mission statement (Walden University, 2020, Vision, Mission, and Goals section, para. 2).

And in the reference list:

Walden University. (2020). Vision, mission, and goals. In 2019-2020 Walden University catalog. https://catalog.waldenu.edu/content.php?catoid=172&navoid=59420&hl=vision&returnto=search

Vartan, S. (2018, January 30). Why vacations matter for your health . CNN. https://www.cnn.com/travel/article/why-vacations-matter/index.html

For webpages on the open web, include the author, date, webpage title, organization/site name, and URL. (There is a slight variation for online versions of print newspapers or magazines. For those sources, follow the models in the previous sections of this page.)

American Federation of Teachers. (n.d.). Community schools . http://www.aft.org/issues/schoolreform/commschools/index.cfm

If there is no specified author, then use the organization’s name as the author. In such a case, there is no need to repeat the organization's name after the title.

In APA 7, active hyperlinks for DOIs and URLs should be used for documents meant for screen reading. Present these hyperlinks in blue and underlined text (the default formatting in Microsoft Word), although plain black text is also acceptable. Be consistent in your formatting choice for DOIs and URLs throughout your reference list.

Related Resources

Knowledge Check: Common Reference List Examples

Didn't find what you need? Email us at [email protected] .

• Previous Page: Reference List: Overview
• Next Page: Common Military Reference List Examples
• Office of Student Disability Services

Walden Resources

Departments.

• Academic Residencies
• Academic Skills
• Career Planning and Development
• Customer Care Team
• Field Experience
• Military Services
• Student Success Advising
• Writing Skills

Centers and Offices

• Center for Social Change
• Office of Academic Support and Instructional Services
• Office of Degree Acceleration
• Office of Research and Doctoral Services
• Office of Student Affairs

Student Resources

• Doctoral Writing Assessment
• Form & Style Review
• Quick Answers
• ScholarWorks
• SKIL Courses and Workshops
• Walden Bookstore
• Walden Catalog & Student Handbook
• Student Safety/Title IX
• Legal & Consumer Information
• Website Terms and Conditions
• Cookie Policy
• Accessibility
• Accreditation
• State Authorization
• Net Price Calculator
• Contact Walden

Walden University is a member of Adtalem Global Education, Inc. www.adtalem.com Walden University is certified to operate by SCHEV © 2024 Walden University LLC. All rights reserved.

• Search This Site All UCSD Sites Faculty/Staff Search Term
• Contact & Directions
• Climate Statement
• Cognitive Behavioral Neuroscience
• Cognitive Psychology
• Developmental Psychology
• Social Psychology
• Adjunct Faculty
• Non-Senate Instructors
• Researchers
• Psychology Grads
• Affiliated Grads
• New and Prospective Students
• Honors Program
• Experiential Learning
• Programs & Events
• Psi Chi / Psychology Club
• Prospective PhD Students
• Current PhD Students
• Area Brown Bags
• Colloquium Series
• Anderson Distinguished Lecture Series
• Speaker Videos
• Undergraduate Program
• Academic and Writing Resources

Writing Research Papers

• What Types of References Are Appropriate?

When writing a research paper, there are many different types of sources that you might consider citing.  Which are appropriate?  Which are less appropriate?  Here we discuss the different types of sources that you may wish to use when working on a research paper.   

Please note that the following represents a general set of recommended guidelines that is not specific to any class and does not represent department policy.  The types of allowable sources may vary by course and instructor.

Highly appropriate: peer-reviewed journal articles

In general, you should primarily cite peer-reviewed journal articles in your research papers.  Peer-reviewed journal articles are research papers that have been accepted for publication after having undergone a rigorous editorial review process.  During that review process, the article was carefully evaluated by at least one journal editor and a group of reviewers (usually scientists that are experts in the field or topic under investigation).  Often the article underwent revisions before it was judged to be satisfactory for publication. 

Most articles submitted to high quality journals are not accepted for publication.  As such, research that is successfully published in a respected peer-reviewed journal is generally regarded as higher quality than research that is not published or is published elsewhere, such as in a book, magazine, or on a website.  However, just because a study was published in a peer-reviewed journal does not mean that it is free from error or that its conclusions are correct.  Accordingly, it is important to critically read and carefully evaluate all sources, including peer-reviewed journal articles.

Tips for finding and using peer-reviewed journal articles:

• Many databases, such as PsycINFO, can be set to only search for peer-reviewed journal articles. Other search engines, such as Google Scholar, typically include both peer-reviewed and not peer-reviewed articles in search results, and thus should be used with greater caution. 
• Even though a peer-reviewed journal article is, by definition, a source that has been carefully vetted through an editorial process, it should still be critically evaluated by the reader. 

Potentially appropriate: books, encyclopedias, and other scholarly works

Another potential source that you might use when writing a research paper is a book, encyclopedia, or an official online source (such as demographic data drawn from a government website).  When relying on such sources, it is important to carefully consider its accuracy and trustworthiness.  For example, books vary in quality; most have not undergone any form of review process other than basic copyediting.  In many cases, a book’s content is little more than the author’s informed or uninformed opinion. 

However, there are books that have been edited prior to publication, as is the case with many reputable encyclopedias; also, many books from academic publishers are comprised of multiple chapters, each written by one or more researchers, with the entire volume carefully reviewed by one or more editors.  In those cases, the book has undergone a form of peer review, albeit often not as rigorous as that for a peer-reviewed journal article.

Tips for using books, encyclopedias, and other scholarly works:

• When using books, encyclopedias, and other scholarly works (that is, works written or produced by researchers, official agencies, or corporations), it is important to very carefully evaluate the quality of that source.
• If the source is an edited volume (in which case in the editor(s) will be listed on the cover), is published by a reputable source (such as Academic Press, MIT Press, and others), or is written by a major expert in the field (such as a researcher with a track record of peer-reviewed journal articles on the subject), then it is more likely to be trustworthy.
• For online encyclopedias such as Wikipedia, an instructor may or may not consider that an acceptable source (by default, don’t assume that a non-peer reviewed source will be considered acceptable). It is best to ask the instructor for clarification. 1

Usually inappropriate: magazines, blogs, and websites  

Most research papers can be written using only peer-reviewed journal articles as sources.  However, for many topics it is possible to find a plethora of sources that have not been peer-reviewed but also discuss the topic.  These may include articles in popular magazines or postings in blogs, forums, and other websites.  In general, although these sources may be well-written and easy to understand, their scientific value is often not as high as that of peer-reviewed articles.  Exceptions include some magazine and newspaper articles that might be cited in a research paper to make a point about public awareness of a given topic, to illustrate beliefs and attitudes about a given topic among journalists, or to refer to a news event that is relevant to a given topic. 

Tips for using magazines, blogs, and websites:

• Avoid such references if possible. You should primarily focus on peer-reviewed journal articles as sources for your research paper.  High quality research papers typically do not rely on non-academic and not peer-reviewed sources.
• Refer to non-academic, not peer-reviewed sources sparingly, and if you do, be sure to carefully evaluate the accuracy and scientific merit of the source.

Downloadable Resources

• How to Write APA Style Research Papers (a comprehensive guide) [ PDF ]
• Tips for Writing APA Style Research Papers (a brief summary) [ PDF ]

Further Resources

How-To Videos     

• Writing Research Paper Videos

Databases and Search Engines (may require connection to UCSD network)

• Google Scholar
• PubMed (NIH/NLM)
• Web of Science  

UCSD Resources on Finding and Evaluating Sources

• UCSD Library Databases A-Z
• UCSD Library Psychology Research Guide: Start Page
• UCSD Library Psychology Research Guide : Finding Articles
• UCSD Library Psychology Research Guide : Evaluating Sources

External Resources

• Critically Reading Journal Articles from PSU/ Colby College
• How to Seriously Read a Journal Article from Science Magazine
• How to Read Journal Articles from Harvard University
• How to Read a Scientific Paper Infographic from Elsevier Publishing
• Tips for searching PsycINFO from UC Berkeley Library
• Tips for using PsycINFO effectively from the APA Student Science Council

1 Wikipedia articles vary in quality; the site has a peer review system and the very best articles ( Featured Articles ), which go through a multi-stage review process, rival those in traditional encyclopedias and are considered the highest quality articles on the site.

Prepared by s. c. pan for ucsd psychology, graphic adapted from  t-x-generic-apply.svg , a public domain creation by the tango desktop project..

Back to top

• Research Paper Structure
• Formatting Research Papers
• Using Databases and Finding References
• Evaluating References and Taking Notes
• Citing References
• Writing a Literature Review
• Writing Process and Revising
• Improving Scientific Writing
• Academic Integrity and Avoiding Plagiarism
• Writing Research Papers Videos

• Privacy Policy

Buy Me a Coffee

Home » How to Cite Research Paper – All Formats and Examples

How to Cite Research Paper – All Formats and Examples

Table of Contents

Research Paper Citation

Research paper citation refers to the act of acknowledging and referencing a previously published work in a scholarly or academic paper . When citing sources, researchers provide information that allows readers to locate the original source, validate the claims or arguments made in the paper, and give credit to the original author(s) for their work.

The citation may include the author’s name, title of the publication, year of publication, publisher, and other relevant details that allow readers to trace the source of the information. Proper citation is a crucial component of academic writing, as it helps to ensure accuracy, credibility, and transparency in research.

How to Cite Research Paper

There are several formats that are used to cite a research paper. Follow the guide for the Citation of a Research Paper:

Last Name, First Name. Title of Book. Publisher, Year of Publication.

Example : Smith, John. The History of the World. Penguin Press, 2010.

Journal Article

Last Name, First Name. “Title of Article.” Title of Journal, vol. Volume Number, no. Issue Number, Year of Publication, pp. Page Numbers.

Example : Johnson, Emma. “The Effects of Climate Change on Agriculture.” Environmental Science Journal, vol. 10, no. 2, 2019, pp. 45-59.

Research Paper

Last Name, First Name. “Title of Paper.” Conference Name, Location, Date of Conference.

Example : Garcia, Maria. “The Importance of Early Childhood Education.” International Conference on Education, Paris, 5-7 June 2018.

Author’s Last Name, First Name. “Title of Webpage.” Website Title, Publisher, Date of Publication, URL.

Example : Smith, John. “The Benefits of Exercise.” Healthline, Healthline Media, 1 March 2022, https://www.healthline.com/health/benefits-of-exercise.

News Article

Last Name, First Name. “Title of Article.” Name of Newspaper, Date of Publication, URL.

Example : Robinson, Sarah. “Biden Announces New Climate Change Policies.” The New York Times, 22 Jan. 2021, https://www.nytimes.com/2021/01/22/climate/biden-climate-change-policies.html.

Author, A. A. (Year of publication). Title of book. Publisher.

Example: Smith, J. (2010). The History of the World. Penguin Press.

Author, A. A., Author, B. B., & Author, C. C. (Year of publication). Title of article. Title of Journal, volume number(issue number), page range.

Example: Johnson, E., Smith, K., & Lee, M. (2019). The Effects of Climate Change on Agriculture. Environmental Science Journal, 10(2), 45-59.

Author, A. A. (Year of publication). Title of paper. In Editor First Initial. Last Name (Ed.), Title of Conference Proceedings (page numbers). Publisher.

Example: Garcia, M. (2018). The Importance of Early Childhood Education. In J. Smith (Ed.), Proceedings from the International Conference on Education (pp. 60-75). Springer.

Author, A. A. (Year, Month Day of publication). Title of webpage. Website name. URL

Example: Smith, J. (2022, March 1). The Benefits of Exercise. Healthline. https://www.healthline.com/health/benefits-of-exercise

Author, A. A. (Year, Month Day of publication). Title of article. Newspaper name. URL.

Example: Robinson, S. (2021, January 22). Biden Announces New Climate Change Policies. The New York Times. https://www.nytimes.com/2021/01/22/climate/biden-climate-change-policies.html

Chicago/Turabian style

Please note that there are two main variations of the Chicago style: the author-date system and the notes and bibliography system. I will provide examples for both systems below.

Author-Date system:

• In-text citation: (Author Last Name Year, Page Number)
• Reference list: Author Last Name, First Name. Year. Title of Book. Place of publication: Publisher.
• In-text citation: (Smith 2005, 28)
• Reference list: Smith, John. 2005. The History of America. New York: Penguin Press.

Notes and Bibliography system:

• Footnote/Endnote citation: Author First Name Last Name, Title of Book (Place of publication: Publisher, Year), Page Number.
• Bibliography citation: Author Last Name, First Name. Title of Book. Place of publication: Publisher, Year.
• Footnote/Endnote citation: John Smith, The History of America (New York: Penguin Press, 2005), 28.
• Bibliography citation: Smith, John. The History of America. New York: Penguin Press, 2005.

JOURNAL ARTICLES:

• Reference list: Author Last Name, First Name. Year. “Article Title.” Journal Title Volume Number (Issue Number): Page Range.
• In-text citation: (Johnson 2010, 45)
• Reference list: Johnson, Mary. 2010. “The Impact of Social Media on Society.” Journal of Communication 60(2): 39-56.
• Footnote/Endnote citation: Author First Name Last Name, “Article Title,” Journal Title Volume Number, Issue Number (Year): Page Range.
• Bibliography citation: Author Last Name, First Name. “Article Title.” Journal Title Volume Number, Issue Number (Year): Page Range.
• Footnote/Endnote citation: Mary Johnson, “The Impact of Social Media on Society,” Journal of Communication 60, no. 2 (2010): 39-56.
• Bibliography citation: Johnson, Mary. “The Impact of Social Media on Society.” Journal of Communication 60, no. 2 (2010): 39-56.

RESEARCH PAPERS:

• Reference list: Author Last Name, First Name. Year. “Title of Paper.” Conference Proceedings Title, Location, Date. Publisher, Page Range.
• In-text citation: (Jones 2015, 12)
• Reference list: Jones, David. 2015. “The Effects of Climate Change on Agriculture.” Proceedings of the International Conference on Climate Change, Paris, France, June 1-3, 2015. Springer, 10-20.
• Footnote/Endnote citation: Author First Name Last Name, “Title of Paper,” Conference Proceedings Title, Location, Date (Place of publication: Publisher, Year), Page Range.
• Bibliography citation: Author Last Name, First Name. “Title of Paper.” Conference Proceedings Title, Location, Date. Place of publication: Publisher, Year.
• Footnote/Endnote citation: David Jones, “The Effects of Climate Change on Agriculture,” Proceedings of the International Conference on Climate Change, Paris, France, June 1-3, 2015 (New York: Springer, 10-20).
• Bibliography citation: Jones, David. “The Effects of Climate Change on Agriculture.” Proceedings of the International Conference on Climate Change, Paris, France, June 1-3, 2015. New York: Springer, 10-20.
• In-text citation: (Author Last Name Year)
• Reference list: Author Last Name, First Name. Year. “Title of Webpage.” Website Name. URL.
• In-text citation: (Smith 2018)
• Reference list: Smith, John. 2018. “The Importance of Recycling.” Environmental News Network. https://www.enn.com/articles/54374-the-importance-of-recycling.
• Footnote/Endnote citation: Author First Name Last Name, “Title of Webpage,” Website Name, URL (accessed Date).
• Bibliography citation: Author Last Name, First Name. “Title of Webpage.” Website Name. URL (accessed Date).
• Footnote/Endnote citation: John Smith, “The Importance of Recycling,” Environmental News Network, https://www.enn.com/articles/54374-the-importance-of-recycling (accessed April 8, 2023).
• Bibliography citation: Smith, John. “The Importance of Recycling.” Environmental News Network. https://www.enn.com/articles/54374-the-importance-of-recycling (accessed April 8, 2023).

NEWS ARTICLES:

• Reference list: Author Last Name, First Name. Year. “Title of Article.” Name of Newspaper, Month Day.
• In-text citation: (Johnson 2022)
• Reference list: Johnson, Mary. 2022. “New Study Finds Link Between Coffee and Longevity.” The New York Times, January 15.
• Footnote/Endnote citation: Author First Name Last Name, “Title of Article,” Name of Newspaper (City), Month Day, Year.
• Bibliography citation: Author Last Name, First Name. “Title of Article.” Name of Newspaper (City), Month Day, Year.
• Footnote/Endnote citation: Mary Johnson, “New Study Finds Link Between Coffee and Longevity,” The New York Times (New York), January 15, 2022.
• Bibliography citation: Johnson, Mary. “New Study Finds Link Between Coffee and Longevity.” The New York Times (New York), January 15, 2022.

Harvard referencing style

Format: Author’s Last name, First initial. (Year of publication). Title of book. Publisher.

Example: Smith, J. (2008). The Art of War. Random House.

Journal article:

Format: Author’s Last name, First initial. (Year of publication). Title of article. Title of journal, volume number(issue number), page range.

Example: Brown, M. (2012). The impact of social media on business communication. Harvard Business Review, 90(12), 85-92.

Research paper:

Format: Author’s Last name, First initial. (Year of publication). Title of paper. In Editor’s First initial. Last name (Ed.), Title of book (page range). Publisher.

Example: Johnson, R. (2015). The effects of climate change on agriculture. In S. Lee (Ed.), Climate Change and Sustainable Development (pp. 45-62). Springer.

Format: Author’s Last name, First initial. (Year, Month Day of publication). Title of page. Website name. URL.

Example: Smith, J. (2017, May 23). The history of the internet. Encyclopedia Britannica. https://www.britannica.com/topic/history-of-the-internet

News article:

Format: Author’s Last name, First initial. (Year, Month Day of publication). Title of article. Title of newspaper, page number (if applicable).

Example: Thompson, E. (2022, January 5). New study finds coffee may lower risk of dementia. The New York Times, A1.

IEEE Format

Author(s). (Year of Publication). Title of Book. Publisher.

Smith, J. K. (2015). The Power of Habit: Why We Do What We Do in Life and Business. Random House.

Journal Article:

Author(s). (Year of Publication). Title of Article. Title of Journal, Volume Number (Issue Number), page numbers.

Johnson, T. J., & Kaye, B. K. (2016). Interactivity and the Future of Journalism. Journalism Studies, 17(2), 228-246.

Author(s). (Year of Publication). Title of Paper. Paper presented at Conference Name, Location.

Jones, L. K., & Brown, M. A. (2018). The Role of Social Media in Political Campaigns. Paper presented at the 2018 International Conference on Social Media and Society, Copenhagen, Denmark.

• Website: Author(s) or Organization Name. (Year of Publication or Last Update). Title of Webpage. Website Name. URL.

Example: National Aeronautics and Space Administration. (2019, August 29). NASA’s Mission to Mars. NASA. https://www.nasa.gov/topics/journeytomars/index.html

• News Article: Author(s). (Year of Publication). Title of Article. Name of News Source. URL.

Example: Johnson, M. (2022, February 16). Climate Change: Is it Too Late to Save the Planet? CNN. https://www.cnn.com/2022/02/16/world/climate-change-planet-scn/index.html

Vancouver Style

In-text citation: Use superscript numbers to cite sources in the text, e.g., “The study conducted by Smith and Johnson^1 found that…”.

Reference list citation: Format: Author(s). Title of book. Edition if any. Place of publication: Publisher; Year of publication.

Example: Smith J, Johnson L. Introduction to Molecular Biology. 2nd ed. New York: Wiley-Blackwell; 2015.

In-text citation: Use superscript numbers to cite sources in the text, e.g., “Several studies have reported that^1,2,3…”.

Reference list citation: Format: Author(s). Title of article. Abbreviated name of journal. Year of publication; Volume number (Issue number): Page range.

Example: Jones S, Patel K, Smith J. The effects of exercise on cardiovascular health. J Cardiol. 2018; 25(2): 78-84.

In-text citation: Use superscript numbers to cite sources in the text, e.g., “Previous research has shown that^1,2,3…”.

Reference list citation: Format: Author(s). Title of paper. In: Editor(s). Title of the conference proceedings. Place of publication: Publisher; Year of publication. Page range.

Example: Johnson L, Smith J. The role of stem cells in tissue regeneration. In: Patel S, ed. Proceedings of the 5th International Conference on Regenerative Medicine. London: Academic Press; 2016. p. 68-73.

In-text citation: Use superscript numbers to cite sources in the text, e.g., “According to the World Health Organization^1…”.

Reference list citation: Format: Author(s). Title of webpage. Name of website. URL [Accessed Date].

Example: World Health Organization. Coronavirus disease (COVID-19) advice for the public. World Health Organization. https://www.who.int/emergencies/disease/novel-coronavirus-2019/advice-for-public [Accessed 3 March 2023].

In-text citation: Use superscript numbers to cite sources in the text, e.g., “According to the New York Times^1…”.

Reference list citation: Format: Author(s). Title of article. Name of newspaper. Year Month Day; Section (if any): Page number.

Example: Jones S. Study shows that sleep is essential for good health. The New York Times. 2022 Jan 12; Health: A8.

Author(s). Title of Book. Edition Number (if it is not the first edition). Publisher: Place of publication, Year of publication.

Example: Smith, J. Chemistry of Natural Products. 3rd ed.; CRC Press: Boca Raton, FL, 2015.

Journal articles:

Author(s). Article Title. Journal Name Year, Volume, Inclusive Pagination.

Example: Garcia, A. M.; Jones, B. A.; Smith, J. R. Selective Synthesis of Alkenes from Alkynes via Catalytic Hydrogenation. J. Am. Chem. Soc. 2019, 141, 10754-10759.

Research papers:

Author(s). Title of Paper. Journal Name Year, Volume, Inclusive Pagination.

Example: Brown, H. D.; Jackson, C. D.; Patel, S. D. A New Approach to Photovoltaic Solar Cells. J. Mater. Chem. 2018, 26, 134-142.

Author(s) (if available). Title of Webpage. Name of Website. URL (accessed Month Day, Year).

Example: National Institutes of Health. Heart Disease and Stroke. National Heart, Lung, and Blood Institute. https://www.nhlbi.nih.gov/health-topics/heart-disease-and-stroke (accessed April 7, 2023).

News articles:

Author(s). Title of Article. Name of News Publication. Date of Publication. URL (accessed Month Day, Year).

Example: Friedman, T. L. The World is Flat. New York Times. April 7, 2023. https://www.nytimes.com/2023/04/07/opinion/world-flat-globalization.html (accessed April 7, 2023).

In AMA Style Format, the citation for a book should include the following information, in this order:

• Title of book (in italics)
• Edition (if applicable)
• Place of publication
• Year of publication

Lodish H, Berk A, Zipursky SL, et al. Molecular Cell Biology. 4th ed. New York, NY: W. H. Freeman; 2000.

In AMA Style Format, the citation for a journal article should include the following information, in this order:

• Title of article
• Abbreviated title of journal (in italics)
• Year of publication; volume number(issue number):page numbers.

Chen H, Huang Y, Li Y, et al. Effects of mindfulness-based stress reduction on depression in adolescents and young adults: a systematic review and meta-analysis. JAMA Netw Open. 2020;3(6):e207081. doi:10.1001/jamanetworkopen.2020.7081

In AMA Style Format, the citation for a research paper should include the following information, in this order:

• Title of paper
• Name of journal or conference proceeding (in italics)
• Volume number(issue number):page numbers.

Bredenoord AL, Kroes HY, Cuppen E, Parker M, van Delden JJ. Disclosure of individual genetic data to research participants: the debate reconsidered. Trends Genet. 2011;27(2):41-47. doi:10.1016/j.tig.2010.11.004

In AMA Style Format, the citation for a website should include the following information, in this order:

• Title of web page or article
• Name of website (in italics)
• Date of publication or last update (if available)
• URL (website address)
• Date of access (month day, year)

Centers for Disease Control and Prevention. How to protect yourself and others. CDC. Published February 11, 2022. Accessed February 14, 2022. https://www.cdc.gov/coronavirus/2019-ncov/prevent-getting-sick/prevention.html

In AMA Style Format, the citation for a news article should include the following information, in this order:

• Name of newspaper or news website (in italics)
• Date of publication

Gorman J. Scientists use stem cells from frogs to build first living robots. The New York Times. January 13, 2020. Accessed January 14, 2020. https://www.nytimes.com/2020/01/13/science/living-robots-xenobots.html

Bluebook Format

One author: Daniel J. Solove, The Future of Reputation: Gossip, Rumor, and Privacy on the Internet (Yale University Press 2007).

Two or more authors: Martha Nussbaum and Saul Levmore, eds., The Offensive Internet: Speech, Privacy, and Reputation (Harvard University Press 2010).

Journal article

One author: Daniel J. Solove, “A Taxonomy of Privacy,” University of Pennsylvania Law Review 154, no. 3 (January 2006): 477-560.

Two or more authors: Ethan Katsh and Andrea Schneider, “The Emergence of Online Dispute Resolution,” Journal of Dispute Resolution 2003, no. 1 (2003): 7-19.

One author: Daniel J. Solove, “A Taxonomy of Privacy,” GWU Law School Public Law Research Paper No. 113, 2005.

Two or more authors: Ethan Katsh and Andrea Schneider, “The Emergence of Online Dispute Resolution,” Cyberlaw Research Paper Series Paper No. 00-5, 2000.

WebsiteElectronic Frontier Foundation, “Surveillance Self-Defense,” accessed April 8, 2023, https://ssd.eff.org/.

News article

One author: Mark Sherman, “Court Deals Major Blow to Net Neutrality Rules,” ABC News, January 14, 2014, https://abcnews.go.com/Politics/wireStory/court-deals-major-blow-net-neutrality-rules-21586820.

Two or more authors: Siobhan Hughes and Brent Kendall, “AT&T Wins Approval to Buy Time Warner,” Wall Street Journal, June 12, 2018, https://www.wsj.com/articles/at-t-wins-approval-to-buy-time-warner-1528847249.

In-Text Citation: (Author’s last name Year of Publication: Page Number)

Example: (Smith 2010: 35)

Reference List Citation: Author’s last name First Initial. Title of Book. Edition. Place of publication: Publisher; Year of publication.

Example: Smith J. Biology: A Textbook. 2nd ed. New York: Oxford University Press; 2010.

Example: (Johnson 2014: 27)

Reference List Citation: Author’s last name First Initial. Title of Article. Abbreviated Title of Journal. Year of publication;Volume(Issue):Page Numbers.

Example: Johnson S. The role of dopamine in addiction. J Neurosci. 2014;34(8): 2262-2272.

Example: (Brown 2018: 10)

Reference List Citation: Author’s last name First Initial. Title of Paper. Paper presented at: Name of Conference; Date of Conference; Place of Conference.

Example: Brown R. The impact of social media on mental health. Paper presented at: Annual Meeting of the American Psychological Association; August 2018; San Francisco, CA.

Example: (World Health Organization 2020: para. 2)

Reference List Citation: Author’s last name First Initial. Title of Webpage. Name of Website. URL. Published date. Accessed date.

Example: World Health Organization. Coronavirus disease (COVID-19) pandemic. WHO website. https://www.who.int/emergencies/disease-coronavirus-2019. Updated August 17, 2020. Accessed September 5, 2021.

Example: (Smith 2019: para. 5)

Reference List Citation: Author’s last name First Initial. Title of Article. Title of Newspaper or Magazine. Year of publication; Month Day:Page Numbers.

Example: Smith K. New study finds link between exercise and mental health. The New York Times. 2019;May 20: A6.

Purpose of Research Paper Citation

The purpose of citing sources in a research paper is to give credit to the original authors and acknowledge their contribution to your work. By citing sources, you are also demonstrating the validity and reliability of your research by showing that you have consulted credible and authoritative sources. Citations help readers to locate the original sources that you have referenced and to verify the accuracy and credibility of your research. Additionally, citing sources is important for avoiding plagiarism, which is the act of presenting someone else’s work as your own. Proper citation also shows that you have conducted a thorough literature review and have used the existing research to inform your own work. Overall, citing sources is an essential aspect of academic writing and is necessary for building credibility, demonstrating research skills, and avoiding plagiarism.

Advantages of Research Paper Citation

There are several advantages of research paper citation, including:

• Giving credit: By citing the works of other researchers in your field, you are acknowledging their contribution and giving credit where it is due.
• Strengthening your argument: Citing relevant and reliable sources in your research paper can strengthen your argument and increase its credibility. It shows that you have done your due diligence and considered various perspectives before drawing your conclusions.
• Demonstrating familiarity with the literature : By citing various sources, you are demonstrating your familiarity with the existing literature in your field. This is important as it shows that you are well-informed about the topic and have done a thorough review of the available research.
• Providing a roadmap for further research: By citing relevant sources, you are providing a roadmap for further research on the topic. This can be helpful for future researchers who are interested in exploring the same or related issues.
• Building your own reputation: By citing the works of established researchers in your field, you can build your own reputation as a knowledgeable and informed scholar. This can be particularly helpful if you are early in your career and looking to establish yourself as an expert in your field.

About the author

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

Delimitations in Research – Types, Examples and...

Research Paper Format – Types, Examples and...

Research Design – Types, Methods and Examples

Research Paper Title – Writing Guide and Example

Research Paper Introduction – Writing Guide and...

Research Paper Conclusion – Writing Guide and...

Purdue Online Writing Lab Purdue OWL® College of Liberal Arts

APA Sample Paper

Welcome to the Purdue OWL

This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.

Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.

Note:  This page reflects the latest version of the APA Publication Manual (i.e., APA 7), which released in October 2019. The equivalent resource for the older APA 6 style  can be found here .

Media Files: APA Sample Student Paper  ,  APA Sample Professional Paper

This resource is enhanced by Acrobat PDF files. Download the free Acrobat Reader

Note: The APA Publication Manual, 7 th Edition specifies different formatting conventions for student  and  professional  papers (i.e., papers written for credit in a course and papers intended for scholarly publication). These differences mostly extend to the title page and running head. Crucially, citation practices do not differ between the two styles of paper.

However, for your convenience, we have provided two versions of our APA 7 sample paper below: one in  student style and one in  professional  style.

Note: For accessibility purposes, we have used "Track Changes" to make comments along the margins of these samples. Those authored by [AF] denote explanations of formatting and [AWC] denote directions for writing and citing in APA 7. 

APA 7 Student Paper:

Apa 7 professional paper:.

Referencing Generator

Powered by chegg.

• Select style:
• Archive material
• Chapter of an edited book
• Conference proceedings
• Dictionary entry
• Dissertation
• DVD, video, or film
• E-book or PDF
• Edited book
• Encyclopedia article
• Government publication
• Music or recording
• Online image or video
• Presentation
• Press release
• Religious text

What Is Cite This For Me’s Reference Generator?

Cite This For Me’s open-access generator is an automated citation machine that turns any of your sources into references in just a click. Using a reference generator helps students to integrate referencing into their research and writing routine; turning a time-consuming ordeal into a simple task.

A referencing generator accesses information from across the web, drawing the relevant information into a fully-formatted bibliography that clearly presents all of the sources that have contributed to your work.

If you don’t know how to reference a website correctly, or have a fast-approaching deadline, Cite This For Me’s accurate and intuitive reference generator will lend you the confidence to realise your full academic potential. In order to get a grade that reflects all your hard work, your references must be accurate and complete. Using a citation machine not only saves you time but also ensures that you don’t lose valuable marks on your assignment.

Not sure how to format your citations, what citations are, or just want to find out more about Cite This For Me’s reference generator? This guide outlines everything you need to know to equip yourself with the know-how and confidence to research and cite a wide range of diverse sources in your work.

Why Do I Need To Reference?

Simply put, when another source contributes to your work, you have to give the original owner the appropriate credit. After all, you wouldn’t steal someone else’s possessions so why would you steal their ideas?

Regardless of whether you are referencing a website, an article or a podcast, any factual material or ideas you take from another source must be acknowledged in a citation unless it is common knowledge (e.g. Winston Churchill was English). Failing to credit all of your sources, even when you’ve paraphrased or completely reworded the information, is plagiarism. Plagiarising will result in disciplinary action, which can range from losing precious marks on your assignment to expulsion from your university.

What’s more, attributing your research infuses credibility and authority into your work, both by supporting your own ideas and by demonstrating the breadth of your research. For many students, crediting sources can be a confusing and tedious process, but it’s a surefire way to improve the quality of your work so it’s essential to get it right. Luckily for you, using Cite This For Me’s reference generator makes creating accurate references easier than ever, leaving more time for you to excel in your studies.

In summary, the citing process serves three main functions:

• To validate the statements and conclusions in your work by providing directions to other sound sources that support and verify them.
• To help your readers locate, read and check your sources, as well as establishing their contribution to your work.
• To give credit to the original author and hence avoid committing intellectual property theft (known as ‘plagiarism’ in academia).

How Do I Cite My Sources With The Cite This For Me Referencing Generator?

Cite This For Me’s reference generator is the most accurate citation machine available, so whether you’re not sure how to format in-text references or are looking for a foolproof solution to automate a fully-formatted bibliography, this referencing generator will solve all of your citing needs.

Crediting your source material doesn’t just prevent you from losing valuable marks for plagiarism, it also provides all of the information to help your reader find for themselves the book, article, or other item you are citing. The accessible interface of the reference generator makes it easy for you to identify the source you have used – simply enter its unique identifier into the citation machine search bar. If this information is not available you can search for the title or author instead, and then select from the search results that appear below the reference generator.

Don’t know how to reference a website? The good news is that by using tools such as Cite This For Me’s reference generator, which help you work smarter, you don’t need to limit your research to sources that are traditional to cite. In fact, there are no limits to what you can cite, whether you are referencing a website, a YouTube video or a tweet.

To use the reference generator, simply:

• Select your style from Harvard, APA, OSCOLA and many more*
• Choose the type of source you would like to cite (e.g. website, book, journal, video)
• Enter the URL , DOI , ISBN , title, or other unique source information to find your source
• Click the ‘Cite’ button on the reference generator
• Copy your new citation straight from the referencing generator into your bibliography
• Repeat for each source that has contributed to your work.

*If you require another style for your paper, essay or other academic work, you can select from over 1,000 styles by creating a free Cite This For Me account.

Once you have created your Cite This For Me account you will be able to use the reference generator to create multiple references and save them into a project. Use Cite This For Me’s highly-rated iOS or Android apps to generate references in a flash with your smartphone camera, export your complete bibliography in one go, and much more.

What Will The Reference Generator Create For Me?

Cite This For Me’s reference generator will create your citation in two parts: an in-text citation and a full citation to be copied straight into your work.

The reference generator will auto-generate the correct formatting for your bibliography depending on your chosen style. For instance, if you select a parenthetical style the reference generator will generate an in-text citation in parentheses, along with a full citation to slot into your bibliography. Likewise, if the reference generator is set to a footnote style then it will create a fully-formatted citation for your reference list and bibliography, as well as a corresponding footnote to insert at the bottom of the page containing the relevant source.

Parenthetical style examples:

In-text example: A nation has been defined as an imagined community (Anderson, 2006).* Alternative format: Anderson (2006) defined a nation as an imagined community.

*The reference generator will create your references in the first style, but this should be edited if the author’s name already appears in the text.

Bibliography / Works Cited list example: Anderson, B. (2006). Imagined Communities. London: Verso.

What Are Citation Styles?

A citation style is a set of rules that you, as an academic writer, must follow to ensure the quality and relevance of your work. There are thousands of styles that are used in different academic institutions around the world, but in the UK the most common are Harvard, APA and Oscola.

The style you need to use will depend on the preference of your lecturer, discipline or academic institution – so if you’re unsure which style you should be using, consult your department and follow their guidelines exactly, as this is what you’ll be evaluated on when it comes to marking. You can also find your university’s style by logging into your Cite This For Me account and setting your institution in ‘My Profile’.

Citing isn’t just there to guard against plagiarism – presenting your research in a clear and consistent way eases the reader’s comprehension. Each style has a different set of rules for formatting both the page and your references. Be sure to adhere to formatting rules such as font type, font size and line spacing to ensure that your work is easily legible. Furthermore, if your work is published as part of an anthology or collected works, each entry will need to be presented in the same style to maintain uniformity throughout. It is important to make sure that you don’t jump from one style to another, so follow the rules carefully to ensure your reference list and bibliography are both accurate and complete.

If you need a hand with your citations then why not try Cite This For Me’s reference generator? It’s the quickest and easiest way to cite any source, in any style. The reference generator above will create your citations in the Harvard referencing style as standard, but it can generate fully-formatted references in over 1,000 styles – including university variations of each style. So, whether your lecturer has asked you to adopt APA referencing , or your subject requires you to use OSCOLA referencing , we’re sure to have the style you need. To access all of them, simply go to Cite This For Me’s website to create your free Cite This For Me account and search for your specific style such as MLA or Vancouver .

How Do I Format A Reference List Or Bibliography?

Drawing on a wide range of sources greatly enhances the quality of your work, and reading above and beyond your recommended reading list – and then using these sources to support your own thesis – is an excellent way to impress your reader. A clearly presented reference list or bibliography demonstrates the lengths you have gone to in researching your chosen topic.

Typically, a reference list starts on a new page at the end of the main body of text and includes a complete list of the sources you have actually cited in your paper. This list should contain all the information needed for the reader to locate the original source of the information, quote or statistic that directly contributed to your work. On the other hand, a bibliography is a comprehensive list of all the material you may have consulted throughout your research and writing process. Both provide the necessary information for readers to retrieve and check the sources cited in your work.

Each style’s guidelines will define the terminology of ‘reference list’ and ‘bibliography’, as well as providing formatting guidelines for font, line spacing and page indentations. In addition, it will instruct you on how to order each list – this will usually be either alphabetical or chronological (meaning the order that these sources appear in your work). Before submitting your work, be sure to check that you have formatted your whole paper according to your style’s formatting guidelines.

Sounds complicated? Citing has never been so easy; Cite This For Me’s reference generator will automatically generate fully-formatted citations for your reference list or bibliography in your chosen style. Sign in to your Cite This For Me account to save and export your bibliography.

How Do References Actually Work?

Although the reference generator will create your bibliography for you in record time, it is still useful to understand how this system works behind the scenes. As well as saving you time with its referencing generator, Cite This For Me provides the learning resources to help you fully understand the citing process and the benefits of adopting great citing standards.

The referencing process:

• Find a book, journal, website or other source that will contribute to your work
• Save the quote, image, data or other information that you will use in your work
• Save the source information that enables you to find it again (i.e. URL, ISBN, DOI etc.)
• Format the source information into a citation
• Copy and paste the citation into the body of the text
• Repeat for each source that contributes to your work.
• Export or copy and paste the fully-formatted citation into your bibliography.

Manage all your references in one place

Create projects, add notes, cite directly from the browser and scan books’ barcodes with a mobile app.

Sign up to Cite This For Me – the ultimate reference management tool.

• Directories
• What are citations and why should I use them?
• When should I use a citation?
• Why are there so many citation styles?
• Which citation style should I use?
• Chicago Notes Style
• Chicago Author-Date Style
• AMA Style (medicine)
• Bluebook (law)
• Additional Citation Styles
• Built-in Citation Tools
• Quick Citation Generators
• Citation Management Software
• Start Your Research
• Research Guides
• University of Washington Libraries
• Library Guides
• UW Libraries
• Citing Sources

Citing Sources: What are citations and why should I use them?

What is a citation.

Citations are a way of giving credit when certain material in your work came from another source. It also gives your readers the information necessary to find that source again-- it provides an important roadmap to your research process. Whenever you use sources such as books, journals or websites in your research, you must give credit to the original author by citing the source. 

Why do researchers cite?

Scholarship is a conversation  and scholars use citations not only to  give credit  to original creators and thinkers, but also to  add strength and authority  to their own work.  By citing their sources, scholars are  placing their work in a specific context  to show where they “fit” within the larger conversation.  Citations are also a great way to  leave a trail  intended to help others who may want to explore the conversation or use the sources in their own work.

In short, citations

(1) give credit

(2) add strength and authority to your work

(3) place your work in a specific context

(4) leave a trail for other scholars

"Good citations should reveal your sources, not conceal them. They should honeslty reflect the research you conducted." (Lipson 4)

Lipson, Charles. "Why Cite?"  Cite Right: A Quick Guide to Citation Styles--MLA, APA, Chicago, the Sciences, Professions, and More . Chicago: U of Chicago, 2006. Print.

What does a citation look like?

Different subject disciplines call for citation information to be written in very specific order, capitalization, and punctuation. There are therefore many different style formats. Three popular citation formats are MLA Style (for humanities articles) and APA or Chicago (for social sciences articles).

MLA style (print journal article):  

Whisenant, Warren A. "How Women Have Fared as Interscholastic Athletic Administrators Since the Passage of Title IX." Sex Roles Vol. 49.3 (2003): 179-182.

APA style (print journal article):

Whisenant, W. A. (2003) How Women Have Fared as Interscholastic Athletic Administrators Since the Passage of Title IX. Sex Roles , 49 (3), 179-182.

Chicago style (print journal article):

Whisenant, Warren A. "How Women Have Fared as Interscholastic Athletic Administrators Since the Passage of Title IX." Sex Roles 49, no. 3 (2003): 179-182.

No matter which style you use, all citations require the same basic information:

• Author or Creator
• Container (e.g., Journal or magazine, website, edited book)
• Date of creation or publication
• Publisher 

You are most likely to have easy access to all of your citation information when you find it in the first place. Take note of this information up front, and it will be much easier to cite it effectively later.

• << Previous: Basics of Citing
• Next: When should I use a citation? >>
• Last Updated: Apr 10, 2024 11:00 AM
• URL: https://guides.lib.uw.edu/research/citations

• Introduction
• Conclusions
• Article Information

Screenshots of the smartphone cognitive tasks developed by Datacubed Health and included in the ALLFTD Mobile App. Details about the task design and instructions are included in the eMethods in Supplement 1. A, Flanker (Ducks in a Pond) is a task of cognitive control requiring participants to select the direction of the center duck. B, Go/no-go (Go Sushi Go!) requires participants to quickly tap on pieces of sushi (go) but not to tap when they see a fish skeleton (no-go). C, Card sort (Card Shuffle) is a task of cognitive flexibility requiring participants to learn rules that change during the task. D, The adaptative, associative memory task (Humi’s Bistro) requires participants to learn the food orders of several restaurant tables. E, Stroop (Color Clash) is a cognitive inhibition paradigm requiring participants to inhibit their tendency to read words and instead respond based on the color of the word. F, The 2-back task (Animal Parade) requires participants to determine whether animals on a parade float match the animals they saw 2 stimuli previously. G, Participants are asked to complete 3 testing sessions over 2 weeks. Shown in dark blue, they have 3 days to complete each testing session with a washout day between sessions on which no tests are available. Session 2 always begins on day 5 and session 3 on day 9. Screenshots are provided with permission from Datacubed Health.

Forest plots present internal consistency and test-retest reliability results in the discovery and validation cohorts, as well as an estimate in a combined sample of discovery and validation participants. ICC indicates interclass correlation coefficient.

A and B, Correlation matrices display associations of in-clinic criterion standard measures and ALLFTD mobile App (mApp) test scores in discovery and validation cohorts. Below the horizontal dashed lines, the associations among app tests and between app tests and demographic characteristics convergent clinical measures, divergent cognitive tests, and neuroimaging regions of interest can be viewed. Most app tests show strong correlations with each other and with age, convergent clinical measures, and brain volume. The measures show weaker correlations with divergent measures of visuospatial (Benson Figure Copy) and language (Multilingual Naming Test [MINT]) abilities. The strength of convergent correlations between app measures and outcomes is similar to the correlations between criterion standard neuropsychological scores and these outcomes, which can be viewed by looking across the rows above the horizontal black line. C and D, In the discovery and validation cohorts, receiver operating characteristics curves were calculated to determine how well a composite of app tests, the Uniform Data Set, version 3.0, Executive Functioning Composite (UDS3-EF), and the Montreal Cognitive Assessment (MoCA) discriminate individuals without symptoms (Clinical Dementia Rating Scale plus National Alzheimer’s Coordinating Center FTLD module sum of boxes [CDR plus NACC-FTLD-SB] score = 0) from individuals with the mildest symptoms of FTLD (CDR plus NACC-FTLD-SB score = 0.5). AUC indicates area under the curve; CVLT, California Verbal Learning Test.

eMethods. Instruments and Statistical Analysis

eResults. Participants

eTable 1. Participant Characteristics and Test Scores in Original and Validation Cohorts

eTable 2. Comparison of Diagnostic Accuracy for ALLFTD Mobile App Composite Score Across Cohorts

eTable 3. Number of Distractions Reported During the Remote Smartphone Testing Sessions

eTable 4. Qualitative Description of the Distractions Reported During Remote Testing Sessions

eFigure 1. Scatterplots of Test-Retest Reliability in a Mixed Sample of Adults Without Functional Impairment and Participants With FTLD

eFigure 2. Comparison of Test-Retest Reliability Estimates by Endorsement of Distractions

eFigure 3. Comparison of Test-Retest Reliability Estimates by Operating System

eFigure 4. Correlation Matrix in the Combined Cohort

eFigure 5. Neural Correlates of Smartphone Cognitive Test Performance

eReferences

Nonauthor Collaborators

Data Sharing Statement

See More About

Sign up for emails based on your interests, select your interests.

Customize your JAMA Network experience by selecting one or more topics from the list below.

• Academic Medicine
• Acid Base, Electrolytes, Fluids
• Allergy and Clinical Immunology
• American Indian or Alaska Natives
• Anesthesiology
• Anticoagulation
• Art and Images in Psychiatry
• Artificial Intelligence
• Assisted Reproduction
• Bleeding and Transfusion
• Caring for the Critically Ill Patient
• Challenges in Clinical Electrocardiography
• Climate and Health
• Climate Change
• Clinical Challenge
• Clinical Decision Support
• Clinical Implications of Basic Neuroscience
• Clinical Pharmacy and Pharmacology
• Complementary and Alternative Medicine
• Consensus Statements
• Coronavirus (COVID-19)
• Critical Care Medicine
• Cultural Competency
• Dental Medicine
• Dermatology
• Diabetes and Endocrinology
• Diagnostic Test Interpretation
• Drug Development
• Electronic Health Records
• Emergency Medicine
• End of Life, Hospice, Palliative Care
• Environmental Health
• Equity, Diversity, and Inclusion
• Facial Plastic Surgery
• Gastroenterology and Hepatology
• Genetics and Genomics
• Genomics and Precision Health
• Global Health
• Guide to Statistics and Methods
• Hair Disorders
• Health Care Delivery Models
• Health Care Economics, Insurance, Payment
• Health Care Quality
• Health Care Reform
• Health Care Safety
• Health Care Workforce
• Health Disparities
• Health Inequities
• Health Policy
• Health Systems Science
• History of Medicine
• Hypertension
• Images in Neurology
• Implementation Science
• Infectious Diseases
• Innovations in Health Care Delivery
• JAMA Infographic
• Law and Medicine
• Leading Change
• Less is More
• LGBTQIA Medicine
• Lifestyle Behaviors
• Medical Coding
• Medical Devices and Equipment
• Medical Education
• Medical Education and Training
• Medical Journals and Publishing
• Mobile Health and Telemedicine
• Narrative Medicine
• Neuroscience and Psychiatry
• Notable Notes
• Nutrition, Obesity, Exercise
• Obstetrics and Gynecology
• Occupational Health
• Ophthalmology
• Orthopedics
• Otolaryngology
• Pain Medicine
• Palliative Care
• Pathology and Laboratory Medicine
• Patient Care
• Patient Information
• Performance Improvement
• Performance Measures
• Perioperative Care and Consultation
• Pharmacoeconomics
• Pharmacoepidemiology
• Pharmacogenetics
• Pharmacy and Clinical Pharmacology
• Physical Medicine and Rehabilitation
• Physical Therapy
• Physician Leadership
• Population Health
• Primary Care
• Professional Well-being
• Professionalism
• Psychiatry and Behavioral Health
• Public Health
• Pulmonary Medicine
• Regulatory Agencies
• Reproductive Health
• Research, Methods, Statistics
• Resuscitation
• Rheumatology
• Risk Management
• Scientific Discovery and the Future of Medicine
• Shared Decision Making and Communication
• Sleep Medicine
• Sports Medicine
• Stem Cell Transplantation
• Substance Use and Addiction Medicine
• Surgical Innovation
• Surgical Pearls
• Teachable Moment
• Technology and Finance
• The Art of JAMA
• The Arts and Medicine
• The Rational Clinical Examination
• Tobacco and e-Cigarettes
• Translational Medicine
• Trauma and Injury
• Treatment Adherence
• Ultrasonography
• Users' Guide to the Medical Literature
• Vaccination
• Venous Thromboembolism
• Veterans Health
• Women's Health
• Workflow and Process
• Wound Care, Infection, Healing

Get the latest research based on your areas of interest.

Others also liked.

• Download PDF
• X Facebook More LinkedIn

Staffaroni AM , Clark AL , Taylor JC, et al. Reliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration. JAMA Netw Open. 2024;7(4):e244266. doi:10.1001/jamanetworkopen.2024.4266

Manage citations:

© 2024

• Permissions

Reliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration

• 1 Department of Neurology, Memory and Aging Center, Weill Institute for Neurosciences, University of California, San Francisco
• 2 Department of Neurology, Columbia University, New York, New York
• 3 Department of Neurology, Mayo Clinic, Rochester, Minnesota
• 4 Department of Quantitative Health Sciences, Division of Biomedical Statistics and Informatics, Mayo Clinic, Rochester, Minnesota
• 5 Department of Neurology, Case Western Reserve University, Cleveland, Ohio
• 6 Department of Neurosciences, University of California, San Diego, La Jolla
• 7 Department of Radiology, University of North Carolina, Chapel Hill
• 8 Department of Neurology, Indiana University, Indianapolis
• 9 Department of Neurology, Vanderbilt University, Nashville, Tennessee
• 10 Department of Neurology, University of Washington, Seattle
• 11 Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota
• 12 Department of Neurology, Institute for Precision Health, University of California, Los Angeles
• 13 Department of Neurology, Knight Alzheimer Disease Research Center, Washington University, Saint Louis, Missouri
• 14 Department of Psychiatry, Knight Alzheimer Disease Research Center, Washington University, Saint Louis, Missouri
• 15 Department of Neuroscience, Mayo Clinic, Jacksonville, Florida
• 16 Department of Neurology, University of Pennsylvania Perelman School of Medicine, Philadelphia
• 17 Division of Neurology, University of British Columbia, Musqueam, Squamish & Tsleil-Waututh Traditional Territory, Vancouver, Canada
• 18 Department of Neurosciences, University of California, San Diego, La Jolla
• 19 Department of Neurology, Nantz National Alzheimer Center, Houston Methodist and Weill Cornell Medicine, Houston Methodist, Houston, Texas
• 20 Department of Neurology, UCLA (University of California, Los Angeles)
• 21 Department of Neurology, University of Colorado, Aurora
• 22 Department of Neurology, David Geffen School of Medicine, UCLA
• 23 Department of Neurology, University of Alabama, Birmingham
• 24 Tanz Centre for Research in Neurodegenerative Diseases, Division of Neurology, University of Toronto, Toronto, Ontario, Canada
• 25 Department of Neurology, Massachusetts General Hospital and Harvard Medical School, Boston
• 26 Department of Epidemiology and Biostatistics, University of California, San Francisco
• 27 Department of Psychological & Brain Sciences, Washington University, Saint Louis, Missouri

Question   Can remote cognitive testing via smartphones yield reliable and valid data for frontotemporal lobar degeneration (FTLD)?

Findings   In this cohort study of 360 patients, remotely deployed smartphone cognitive tests showed moderate to excellent reliability comparedwith criterion standard measures (in-person disease severity assessments and neuropsychological tests) and brain volumes. Smartphone tests accurately detected dementia and were more sensitive to the earliest stages of familial FTLD than standard neuropsychological tests.

Meaning   These findings suggest that remotely deployed smartphone-based assessments may be reliable and valid tools for evaluating FTLD and may enhance early detection, supporting the inclusion of digital assessments in clinical trials for neurodegeneration.

Importance   Frontotemporal lobar degeneration (FTLD) is relatively rare, behavioral and motor symptoms increase travel burden, and standard neuropsychological tests are not sensitive to early-stage disease. Remote smartphone-based cognitive assessments could mitigate these barriers to trial recruitment and success, but no such tools are validated for FTLD.

Objective   To evaluate the reliability and validity of smartphone-based cognitive measures for remote FTLD evaluations.

Design, Setting, and Participants   In this cohort study conducted from January 10, 2019, to July 31, 2023, controls and participants with FTLD performed smartphone application (app)–based executive functioning tasks and an associative memory task 3 times over 2 weeks. Observational research participants were enrolled through 18 centers of a North American FTLD research consortium (ALLFTD) and were asked to complete the tests remotely using their own smartphones. Of 1163 eligible individuals (enrolled in parent studies), 360 were enrolled in the present study; 364 refused and 439 were excluded. Participants were divided into discovery (n = 258) and validation (n = 102) cohorts. Among 329 participants with data available on disease stage, 195 were asymptomatic or had preclinical FTLD (59.3%), 66 had prodromal FTLD (20.1%), and 68 had symptomatic FTLD (20.7%) with a range of clinical syndromes.

Exposure   Participants completed standard in-clinic measures and remotely administered ALLFTD mobile app (app) smartphone tests.

Main Outcomes and Measures   Internal consistency, test-retest reliability, association of smartphone tests with criterion standard clinical measures, and diagnostic accuracy.

Results   In the 360 participants (mean [SD] age, 54.0 [15.4] years; 209 [58.1%] women), smartphone tests showed moderate-to-excellent reliability (intraclass correlation coefficients, 0.77-0.95). Validity was supported by association of smartphones tests with disease severity ( r range, 0.38-0.59), criterion-standard neuropsychological tests ( r range, 0.40-0.66), and brain volume (standardized β range, 0.34-0.50). Smartphone tests accurately differentiated individuals with dementia from controls (area under the curve [AUC], 0.93 [95% CI, 0.90-0.96]) and were more sensitive to early symptoms (AUC, 0.82 [95% CI, 0.76-0.88]) than the Montreal Cognitive Assessment (AUC, 0.68 [95% CI, 0.59-0.78]) ( z of comparison, −2.49 [95% CI, −0.19 to −0.02]; P  = .01). Reliability and validity findings were highly similar in the discovery and validation cohorts. Preclinical participants who carried pathogenic variants performed significantly worse than noncarrier family controls on 3 app tasks (eg, 2-back β = −0.49 [95% CI, −0.72 to −0.25]; P  < .001) but not a composite of traditional neuropsychological measures (β = −0.14 [95% CI, −0.42 to 0.14]; P  = .32).

Conclusions and Relevance   The findings of this cohort study suggest that smartphones could offer a feasible, reliable, valid, and scalable solution for remote evaluations of FTLD and may improve early detection. Smartphone assessments should be considered as a complementary approach to traditional in-person trial designs. Future research should validate these results in diverse populations and evaluate the utility of these tests for longitudinal monitoring.

Frontotemporal lobar degeneration (FTLD) is a neurodegenerative pathology causing early-onset dementia syndromes with impaired behavior, cognition, language, and/or motor functioning. 1 Although over 30 FTLD trials are planned or in progress, there are several barriers to conducting FTLD trials. Clinical trials for neurodegenerative disease are expensive, 2 and frequent in-person trial visits are burdensome for patients, caregivers, and clinicians, 3 a concern magnified in FTLD by behavioral and motor impairments. Given the rarity and geographical dispersion of eligible participants, FTLD trials require global recruitment, 4 particularly for those that are far from expert FTLD clinical trial centers. Furthermore, criterion standard neuropsychological tests are not adequately sensitive until symptoms are already noticeable to families, limiting their usefulness as outcomes in early-stage FTLD treatment trials. 4

Reliable, valid, and scalable remote data collection methods may help surmount these barriers to FTLD clinical trials. Smartphones are garnering interest across neurological conditions as a method for administering remote cognitive and motor evaluations. Preliminary evidence supports the feasibility, reliability, and/or validity of unsupervised smartphone cognitive and motor testing in older adults at risk for Alzheimer disease, 5 - 8 Parkinson disease, 9 and Huntington disease. 10 The clinical heterogeneity of FTLD necessitates a uniquely comprehensive smartphone battery. In the ALLFTD Consortium (Advancing Research and Treatment in Frontotemporal Lobar Degeneration [ARTFLD] and Longitudinal Evaluation of Familial Frontotemporal Dementia Subjects [LEFFTDS]), the ALLFTD mobile Application (ALLFTD-mApp) was designed to remotely monitor cognitive, behavioral, language, and motor functioning in FTLD research. Taylor et al 11 recently reported that unsupervised ALLFTD-mApp data collection through a multicenter North American FTLD research network was feasible and acceptable to participants. Herein, we extend that work by investigating the reliability and validity of unsupervised remote smartphone tests of executive functioning and memory in a cohort with FTLD that has undergone extensive phenotyping.

Participants were enrolled from ongoing FTLD studies requiring in-person assessment, including participants from 18 centers from the ALLFTD study study 12 and University of California, San Francisco (UCSF) FTLD studies. To study the app in older individuals, a small group of older adults without functional impairment was recruited from the UCSF Brain Aging Network for Cognitive Health. All study procedures were approved by the UCSF or Johns Hopkins Central Institutional Review Board. All participants or legally authorized representatives provided written informed consent. The study followed the Strengthening the Reporting of Observational Studies in Epidemiology ( STROBE ) reporting guideline.

Inclusion criteria were age 18 years or older, having access to a smartphone, and reporting English as the primary language. Race and ethnicity were self reported by participants using options consistent with the National Alzheimer’s Coordinating Center (NACC) Uniform Data Set (UDS) and were collected to contextualize the generalizability of these results. Participants were asked to complete tests on their own smartphones. Informants were encouraged for all participants and required for those with symptomatic FTLD (Clinical Dementia Rating Scale plus NACC FTLD module [CDR plus NACC-FTLD] global score ≥1). Recruitment targeted individuals with CDR plus NACC-FTLD global scores less than 2, but sites had discretion to enroll more severely impaired participants. Exclusion criteria were consistent with the parent ALLFTD study. 12

Participants were enrolled in the ALLFTD-mApp study within 90 days of annual ALLFTD study visits (including neuropsychological and neuroimaging data collection). Site research coordinators (including J.C.T., A.B.W., S.D., and M.M.) assisted participants with app download, setup, and orientation and observed participants completing the first questionnaire. All cognitive tasks were self-administered without supervision (except pilot participants, discussed below) in a predefined order with minor adjustments throughout the study. Study partners of participants with symptomatic FTLD were asked to remain nearby during participation to help navigate the ALLFTD-mApp but were asked not to assist with testing.

The baseline participation window was divided into three 25- to 35-minute assessment sessions occurring over 11 days. All cognitive tests were repeated in every session to enhance task reliability 6 , 13 and enable assessment of test-retest reliability, except for card sort, which was administered once every 6 months due to expected practice effects. Adherence was defined as the percentage of all available tasks that were completed. Participants were asked to complete the triplicate of sessions every 6 months for the duration of the app study. Only the baseline triplicate was analyzed in this study.

Replicability was tested by dividing the sample into a discovery cohort (n = 258) comprising all participants enrolled until the initial data freeze (October 1, 2022) and a validation cohort (n = 102) comprising participants enrolled after October 1, 2022, and 18 pilot participants 11 who completed the first session in person with an examiner present during cognitive pretesting. Sensitivity analyses excluded this small pilot cohort.

ALLFTD investigators partnered with Datacubed Health 14 to develop the ALLFTD-mApp on Datacubed Health’s Linkt platform. The app includes cognitive, motor, and speech tasks. This study focuses on 6 cognitive tests developed by Datacubed Health 11 comprising an adaptive associative memory task (Humi’s Bistro) and gamified versions of classic executive functioning paradigms: flanker (Ducks in a Pond), Stroop (Color Clash), 2-back (Animal Parade), go/no-go (Go Sushi Go!), and card sort (Card Shuffle) ( Figure 1 and eMethods in Supplement 1 ). Most participants with symptomatic FTLD (49 [72.1%]) were not administered Stroop or 2-back, as pilot studies identified these as too difficult. 11 The app test results were summarized as a composite score (eMethods in Supplement 1 ). Participants completed surveys to assess technological familiarity (daily or less than daily use of a smartphone) and distractions (present or absent).

Criterion standard clinical data were collected during parent project visits. Syndromic diagnoses were made according to published criteria 15 - 19 based on multidisciplinary conferences that considered neurological history, neurological examination results, and collateral interview. 20

The CDR plus NACC-FTLD module is an 8-domain rating scale based on informant and participant report. 21 A global score was calculated to categorize disease severity as asymptomatic or preclinical if a pathogenic variant carrier (0), prodromal (0.5), or symptomatic (1.0-3.0). 22 A sum of the 8 domain box scores (CDR plus NACC-FTLD sum of boxes) was also calculated. 22

Participants completed the UDS Neuropsychological Battery, version 3.0 23 (eMethods in Supplement 1 ), which includes traditional neuropsychological measures and the Montreal Cognitive Assessment (MoCA), a global cognitive screen. Executive functioning and processing speed measures were summarized into a composite score (UDS3-EF). 24 Participants also completed a 9-item list-learning memory test (California Verbal Learning Test, 2nd edition, Short Form). 25 Most (339 [94.2%]) neuropsychological evaluations were conducted in person. In a subsample (n = 270), motor speed and dexterity were assessed using the Movement Disorder Society Uniform Parkinson Disease Rating Scale 26 Finger Tapping subscale (0 indicates no deficits [n = 240]).

We acquired T1-weighted brain magnetic resonance imaging for 199 participants. Details of image acquisition, harmonization, preprocessing, and processing are provided in eMethods in Supplement 1 and prior publications. 27 Briefly, SPM12 (Statistical Parametric Mapping) was used for segmentation 28 and Large Deformation Diffeomorphic Metric Mapping for generating group templates. 29 Gray matter volumes were calculated in template space by integrating voxels and dividing by total intracranial volume in 2 regions of interest (ROIs) 30 : a frontoparietal and subcortical ROI and a hippocampal ROI. Voxel-based morphometry was used to test unbiased voxel-wise associations of volume with smartphone tests (eMethods in Supplement 1 ). 31 , 32

Participants in the ALLFTD study underwent genetic testing 33 at the University of California, Los Angeles. DNA samples were screened using targeted sequencing of a custom panel of genes previously implicated in neurodegenerative diseases, including GRN ( 138945 ) and MAPT ( 157140 ). Hexanucleotide repeat expansions in C9orf72 ( 614260 ) were detected using both fluorescent and repeat-primed polymerase chain reaction analysis. 34

Statistical analyses were conducted using Stata, version 17.0 (StataCorp LLC), and R, version 4.4.2 (R Project for Statistical Computing). All tests were 2 sided, with a statistical significance threshold of P < .05.

Psychometric properties of the smartphone tests were explored using descriptive statistics. Comparisons between CDR plus NACC-FTLD groups (ie, asymptomatic or preclinical, prodromal, and symptomatic) for continuous variables, including demographic characteristics and cognitive task scores (first exposure to each measure), were analyzed by fitting linear regressions. We used χ 2 difference tests for frequency data (eg, sex and race and ethnicity).

Internal consistency, which measures reliability within a task, was estimated for participants’ first exposure to each test using Cronbach α (details in eMethods in Supplement 1 ). Test-retest reliability was estimated using intraclass correlation coefficients for participants who completed a task at least twice; all exposures were included. Reliability estimates are described as poor (<0.500), moderate (0.500-0.749), good (0.750-0.890), and excellent (≥0.900) 35 ; these are reporting rules of thumb, and clinical interpretation should consider raw estimates. We calculated 95% CIs via bootstrapping with 1000 samples.

Validity analyses used participants’ first exposure to each test. Linear regressions were fitted in participants without symptoms with age, sex, and educational level as independent variables to understand the unique contribution of each demographic factor to cognitive test scores. Correlations and linear regression between the app-based tasks and disease severity (CDR plus NACC-FTLD sum of boxes score), neuropsychological test scores, and gray matter ROIs were used to investigate construct validity in the full sample. Demographic characteristics were not entered as covariates because the primary goal was to assess associations between app-based measures and criterion standards, rather than understand the incremental predictive value of app measures. To address potential motor confounds, associations with disease severity were evaluated in a subsample without finger dexterity deficits on motor examination (using the Movement Disorder Society Uniform Parkinson Disease Rating Scale Finger Tapping subscale). To complement ROI-based neuroimaging analysis based on a priori hypotheses, we conducted voxel-based morphometry (eMethods in Supplement 1 ) to uncover other potential neural correlates of test performance. 31 , 32 Finally, we evaluated the association of the number of distractions and operating system with reliability and validity, controlling for age and disease severity, which are predictive factors associated with test performance in correlation analyses.

To evaluate the app’s ability to select participants with prodromal or symptomatic FTLD for trial enrollment, we tested discrimination of participants without symptoms from those with prodromal and symptomatic FTLD. To understand the app’s utility for screening early cognitive impairment, we fit receiver operating characteristics curves testing the predictive value of the app composite, UDS3-EF, and MoCA for differentiating participants without symptoms and those with preclinical FTLD from those with prodromal FTLD; areas under the curves (AUC) for the app and MoCA were compared using the DeLong test in participants with results for both predictive factors.

We compared app performance in preclinical participants who carried pathogenic variants with that in noncarrier controls using linear regression adjusted for age (a predictive factor in earlier models). For this analysis, we excluded those younger than 45 years to remove participants likely to be years from symptom onset based on natural history studies. 4 We analyzed memory performance in participants who carried MAPT pathogenic variants, as early executive deficits may be less prominent. 34 , 36

Of 1163 eligible participants, 360 were enrolled, 439 were excluded, and 364 refused to participate (additional details are provided in the eResults in Supplement 1 ). Participant characteristics are reported in Table 1 for the full sample. The discovery and validation cohorts did not significantly differ in terms of demographic characteristics, disease severity, or cognition (eTable 1 in Supplement 1 ). In the full sample, there were 209 women (58.1%) and 151 men (41.9%), and the mean (SD) age was 54.0 (15.4) years (range, 18-89 years). The mean (SD) educational level was 16.5 (2.3) years (range, 12-20 years). Among the 358 participants with racial and ethnic data available, 340 (95.0%) identified as White. For the 18 participants self-identifying as being of other race or ethnicity, the specific group was not provided to protect participant anonymity. Among the 329 participants with available CDR plus NACC-FTLD scores ( Table 1 ), 195 (59.3%) were asymptomatic or preclinical (Global Score, 0), 66 (20.1%) were prodromal (Global score, 0.5), and 68 (20.7%) were symptomatic (global score, 1.0 or 2.0). Of those with available genetic testing results (n = 222), 100 (45.0%) carried a pathogenic familial FTLD pathogenic variant, including 63 of 120 participants without symptoms and with available results. On average, participants completed 78% of available smartphone measures over a mean (SD) of 2.6 (0.6) sessions.

Descriptive statistics for each task are presented in Table 2 . Ceiling effects were not observed for any tests. A small percentage of participants were at the floor for flanker (19 [5.3%]), go/no-go (13 [4.0%]), and card sort (9 [3.3%]) scores. Floor effects were only observed in participants with prodromal or symptomatic FTLD.

Except for go/no-go, internal consistency estimates ranged from good to excellent (Cronbach α range, 0.84 [95% CI, 0.81-0.87] to 0.99 [95% CI, 0.99-0.99]), and test-retest reliabilities were moderate to excellent (interclass correlation coefficient [ICC] range, 0.77 [95% CI, 0.69-0.83] to 0.95 [95% CI, 0.93-0.96]), with slightly higher estimates in participants with prodromal or symptomatic FTLD ( Table 2 , Figure 2 , and eFigure 1 in Supplement 1 ). Go/no-go reliability was particularly poor in participants without symptoms (ICC, 0.10 [95% CI, −0.37 to 0.48]) and was removed from subsequent validation analyses except the correlation matrix ( Figure 3 A and B). The 95% CIs for reliability estimates overlapped in the discovery and validation cohorts ( Figure 2 ). Reliability estimates showed overlapping 95% CIs regardless of distractions (eFigure 2 in Supplement 1 ) or operating systems (eFigure 3 in Supplement 1 ), with a pattern of slightly lower reliability estimates when distractions were endorsed for all comparisons except Stroop (Cronbach α).

In 57 participants without symptoms who did not carry pathogenic variants, older age was associated with worse performance on all measures (β range,  − 0.40 [95 CI, −0.68 to −0.13] to −0.78 [95 CI, −0.89 to −0.52]; P ≤ .03), except card sort (β = −0.22 [95% CI, −0.54 to 0.09]; P  = .16) and go-no/go (β = −0.15 [95% CI, −0.44 to 0.14]; P  = .31), though associations were in the expected direction. Associations with sex and educational level were not statistically significant.

Cognitive tests administered using the app showed evidence of convergent and divergent validity (eFigure 4 in Supplement 1 ), with very similar findings in discovery ( Figure 3 A) and validation cohorts ( Figure 3 B). App–based measures of executive functioning were generally correlated with criterion standard in-person measures of these domains and less with measures of other cognitive domains ( r range, 0.40-0.66). For example, the flanker task was associated with the UDS3-EF composite (β = 0.58 [95% CI, 0.48-0.68]; P  < .001) and measures of visuoconstruction (β for Benson Figure Copy, 0.43 [95% CI, 0.32-0.54]; P  = .01) and naming (β for Multilingual Naming Test, 0.25 [95% CI, 0.14-0.37]; P  < .001). The app memory test was associated with criterion standard memory and executive functioning tests.

Worse performance on all app measures was associated with greater disease severity on CDR plus NACC-FTLD ( r range, 0.38-0.59) ( Table 1 , Figure 3 , and eFigure 4 in Supplement 1 ). The same pattern of results was observed after excluding those with finger dexterity issues. Except for go/no-go, performance of participants with prodromal FTLD was statistically significantly worse than that of participants without symptoms on all measures ( P  < .001).

The AUC for the app composite to distinguish participants without symptoms from those with dementia was 0.93 (95% CI, 0.90-0.96). The app also accurately differentiated participants without symptoms from those with prodromal or symptomatic FTLD (AUC, 0.87 [95% CI, 0.84-0.92]). Compared with the MoCA (AUC, 0.68 [95% CI, 0.59-0.78), app composite performance (AUC, 0.82 [95% CI, 0.76-0.88]) more accurately differentiated participants without symptoms and with prodromal FTLD ( z of comparison, −2.49 [95% CI, −0.19 to −0.02]; P  = .01), with similar accuracy to the UDS3-EF (AUC, 0.81 [95% CI, 0.73-0.88]); highly similar results (eTable 2 in Supplement 1 ) were observed in the discovery ( Figure 3 C) and validation ( Figure 3 D) cohorts.

In 56 participants without symptoms who were older than 45 years, those carrying GRN , C9orf72 , or another rare pathogenic variants performed significantly worse on 3 of 4 executive tests compared with noncarrier controls, including flanker (β = −0.26 [95% CI, −0.46 to −0.05]; P  = .02), card sort (β = −0.28 [95% CI, −0.54 to −0.30]; P  = .03), and 2-back (β = −0.49 [95% CI, −0.72 to −0.25]; P  < .001). The estimated scores of participants who carried pathogenic variants were on average lower than those of carriers on a composite of criterion standard in-person tests, but the difference was not statistically significant (UDS3-EF β = −0.14 [95% CI, −0.42 to 0.14]; P  = .32). Participants who carried preclinical MAPT pathogenic variants scored higher than noncarriers on the app Memory test, though the difference was not statistically significant (β = 0.21 [95% CI, −0.50 to 0.58]; P  = .19).

In prespecified ROI analyses, worse app executive functioning scores were associated with lower frontoparietal and/or subcortical volume ( Figures 3 A and B) (β range, 0.34 [95% CI, 0.22-0.46] to 0.50 [95 CI, 0.40-0.60]; P < .001 for all) and worse memory scores with smaller hippocampal volume (β = 0.45 [95% CI, 0.34-0.56]; P  < .001). Voxel-based morphometry (eFigure 5 in Supplement 1 ) suggested worse app performance was associated with widespread atrophy, particularly in frontotemporal cortices.

Only for card sort were distractions (eTables 3 and 4 in Supplement 1 ) associated with task performance; those experiencing distractions unexpectedly performed better (β = 0.16 [95% CI, 0.05-0.28]; P  = .005). The iPhone operating system was associated with better performance on 2 speeded tasks: flanker (β = 0.16 [95% CI, 0.07-0.24]; P  < .001) and go/no-go (β = 0.16 [95% CI, 0.06-0.26]; P  = .002). In a sensitivity analysis, associations of all app tests with disease severity, UDS3-EF, and regional brain volumes remained after covarying for distractions and operating system, as did the models differentiating participants who carried preclinical pathogenic variants and noncarrier controls.

There is an urgent need to identify reliable and valid digital tools for remote neurobehavioral measurement in neurodegenerative diseases, including FTLD. Prior studies provided preliminary evidence that smartphones collect reliable and valid cognitive data in a variety of age-related and neurodegenerative illnesses. This is the first study, to our knowledge, to provide analogous support for the reliability and validity of remote cognitive testing via smartphones in FTLD and preliminary evidence that this approach improves early detection relative to traditional in-person measures.

Reliability, a prerequisite for a valid clinical trial end point, indicates measurements are consistent. In 2 cohorts, we found smartphone cognitive tests were reliable within a single administration (ie, internally consistent) and across repeated assessments (ie, test-retest reliability) with no apparent differences by operating system. For all measures except go/no-go, reliability estimates were moderate to excellent and on par with other remote digital assessments 5 , 6 , 10 , 37 , 38 and in-clinic criterion standards. 39 - 41 Go/no-go showed similar within- and between-person variability in participants without symptoms (ie, poor reliability), and participant feedback suggested instructions were confusing and the stimuli disappeared too quickly. Those endorsing distractions tended to have lower reliability, though 95% CIs largely overlapped; future research detailing the effect of the home environment on test performance is warranted.

Construct validity was supported by strong associations of smartphone tests with demographics, disease severity, neuroimaging, and criterion standard neuropsychological measures that replicated in a validation sample. These associations were similar to those observed among the criterion standard measures and similar to associations reported in other validation studies of smartphone cognitive tests. 5 , 6 , 10 Associations with disease severity were not explained by motor impairments. The iPhone operating system was associated with better performance on 2 time-based measures, consistent with prior findings. 6

A composite of brief smartphone tests was accurate in distinguishing dementia from cognitively unimpaired participants, screening out participants without symptoms, and detecting prodromal FTLD with greater sensitivity than the MoCA. Moreover, carriers of preclinical C9orf72 and GRN pathogenic variants performed significantly worse than noncarrier controls on 3 tests, whereas they did not significantly differ on criterion standard measures. These findings are consistent with previous studies showing digital executive functioning paradigms may be more sensitive to early FTLD than traditional measures. 42 , 43

This study has some limitations. Validation analyses focused on participants’ initial task exposure. Future studies will explore whether repeated measurements and more sophisticated approaches to composite building (current composite assumes equal weighting of tests) improve reliability and sensitivity, and a normative sample is being collected to better adjust for demographic effects on testing. 24 Longitudinal analyses will explore whether the floor effects in participants with symptomatic FTLD will affect the utility for monitoring. The generalizability of the findings is limited by the study cohort, which comprised participants who were college educated on average, mostly White, and primarily English speakers who owned smartphones and participated in the referring in-person research study. Equity in access to research is a priority in FTLD research 44 , 45 ; translations of the ALLFTD-mApp are in progress, cultural adaptations are being considered, and devices have been purchased for provisioning to improve the diversity of our sample.

The findings of this cohort study, coupled with prior reports indicating that smartphone testing is feasible and acceptable to patients with FTLD, 11 suggest that smartphones may complement traditional in-person research paradigms. More broadly, the scalability, ease of use, reliability, and validity of the ALLFTD-mApp suggest the feasibility and utility of remote digital assessments in dementia clinical trials. Future research should validate these results in diverse populations and evaluate the utility of these tests for longitudinal monitoring.

Accepted for Publication: February 2, 2024.

Published: April 1, 2024. doi:10.1001/jamanetworkopen.2024.4266

Open Access: This is an open access article distributed under the terms of the CC-BY License . © 2024 Staffaroni AM et al. JAMA Network Open .

Corresponding Author: Adam M. Staffaroni, PhD, Weill Institute for Neurosciences, Department of Neurology, Memory and Aging Center, University of California, San Francisco, 675 Nelson Rising Ln, Ste 190, San Francisco, CA 94158 ( [email protected] ).

Author Contributions: Dr Staffaroni had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Staffaroni, A. Clark, Taylor, Heuer, Wise, Forsberg, Miller, Hassenstab, Rosen, Boxer.

Acquisition, analysis, or interpretation of data: Staffaroni, A. Clark, Taylor, Heuer, Sanderson-Cimino, Wise, Dhanam, Cobigo, Wolf, Manoochehri, Mester, Rankin, Appleby, Bayram, Bozoki, D. Clark, Darby, Domoto-Reilly, Fields, Galasko, Geschwind, Ghoshal, Graff-Radford, Hsiung, Huey, Jones, Lapid, Litvan, Masdeu, Massimo, Mendez, Miyagawa, Pascual, Pressman, Ramanan, Ramos, Rascovsky, Roberson, Tartaglia, Wong, Kornak, Kremers, Kramer, Boeve, Boxer.

Drafting of the manuscript: Staffaroni, A. Clark, Taylor, Heuer, Wolf, Lapid.

Critical review of the manuscript for important intellectual content: Staffaroni, Taylor, Heuer, Sanderson-Cimino, Wise, Dhanam, Cobigo, Manoochehri, Forsberg, Mester, Rankin, Appleby, Bayram, Bozoki, D. Clark, Darby, Domoto-Reilly, Fields, Galasko, Geschwind, Ghoshal, Graff-Radford, Hsiung, Huey, Jones, Lapid, Litvan, Masdeu, Massimo, Mendez, Miyagawa, Pascual, Pressman, Ramanan, Ramos, Rascovsky, Roberson, Tartaglia, Wong, Miller, Kornak, Kremers, Hassenstab, Kramer, Boeve, Rosen, Boxer.

Statistical analysis: Staffaroni, A. Clark, Taylor, Heuer, Sanderson-Cimino, Cobigo, Kornak, Kremers.

Obtained funding: Staffaroni, Rosen, Boxer.

Administrative, technical, or material support: A. Clark, Taylor, Heuer, Wise, Dhanam, Wolf, Manoochehri, Forsberg, Darby, Domoto-Reilly, Ghoshal, Hsiung, Huey, Jones, Litvan, Massimo, Mendez, Miyagawa, Pascual, Pressman, Ramanan, Kramer, Boeve, Boxer.

Supervision: Geschwind, Miyagawa, Roberson, Kramer, Boxer.

Conflict of Interest Disclosures: Dr Staffaroni reported being a coinventor of 4 ALLFTD mobile application tasks (not analyzed in the present study) and receiving licensing fees from Datacubed Health; receiving research support from the National Institute on Aging (NIA) of the National Institutes of Health (NIH), Bluefield Project to Cure FTD, the Alzheimer’s Association, the Larry L. Hillblom Foundation, and the Rainwater Charitable Foundation; and consulting for Alector Inc, Eli Lilly and Company/Prevail Therapeutics, Passage Bio Inc, and Takeda Pharmaceutical Company. Dr Forsberg reported receiving research support from the NIH. Dr Rankin reported receiving research support from the NIH and the National Science Foundation and serving on the medical advisory board for Eli Lilly and Company. Dr Appleby reported receiving research support from the Centers for Disease Control and Prevention (CDC), the NIH, Ionis Pharmaceuticals Inc, Alector Inc, and the CJD Foundation and consulting for Acadia Pharmaceuticals Inc, Ionis Pharmaceuticals Inc, and Sangamo Therapeutics Inc. Dr Bayram reported receiving research support from the NIH. Dr Domoto-Reilly reported receiving research support from NIH and serving as an investigator for a clinical trial sponsored by Lawson Health Research Institute. Dr Bozoki reported receiving research funding from the NIH, Alector Inc, Cognition Therapeutics Inc, EIP Pharma, and Transposon Therapeutics Inc; consulting for Eisai and Creative Bio-Peptides Inc; and serving on the data safety monitoring board for AviadoBio. Dr Fields reported receiving research support from the NIH. Dr Galasko reported receiving research funding from the NIH; clinical trial funding from Alector Inc and Esai; consulting for Esai, General Electric Health Care, and Fujirebio; and serving on the data safety monitoring board of Cyclo Therapeutics Inc. Dr Geschwind reported consulting for Biogen Inc and receiving research support from Roche and Takeda Pharmaceutical Company for work in dementia. Dr Ghoshal reported participating in clinical trials of antidementia drugs sponsored by Bristol Myers Squibb, Eli Lilly and Company/Avid Radiopharmaceuticals, Janssen Immunotherapy, Novartis AG, Pfizer Inc, Wyeth Pharmaceuticals, SNIFF (The Study of Nasal Insulin to Fight Forgetfulness) study, and A4 (The Anti-Amyloid Treatment in Asymptomatic Alzheimer’s Disease) trial; receiving research support from Tau Consortium and the Association for Frontotemporal Dementia; and receiving funding from the NIH. Dr Graff-Radford reported receiving royalties from UpToDate; reported participating in multicenter therapy studies by sponsored by Biogen Inc, TauRx Therapeutics Ltd, AbbVie Inc, Novartis AG, and Eli Lilly and Company; and receiving research support from the NIH. Dr Grossman reported receiving grant support from the NIH, Avid Radiopharmaceuticals, and Piramal Pharma Ltd; participating in clinical trials sponsored by Biogen Inc, TauRx Therapeutics Ltd, and Alector Inc; consulting for Bracco and UCB; and serving on the editorial board of Neurology . Dr Hsiung reported receiving grant support from the Canadian Institutes of Health Research, the NIH, and the Alzheimer Society of British Columbia; participating in clinical trials sponsored by Anavax Life Sciences Corp, Biogen Inc, Cassava Sciences, Eli Lilly and Company, and Roche; and consulting for Biogen Inc, Novo Nordisk A/S, and Roche. Dr Huey reported receiving research support from the NIH. Dr Jones reported receiving research support from the NIH. Dr Litvan reported receiving research support from the NIH, the Michael J Fox Foundation, the Parkinson Foundation, the Lewy Body Association, CurePSP, Roche, AbbVie Inc, H Lundbeck A/S, Novartis AG, Transposon Therapeutics Inc, and UCB; serving as a member of the scientific advisory board for the Rossy PSP Program at the University of Toronto and for Amydis; and serving as chief editor of Frontiers in Neurology . Dr Masdeu reported consulting for and receiving research funding from Eli Lilly and Company; receiving personal fees from GE Healthcare; receiving grant funding and personal fees from Eli Lilly and Company; and receiving grant funding from Acadia Pharmaceutical Inc, Avanir Pharmaceuticals Inc, Biogen Inc, Eisai, Janssen Global Services LLC, the NIH, and Novartis AG outside the submitted work. Dr Mendez reported receiving research support from the NIH. Dr Miyagawa reported receiving research support from the Zander Family Foundation. Dr Pascual reported receiving research support from the NIH. Dr Pressman reported receiving research support from the NIH. Dr Ramos reported receiving research support from the NIH. Dr Roberson reported receiving research support from the NIA of the NIH, the Bluefield Project, and the Alzheimer’s Drug Discovery Foundation; serving on a data monitoring committee for Eli Lilly and Company; receiving licensing fees from Genentech Inc; and consulting for Applied Genetic Technologies Corp. Dr Tartaglia reported serving as an investigator for clinical trials sponsored by Biogen Inc, Avanex Corp, Green Valley, Roche/Genentech Inc, Bristol Myers Squibb, Eli Lilly and Company/Avid Radiopharmaceuticals, and Janssen Global Services LLC and receiving research support from the Canadian Institutes of Health Research (CIHR). Dr Wong reported receiving research support from the NIH. Dr Kornak reported providing expert witness testimony for Teva Pharmaceuticals Industries Ltd, Apotex Inc, and Puma Biotechnology and receiving research support from the NIH. Dr Kremers reported receiving research funding from NIH. Dr Kramer reported receiving research support from the NIH and royalties from Pearson Inc. Dr Boeve reported serving as an investigator for clinical trials sponsored by Alector Inc, Biogen Inc, and Transposon Therapeutics Inc; receiving royalties from Cambridge Medicine; serving on the Scientific Advisory Board of the Tau Consortium; and receiving research support from NIH, the Mayo Clinic Dorothy and Harry T. Mangurian Jr. Lewy Body Dementia Program, and the Little Family Foundation. Dr Rosen reported receiving research support from Biogen Inc, consulting for Wave Neuroscience and Ionis Pharmaceuticals, and receiving research support from the NIH. Dr Boxer reported being a coinventor of 4 of the ALLFTD mobile application tasks (not the focus of the present study) and previously receiving licensing fees; receiving research support from the NIH, the Tau Research Consortium, the Association for Frontotemporal Degeneration, Bluefield Project to Cure Frontotemporal Dementia, Corticobasal Degeneration Solutions, the Alzheimer’s Drug Discovery Foundation, and the Alzheimer’s Association; consulting for Aeovian Pharmaceuticals Inc, Applied Genetic Technologies Corp, Alector Inc, Arkuda Therapeutics, Arvinas Inc, AviadoBio, Boehringer Ingelheim, Denali Therapeutics Inc, GSK, Life Edit Therapeutics Inc, Humana Inc, Oligomerix, Oscotec Inc, Roche, Transposon Therapeutics Inc, TrueBinding Inc, and Wave Life Sciences; and receiving research support from Biogen Inc, Eisai, and Regeneron Pharmaceuticals Inc. No other disclosures were reported.

Funding/Support: This work was supported by grants AG063911, AG077557, AG62677, AG045390, NS092089, AG032306, AG016976, AG058233, AG038791, AG02350, AG019724, AG062422, NS050915, AG032289-11, AG077557, K23AG061253, and K24AG045333 from the NIH; the Association for Frontotemporal Degeneration; the Bluefield Project to Cure FTD; the Rainwater Charitable Foundation; and grant 2014-A-004-NET from the Larry L. Hillblom Foundation. Samples from the National Centralized Repository for Alzheimer’s Disease and Related Dementias, which receives government support under cooperative agreement grant U24 AG21886 from the NIA, were used in this study.

Role of the Funder/Sponsor: The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Group Information: A complete list of the members of the ALLFTD Consortium appears in Supplement 2 .

Data Sharing Statement: See Supplement 3 .

Additional Contributions: We thank the participants and study partners for dedicating their time and effort, and for providing invaluable feedback as we learn how to incorporate digital technologies into FTLD research.

Additional Information: Dr Grossman passed away on April 4, 2023. We want to acknowledge his many contributions to this study, including data acquisition, and design and conduct of the study. He was an ALLFTD site principal investigator and contributed during the development of the ALLFTD mobile app.

• Register for email alerts with links to free full-text articles
• Access PDFs of free articles
• Manage your interests
• Save searches and receive search alerts

Help | Advanced Search

Computer Science > Computation and Language

Title: realm: reference resolution as language modeling.

Abstract: Reference resolution is an important problem, one that is essential to understand and successfully handle context of different kinds. This context includes both previous turns and context that pertains to non-conversational entities, such as entities on the user's screen or those running in the background. While LLMs have been shown to be extremely powerful for a variety of tasks, their use in reference resolution, particularly for non-conversational entities, remains underutilized. This paper demonstrates how LLMs can be used to create an extremely effective system to resolve references of various types, by showing how reference resolution can be converted into a language modeling problem, despite involving forms of entities like those on screen that are not traditionally conducive to being reduced to a text-only modality. We demonstrate large improvements over an existing system with similar functionality across different types of references, with our smallest model obtaining absolute gains of over 5% for on-screen references. We also benchmark against GPT-3.5 and GPT-4, with our smallest model achieving performance comparable to that of GPT-4, and our larger models substantially outperforming it.

Submission history

Access paper:.

• HTML (experimental)
• Other Formats

References & Citations

• Google Scholar
• Semantic Scholar

BibTeX formatted citation

Bibliographic and Citation Tools

Code, data and media associated with this article, recommenders and search tools.

• Institution

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .

Scribbr Citation Generator

Accurate APA, MLA, Chicago, and Harvard citations, verified by experts, trusted by millions

Scribbr for Chrome: Your shortcut to citations

Cite any page or article with a single click right from your browser. The extension does the hard work for you by automatically grabbing the title, author(s), publication date, and everything else needed to whip up the perfect citation.

Perfectly formatted references every time

Inaccurate citations can cost you points on your assignments, so our seasoned citation experts have invested countless hours in perfecting Scribbr’s citation generator algorithms. We’re proud to be recommended by teachers and universities worldwide.

Enjoy a citation generator without flashy ads

Staying focused is already difficult enough, so unlike other citation generators, Scribbr won’t slow you down with flashing banner ads and video pop-ups. That’s a promise!

Citation Generator features you'll love

Look up your source by its title, URL, ISBN, or DOI, and let Scribbr find and fill in all the relevant information automatically.

APA, MLA, Chicago, and Harvard

Generate flawless citations according to the official APA, MLA, Chicago, Harvard style, or many other rules.

Export to Word

When your reference list is complete, export it to Word. We’ll apply the official formatting guidelines automatically.

Lists and folders

Create separate reference lists for each of your assignments to stay organized. You can also group related lists into folders.

Export to Bib(La)TeX

Are you using a LaTex editor like Overleaf? If so, you can easily export your references in Bib(La)TeX format with a single click.

Custom fonts

Change the typeface used for your reference list to match the rest of your document. Options include Times New Roman, Arial, and Calibri.

Industry-standard technology

Scribbr’s Citation Generator is built using the same citation software (CSL) as Mendeley and Zotero, but with an added layer for improved accuracy.

Annotations

Describe or evaluate your sources in annotations, and Scribbr will generate a perfectly formatted annotated bibliography .

Citation guides

Scribbr’s popular guides and videos will help you understand everything related to finding, evaluating, and citing sources.

Secure backup

Your work is saved automatically after every change and stored securely in your Scribbr account.

• Introduction
• Finding sources

Evaluating sources

• Integrating sources

Citing sources

Tools and resources, a quick guide to working with sources.

Working with sources is an important skill that you’ll need throughout your academic career.

It includes knowing how to find relevant sources, assessing their authority and credibility, and understanding how to integrate sources into your work with proper referencing.

This quick guide will help you get started!

Finding relevant sources

Sources commonly used in academic writing include academic journals, scholarly books, websites, newspapers, and encyclopedias. There are three main places to look for such sources:

• Research databases: Databases can be general or subject-specific. To get started, check out this list of databases by academic discipline . Another good starting point is Google Scholar .
• Your institution’s library: Use your library’s database to narrow down your search using keywords to find relevant articles, books, and newspapers matching your topic.
• Other online resources: Consult popular online sources like websites, blogs, or Wikipedia to find background information. Be sure to carefully evaluate the credibility of those online sources.

When using academic databases or search engines, you can use Boolean operators to refine your results.

Generate APA, MLA, Chicago, and Harvard citations in seconds

Get started

In academic writing, your sources should be credible, up to date, and relevant to your research topic. Useful approaches to evaluating sources include the CRAAP test and lateral reading.

CRAAP is an abbreviation that reminds you of a set of questions to ask yourself when evaluating information.

• Currency: Does the source reflect recent research?
• Relevance: Is the source related to your research topic?
• Authority: Is it a respected publication? Is the author an expert in their field?
• Accuracy: Does the source support its arguments and conclusions with evidence?
• Purpose: What is the author’s intention?

Lateral reading

Lateral reading means comparing your source to other sources. This allows you to:

• Verify evidence
• Contextualize information
• Find potential weaknesses

If a source is using methods or drawing conclusions that are incompatible with other research in its field, it may not be reliable.

Integrating sources into your work

Once you have found information that you want to include in your paper, signal phrases can help you to introduce it. Here are a few examples:

Following the signal phrase, you can choose to quote, paraphrase or summarize the source.

• Quoting : This means including the exact words of another source in your paper. The quoted text must be enclosed in quotation marks or (for longer quotes) presented as a block quote . Quote a source when the meaning is difficult to convey in different words or when you want to analyze the language itself.
• Paraphrasing : This means putting another person’s ideas into your own words. It allows you to integrate sources more smoothly into your text, maintaining a consistent voice. It also shows that you have understood the meaning of the source.
• Summarizing : This means giving an overview of the essential points of a source. Summaries should be much shorter than the original text. You should describe the key points in your own words and not quote from the original text.

Whenever you quote, paraphrase, or summarize a source, you must include a citation crediting the original author.

Citing your sources is important because it:

• Allows you to avoid plagiarism
• Establishes the credentials of your sources
• Backs up your arguments with evidence
• Allows your reader to verify the legitimacy of your conclusions

The most common citation styles are APA, MLA, and Chicago style. Each citation style has specific rules for formatting citations.

Generate APA, MLA, Chicago,  and Harvard citations in seconds

Scribbr offers tons of tools and resources to make working with sources easier and faster. Take a look at our top picks:

• Citation Generator: Automatically generate accurate references and in-text citations using Scribbr’s APA Citation Generator, MLA Citation Generator , Harvard Referencing Generator , and Chicago Citation Generator .
• Plagiarism Checker : Detect plagiarism in your paper using the most accurate Turnitin-powered plagiarism software available to students.
• AI Proofreader: Upload and improve unlimited documents and earn higher grades on your assignments. Try it for free!
• Paraphrasing tool: Avoid accidental plagiarism and make your text sound better.
• Grammar checker : Eliminate pesky spelling and grammar mistakes.
• Summarizer: Read more in less time. Distill lengthy and complex texts down to their key points.
• AI detector: Find out if your text was written with ChatGPT or any other AI writing tool. ChatGPT 2 & ChatGPT 3 supported.
• Proofreading services : Have a human editor improve your writing.
• Citation checker: Check your work for citation errors and missing citations.
• Knowledge Base : Explore hundreds of articles, bite-sized videos, time-saving templates, and handy checklists that guide you through the process of research, writing, and citation.