Fallacious reasoning in the argument to eliminate the major depression bereavement exclusion in DSM‐5
Abstract
We thank E. Corruble and R. Pies for their comments on our review of the evidence pertaining to the validity of the DSM's major depression (MDD) bereavement exclusion (BE) 1. Regarding the former letter, as our review explained, Corruble's studies 2,3,4 provide no evidence regarding the BE's validity, because the BE was misapplied. This conclusion is not “dogmatic”, but based on Corruble's data. After interviewing depressed patients, physicians in Corruble's studies marked each MDD symptom and criterion “yes” or “no” on a questionnaire. Criterion E (the BE) for MDD requires that, if the depressive episode occurs during bereavement, it must have one or more of certain features that are uncharacteristic of normal grief (i.e., psychomotor retardation, feelings of worthlessness, suicidal ideation, marked impairment, psychotic ideation, or duration greater than 2 months) showing that it is better explained as MDD than as normal bereavement. Thus, a “yes” rating on criterion E indicated that the episode was a bona fide case of MDD, whereas a “no” rating meant that the episode was placed in Corruble's “excluded” sample. However, the vast majority of physicians who checked “no” to criterion E also checked “yes” to either “psychomotor retardation” (70.6%), “suicidal ideation” (36.0%), or “feelings of worthlessness” (66.8%). Yet, criterion E requires that these symptoms not be present for a case to be excluded, so the “no” rating for criterion E was logically inconsistent with the “yes” on the symptom ratings. If the BE had been applied correctly, these symptoms’ rates would necessarily have been 0% among the excluded cases. In essence, the symptom profile served as a validity check on the physicians’ application of the BE, and revealed its invalidity. We speculated that lack of training contributed to the physicians’ incorrect application of the BE. Corruble objects that the physicians did receive some preparation. The fact that they still got confused suggests that the BE's double-negative wording requires simplification, and we proposed such a simplification in our review. But this does not change the fact that the physicians applied the BE incorrectly. Corruble suggests that there are two possible explanations for the contradictory results — either the physicians incorrectly applied the BE, or the BE is so complex that it cannot be correctly applied in real world settings. However, both these “explanations” imply that criterion E was not applied correctly, supporting our conclusion. Attempting to elevate her physicians’ errors into a general condemnation of the BE, Corruble asserts the BE is so complex that it is incapable of real-world application. However, although confusingly worded, the BE ultimately relies on duration, impairment, and symptom criteria — the same kind found in most DSM diagnostic criteria sets. Physicians who initially misapply the BE generally learn to apply it correctly with further training, and lay interviewers have applied the BE successfully in research studies. Moreover, physicians have a similar trajectory in learning to diagnose depression in general, with more incorrect than correct diagnoses initially, so the BE's diagnostic learning curve is not unique 5. Corruble's publications misleadingly suggest that her studies reveal the surprising severity of BE-excluded episodes, rather than explaining that her “excluded” sample would not be excluded by the BE. For example, in her letter, Corruble states that “our results… show that the bereavement exclusion criterion has a poor discriminant validity…”. However, the results show nothing about the BE's discriminant validity, because the criterion was not properly applied. Recent recurrence studies described in our review strongly support the BE's discriminant validity. Corruble asks elsewhere “Should the E criterion for the diagnosis of MDE be retained?… Or should it be deleted?” and answers “Unfortunately, our data cannot answer these questions” 6. Our review explains why we strongly agree with this conclusion. Regarding Pies’ letter, he argued in recent papers that the available evidence supports the invalidity of the BE 7,8. Our review shows that the evidence Pies cited offers no such support. Pies now claims that no evidence is needed to eliminate the BE, because there was no adequate evidence for having included it in the first place. However, the procedures established for revising the DSM sensibly require that changes be justified by evidence 9. If one generally adopted Pies’ proposed standard for the BE that there must be methodologically perfect studies to justify retention of a criterion, then much of the DSM would have to be thrown out along with the BE. Yet in many cases, including the BE, there are good reasons anchored in medical observation and relevant but less-than-perfect evidence allowing a plausible judgment of a condition's likely status, pending further evidence. Pies’ own standard when arguing for eliminating the BE was the “best available evidence” or the “preponderance of evidence” despite “the limited data we have” 7,8. Pies summarily dismisses Clayton's 10,11 pre-DSM-III prospective studies of grief as justification for the BE's introduction. However, whatever their limitations, those studies provided crucial and still-persuasive evidence that some MDD symptoms are also common in normal grief, and that the BE is necessary to avoid massive false positives. Recent studies confirm Clayton's early conclusions (see below). Pies claims that “the burden of proof should fall on those who believe the bereavement exclusion should be retained”. Although this claim is questionable for the reasons above, nonetheless this burden has been met. As our review explained, two recent studies using different samples and follow-up periods reached convergent conclusions — that having a BE-excluded episode does not elevate the probability of recurrence of depression over background rates, whereas other types of MDD have recurrence rates much greater than population levels 12,13. Pies’ rejection of such evidence from epidemiological studies ignores the many well-known reasons why such studies offer superior scientific evidence and form the foundation for many DSM validity evaluations. Pies’ rejection of epidemiological evidence also rings hollow because he cited primarily epidemiological studies or reviews that relied on them when he argued for the BE's elimination 7,8. Pies’ main argument against the BE has been that there is no evidence that BE-excluded episodes are “fundamentally different”, “less severe or persistent”, have different “prognostic or treatment implications”, or “significantly differ… in terms of symptom picture, risk of recurrence, or clinical outcome” from other MDD 7,8. All of these assertions are contradicted by the recent recurrence evidence. Pies asserts that it is a “rudimentary matter of logic” that bereaved individuals meeting MDD criteria should be considered disordered, unless there is evidence that they differ importantly from other MDD cases. This is not in fact a logically valid principle (such an inference is warranted only if you have first established the essential homogeneity of the overall syndrome, something that has not been done for any DSM-defined syndrome, let alone MDE), but no matter. The recurrence studies 12,13 provide precisely the demanded evidence of important differences. By Pies’ own stated standards, the evidence supports the retention of the BE.
| Authors: | ; |
|---|---|
| Published in: | World Psychiatry, vol. 11, no. 3, pp. 204-205 |
| Publication date: | 01/10/2012 |
| Publisher: | Wiley |
| Document type: | Article |
| Language: | English |
| DOI: | 10.1002/j.2051-5545.2012.tb00135.x |
| ISSN: | 1723-8617, 2051-5545 |
| Open access: | Open access Bronze: free to read at the publisher, without an open license – World Psychiatry |
| Cited by: | 12 |
| Subjects: |
Grief, Bereavement, and Mental Health
(Social Sciences > Psychology > Clinical Psychology)
Mental Health and Psychiatry
(Social Sciences > Arts and Humanities > Philosophy)
Treatment of Major Depression
(Health Sciences > Medicine > Pharmacology)
|
| Identifiers: | OpenAlex W1548525776 · PMID 23024684 |
Central index data: OpenAlex (CC0 license).
Full central index record (JSON) from api.openalex.org/works/W1548525776
{
"abstract (reconstructed from abstract_inverted_index)": "We thank E. Corruble and R. Pies for their comments on our review of the evidence pertaining to the validity of the DSM's major depression (MDD) bereavement exclusion (BE) 1. Regarding the former letter, as our review explained, Corruble's studies 2,3,4 provide no evidence regarding the BE's validity, because the BE was misapplied. This conclusion is not “dogmatic”, but based on Corruble's data. After interviewing depressed patients, physicians in Corruble's studies marked each MDD symptom and criterion “yes” or “no” on a questionnaire. Criterion E (the BE) for MDD requires that, if the depressive episode occurs during bereavement, it must have one or more of certain features that are uncharacteristic of normal grief (i.e., psychomotor retardation, feelings of worthlessness, suicidal ideation, marked impairment, psychotic ideation, or duration greater than 2 months) showing that it is better explained as MDD than as normal bereavement. Thus, a “yes” rating on criterion E indicated that the episode was a bona fide case of MDD, whereas a “no” rating meant that the episode was placed in Corruble's “excluded” sample. However, the vast majority of physicians who checked “no” to criterion E also checked “yes” to either “psychomotor retardation” (70.6%), “suicidal ideation” (36.0%), or “feelings of worthlessness” (66.8%). Yet, criterion E requires that these symptoms not be present for a case to be excluded, so the “no” rating for criterion E was logically inconsistent with the “yes” on the symptom ratings. If the BE had been applied correctly, these symptoms’ rates would necessarily have been 0% among the excluded cases. In essence, the symptom profile served as a validity check on the physicians’ application of the BE, and revealed its invalidity. We speculated that lack of training contributed to the physicians’ incorrect application of the BE. Corruble objects that the physicians did receive some preparation. The fact that they still got confused suggests that the BE's double-negative wording requires simplification, and we proposed such a simplification in our review. But this does not change the fact that the physicians applied the BE incorrectly. Corruble suggests that there are two possible explanations for the contradictory results — either the physicians incorrectly applied the BE, or the BE is so complex that it cannot be correctly applied in real world settings. However, both these “explanations” imply that criterion E was not applied correctly, supporting our conclusion. Attempting to elevate her physicians’ errors into a general condemnation of the BE, Corruble asserts the BE is so complex that it is incapable of real-world application. However, although confusingly worded, the BE ultimately relies on duration, impairment, and symptom criteria — the same kind found in most DSM diagnostic criteria sets. Physicians who initially misapply the BE generally learn to apply it correctly with further training, and lay interviewers have applied the BE successfully in research studies. Moreover, physicians have a similar trajectory in learning to diagnose depression in general, with more incorrect than correct diagnoses initially, so the BE's diagnostic learning curve is not unique 5. Corruble's publications misleadingly suggest that her studies reveal the surprising severity of BE-excluded episodes, rather than explaining that her “excluded” sample would not be excluded by the BE. For example, in her letter, Corruble states that “our results… show that the bereavement exclusion criterion has a poor discriminant validity…”. However, the results show nothing about the BE's discriminant validity, because the criterion was not properly applied. Recent recurrence studies described in our review strongly support the BE's discriminant validity. Corruble asks elsewhere “Should the E criterion for the diagnosis of MDE be retained?… Or should it be deleted?” and answers “Unfortunately, our data cannot answer these questions” 6. Our review explains why we strongly agree with this conclusion. Regarding Pies’ letter, he argued in recent papers that the available evidence supports the invalidity of the BE 7,8. Our review shows that the evidence Pies cited offers no such support. Pies now claims that no evidence is needed to eliminate the BE, because there was no adequate evidence for having included it in the first place. However, the procedures established for revising the DSM sensibly require that changes be justified by evidence 9. If one generally adopted Pies’ proposed standard for the BE that there must be methodologically perfect studies to justify retention of a criterion, then much of the DSM would have to be thrown out along with the BE. Yet in many cases, including the BE, there are good reasons anchored in medical observation and relevant but less-than-perfect evidence allowing a plausible judgment of a condition's likely status, pending further evidence. Pies’ own standard when arguing for eliminating the BE was the “best available evidence” or the “preponderance of evidence” despite “the limited data we have” 7,8. Pies summarily dismisses Clayton's 10,11 pre-DSM-III prospective studies of grief as justification for the BE's introduction. However, whatever their limitations, those studies provided crucial and still-persuasive evidence that some MDD symptoms are also common in normal grief, and that the BE is necessary to avoid massive false positives. Recent studies confirm Clayton's early conclusions (see below). Pies claims that “the burden of proof should fall on those who believe the bereavement exclusion should be retained”. Although this claim is questionable for the reasons above, nonetheless this burden has been met. As our review explained, two recent studies using different samples and follow-up periods reached convergent conclusions — that having a BE-excluded episode does not elevate the probability of recurrence of depression over background rates, whereas other types of MDD have recurrence rates much greater than population levels 12,13. Pies’ rejection of such evidence from epidemiological studies ignores the many well-known reasons why such studies offer superior scientific evidence and form the foundation for many DSM validity evaluations. Pies’ rejection of epidemiological evidence also rings hollow because he cited primarily epidemiological studies or reviews that relied on them when he argued for the BE's elimination 7,8. Pies’ main argument against the BE has been that there is no evidence that BE-excluded episodes are “fundamentally different”, “less severe or persistent”, have different “prognostic or treatment implications”, or “significantly differ… in terms of symptom picture, risk of recurrence, or clinical outcome” from other MDD 7,8. All of these assertions are contradicted by the recent recurrence evidence. Pies asserts that it is a “rudimentary matter of logic” that bereaved individuals meeting MDD criteria should be considered disordered, unless there is evidence that they differ importantly from other MDD cases. This is not in fact a logically valid principle (such an inference is warranted only if you have first established the essential homogeneity of the overall syndrome, something that has not been done for any DSM-defined syndrome, let alone MDE), but no matter. The recurrence studies 12,13 provide precisely the demanded evidence of important differences. By Pies’ own stated standards, the evidence supports the retention of the BE.",
"id": "https://openalex.org/W1548525776",
"doi": "https://doi.org/10.1002/j.2051-5545.2012.tb00135.x",
"title": "Fallacious reasoning in the argument to eliminate the major depression bereavement exclusion in DSM‐5",
"display_name": "Fallacious reasoning in the argument to eliminate the major depression bereavement exclusion in DSM‐5",
"publication_year": 2012,
"publication_date": "2012-10-01",
"ids": {
"openalex": "https://openalex.org/W1548525776",
"doi": "https://doi.org/10.1002/j.2051-5545.2012.tb00135.x",
"mag": "1548525776",
"pmid": "https://pubmed.ncbi.nlm.nih.gov/23024684"
},
"language": "en",
"primary_location": {
"id": "doi:10.1002/j.2051-5545.2012.tb00135.x",
"doi": "https://doi.org/10.1002/j.2051-5545.2012.tb00135.x",
"is_oa": true,
"landing_page_url": "https://doi.org/10.1002/j.2051-5545.2012.tb00135.x",
"pdf_url": "https://onlinelibrary.wiley.com/doi/pdfdirect/10.1002/j.2051-5545.2012.tb00135.x",
"source": {
"id": "https://openalex.org/S183644930",
"display_name": "World Psychiatry",
"issn_l": "1723-8617",
"issn": [
"1723-8617",
"2051-5545"
],
"is_oa": false,
"is_in_doaj": false,
"is_core": true,
"listed_in": [
"cwts-core",
"doyens",
"jufo-3",
"ki-jl-3",
"norway-2"
],
"host_organization": "https://openalex.org/P4310320595",
"host_organization_name": "Wiley",
"host_organization_lineage": [
"https://openalex.org/P4310320595"
],
"host_organization_lineage_names": [
"Wiley"
],
"type": "journal"
},
"license": null,
"license_id": null,
"version": "publishedVersion",
"is_accepted": true,
"is_published": true,
"raw_source_name": "World Psychiatry",
"raw_type": "journal-article"
},
"volume": null,
"type": "article",
"indexed_in": [
"crossref",
"pubmed"
],
"open_access": {
"is_oa": true,
"oa_status": "bronze",
"oa_url": "https://onlinelibrary.wiley.com/doi/pdfdirect/10.1002/j.2051-5545.2012.tb00135.x",
"any_repository_has_fulltext": true
},
"authorships": [
{
"author_position": "first",
"author": {
"id": "https://openalex.org/A5091505956",
"display_name": "Jerome Carl Wakefield",
"orcid": "https://orcid.org/0000-0002-6809-5515",
"observed_orcids": [
"https://orcid.org/0000-0002-6809-5515"
]
},
"institutions": [
{
"id": "https://openalex.org/I57206974",
"display_name": "New York University",
"ror": "https://ror.org/0190ak572",
"country_code": "US",
"type": "education",
"lineage": [
"https://openalex.org/I57206974"
]
}
],
"countries": [
"US"
],
"is_corresponding": false,
"raw_author_name": "JEROME WAKEFIELD",
"raw_affiliation_strings": [
"Department of Psychiatry, School of Medicine, New York University, 550 First Avenue, New York, NY 10016, USA",
"Department of Psychiatry, School of Medicine, New York University, 550 First Avenue, New York, NY 10016. USA"
],
"raw_orcid": null,
"affiliations": [
{
"raw_affiliation_string": "Department of Psychiatry, School of Medicine, New York University, 550 First Avenue, New York, NY 10016, USA",
"institution_ids": [
"https://openalex.org/I57206974"
]
},
{
"raw_affiliation_string": "Department of Psychiatry, School of Medicine, New York University, 550 First Avenue, New York, NY 10016. USA",
"institution_ids": [
"https://openalex.org/I57206974"
]
}
]
},
{
"author_position": "last",
"author": {
"id": "https://openalex.org/A5006482282",
"display_name": "Michael B. First",
"orcid": "https://orcid.org/0000-0002-8032-3947",
"observed_orcids": [
"https://orcid.org/0000-0002-8032-3947"
]
},
"institutions": [
{
"id": "https://openalex.org/I78577930",
"display_name": "Columbia University",
"ror": "https://ror.org/00hj8s172",
"country_code": "US",
"type": "education",
"lineage": [
"https://openalex.org/I78577930"
]
}
],
"countries": [
"US"
],
"is_corresponding": false,
"raw_author_name": "MICHAEL FIRST",
"raw_affiliation_strings": [
"Department of Psychiatry, Columbia University College of Physicians and Surgeons, New York, NY 10032, USA",
"Department of Psychiatry Columbia University College of Physicians and Surgeons, New York, NY 10032 USA"
],
"raw_orcid": null,
"affiliations": [
{
"raw_affiliation_string": "Department of Psychiatry, Columbia University College of Physicians and Surgeons, New York, NY 10032, USA",
"institution_ids": [
"https://openalex.org/I78577930"
]
},
{
"raw_affiliation_string": "Department of Psychiatry Columbia University College of Physicians and Surgeons, New York, NY 10032 USA",
"institution_ids": [
"https://openalex.org/I78577930"
]
}
]
}
],
"institutions": [],
"countries_distinct_count": 1,
"institutions_distinct_count": 2,
"corresponding_author_ids": [],
"corresponding_institution_ids": [],
"apc_list": null,
"apc_paid": null,
"fwci": 2.4383,
"has_fulltext": true,
"cited_by_count": 12,
"citation_normalized_percentile": {
"value": 0.87645611,
"is_in_top_1_percent": false,
"is_in_top_10_percent": false
},
"cited_by_percentile_year": {
"min": 88,
"max": 98
},
"biblio": {
"volume": "11",
"issue": "3",
"first_page": "204",
"last_page": "205"
},
"is_retracted": false,
"is_paratext": false,
"is_xpac": false,
"primary_topic": {
"id": "https://openalex.org/T11388",
"display_name": "Grief, Bereavement, and Mental Health",
"score": 0.7494999766349792,
"subfield": {
"id": "https://openalex.org/subfields/3203",
"display_name": "Clinical Psychology"
},
"field": {
"id": "https://openalex.org/fields/32",
"display_name": "Psychology"
},
"domain": {
"id": "https://openalex.org/domains/2",
"display_name": "Social Sciences"
}
},
"topics": [
{
"id": "https://openalex.org/T11388",
"display_name": "Grief, Bereavement, and Mental Health",
"score": 0.7494999766349792,
"subfield": {
"id": "https://openalex.org/subfields/3203",
"display_name": "Clinical Psychology"
},
"field": {
"id": "https://openalex.org/fields/32",
"display_name": "Psychology"
},
"domain": {
"id": "https://openalex.org/domains/2",
"display_name": "Social Sciences"
}
},
{
"id": "https://openalex.org/T12308",
"display_name": "Mental Health and Psychiatry",
"score": 0.15690000355243683,
"subfield": {
"id": "https://openalex.org/subfields/1211",
"display_name": "Philosophy"
},
"field": {
"id": "https://openalex.org/fields/12",
"display_name": "Arts and Humanities"
},
"domain": {
"id": "https://openalex.org/domains/2",
"display_name": "Social Sciences"
}
},
{
"id": "https://openalex.org/T11071",
"display_name": "Treatment of Major Depression",
"score": 0.02280000038444996,
"subfield": {
"id": "https://openalex.org/subfields/2736",
"display_name": "Pharmacology"
},
"field": {
"id": "https://openalex.org/fields/27",
"display_name": "Medicine"
},
"domain": {
"id": "https://openalex.org/domains/4",
"display_name": "Health Sciences"
}
}
],
"keywords": [
{
"id": "https://openalex.org/keywords/major-depressive-disorder",
"display_name": "major depressive disorder",
"score": 0.7730000019073486
},
{
"id": "https://openalex.org/keywords/bereavement-exclusion",
"display_name": "bereavement exclusion",
"score": 0.972000002861023
},
{
"id": "https://openalex.org/keywords/dsm-5",
"display_name": "DSM-5",
"score": 0.9480000138282776
},
{
"id": "https://openalex.org/keywords/diagnostic-validity",
"display_name": "diagnostic validity",
"score": 0.734000027179718
},
{
"id": "https://openalex.org/keywords/psychomotor-retardation",
"display_name": "psychomotor retardation",
"score": 0.7879999876022339
},
{
"id": "https://openalex.org/keywords/suicidal-ideation",
"display_name": "suicidal ideation",
"score": 0.9909999966621399
},
{
"id": "https://openalex.org/keywords/feelings-of-worthlessness",
"display_name": "feelings of worthlessness",
"score": 0.9419999718666077
},
{
"id": "https://openalex.org/keywords/logical-fallacies",
"display_name": "logical fallacies",
"score": 0.6240000128746033
},
{
"id": "https://openalex.org/keywords/depressive-episode-duration",
"display_name": "depressive episode duration",
"score": 0.3630000054836273
}
],
"concepts": [
{
"id": "https://openalex.org/C98184364",
"wikidata": "https://www.wikidata.org/wiki/Q1780131",
"display_name": "Argument (complex analysis)",
"level": 2,
"score": 0.7624974250793457
},
{
"id": "https://openalex.org/C71924100",
"wikidata": "https://www.wikidata.org/wiki/Q11190",
"display_name": "Medicine",
"level": 0,
"score": 0.6818707585334778
},
{
"id": "https://openalex.org/C2776867660",
"wikidata": "https://www.wikidata.org/wiki/Q1814941",
"display_name": "Depression (economics)",
"level": 2,
"score": 0.6758859753608704
},
{
"id": "https://openalex.org/C118552586",
"wikidata": "https://www.wikidata.org/wiki/Q7867",
"display_name": "Psychiatry",
"level": 1,
"score": 0.5291576385498047
},
{
"id": "https://openalex.org/C2781406353",
"wikidata": "https://www.wikidata.org/wiki/Q3064664",
"display_name": "DSM-5",
"level": 2,
"score": 0.5186523795127869
},
{
"id": "https://openalex.org/C139719470",
"wikidata": "https://www.wikidata.org/wiki/Q39680",
"display_name": "Macroeconomics",
"level": 1,
"score": 0
},
{
"id": "https://openalex.org/C126322002",
"wikidata": "https://www.wikidata.org/wiki/Q11180",
"display_name": "Internal medicine",
"level": 1,
"score": 0
},
{
"id": "https://openalex.org/C162324750",
"wikidata": "https://www.wikidata.org/wiki/Q8134",
"display_name": "Economics",
"level": 0,
"score": 0
}
],
"mesh": [],
"locations_count": 4,
"locations": [
{
"id": "doi:10.1002/j.2051-5545.2012.tb00135.x",
"doi": "https://doi.org/10.1002/j.2051-5545.2012.tb00135.x",
"is_oa": true,
"landing_page_url": "https://doi.org/10.1002/j.2051-5545.2012.tb00135.x",
"pdf_url": "https://onlinelibrary.wiley.com/doi/pdfdirect/10.1002/j.2051-5545.2012.tb00135.x",
"source": {
"id": "https://openalex.org/S183644930",
"display_name": "World Psychiatry",
"issn_l": "1723-8617",
"issn": [
"1723-8617",
"2051-5545"
],
"is_oa": false,
"is_in_doaj": false,
"is_core": true,
"listed_in": [
"cwts-core",
"doyens",
"jufo-3",
"ki-jl-3",
"norway-2"
],
"host_organization": "https://openalex.org/P4310320595",
"host_organization_name": "Wiley",
"host_organization_lineage": [
"https://openalex.org/P4310320595"
],
"host_organization_lineage_names": [
"Wiley"
],
"type": "journal"
},
"license": null,
"license_id": null,
"version": "publishedVersion",
"is_accepted": true,
"is_published": true,
"raw_source_name": "World Psychiatry",
"raw_type": "journal-article"
},
{
"id": "pmid:23024684",
"doi": null,
"is_oa": false,
"landing_page_url": "https://pubmed.ncbi.nlm.nih.gov/23024684",
"pdf_url": null,
"source": {
"id": "https://openalex.org/S4306525036",
"display_name": "PubMed",
"issn_l": null,
"issn": null,
"is_oa": false,
"is_in_doaj": false,
"is_core": false,
"listed_in": [],
"host_organization": "https://openalex.org/I1299303238",
"host_organization_name": "National Institutes of Health",
"host_organization_lineage": [
"https://openalex.org/I1299303238"
],
"host_organization_lineage_names": [],
"type": "repository"
},
"license": null,
"license_id": null,
"version": "publishedVersion",
"is_accepted": true,
"is_published": true,
"raw_source_name": "World psychiatry : official journal of the World Psychiatric Association (WPA)",
"raw_type": "Journal Article"
},
{
"id": "pmh:oai:europepmc.org:2459563",
"doi": null,
"is_oa": false,
"landing_page_url": "https://www.ncbi.nlm.nih.gov/pmc/articles/3449345",
"pdf_url": null,
"source": {
"id": "https://openalex.org/S4306400806",
"display_name": "Europe PMC (PubMed Central)",
"issn_l": null,
"issn": null,
"is_oa": false,
"is_in_doaj": false,
"is_core": false,
"listed_in": [],
"host_organization": "https://openalex.org/I1303153112",
"host_organization_name": "European Bioinformatics Institute",
"host_organization_lineage": [
"https://openalex.org/I1303153112"
],
"host_organization_lineage_names": [],
"type": "repository"
},
"license": null,
"license_id": null,
"version": "submittedVersion",
"is_accepted": false,
"is_published": false,
"raw_source_name": null,
"raw_type": "Text"
},
{
"id": "pmh:oai:pubmedcentral.nih.gov:3449345",
"doi": null,
"is_oa": true,
"landing_page_url": "https://www.ncbi.nlm.nih.gov/pmc/articles/3449345",
"pdf_url": null,
"source": {
"id": "https://openalex.org/S2764455111",
"display_name": "PubMed Central",
"issn_l": null,
"issn": null,
"is_oa": true,
"is_in_doaj": false,
"is_core": false,
"listed_in": [],
"host_organization": "https://openalex.org/I1299303238",
"host_organization_name": "National Institutes of Health",
"host_organization_lineage": [
"https://openalex.org/I1299303238"
],
"host_organization_lineage_names": [],
"type": "repository"
},
"license": null,
"license_id": null,
"version": "submittedVersion",
"is_accepted": false,
"is_published": false,
"raw_source_name": "World Psychiatry",
"raw_type": "Text"
}
],
"best_oa_location": {
"id": "doi:10.1002/j.2051-5545.2012.tb00135.x",
"doi": "https://doi.org/10.1002/j.2051-5545.2012.tb00135.x",
"is_oa": true,
"landing_page_url": "https://doi.org/10.1002/j.2051-5545.2012.tb00135.x",
"pdf_url": "https://onlinelibrary.wiley.com/doi/pdfdirect/10.1002/j.2051-5545.2012.tb00135.x",
"source": {
"id": "https://openalex.org/S183644930",
"display_name": "World Psychiatry",
"issn_l": "1723-8617",
"issn": [
"1723-8617",
"2051-5545"
],
"is_oa": false,
"is_in_doaj": false,
"is_core": true,
"listed_in": [
"cwts-core",
"doyens",
"jufo-3",
"ki-jl-3",
"norway-2"
],
"host_organization": "https://openalex.org/P4310320595",
"host_organization_name": "Wiley",
"host_organization_lineage": [
"https://openalex.org/P4310320595"
],
"host_organization_lineage_names": [
"Wiley"
],
"type": "journal"
},
"license": null,
"license_id": null,
"version": "publishedVersion",
"is_accepted": true,
"is_published": true,
"raw_source_name": "World Psychiatry",
"raw_type": "journal-article"
},
"sustainable_development_goals": [
{
"display_name": "Good health and well-being",
"score": 0.8560000061988831,
"id": "https://metadata.un.org/sdg/3"
}
],
"sustainable_development_goals_aurora": [
{
"display_name": "Reduced inequalities",
"score": 0.8299999833106995,
"id": "https://metadata.un.org/sdg/10"
}
],
"study_designs": [],
"awards": [],
"funders": [],
"has_content": {
"pdf": true,
"grobid_xml": true
},
"content_urls": {
"pdf": "https://content.openalex.org/works/W1548525776.pdf",
"grobid_xml": "https://content.openalex.org/works/W1548525776.grobid-xml"
},
"referenced_works_count": 12,
"referenced_works": [
"https://openalex.org/W22827645",
"https://openalex.org/W296645084",
"https://openalex.org/W1985592855",
"https://openalex.org/W1997551918",
"https://openalex.org/W2000060120",
"https://openalex.org/W2033836251",
"https://openalex.org/W2040618871",
"https://openalex.org/W2049035091",
"https://openalex.org/W2065572164",
"https://openalex.org/W2089940945",
"https://openalex.org/W2134431612",
"https://openalex.org/W2168910503"
],
"related_works": [
"https://openalex.org/W2899084033",
"https://openalex.org/W2748952813",
"https://openalex.org/W3031052312",
"https://openalex.org/W3032375762",
"https://openalex.org/W1995515455",
"https://openalex.org/W2080531066",
"https://openalex.org/W3108674512",
"https://openalex.org/W1506200166",
"https://openalex.org/W2048182022",
"https://openalex.org/W2604872355"
],
"counts_by_year": [
{
"year": 2020,
"cited_by_count": 1
},
{
"year": 2019,
"cited_by_count": 2
},
{
"year": 2017,
"cited_by_count": 1
},
{
"year": 2016,
"cited_by_count": 1
},
{
"year": 2015,
"cited_by_count": 1
},
{
"year": 2014,
"cited_by_count": 4
},
{
"year": 2013,
"cited_by_count": 2
}
],
"updated_date": "2026-09-27T08:07:27.782135",
"created_date": "2025-10-10T00:00:00"
}