第11讲+研究报告撰写指南-2012--社会研究方法A--教学课件.ppt

第第11讲 研究研究报告撰写指南告撰写指南IntroductionStandards for Reporting on Empirical Social Science Research in AERA Publications（美国教育研究会）Two overarching Principles for the GuidelinesSufficiency of warrantsTransparency of the reportReporting should make explicit the logic of inquiry and activities that led from the development of the initial interest,topic,problem,or research question;through the definition,collection,and analysis of data or empirical evidence;to the articulated outcomes of the study.Reporting that takes these principles into account permits scholars to understand one anothers work,prepares that work for public scrutiny,and enables others to use that work.Outlines1.Problem formulation2.Design and logic of the study3.Source of evidence4.Measurement and classification5.Analysis and interpretation6.Generalization7.Ethics in reporting8.Title,abstract,and headings.These choices can have a significant influence on how a problem is understood,what generalizations can be made,and the extent to which a work can contribute to addressing significant issues.Reporting needs to provide as comprehensive a picture as possible of what the problem is about and how it has been approached.1.Problem formulation(Concrete Requirements)1.1.The problem formulation should provide a clear statement of the purpose and scope of the study.1.2.Reporting should make clear how the study is a contribution to knowledge.1.3.Reporting should include a review of the relevant scholarship that bears directly on the topic of the report.1.4.The rationale for the conceptual,methodological,or theoretical orientation of the study should be described and explained with relevant citations to what others have written about it.1.5.A rationale should be provided for the problem formulation as it relates to the groups studied(especially with respect to relevant features of the historical,linguistic,social,and cultural backgrounds of the group)where questions about appropriateness of the connections may arise.In some situations and in some forms of research,aspects of designs can be well specified in advance;in other circumstances,these may evolve,and the initial research questions become more elaborate or focused,as researchers become more familiar with the contexts in which they work.Moreover,research designs often take account of constraints;some designs are more feasible or practical in certain research situations than others.2.Design and Logic(Concrete Requirements)Research reporting should follow a clear logic of inquiry that allows readers to trace the path from the initial statement of the problem,issue,or interest;to the review of the relevant scholarship and intellectual orientation of the study;to the research questions initiated and/or developed in the study;to the description of the site,group,and/or participants(demographic information);to the methodology guiding collection and analysis of evidence;to the interpretation and presentation of outcomes and understandings gained from the research process.There should be a coherent presentation of these aspects of the study,and it should be clear how the different parts of the study are related to each other.Data sources typically include participant and nonparticipant observations;unstructured or semi-structured interviews;documents and other artifacts;audio-or video-recordings;and standardized instruments like surveys or tests,structured interview protocols,and categorical demographic information that permit aggregation of data across cases or units of analysis.4.Measurement and Classification(in General)Measurement is the process by which behavior or observation is converted into quantities,which may,in turn,then be subjected to some kind of quantitative analysis.Classification refers to processes of segmenting data into units of analysis and categorizing or coding them.With qualitative methods in particular,classification is often considered integral to the data analysis.The validity of empirical studies depends,in part,on the claim that classifications and measurements preserve important characteristics of the phenomena they represent.Descriptions of the development of classifications and measurements,as well as evidence of their meaningfulness and appropriateness for capturing important characteristics of the groups or participants studied,are important elements of research reporting.Empirical investigations often involve a large number of data elements,some of which are more important to the logic of inquiry and interpretation of the investigation than others.It is important to distinguish key data elements that are crucial to the logic and interpretation of the outcomes.4.4.When transcriptions of audio-or video-recordings are provided,the conventions and symbols used to represent the discourse or characterize the actions or interactions should be clearly described and a rationale provided.4.5.A rationale should be provided for the relevance of a measurement or classification as capturing important characteristics of the group studied(especially with respect to relevant features of the historical,linguistic,social,and cultural background of the group)where questions about appropriateness might readily arise.5.Analysis and Interpretation(in General)5.1.The procedures used for analysis should be precisely and transparently described from the beginning of the study through presentation of the outcomes.Reporting should make clear how the analysis procedures address the research question or problem and lead to the outcomes reported.The relevance of the analysis procedures to the problem formulation should be made clear.5.2.Analytic techniques should be described in sufficient detail to permit understanding of how the data were analyzed and the processes and assumptions underlying specific techniques5.3.The analysis and presentation of the outcomes of the analysis should make clear how they support claims or conclusions drawn in the research.5.4.Analysis and interpretation should include information about any intended or unintended circumstances that may have significant implications for interpretation of the outcomes,limit their applicability,or compromise their validity.5.5.The presentation of conclusions should(a)provide a statement of how claims and interpretations address the research problem,question,or issue underlying the research;(b)show how the conclusions connect to support,elaborate,or challenge conclusions in earlier scholarship;and(c)emphasize the theoretical,practical,or methodological implications of the study.5.Analysis and Interpretation(with Quantitative Methods)5.6.Reporting should clearly state what statistical analyses were conducted and the appropriateness of the statistical tests,linking them to the logic of design and analysis and describing them in enough detail that they could be replicated by a competent data analyst.5.7.Descriptive and inferential statistics should be provided for each of the statistical analyses that is essential to the interpretation of the results.5.8.Any considerations that arose in the data collection and processing(e.g.,attrition,missing data,ceiling or floor effects,deviations from standard administration of instruments,suspected cheating)that might compromise the validity of the statistical analysis or inferences should be reported.5.9.Any considerations that are identified during the data analysis(e.g.,violations of assumptions of statistical procedures,failure of iterative statistical procedures to converge,changes in data analysis models necessitated by unexpected data patterns)that might compromise the validity of the statistical analyses or inferences should be reported.5.Analysis and Interpretation(with Qualitative Methods)5.11.The process of developing the descriptions,claims,and interpretations should be clearly described and illustrated.5.12.The evidence that serves as a warrant for each claim should be presented.5.13.Practices used to develop and enhance the warrant for the claims should be described,including the search for disconfirming evidence and alternative interpretations of the same evidence.5.14.Interpretive commentary should provide a deeper understanding of the claimshow and why the patterns described may have occurred;the social,cultural,or historical contexts in which they occurred;how they relate to one another;how they relate to(support or challenge)theory and findings from previous research;and what alternative claims or counter-claims were considered.6.GeneralizationSometimes the generalization intended is from a sample to a sampling frame(a population or universe).In this case,one logic that could support the generalization is embodied in the sampling theory of generalization.Sometimes the generalization intended is from a sample to a population,but the sample is not a probability sample from that population.In this case,an argument that is similar to the probability sampling argument is used,an argument that involves a claim that the sample is“representative,”a nontechnical term that usually means that the sample supports the same kind of generalization as a probability sample6.Generalization6.1.Whether generalization is intended by the author or not,it is crucial to make clear the specifics of the participants,contexts,activities,data collections,and manipulations involved in the study.6.2.When generalization is intended,the author should make clear the intended scope of generalization of the findings of the study.6.3.Generalization that is intended by the author should make clear the logic by which the findings of the study should apply within the intended scope of generalization.7.Ethics in Reporting7.1.Ethical considerations involved in data collection,analysis,and reporting should be explicitly addressed.7.2.Reporting on research and findings should be presented in a way that honors consent agreements with human participants and any other agreements with respect to gaining access to research sites or data.7.3.Reporting should include a description of any potential conflicts of interest or biases of the researcher that may have influenced or could have the appearance of influencing the research,along with a description of how they were managed in the conduct of the study.8.Title,Abstract,and Headings8.1.The title should clearly convey what the article is about.8.2.The abstract should provide a summary of the article that is self-contained,concise,and accurate.8.3.Headings and subheadings should make clear the logic of inquiry underlying the report.