fSyrhO/Ogy
in
the
Schools
Volume
29.
April
1992
DETECTING POTENTIAL HUCKSTERISM
IN
META-ANALY SIS
USING
A FOLLOW-UP FAIL-SAFE TEST
JONATHAN
R.
BROWN
State University
of
New York
Meta-analysis is an analysis
of
analyses. It is a technique widely used by researchers
and practitioners to aggregate and summarize statistically reported empirical educa-
tional research. In
10
years, meta-analysis appeared more than
600
times in research
journals and dissertation abstracts. Although most meta-analyses were reported as
significant, few
of
the findings determined how many unpublished ”no-effect” studies,
if
sampled, would have invalidated significance.
If
significant meta-analysis results
are overrepresented through selective sampling, hucksterism in the form
of
sampling
bias exists. An explanation for using a follow-up test called the fail-safe Nis provided
with tables constructed to assist researchers and practitioners to estimate, without
calculation, the relative stability
of
meta-analysis results. The implication is that fail-
safe
N
should routinely be used and reported in meta-analysis research.
Whenever an educational controversy arises, reported research is sought to sup-
port a particular position. Educators often initiate a futile search for the “perfect” study.
They may also tend to cite only research that supports their personal biases. The old
research and the new, however, often remain isolated and variegated in a data base filled
with conflicting findings (Kavale, 1984). Meta-analysis is a process designed to help pro-
fessionals resolve conflicting research findings. The fail-safe
N
is a follow-up procedure
to assess meta-analysis results to detect possible misrepresentation,
or
hucksterism (selling
or
advertising in an aggressive and questionable way). The purpose of this article is to
describe briefly a way to use the fail-safe
N.
Meta-analysis is a widely used methodological technique to aggregate and summarize
statistically a number of empirical educational research studies analyzed to test a specified
research hypothesis. From 1981 to 1991, meta-analysis appeared more than
600
times
in abstracts of articles cited in Educational, Psychological, and Dissertation Abstracts.
Meta-analysis is important because it helps advance theory and knowledge. This ad-
vancement comes as the result of summarizations, theoretical linking
or
modeling across
a wide variety
of
samples, and suggesting that certain relationships are understood and
additional investigation is warranted. It is a technique that may be used with minimum
technical knowledge about complex statistics to draw meaningful relationships for every-
day applications (Brown
&
Brown, 1987).
The fail-safe Nstatistic is a follow-up test used with meta-analysis results to estimate
the number of new, unpublished,
or
unretrieved nonsignificant (null-result) studies that
would, on the average, change the significance of a meta-analysis study to nonsignificance.
Nonsignificance would result in concluding that the sampled studies were not congruent
with some specified research hypothesis analyzed by meta-analysis (Carson, Schriesheim,
&
Kinicki, 1990). The fail-safe
N
is based on initial work by Rosenthal (1979). Rosen-
thal’s work was later modified by Orwin (1983).
A significant meta-analysis study, Rosenthal(l979) reasoned, could be made non-
significant by adding some number of hypothetical studies that averaged null results.
Correspondence and requests for reprints should be addressed to Jonathan
R.
Brown, State University
of
New
York,
Fredonia,
NY
14063.
179
资源评论
weixin_38731385
- 粉丝: 2
- 资源: 871
最新资源
- 基于PLC的全自动洗衣机控制系统设计：硬件与软件的完美结合方案,基于PLC的全自动洗衣机控制系统设计详解含硬件和软件设计章节一套完整方案,基于PLC全自动洗衣机控制系统设计 含Word文档一整套 前
- 基于COMSOL的结晶凝固过程仿真：考虑温度场、浓度场、相变及物质偏析的全方位分析,COMSOL仿真模拟结晶过程：涵盖温度场、浓度场、相变及物质偏析等多元因素研究,comsol 仿真结晶，凝固，考虑温
- stm32 OLED显示模块 寄存器方式代码
- 基于Matlab的迁移学习技术用于滚动轴承故障诊断，振动信号转图像处理并高精度分类,基于Matlab的迁移学习滚动轴承故障诊断系统：高准确率，简易操作,Matlab 基于迁移学习的滚动轴承故障诊断 1
- 双缸水平蒸汽机3D 双缸水平蒸汽机
- 基于XAFS数据处理的拟合算法及小波变换应用研究,基于XAFS数据处理的拟合算法及小波变换应用研究,xafs数据处理，拟合，小波变 ,xafs数据处理; 拟合; 小波变换,Xafs数据处理与拟合的小波
- 无线通信Mimo系统中STBC空时编码与MRC最大比合并的性能比较研究（基于Matlab 2016b版本）,无线通信MIMO系统中的STBC空时编码与MRC最大比合并技术性能研究，基于Matlab 2
- 基于Python的Django-vue基于Spark的国漫推荐系统实现源码-说明文档-演示视频.zip
- C#实现多协议数据传输：OPC与DCS无DCOM配置读取及高效数据转发方案,C#实现无需DCOM配置的OPC与DCS数据传输：通过Socket转发至其他电脑或MODBUS/UDP协议实现高效数据读取与
- C语言基础入门学习笔记大纲.pdf
- 回溯组合问题_202503061306_54460.hinote
- 火狐判断安装_64位版本 (1).exe
- 基于python+PYQT开发的电子发票管理软件（源码+说明）
- 基于STM32F103C8T6与ATT7022芯片的三相交流电测量RTU-功能丰富、数据准确、稳定可靠的电能监控系统,基于STM32与ATT7022芯片的三相交流电测量RTU系统：集成电压、电流及多
- 回溯组合问题_202503061309_56587.pdf
- 基于python和豆包开发的根据提示词生成脚本 通过视频脚本调用微软tts生成语音功能的软件（源码）
资源上传下载、课程学习等过程中有任何疑问或建议，欢迎提出宝贵意见哦~我们会及时处理！
点击此处反馈
