报告人：马欣 教授

主持人：范良火 教授

时  间：2020/10/10 周六上午 8:30-9:30 am

地  点：线上会议 钉钉ID：32251333

报告人简介：

  马欣博士是美国肯塔基大学定量和心理测量方法的全职教授和项目协调员。他教授高级统计学课程（例如，元分析、多级数据分析和数据挖掘技术）。他是（美国）国家教育学院的斯宾塞研究员，美国教育研究协会早期职业贡献奖的获得者，（前）加拿大国家数据库研究中心创始人和（前）主任。他的研究方向包括高级统计（定量）方法、大型（国家、国家和国际）调查的高级数据分析、数学教育心理学、课程评估和政策分析以及组织（学校）的有效性和改进。他致力于推进定量研究，利用最新的统计理论和模型，改进和加强对教育政策和实践中关键问题的定量分析。在他众多的出版物中，他是《美国数学参与的国家评估：描述学生学术生涯的生存分析模型》一书的作者。马欣教授是亚洲数学教育中心学术委员会委员。

报告内容简介：

Instrument validation is a critically important issue in the measurement and evaluation of human behaviors. Often, data do not come from individuals of interest, but from other individuals with close knowledge or experience about the individuals of interest, creating therefore data hierarchy. Previous methods for instrument validation ignore this data hierarchy. They are not appropriate and may produce serious biases concerning the instruments. This presentation is about a breakthrough in instrument valuation. One illustrative example assesses an instrument that uses responses from teachers to measure principal behaviors. To account for the data hierarchy of teachers nested within schools, we employ a multilevel confirmatory factor analysis and estimate multilevel (teacher and school) reliabilities to examine the instrument. We find that when teachers provide responses as indicators of principal behaviors, the instrument can generate a valid and highly reliable measure or estimate of principal behaviors at the school level. However, data analysis at the teacher level attempting to use teacher perceptions of principal behaviors as either dependent variables or independent variables should be avoided because of the low reliability at the teacher level.

Keywords: multilevel confirmatory factor analysis, multilevel reliability analysis.