James E. Pustejovsky

@jepusto.bsky.social

1548 Followers 839 Following

Statistician interested in meta-analysis, data science, R, special education. Associate Professor at UW Madison. Also @jepusto@fediscience.org https://jepusto.com

Given what is needed to improve the P-curve tests, we do not recommend their use in their current form. Their statistical properties are problematic and it is not clear what substantive conclusions they afford. Given the stated purpose of the P-curve—evaluating the trustworthiness of scientific literatures—the stakes are too high to use tests with such poor, or poorly-understood, properties.
Simulation is a powerful tool and can help build intuition, but it is not a substitute for formal analysis. Simulation may provide hints of problems with a procedure, but only if the simulator’s formal knowledge helps guide the choice of simulations. A simulator might quit after running a few simulations that tell them what they think is true while problems remain uncovered. Given the implications of poor forensic procedures for science, all such procedures demand deeper formal scrutiny.
Code and output for R. The output shows an estimate of 1273 with a Std. Error of 770.
Code and output for R. The output shows an estimate of 1273 with a Std. Error of 770.
Code and output for R. The output shows an estimate of 1273 with a Std. Error of 781.
AERA Systematic Review and Meta-Analysis SIG Online Seminar Series Friday, October 18, 2024 7 am PDT / 8 am MDT / 9 am CDT / 10 am EDT / 14.00 UTC Fitting Flexible Meta-Analytic Models with Structural Equation Modeling Dr. Mike Cheung National University of Singapore More details and registration at https://www.srmasig.org/seminar/upcoming-seminars/
AERA Systematic Review and Meta-Analysis SIG Upcoming 2024 Events Fridays 9-10 am Pacific, 10-11 am Mountain, 11-12 noon Central, 12-1 Eastern, 16.00-17.00 UTC Sep 27: Getting Meta-Analysis Done: A Panel Discussion with Experienced Reviewers Carlton Fong, Peng Peng, and Amanda Neitzel Oct 18: Fitting Flexible Meta-Analytic Models with Structural Equation Modeling Mike Cheung Note special start time of 8 am MDT / 9 am CDT / 10 am EDT / 16 CEST Nov 15: Using GPT API models as second screeners of titles and abstracts in high-quality systematic reviews Mikkel Vembye Dec 13: Friday the 13th and Single Case Experimental Designs: Allegedly Unlucky Encounters for Meta-Analysts John Ferron and Megan Kirby
AERA Systematic Review and Meta-Analysis SIG Online Seminar Series Friday, May 17, 2024 9-10 am Pacific / 10-11 am Mountain / 11-12 noon Central / 1-2 pm Eastern / 16-17:00 UTC Investigating Patterns of Fadeout using MERF, the Meta-Analysis of Educational RCTs with Follow-up Emma Hart Teachers College, Columbia University More details and registration at https://www.srmasig.org/seminar/upcoming-seminars/
AERA Systematic Review and Meta-Analysis SIG Online Seminar Series Friday, April 19, 2024 9-10 am Pacific / 10-11 am Mountain / 11-12 noon Central / 1-2 pm Eastern / 16-17:00 UTC ESHackathon: Unlocking Evidence Synthesis Through Innovation Matthew Grainger Norwegian Institute for Nature Research
AERA Systematic Review and Meta-Analysis SIG Online Seminar Series Friday, March 15, 2024 9-10 am Pacific / 10-11 am Mountain / 11-12 noon Central / 1-2 pm Eastern / 16-17:00 UTC Enhancing Reliability in Automated Record Screening: A Resampling Algorithm Zhipeng Hou Northwestern University
AERA Systematic Review and Meta-Analysis SIG Online Seminar Series Speaker: Dr. Marta Topor, Postdoctoral Fellow, Linköping University Title: Overcoming Barriers to Conducting Systematic Reviews of Non-intervention Research Date: Friday, February 16, 2024 9-10 am Pacific / 10-11 am Mountain / 11-12 noon Central / 12-1 pm Eastern / 16-17 UTC
AERA Systematic Review and Meta-Analysis SIG Online Seminar Series Dr. Kaitlyn Fitzgerald Azusa Pacific University Knowledge Mobilization and Lessons for Communicating Meta-Analytic Results Friday, December 8, 2023 9-10 am PST / 10-11 am MST / 11-12 am CST / 12-1 pm EST / 16:00 UTC
META-ANALYSIS SIG ONLINE SEMINAR SERIES František Bartoš, University of Amsterdam Robust Bayesian Meta-Regression — Model-Averaged Moderation Analysis in the Presence of Publication Bias Date: Friday, November 17, 2023 9-10 am Pacific, 10-11 am Mountain, 11am-12 noon Central, 12-1 pm Eastern, 16:00-17:00 UTC
META-ANALYSIS SIG ONLINE SEMINAR SERIES Julia Littell, Bryn Mawr College The Logic of Generalization from Systematic Reviews and Meta-analysis Date: Friday, October 20, 2023 9-10 am Pacific, 10-11 am Mountain, 11am-12 noon Central, 12-1 pm Eastern, 16:00-17:00 UTC
Painting of portly man with an underbite, wearing a black suit while sitting in a high-backed arm chair. The background has a black and dirty white checkered floor and dirty off-white walls. On the wall it says “EL ACADEMICO” with a red arrow pointing to the man. Signed “SEGUI” in the upper right corner.
“Philosophy matters to practitioners because they use it to guide their practice; even those who believe themselves quite exempt from any philosophical influence are usually the slaves of some defunct methodologist.”
AERA Systematic Review and Meta-Analysis SIG Online Seminar Series Friday, September 22, 2023 9-10 am Pacific / 10-11 am Mountain / 11-12 noon Central / 1-2 pm Eastern / 16-17:00 UTC Designing for Epistemic Uncertainty in Research Synthesis Dr. Alexander Kale University of Chicago
AERA Systematic Review and Meta-Analysis SIG Online Seminar Series Fall 2023 Schedule 9-10 am Pacific / 10-11 am Mountain / 11-12 noon Central / 1-2 pm Eastern / 16-17:00 UTC 9/22/2023 Designing for Epistemic Uncertainty in Research Synthesis Dr. Alex Kale 10/20/2023 The logic of generalization from systematic reviews of intervention effects in policy and practice contexts Dr. Julia Littell 11/17/2023 Robust Bayesian meta-regresssion: Model-averaged moderation analysis in the presence of publication bias Frantisek Bartos 12/8/2023 Knowledge mobilization and lessons for communicating meta-analytic results Dr. Kaitlyn G. Fitzgerald More information: https://www.srmasig.org/seminar/ https://twitter.com/SRMA_SIG