#ESMARConf2025 is live now (https://www.youtube.com/@esmarconf), starting with a talk by @ASanchez_Tojar on "Practising what we preach: Rethinking standards in meta-analysis for ecology and evolution".

At 11am (CEST), I will give a talk on how to visualize the amount of heterogeneity in forest plots.

#MetaAnalysis #Rstats #EvidenceSynthesis #ResearchSynthesis

Before you continue to YouTube

Together with colleagues from Spain, we recently conducted a comprehensive simulation study examining the performance of various types of tests and methods for constructing confidence intervals for the scale coefficients in meta-analytic location-scale models. Although things are complex, generally the likelihood-ratio test and corresponding profile-likelihood intervals performed best. See here for further details: https://doi.org/10.3758/s13428-025-02622-5

#Statistics #MetaAnalysis #ResearchSynthesis

Performance of location-scale models in meta-analysis: A simulation study - Behavior Research Methods

Location-scale models in the field of meta-analysis allow researchers to simultaneously study the influence of moderator variables on the mean (location) and variance (scale) of the distribution of true effects. However, the increased complexity of such models can make model fitting challenging. Moreover, the statistical properties of the estimation and inference methods for such models have not been systematically examined in the meta-analytic context. We therefore conducted a Monte Carlo simulation study to compare different estimation methods (maximum or restricted maximum likelihood estimation), significance tests (Wald-type, permutation, and likelihood-ratio tests), and methods for constructing confidence intervals (Wald-type and profile-likelihood intervals) for the scale coefficients of such models. When restricted maximum likelihood estimation was used, slightly closer to nominal rejection rates and narrower confidence intervals were obtained. The permutation test yielded type I error rates closest to the nominal level, whereas the likelihood-ratio test obtained the highest statistical power. In most scenarios, profile-likelihood intervals showed lower coverage probabilities than the Wald-type method but closer to the nominal 95% level. Finally, slightly higher rejection rates and coverage probabilities were obtained when a dichotomous moderator was examined rather than a continuous one. Despite the need to use some constraints on the parameter space for the scale coefficients and the possibility of non-convergence of some procedures that may affect the fitting of the specified models, location-scale models proved to be a valid and useful tool for modeling the heterogeneity parameter in meta-analysis.

SpringerLink

1/3 In a recent paper, we described the use of location-scale models in meta-analysis to not only examine how moderators may be related to the size of the effect, but also how moderators may be related to the amount of heterogeneity among the effects: https://doi.org/10.1002/jrsm.1562

Such models can be fit with the metafor package in R: https://wviechtb.github.io/metafor/reference/rma.uni.html#location-scale-models

#statistics #MetaAnalysis #EvidenceSynthesis #ResearchSynthesis #Rstats

Stopping #ClimateChange protects human health. The DESTINY project helps to pool the knowledge!

@wellcometrust has commissioned a consortium led by @MCC_Berlin

researchers to push the boundaries of #ResearchSynthesis through #ArtificialIntelligence.

https://www.mcc-berlin.net/en/news/information/information-detail/article/stopping-climate-change-protects-human-health-a-major-project-helps-to-pool-the-knowledge.html

Stopping climate change protects human health – a major project helps to pool the knowledge

The Wellcome Trust has commissioned a consortium led by MCC researchers to push the boundaries of research synthesis through artificial intelligence.

New paper has just been published! amstar2Vis is our new R package for AMSTAR 2 assessment presentation ➡️
https://onlinelibrary.wiley.com/doi/full/10.1002/jrsm.1705

#rstats #DataViz #ggplot2 #SystematicReview #EvidenceSynthesis
#R #ResearchSynthesis

Nice to see Georgia Salanti (@geointheworld) joining Mastodon. If you are interested in research synthesis and (network) meta-analysis, give her a follow! #MetaAnalysis #ResearchSynthesis

#ResearchSynthesis folks!
I created an R script to scrape #googleScholar search results to save you (and me) the tedious clicking.

Put in your search string and number of search results you need and get a csv. Use it, share it, improve it.

#metaanalysis

https://github.com/j-5chneider/sysreview/blob/master/scrape_google_scholar/scrape_google_scholar.R

sysreview/scrape_google_scholar/scrape_google_scholar.R at master · j-5chneider/sysreview

Contribute to j-5chneider/sysreview development by creating an account on GitHub.

GitHub
Interested in what people think is necessary in systematic reviews in #hci? Have a look at the results of our informal survey: https://bit.ly/hcisysrevs-informalsurvey #researchsynthesis #systematicreviews
HCI Systematic Review-lution

A landing page and collection of resources for a movement towards more rigorous and useful systematic reviews in human-computer interaction (HCI).

HCI Systematic Review-lution

If you use AMSTAR 2 tool to assess many reviews in your study, check the {amstar2} package. It includes three easy-to-use functions:
1. amstar2_gtable()
2. amstar2_barplot()
3. amstar2_overall()

➡️ https://github.com/bougioukas/amstar2

#rstats #DataViz #ggplot2 #SystematicReview #EvidenceSynthesis #R #ResearchSynthesis

GitHub - bougioukas/amstar2: A package for the AMSTAR 2 checklist.

A package for the AMSTAR 2 checklist. Contribute to bougioukas/amstar2 development by creating an account on GitHub.

GitHub

At this year's ZPID ressyn-bigdata.org symposium, we had most exciting keynotes on #BigData and #ResearchSynthesis in #psychology.

You can watch the videos here: https://zpid.cloud.panopto.eu/Panopto/Pages/Sessions/List.aspx#

Slides, posters, and more: https://www.psycharchives.org/en/browse/?q=%22Big+Data+%26+Research+Syntheses+2023%2C+Frankfurt%2C+Germany%22

#AI #OpenScience #ML

Panopto

Capture, manage, and search all your video content.

Panopto