Multimedia

The junior research group "Multimedia" is part of the research center CATALPA.

Fall back on proven sources and strategies or try out new ways? Which learning strategy leads to the goal or which learning strategy is used by learners is highly individual. In interactive, multimedia learning, this decision plays an important role. The Multimedia Junior Research Group has set itself the goal of better understanding and utilizing these processes.

Goals and research questions

In interactive multimedia learning with modern web-based technologies, learners need to balance their time between (a) processing information from known sources by available strategies and (b) investing time in seeking potential new sources of information and trying new ways to process it. It is the exploration-exploitation dilemma, which is as one of the most fundamental problem of human control of action and learning. For a long time, transferring from laboratory paradigms to real-world task was a hard step to take. While the controlling of this balance had been unobservable in the times of paper-based libraries and learning, online-based learning allows to (1) experimentally manipulate candidate factors influencing the balance between exploration and exploitation in natural settings that nevertheless allow for high levels of experimental control and to (2) track learning processes and outcomes. This research group aims to scrutinize how learners control the exploration-exploitation dilemma. It further aims to provide the bases for adaptive support of learners by predicting which events alter their processing strategies.

  • Dr. Fang Zhao

  • April 2021 through June 2024

  • 2022

    Journals

    • Aufschnaiter, S., Zhao, F., Gaschler, R., Kiesel, A., & Thomaschke, R. (2022). Investigating time-based expectancy beyond binary timing scenarios: Evidence from a paradigm employing three predictive pre-target intervals. Psychological Research, 86(2007-2020). https://doi.org/10.1007/s00426-021-01606-2
    • Leh, A., Langhanns, C., Zhao, F., Gaschler, R., & Müller, H. (2022). Muscle activity in explicit and implicit sequence learning: Exploring additional measures of learning and certainty via tensor decomposition. Acta Psychologica, 226, 103587. https://doi.org/10.1016/j.actpsy.2022.103587
    • Zhao, F., Gaschler, R., Schnotz, W., & Wagner, I. (2022). Lower grade students tend to give up early in multimedia learning. European Journal of Psychology of Education. https://doi.org/10.1007/s10212-022-00612-1

    2021

    Journals

    Other Publications

    • Zhao, F., Schäfter, L. O., Rijn, L. van, & Wöhrle, J. (2021). Snails on the chase: How to cope with anxiety in academic career. In Elephant in the lab. https://doi.org/https://doi.org/10.5281/zenodo.5574873

    2020

    Journals

    • Zhao, F., Gaschler, R., Kneschke, A., Radler, S., Duttine, C., & Haider, H. (2020). Origami folding: Taxing resources necessary for the acquisition of sequential skills. PLoS ONE, 15(10), e0240226. https://doi.org/10.1371/journal. pone.0240226
    • Zhao, F., Gaschler, R., Nöhring, O., Röttger, E., & Haider, H. (2020). Sequential modulation of across-task congruency in the serial reaction time task. Acta Psychologica, 205(103043). https://doi.org/10.1016/j.actpsy.2020.103043
    • Zhao, F., Gaschler, R., Schnotz, W., & Wagner, I. (2020). Regulating distance to the screen while engaging in difficult tasks. Frontline Learning Research, 8(6), 59–76. https://doi.org/10.14786/flr.v8i6.663
    • Zhao, F., Schnotz, W., Wagner, I., & Gaschler, R. (2020). Texts and pictures serve different functions in conjoint mental model construction and adaptation. Memory & Cognition, 48(1), 69–82. https://doi.org/10.3758/s13421-019-00962-0

    2019

    Journals

    • Gaschler, R., Zhao, F., Röttger, E., Panzer, S., & Haider, H. (2019). More than hitting the correct key quickly: Spatial variability in touch screen response location under multitasking in the serial reaction time task. Experimental Psychology, 66(3), 207–220. https://doi.org/10.1027/1618-3169/a000446
    • Röttger, E., Haider, H., Zhao, F., & Gaschler, R. (2019). Implicit sequence learning despite multitasking: The role of across-task predictability. Psychological Research, 83(3), 526–543. https://doi.org/10.1007/s00426-017-0920-4
    • Zhao, F., Gaschler, R., Thomaschke, R., Röttger, E., & Haider, H. (2019). Sequence knowledge on “when” and “what” supports dual tasking. Journal of Cognition, 2(1), 18. https://doi.org/10.5334/joc.76

    2018

    Journals

    • Gaschler, R., Kemper, M., Zhao, F., Pumpe, I., Ruderisch, C.-B., Röttger, E., & Haider, H. (2018). Differential effects of cue-based and sequence knowledge-based predictability on multitasking performance. Acta Psychologica, 191, 76–86. https://doi.org/https://doi.org/10.1016/j.actpsy.2018.09.004
    • Zhao, F., Gaschler, R., Travi, T., Imgrund, B., Kossack, V., Röttger, E., & Haider, H. (2018). Effects of overlap between consecutive words on speeded typing inform about representation of serial order within words. Advances in Cognitive Psychology, 14(3), 139–149. https://doi.org/10.5709/acp-0244-6
    • Zhao, F., & Mahrt, N. (2018). Influences of comics expertise and comics types in comics reading. International Journal of Innovation and Research in Educational Sciences, 5(2), 2349–5219.

    2017

    Journals

    • Broeker, L., Kiesel, A., Aufschnaiter, S., Ewolds, H. E., Gaschler, R., Haider, H., Künzell, S., Raab, M., Röttger, E., Thomaschke, R., & Zhao, F. (2017). Why prediction matters in multitasking and how predictability can improve it. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.02021

    Chapters in Books

    • Schnotz, W., Wagner, I., Zhao, F., Ullrich, M., Horz, H., McElvany, N., Ohle, A., & Baumert, J. (2017). Development of dynamic usage of strategies for integrating text and picture information in secondary schools. In Methodology of Educational Measurement and Assessment (pp. 303–313). Springer International Publishing.
Research Center CATALPA | 14.12.2022