{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T23:24:49Z","timestamp":1762298689308,"version":"3.41.0"},"reference-count":34,"publisher":"Wiley","issue":"7","license":[{"start":{"date-parts":[[2017,10,13]],"date-time":"2017-10-13T00:00:00Z","timestamp":1507852800000},"content-version":"vor","delay-in-days":12,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Computer Graphics Forum"],"published-print":{"date-parts":[[2017,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>MOOCs (Massive Open Online Courses) are increasingly prevalent as an online educational resource open to everyone and have attracted hundreds of thousands learners enrolling these online courses. At such scale, there is potentially rich information of learners' behaviors embedded in the interactions between learners and videos that may help instructors and content producers adjust the instructions and refine the online courses. However, the lack of tools to visualize information from interactive data, including messages left to the videos at particular timestamps as well as the temporal variations of learners' online participation and perceived experience, has prevented people from gaining more insights from video\u2010watching logs. In this paper, we focus on extracting and visualizing useful information from time\u2010anchored comments that learners left to specific time points of the videos when watching them. Timestamps as a kind of metadata of messages can be useful to recover the interactive dynamics of learners occurring around the videos. Therefore, we present a visualization system to analyze and categorize time\u2010anchored comments based on topics and content types. Our system integrates visualization methods of temporal text data, namely ToPIN and ThemeRiver, which can help people understand the quality and quantity of online learners' feedback and their states of learning. To evaluate the proposed system, we visualized time\u2010anchored commenting data from two online course videos, and conducted two user studies participated by course instructors and third\u2010party educational evaluators. The results validate the usefulness of the approach and show how the quantitative and qualitative visualizations can be used to gain interesting insights around learners' online learning behaviors.<\/jats:p>","DOI":"10.1111\/cgf.13280","type":"journal-article","created":{"date-parts":[[2017,10,13]],"date-time":"2017-10-13T09:25:12Z","timestamp":1507886712000},"page":"145-155","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Exploring Online Learners' Interactive Dynamics by Visually Analyzing Their Time\u2010anchored Comments"],"prefix":"10.1111","volume":"36","author":[{"given":"Ching\u2010Ying","family":"Sung","sequence":"first","affiliation":[{"name":"National Chiao Tung University Hsinchu Taiwan"}]},{"given":"Xun\u2010Yi","family":"Huang","sequence":"additional","affiliation":[{"name":"National Chiao Tung University Hsinchu Taiwan"}]},{"given":"Yicong","family":"Shen","sequence":"additional","affiliation":[{"name":"National Chiao Tung University Hsinchu Taiwan"}]},{"given":"Fu\u2010Yin","family":"Cherng","sequence":"additional","affiliation":[{"name":"National Chiao Tung University Hsinchu Taiwan"}]},{"given":"Wen\u2010Chieh","family":"Lin","sequence":"additional","affiliation":[{"name":"National Chiao Tung University Hsinchu Taiwan"}]},{"given":"Hao\u2010Chuan","family":"Wang","sequence":"additional","affiliation":[{"name":"National Tsing Hua University Hsinchu Taiwan"}]}],"member":"311","published-online":{"date-parts":[[2017,10,13]]},"reference":[{"key":"e_1_2_10_2_2","first-page":"13","article-title":"Studying learning in the worldwide classroom: Research into edX's first MOOC","volume":"1","author":"Breslow L.","year":"2013","journal-title":"Research and Practice in Assessments"},{"doi-asserted-by":"publisher","key":"e_1_2_10_3_2","DOI":"10.1109\/TVCG.2008.166"},{"doi-asserted-by":"crossref","unstructured":"ChenY. ChenQ. ZhaoM. BoyerS. VeeramachaneniK. QuH.:DropoutSeer: Visualizing learning patterns in massive open online courses for dropout reasoning and prediction. IEEE VAST(2016). 3","key":"e_1_2_10_4_2","DOI":"10.1109\/VAST.2016.7883517"},{"doi-asserted-by":"publisher","key":"e_1_2_10_5_2","DOI":"10.1109\/TVCG.2011.239"},{"volume-title":"Tech. rep.","year":"2013","author":"Cross S.","key":"e_1_2_10_6_2"},{"doi-asserted-by":"publisher","key":"e_1_2_10_7_2","DOI":"10.1111\/cgf.12919"},{"doi-asserted-by":"crossref","unstructured":"FaridaniS. BittonE. RyokaiK. GoldbergK.:Opinion space: a scalable tool for browsing online comments. In CHI(2010) pp.1175\u20131184. 3","key":"e_1_2_10_8_2","DOI":"10.1145\/1753326.1753502"},{"doi-asserted-by":"publisher","key":"e_1_2_10_9_2","DOI":"10.1109\/TVCG.2016.2598444"},{"doi-asserted-by":"crossref","unstructured":"GuoP.J. KimJ. RubinR.:How video production affects student engagement: An empirical study of mooc videos. In L@S(2014) pp.41\u201350. 1 3","key":"e_1_2_10_10_2","DOI":"10.1145\/2556325.2566239"},{"doi-asserted-by":"publisher","key":"e_1_2_10_11_2","DOI":"10.1111\/cgf.12378"},{"doi-asserted-by":"publisher","key":"e_1_2_10_12_2","DOI":"10.1109\/2945.981848"},{"doi-asserted-by":"crossref","unstructured":"HuronS. IsenbergP. FeketeJ.D.:PolemicTweet: Video annotation and analysis through tagged tweets. In INTERACT'13.2013 pp.135\u2013152. 3","key":"e_1_2_10_13_2","DOI":"10.1007\/978-3-642-40480-1_9"},{"doi-asserted-by":"crossref","unstructured":"HuM. LiuB.:Mning and summarizing customer reviews. In ACM SIGKDD(2004) pp.168\u2013177. 4","key":"e_1_2_10_14_2","DOI":"10.1145\/1014052.1014073"},{"unstructured":"HuangA.:Similarity measures for text document clustering. In Proceedings of the Sixth New Zealand Computer Science Research Student Conference(2008) pp.49\u201356. 3","key":"e_1_2_10_15_2"},{"doi-asserted-by":"crossref","unstructured":"KimJ. GuoP.J. CaiC.J. LiS.\u2010W. D. GajosK.Z. MillerR.C.:Data\u2010driven interaction techniques for improving navigation of educational videos. In UIST(2014) pp.563\u2013572. 2 3","key":"e_1_2_10_16_2","DOI":"10.1145\/2642918.2647389"},{"doi-asserted-by":"crossref","unstructured":"KimJ. GuoP.J. SeatonD.T. MitrosP. GaiosK.Z. MillerR.C.:Understanding in\u2010video dropouts and interaction peaks in online lecture videos. In L@S(2014) pp.31\u201340. 1 2 3","key":"e_1_2_10_17_2","DOI":"10.1145\/2556325.2566237"},{"issue":"6","key":"e_1_2_10_18_2","first-page":"78","article-title":"Techniques for evaluating training programs","volume":"33","author":"Kirkpatrick D.L.","year":"1979","journal-title":"Training and Development Journal"},{"doi-asserted-by":"crossref","unstructured":"KayeJ. LillieA. JagdishD. WalkupJ. ParadaR. MoriK.:Nokia internet pulse: a long term deployment and iteration of a twitter visualization. In CHI Extended Abstracts(2012) pp.829\u2013844. 2","key":"e_1_2_10_19_2","DOI":"10.1145\/2212776.2212856"},{"doi-asserted-by":"crossref","unstructured":"LeeY.\u2010C. LinW.\u2010C. CherngF.\u2010Y. WangH.\u2010C. SungC.\u2010Y. KingJ.\u2010T.:Using time\u2010anchored peer comments to enhance social interaction in online educational videos. In CHI(2015). 1 6 10","key":"e_1_2_10_20_2","DOI":"10.1145\/2702123.2702349"},{"doi-asserted-by":"crossref","unstructured":"LiJ. MalikS. SmithA. PapadatosP.:TopicFlow: Visualizing topic alignment of twitter data over time. International Conference on Advances in Social Networks Analysis and Mining(2013) 720\u2013726. 2","key":"e_1_2_10_21_2","DOI":"10.1145\/2492517.2492639"},{"doi-asserted-by":"publisher","key":"e_1_2_10_22_2","DOI":"10.1109\/TVCG.2010.194"},{"doi-asserted-by":"publisher","key":"e_1_2_10_23_2","DOI":"10.1016\/j.ijhcs.2006.08.008"},{"doi-asserted-by":"publisher","key":"e_1_2_10_24_2","DOI":"10.1108\/JD-06-2012-0078"},{"doi-asserted-by":"publisher","key":"e_1_2_10_25_2","DOI":"10.1561\/1500000011"},{"doi-asserted-by":"publisher","key":"e_1_2_10_26_2","DOI":"10.3115\/1118693.1118704"},{"issue":"10","key":"e_1_2_10_27_2","first-page":"2315","article-title":"PeakVizor: Visual analytics of peaks in video clickstreams from massive open online courses","volume":"22","author":"Qing C.","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph"},{"doi-asserted-by":"publisher","key":"e_1_2_10_28_2","DOI":"10.1145\/2500876"},{"doi-asserted-by":"crossref","unstructured":"ShiC. FuS. ChenQ. QuH.:VisMOOC: Visualizing video clickstream data from massive open online courses. In IEEE Pacific Visualization Symposium (PacificVis)(2015) pp.159\u2013166. 1 2 3","key":"e_1_2_10_29_2","DOI":"10.1109\/PACIFICVIS.2015.7156373"},{"doi-asserted-by":"crossref","unstructured":"Stephens\u2010MartinezK. HearstM.A. FoxA.:Monitoring MOOCs: which information sources do instructors value? In L@S(2014) pp.79\u201388. 1 2 10","key":"e_1_2_10_30_2","DOI":"10.1145\/2556325.2566246"},{"doi-asserted-by":"crossref","unstructured":"SopanA. ReyP.J. ButlerB. ShneidermanB.:Monitoring academic conferences: Real\u2010time visualization and retrospective analysis of backchannel conversations. In International Conference on Social Informatics(2012) pp.62\u201369. 3","key":"e_1_2_10_31_2","DOI":"10.1109\/SocialInformatics.2012.20"},{"doi-asserted-by":"crossref","unstructured":"SunZ. SunM. CaoN. MaX.:VideoForest: interactive visual summarization of video streams based on danmu data. In SIGGRAPHASIA 2016 Symposium on Visualization(2016) p.10. 3","key":"e_1_2_10_32_2","DOI":"10.1145\/3002151.3002159"},{"doi-asserted-by":"publisher","key":"e_1_2_10_33_2","DOI":"10.1109\/TVCG.2014.2346919"},{"doi-asserted-by":"publisher","key":"e_1_2_10_34_2","DOI":"10.1109\/TVCG.2014.2346920"},{"doi-asserted-by":"crossref","unstructured":"WattenbergM. MillenD.:Conversation thumbnails for large\u2010scale discussions. In CHI Extended Abstracts(2003) pp.742\u2013743. 3","key":"e_1_2_10_35_2","DOI":"10.1145\/765891.765963"}],"container-title":["Computer Graphics Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fcgf.13280","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cgf.13280","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,26]],"date-time":"2025-06-26T13:21:18Z","timestamp":1750944078000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/cgf.13280"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10]]},"references-count":34,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2017,10]]}},"alternative-id":["10.1111\/cgf.13280"],"URL":"https:\/\/doi.org\/10.1111\/cgf.13280","archive":["Portico"],"relation":{},"ISSN":["0167-7055","1467-8659"],"issn-type":[{"type":"print","value":"0167-7055"},{"type":"electronic","value":"1467-8659"}],"subject":[],"published":{"date-parts":[[2017,10]]},"assertion":[{"value":"2017-10-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}