Data (analytics) informed (e)Teaching and (e)Learning: Learning Analytics Short Course

Saturday, April 21, 2018

Learning Analytics Short Course

https://datainformedelearning.blogspot.sg/2018/04/learning-analytics-short-course.html

Message from the workshop organisers:

Dear participants,

Thank you for participating in this Learning Analytics (LA) Short Course.

To take full advantage of this opportunity, we recommend the following process.

1. The session objectives, pre-reading, and pre-workshop reflection exercise is outlined in the course blog, which has been emailed out to you one week before.

https://datainformedelearning.blogspot.com/2018/04/learning-analytics-short-course.html

Please allocate one hour to the pre-session reflection exercise, using the resources of the course blog as a content buffet, to start your thinking process.

Please make sure you make a record of your pre-session reflections, which we request that each participant email back to the organisers by 8am Monday, June 11, 2018, one day before the session.

2. During the interactive group activity on Tuesday, 11 June, we will work on your reflection exercise individually, and as a group, before sharing this amongst the participants.

3. The organisers envisage that this process will form the foundation for the next stage in the planning and implementation of LA use at NUHS.

__________________

Session Objectives

1. The definition of learning analytics

2. Types of learning analytics and their purpose in education

3. Tools in supporting learning analytics

4. How data-driven decision making differ from traditional decision making and the potential future implications of this transition.

5. How to draw/determine real time and predictive data about students and trainees data

PRE-SESSION ACTIVITY

1. Read the following articles

Goh, P.S. Learning Analytics in Medical Education. MedEdPublish. 2017 Apr; 6(2), Paper No:5. Epub 2017 Apr 4. https://doi.org/10.15694/mep.2017.000067 and SlideShare presentation by Rebecca Ferguson

https://www.slideshare.net/R3beccaF/learning-analytics-the-way-forward

https://www.jisc.ac.uk/reports/learning-analytics-in-higher-education

http://brownemblog.com/blog-1/2018/3/10/aem-education-and-training-learning-analytics-in-medical-education-assessment

(Podcast)

https://er.educause.edu/articles/2012/7/learning-analytics-the-new-black

https://cloudplatform.googleblog.com/2013/11/kaplan-builds-online-education-platform-kapx-with-google-app-engine.html

https://edu.google.com/latest-news/stories/strayer-university-gcp/?modal_active=none

https://www.cio.com/article/3153389/it-industry/how-small-data-became-bigger-than-big-data.html

https://www.mckinsey.com/business-functions/operations/our-insights/the-ceo-guide-to-customer-experience

2. Prepare the following, BEFORE the workshop.

Reflect on your roles in medical education and clinical training. Make notes on the following, which we will add to during the "live" session.

What data do you currently have about students and trainees?

What data do you feel we should collect?

What analysis are we currently doing with this data?

What could we be doing?

How can data, and analysis (of this data) improve our education and training efforts?

How could we do this?

Session takeaways:

7 byte-size ideas from Poh-Sun

https://www.slideshare.net/dnrgohps/data-analytics-informed-eteaching-and-elearning-7-byte-size-ideas

and

5 (more) short takeaways from Poh-Sun

1 - Arguably the aim (outcome) of any learning session is to be able to THINK about (have a conversation), DO, and have a FEEL (opinion) about something, at the end of the educational and training process. Or gain Knowledge, Skills, and (form or change) Attitudes (KSA).

For this topic, when starting out, the material and terminology will feel unfamiliar at the beginning. With further reading, review of more material, repeatedly coming back to the topic, discussing and working through the ideas with other participants, colleagues and collaborators; starting and continuing to USE these ideas, you will progressively increase insight, understanding and skill in this area. Keep going. One step at a time. Iteratively. The more one thinks about, and uses ideas and strategies, the more one becomes familiar with, and confident in a topic, or area of professional practice.

2 - Start with the your goal or objective as a teacher or educator. What is your learning objective(s)? How will you know this is (being) achieved? What data, evidence, and observations inform you (that this has been accomplished)?

3 - Increasingly education, learning and training will be technology mediated, technology facilitated, and technology enhanced. Take advantage of your delivery and engagement platform and process to gather this data and evidence. In real time. To inform, and further customise your educational offering. Similar to what you are familiar with in a traditional classroom and training setting.

4 - Customisation and personalisation (personal learning) may simply require offering a "buffet" of (digital) content, and training scenarios, to suit individual preference and choice, for a specific purpose, at a specific time. Or use a "well stocked" digital repository for instructor facilitated, and specifically curated teaching and learning.

5 - Technology enhanced Learning (TeL) makes what we teach with, and assess on visible, accessible, and assessable. We can "show what we teach with, and assess on". For students, trainees, peers, colleagues, administrators. In fact all potential stakeholders. To make this (data) available as evidence of scholarly activity, and educational scholarship (the Scholarship of Teaching and Learning, or SOTL).

https://datainformedelearning.blogspot.sg/2018/01/bite-or-byte-size-tips-for-using.html

https://datainformedelearning.blogspot.sg/2017/11/using-data-analytics-to-inform.html

https://datainformedelearning.blogspot.sg/2017/11/how-to-use-data-analytics-to-inform.html

https://medicaleducationelearning.blogspot.sg/2017/10/requirements-for-data-informed-personal.html

https://medicaleducationelearning.blogspot.sg/2017/09/applied-learning-analytics-for-modular.html

https://medicaleducationelearning.blogspot.sg/2017/03/learning-analytics-in-medical-education.html

Chan, T., Sebok-Syer, S., Thoma, B., Wise, A., Sherbino, J. and Pusic, M. Learning Analytics in Medical Education Assessment: The Past, The Present and The Future. Education and Training, April 2018. https://onlinelibrary.wiley.com/doi/abs/10.1002/aet2.10087

Matt M. Cirigliano, Charlie Guthrie, Martin V. Pusic, Anna T. Cianciolo, Jennifer E. Lim-Dunham, Anderson Spickard III & Valerie Terry (2017) “Yes, and …” Exploring the Future of Learning Analytics in Medical Education, Teaching and Learning in Medicine, 29:4, 368-372, DOI: 10.1080/10401334.2017.1384731

https://www-tandfonline-com.libproxy1.nus.edu.sg/doi/full/10.1080/10401334.2017.1384731

Goh P, Learning Analytics in Medical Education , MedEdPublish, 2017, 6, [2], 5, doi:https://doi.org/10.15694/mep.2017.000067

Mirella Atherton, Mahsood Shah, Jenny Vazquez, Zoe Griffiths, Brian Jackson & Catherine Burgess (2017) Using learning analytics to assess student engagement and academic outcomes in open access enabling programmes, Open Learning: The Journal of Open, Distance and e-Learning, 32:2, 119-136, DOI: 10.1080/02680513.2017.1309646

Norman, G. (2012). Medical education: past, present and future. Perspectives on Medical Education, 1(1), 6–14. http://doi.org/10.1007/s40037-012-0002-7

Vaitsis C, Nilsson G, Zary N. Visual analytics in healthcare education: exploring novel ways to analyze and represent big data in undergraduate medical education. PeerJ. 2014 Nov 25;2:e683. doi: 10.7717/peerj.683. eCollection 2014.

Billy Tak Ming Wong, (2017) "Learning analytics in higher education: an analysis of case studies", Asian Association of Open Universities Journal, Vol. 12 Issue: 1, pp.21-40, https://doi.org/10.1108/AAOUJ-01-2017-0009

______________

https://www.instagram.com/p/Bh2h697Hvvh/?hl=en&taken-by=gohpohsun

Learning Analytics Short Course from Poh-Sun Goh

https://www.instagram.com/p/Bjipq98HRxq/?hl=en&taken-by=gohpohsun

Data / Learning analytics in Medical education and Training from Poh-Sun Goh

https://www.instagram.com/p/BhSOoAgHU1X/?hl=en&taken-by=gohpohsun

TeL in Medical Education - Content, Engagement and Outcomes from Poh-Sun Goh

http://www.rt3nc.org/edtech/the-tpack-model/

https://www.mindtools.com/pages/article/kirkpatrick.htm

http://stemlynsblog.org/educational-theories-you-must-know-millers-pyramid-st-emlyns/

https://thesecondprinciple.com/teaching-essentials/beyond-bloom-cognitive-taxonomy-revised/

above from

https://www.instagram.com/p/Bc1KvABltiq/?hl=en&taken-by=gohpohsun

Data and Evidence of Value and Impact of (e)Learning Activities and Outcomes from Poh-Sun Goh

above from

Goh, P.S. Learning Analytics in Medical Education. MedEdPublish. 2017 Apr; 6(2), Paper No:5. Epub 2017 Apr 4. https://doi.org/10.15694/mep.2017.000067

https://medicaleducationelearning.blogspot.sg/2017/09/see-one-do-one-teach-one-to-see-show-do.html

https://telatcenmed.blogspot.sg/2018/03/technology-enhanced-learning-elearning.html

above from

https://www.instagram.com/p/BcvRw9Blo4w/?hl=en&taken-by=gohpohsun

Concrete examples data informing teaching and learning from Poh-Sun Goh

above from

https://www.instagram.com/p/BcRPma2FTkM/?hl=en&taken-by=gohpohsun

Learning analytics in Med Ed from Poh-Sun Goh

above from

https://www.instagram.com/p/BcS7RO9F3Ih/?hl=en&taken-by=gohpohsun

Learning analytics in Med Ed (updated) from Poh-Sun Goh

Using data to inform (e)teaching and (e)learning workshop and symposium from Poh-Sun Goh

Using data to guide (e)teaching and (e)learning from Poh-Sun Goh

Efficiency Cost Effectiveness Time Effort Output from Poh-Sun Goh

Using data (analytics:analysis) to guide (e)teaching and (e)learning from Poh-Sun Goh

Application of learning analytics to case studies from Poh-Sun Goh

Applying learning analytics to the flipped classroom from Poh-Sun Goh

Applying learning analytics to the flipped classroom (updated) from Poh-Sun Goh

Applied learning analytics to class and program learning activities from Poh-Sun Goh

Applied learning analytics for e teachers from Poh-Sun Goh

Role of digital analytics to guide e teaching and elearning from Poh-Sun Goh

Role of digital analytics to guide learning (updated) from Poh-Sun Goh

https://www.instagram.com/p/BhPiQx2Hd99/?hl=en&taken-by=gohpohsun

eLearning or TEL in MedEd - A hierarchy of Engagement and Learning from Poh-Sun Goh

https://medicaleducationelearning.blogspot.sg/2017/09/see-one-do-one-teach-one-to-see-show-do.html

above abstract of paper accepted for presentation at upcoming 50th JSME meeting, 3 August 2018

https://www.instagram.com/p/BjtGCzyHkIH/?hl=en&taken-by=gohpohsun

Norman, G. (2012). Medical education: past, present and future. Perspectives on Medical Education, 1(1), 6–14. http://doi.org/10.1007/s40037-012-0002-7

"Understanding basic theory using a few illustrative examples. Mastering a topic by exposure to and experience with many examples

Typical examples or real-life scenarios can be used to illustrate theory, and help students understand fundamental principles. Mastering a topic usually requires exposure to and experience with many examples, both typical and atypical, common to uncommon including subtle manifestations of a phenomenon. The traditional method of doing this is via a long apprenticeship, or many years of practice with feedback and experience. A digital collection of educational scenarios and cases can support and potentially shorten this educational and training process. Particularly if a systematic attempt is made to collect and curate a comprehensive collection of all possible educational scenarios and case-based examples, across the whole spectrum of professional practice. Online access to key elements, parts of and whole sections of these learning cases; used by students with guidance by instructors under a deliberate practice and mastery training framework, can potentially accelerate the educational process, and deepen learning."

above from

Goh, P.S. A series of reflections on eLearning, traditional and blended learning. MedEdPublish. 2016 Oct; 5(3), Paper No:19. Epub 2016 Oct 14. http://dx.doi.org/10.15694/mep.2016.000105

Goh P, Learning Analytics in Medical Education , MedEdPublish, 2017, 6, [2], 5, doi:https://doi.org/10.15694/mep.2017.000067

https://www-tandfonline-com.libproxy1.nus.edu.sg/doi/full/10.1080/10401334.2017.1384731