Academia

When is a White Trillium not?

Leave a Comment

A post shared by Gavan Watson (@gavanwatson) on

Here’s a bit of a natural history mystery that I found yesterday: this green flower in a bed of White Trilliums (Trillium grandiflorum); something that I had never seen before.

The few initial web references I found suggested this is caused by a bacterium or a virus; further detective work unearthed a 46-year old paper (Hooper, Case & Myers, 1971) that suggests this greening is caused by “mycoplasma organisms”—a kind of bacteria and will cause the plant (eventually) to die.

It sounds like in the ensuing 40+ years since Hooper, Case & Myers published their (3 page!) paper, these “mycoplasma organisms” pathogens have come to be called phytoplasma—see Bertaccini et al., (1999), a paper that references Hooper, Case & Myers (1971).

And with that little discovery, a new world opens: a 2016 paper by Arocha-Rosete et al. that links the disease to a specific strain of phytoplasm: Candidatus Phytoplasma pruni, closely related (like 99% similar) to a phytoplasm called Milkweed yellows phytoplasma.

So…mystery solved?

Because I’m a geek, here’s the reference to the 1971 article: Hooper, G. R., Case, F. W. and Myers, R. 1971. Mycoplasma-like bodies associated with a flower greening disorder of a wild flower, Trillium grandflorium. Plant Disease Reporter, 55: 1108–1110.

Here are the rest of the references I unearthed:

Bertaccini, A., Fránová, J., Paltrinieri, S. et al. European Journal of Plant Pathology (1999) 105: 487. doi:10.1023/A:1008745206438

Arocha-Rosete Y, Morales-Lizcano NP, Hasan A, Yoshioka K, Moeder W, Michelutti R, Satta E, Bertaccini A, Scott J (2016) First report of the identification of a ‘Candidatus Phytoplasma pruni’-related strain in Trillium species in Canada. New Disease Reports 34, 19. doi: 10.5197/j.2044-0588.2016.034.019

View the image on Instagram

Synchronous, collaborative curriculum mapping with Google Sheets

Leave a Comment

Prideax’s (2003) description of three levels (the planned, the delivered, and the experienced) for examining curriculum is helpful for thinking about what kind of questions get asked about curricula. With a focus on the delivered curriculum, faculty members engage in curriculum mapping to see, over the course of a program, what gets taught, when it gets taught and how it gets assessed. The mapping described below occupies Prideax’s “delivered curriculum” level with faculty members’ experiences in their individual classrooms a key component of analysis.

Two key assumptions here: the data is meant to be examined in aggregate—that is, the unit of assessment is at the program level, not at the level individual courses1 ; and that the data does not drive decisions, rather the data drives discussions amongst faculty members which, in turn, drives decision making.

A challenge with curriculum mapping can be the logistics of it — done by hand and following a collaborative model, there are sticky notes to transport and transcribe, not mentioning the additional challenge of getting faculty members together in one room at one time.

At Western University we’re in the midst of developing a web-based curriculum visualization tool that will create a series of curriculum visualizations. In the meantime, we felt we could improve our analog process by taking a small step into the digital world. Enter: Google Sheets.

Before I go into any sort of detail on what we’ve done, I’m just going to go ahead and share an example map with dummy data entered2.

The data collected produces two visualizations: the first is a visualization of a progression of learning through the program (what we sometimes call and IRM chart, where I stands for Introduce, R stands for Reinforce and M stands for Master). The approach of asking instructor to weight the complexity of an outcomes was inspired, in part, by Veltri, Webb, Matveev & Zapatero (2011). The second asks instructors whether an outcome is taught and / or assessed in their course (what we’ll often call an T/A chart).

Sandwiched between these two visualizations is an opportunity for faculty to enter the assessment methods and instructional methods used to assess and teach the particular program-level learning outcome in their course.

What’s elegant about this stop-gap is the fact that as instructors enter data, they create the visualization. There is no additional transcription or translation — my colleague, Dr. Beth Hundey, and I set up the Google Sheet to automatically update the colour of the cell, for example, in the IRM chart. At a glance, there’s the opportunity to see how a particular program-level learning outcome progresses through a program curriculum. The data can become “useful” the moment that faculty are done entering data.

Less elegant is the interpretation of the assessment and instruction data. We provide a list of methods linked to numbers, asking instructors to enter the list numbers that match the methods used in the course. There isn’t, however, an easy way to visualize the data entered — it requires extra step(s) of downloading and manipulating the data in a program like Excel. It should be noted that Google has added an “Explore” option that interprets the data entered and creates automatic visualizations of the data. My cursory look at the graphs created doesn’t make me want to suggest that this will be a viable option for creating useful visualizations.

Regardless, as we work with programs undergoing curriculum review, our collaborative sheet allows for the quick collection and interpretation of data. There’s certainly some work that’s required to set the sheet up as well as introducing the task to individual instructors. A curriculum visualization process set up in Google Sheets can work in very specific situations to simplify the task of collecting curriculum data for both faculty members and curriculum developers.

References

Prideaux, D. (2003). ABC Of Learning And Teaching In Medicine: Curriculum Design. British Medical Journal, 326(7383), 268–270. Retrieved from http://www.jstor.org/stable/25453551.

Veltri, N. F., Webb, H. W., Matveev, A. G., & Zapatero, E. G. (2011). Curriculum mapping as a tool for continuous improvement of IS curriculum. Journal of Information Systems Education, 22(1), 31.

  1. This is largely an act of “bracketing” as individual courses can be seen in the data. The intent is not to use the data to say “Professor X is not doing Y in class Z”. [↩]
  2. And it should be noted that the template is licensed under the Creative Commons under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License [↩]

Considerations for Podcasting as a Higher Education Assignment

2 Comments

My Podcast Set I

This morning, I’m doing a quick scoping of the teaching and learning resources related to using Podcasts as an assessment tool in the Higher Education classroom. The intended outcome of this environmental scan is to see what the evidence suggests as best practice for designing and facilitating Podcasting assignments. My sources are varied, from Blog posts to peer-reviewed journals (see the bottom of the post for relevant links to the literature).

Initial reactions

Generally speaking, the literature describes students as reacting positively to Podcasting as an assignment type in their course.

Curiously, much of the peer-reviewed literature around Podcasts seems to “peak” at the end of the oughts. Google’s trend data using the search term “Podcast” appears to support this: an explosion of searches for Podcasts, which reaches its relative peak in 20061. If this is the height of the Podcast hype, then it’s not surprising to see papers start to appear in the closing years of the 2000s reporting on the use of Podcasts in the higher ed classroom. But Podcasts, as an assessment type, seems to have moved along the educational technology “hype cycle“.

Rather than work that describes the use of Podcasts as a kind of assessment, I’ve noticed more research on the use of Podcasts as:

  • a kind of instructional technology (e.g. recording lectures as making them available as Podcasts) and
  • a way to provide student feedback.

Can’t help but think there’s an opportunity here for some kind of introspective and retrospective look at eLearning, using Podcasting as a case study.

Design & facilitation considerations

So, without further ado, here’s what people have said about creating Podcast assignments:

Design

  • It will take students more time to produce their Podcasts than you initially imagine.
    • Limiting the length of the Podcast can limit the scope of production and, subsequently, time.
  • Consider if it is a group assignment or an individual assignment: if creating Podcasts for the first time, students want to be able to troubleshoot tech issues with peers rather than feeling it’s up to them to solve their problems.
  • To help tackle the scope of the project, and help with the technical side of things, consider scaffolding Podcasting assignment: break down the Podcast production into discrete steps and have students submit these along the way, in addition to the final version of the Podcast.
  • Is the Podcast a means to an end or an end itself: are you assessing the quality of production or the quality of ideas?
    • Consider providing explicit direction on the amount of time student should spend on post-production.
    • Reflect this in the assignment rubric.

Podcasting as a skill

  • Don’t assume that the “digital natives” in your class know what tools to use to create Podcasts, or, how to use the tools: Podcasting is a skill and they need to be taught that skill.
    • Having exemplars of other students’ Podcasts can help student grasp the expectations and scope of the assignment; or, create an example yourself.
    • One suggestion is to consider creating a Podcast as a live demo in-class: it can set students at ease and can demystify the production process.
  • Make use of your campus’ technology resources when introducing the assignment; having the appropriate campus support introduce the tools and how to use them is a great first step but…
    • Be prepared to devote class time to addressing on-going technical issues.
    • Don’t assume that there is sufficient campus resources to offer individualized support for each group or individual in your class.
  • Keep the tools inexpensive and simple: Garageband (OSX & iOS, $5) or Audacity (Windows, Linux, OSX, Free) should suffice for production.

Evaluation

Other considerations

  • Who is the audience for the Podcast? Have a clear notion of who the intended audience is and be able to communicate that to students.

Podcast Resources

As an assessment tool

Podcasts as an assessment tool in Higher Ed (Blog Post, 2013)

Student Thoughts about Podcasting Assignments (Blog Post, 2012)

Four Mistakes I Made when Assigning Podcasts (Blog Post, 2012)

Can Creating Podcasts be a Useful Assignment in a Large Undergraduate Chemistry Class? (Conference Proceeding, 2010)

Podcasting (Blog Post, 2010)

As a feedback tool

Reflections on using podcasting for student feedback (Article, 2007)

It was just like a personal tutorial: Using podcasts to provide assessment feedback as an instructional tool (Conference paper, 2008)

As an instructional tool

Podcasts and Mobile Assessment Enhance Student Learning Experience and Academic Performance (Article, 2010)

The value of using short-format podcasts to enhance learning and teaching (Article, 2009)

The effectiveness of educational podcasts for teaching music and visual arts in higher education (Article, 2012)

  1. Curiously, there’s another peak in December 2014 which Google attributes to the Serial Podcast [↩]

How we scaffolded critical reflection

Leave a Comment
By the canal, licensed for use under the creative commons.

By the canal, licensed for use under the creative commons.

We1 made a significant change in the way we “taught” critical reflection in UNIV*6800: University Teaching, Theory and Practice in the fall of 2013. To measure the success of our change, we asked students rate their confidence in their ability to reflect critically on their learning and teaching practices before the course and at the end of the course2.

To do so, we asked them to disagree or agree with the following statement on a scale of 1 – 4, where 1 was “strongly disagree” and  4 was “strongly agree”: “I feel confident in my ability to critically reflect on my learning and teaching practices.” Students self-rated agreement with that statement increased from 2.1 before the course to 3.7 after the course, with all respondents (n=18) either agreeing (3 on the scale) or strongly agreeing (4 on the scale) that they now feel confident in their abilities to reflect on their teaching practices. Granted, while these are only descriptive statistics, I would suggest they do illustrate a trend in the student’s perceptions on undertaking critical reflection and the impact of our process.

So: what did we do? Based on research I conducted for a presentation at STLHE3 in 2013 on best practices in “teaching” critical reflection4 we redesigned how we introduced critical reflection, scaffolded the activity and “built” the assignment.

Here’s a thumbnail sketch of the assignment (with the educational rationale behind the decision indented below each point):

It was a series of three submissions (each around 750 words).

  • Three submissions modelled the ongoing nature of critical reflection; it also required students to practice the skill of critical reflection. I believe that getting students to do critical reflections over the course of the semester is key in learning the skill (and three appears to be  a sweet spot between repetition and being repetitive).

We wrote two critical reflections and posted them to the course website as exemplars

  • Erin and I were demonstrating that we took the skill seriously and provided students’ with two exemplars of what critical reflection “looks like” (or, at least, what we think it looks like).

After introducing what critical reflection was, the first submission was assigned and completed in-class.

  • By having students write their first critical reflection in class, we were trying to limit the time they could spend on the assignment and lower the stakes of the assignment. Additionally, the material concerning components is fresh—students have to spend less time recalling just what they’re supposed to being doing.

I used the same time and prompt to write a critical reflection.

  • Completing this with students in-class was helpful for me as I was able to share the difficulties of the experience and what mistakes I made (like spending too much time on describing the situation and not enough time on critical reflection).

Each student was provided formative feedback by at least one of the course instructors before the next submission was due.

  • Prompt feedback was key for helping students understand where they were doing well with the skill and where they could grow for the next submission. Students had the option of submitting reflections to a blog5; if they chose that option, both Erin and I would comment on their submission meaning that they would get additional feedback or prompts for further thought. In some cases, students even responded to our comments, furthering the conversation.

The second and third submission were designed to be completed outside of class.

  • Increasing the complexity of the assignment.

We provided prompts for the first and second critical reflections; a single prompt for the first submission and a choice of three prompts for the second submission.

  • Prompts are defined in the critical reflection lit as a dilemma or critical incident that inspires the critical reflection; while in “real life” a teacher will uncover the dilemma or critical incident themselves, providing prompts reduces the cognitive load of the student so that they can concentrate on the skill of writing a critical reflection rather than the need to also find something to reflect about. The lit also suggests that choice in prompts also increases the relevance for learners, so we increased the complexity of the second critical reflection (and the relevance) by offering a choice of three prompts.

No prompt was provided for the third.

  • The end point of the scaffolded assignment6.

We did, however, provide them a focus for their third critical reflection: a submission on their practice teaching session.

  • The third submission was the most “authentic” critical reflection as not only were students responsible for selecting their own prompt, but the reflection needed to be based on a practice teaching session they facilitated. This was designed to mimic their typical use of critical reflection as university educators.

So, that was our process. While not perfect, it did work significantly better than previous years with the quality of critical reflections improving by the third submission and student’s self-rated comfort with critical reflection increasing over the course of the semester. What process do you use to teach critical reflection to students?

  1. And by we, I mean my co-instructor Dr. Erin Aspenlieder and I. [↩]
  2. This is in the model of a self-evaluation method called pre-post-then; in this case assessing post-then. See this article (opens in a new window) for more information on pre-post-then. [↩]
  3. STLHE=The Society for Teaching and Learning in Higher Education. [↩]
  4. Also outlined in this blog post. [↩]
  5. With mixed results. [↩]
  6. Scaffolding is defined as breaking up learning into manageable steps to reduce a student’s cognitive load and encouraging progressive learning. [↩]

Greet, Get, Give, Gauge & Go: a Framework for Student Consultations

Leave a Comment

As an instructor, it might be tempting to measure the success of student visits by how quickly you can provide a correct answer—but excelling at this particular metric might come at the cost of a student building their own ability to answer similar questions in the future. The 5G framework1 for student consultations not only offers a structure for answering a variety of student questions, but is a tool that can be used to build a student’s future success as well as providing a way to measure the outcomes of consultations. It consists of the five following steps:

  1. Greet
  2. Get
  3. Give
  4. Gauge
  5. Go
  1. The 5G framework draws its inspiration from a framework outlined on page 53 in Nyquist, J. D., & Wulff, D. H. (1996). Working effectively with graduate assistants. Thousands Oaks: Sage Publications. It was my colleague, Dr. Natasha Kenny, who made me aware of Nyquist & Wulff’s work, so a tip-of-the-hat to her as well. [↩]

“Teaching” Critical Reflection

Leave a Comment

Barker Dam Reflections

Thinking about critical reflection has been “front of mind” over the past few days, primarily because Natasha and I are presenting a workshop at this year’s Society for Teaching and Learning in Higher Education (STLHE) annual conference focused on just that. More specifically, the workshop focuses on a “disorienting dilemma” we’ve faced as course instructors for UNIV*6800, the graduate course at the University of Guelph that focuses on University Teaching.

Update (14/6/14): This post is the inspiration for the peer reviewed paper published in Collected Essays on Learning and Teaching: Teaching Critical Reflection to Graduate Students (Watson & Kenny, 2014).

Update (21/3/14): I’ve blogged on the process that resulted from this research. See how we scaffolded critical reflection.

Five things a TA should do in their first lab, seminar, tutorial or class

Leave a Comment

Classics seminar

1. Whatever approach you’re going to take in your classroom, model it.

If you plan to use discussions, case studies or experimental work, model some component of it on your first day. You want students to understand that these approaches are important to their success in the course while also letting them know that they’ll be expected to participate in this particular way.

2. Make a commitment to learn student names. State it in the first class. Hold yourself accountable.

Learning student names is a key (and simple) component to engaging students; research suggests the more positive a relationship a student has with an instructor, the higher the student’s final grade (Micari & Pazos, 2012).

3. Bring extras.

This can include: extra course syllabi; details of your office hours & contact information; extra chalk / white board markers; pencils; scrap paper; and lab instructions. Students are bound to forget any and all of these. Plus, looking prepared is a good way to set a tone of your own professionalism.

4. Write the course name, number and tutorial / lab section on the board.

Allows students to check right away if they’re in the correct room; saves the “walk of shame” when they realize they’re not.

5. Start creating a safe space for learning.

This means different things in different classrooms: in a chemistry lab, it might mean highlighting proper procedures; in a humanities seminar, it might mean talking about the kind of environments that encourage appropriate conversation.

References

Micari, M., & Pazos, P. (2012). Connecting to the Professor: Impact of the Student-Faculty Relationship in a Highly Challenging Course. College Teaching, 60(2), 41-47. doi: 10.1080/87567555.2011.627576

“Grade” expectations

Leave a Comment

Studying spanish
cc image source

With apologies to Dickens, in preparation for the upcoming Graduate Student University Teaching Conference, I’ve been editing the TA survival guide that we provide all conference participants. One specific section that I’ve updated is based on the most recent data collected from 2011 incoming undergraduate students.

Respectfully, you’re doing it wrong

4 Comments

Twitter Wallpaper - Vector Redo
cc-licensed photo source

Twitter—more than just broadcasting—is about engagement.

If you agree with this premise, then take a moment to visit the University of Guelph’s Twitter account. Notice anything? A stream of tweets linking to the University’s communications and public affairs news releases and At Guelph articles. No conversations, no re-tweets. How many people are following @UofG? A little over 8700 (as of July 2012). How many accounts does the University follow back? 35.

How about a quick visit to the Library’s main account? Looks to be a feed of truncated re-posts from the Library’s news service. A lone-wolf, it follows no one.

Now have a look at the University’s Guelph Gryphons account. Admirably, there is the odd re-tweet, but again we see that the majority of time, it’s a tweet with a link to a news release on the Gryphon’s site. Not a single conversation in sight.

Perhaps it’s okay to be a nameless, faceless institutional account and go on sending out 140-character links to press releases, but what about the public faces of the University?

None would be more visible than President Alastair Summerlee. Dr. Summerlee’s tweeting tempo has improved recently and though abrupt, I don’t mind his staccato style but there isn’t a re-tweet or conversation in sight. The Associate VP Student Affairs is on Twitter too. But the trend continues, and Brenda Whiteside‘s stream is infrequently updated and (broken record time, sorry) without any evidence of conversations.

But why should @UofG, @LibraryUofG, @Guelph_Gryphons, @UoG_President or @WhitesideBrenda care about my observations here? Because people who are active users of Twitter are expecting engagement. And the best brands know this and already are engaging with their broad community of followers. And while brand could mean American Airlines, I actually mean fellow institutions of higher education here in Ontario. For examples of how other Universities are “getting” how to use Twitter, see the University of Waterloo‘s institutional account or Queen’s University Principal Dr. Daniel Woolf’s account: conversations, information, re-tweets. They’re all there. And personally as an alumni, staff member and active Twitter user on-campus, I can’t help but want better for our image, perception and institution.

It’s not all dire on-campus. The University’s Alumni account is exact antithesis of my criticisms above. But it does leave me with more questions about Twitter and Higher Ed: What are institutional accounts for? Is lower activity and no engagement better than no account at all? And can we improve how we “do” Twitter here @UofG?

Edit (4:31 pm, July 24): Ensuing conversation on Twitter that suggests other U of G accounts that are engaging, enjoyable and, in one case, a cannon:


Edit (8:25 pm, July 24): Another suggestion: