First, let me share the student feedback with you.
They said: They universally loved the ability to define a word right there. They loved how easily and quickly they could find out the definition.
I say: Excellent! They are thinking about words and defining them right as they are in the context of the word. This is a major win. If I had a university research team, I would design a study to test word meaning retention using a tap-to-define feature on a site like this or a kindle, versus using a paper dictionary or a dictionary on a different device. My hypothesis would be that because they are tying the word's meaning to its use in the same instant, the meaning of the text overall and the individual word are strengthened.
They said: When I asked them about the questions I had embedded in the text, they liked how the questions made them stop and think. One student said that it helped to break up the reading and make her think rather than just rushing on ahead. A lot of them said that the questions made them reread because they realized they didn't understand something. They liked the questions that asked them to summarize so that they could process what they had just read.
I say: This is a win! I was worried they would be annoyed by the questions and have their flow unnecessarily interrupted. My theory is that with a tricky text like this translation of Oedipus, the questions help to clarify and focus their reading. My guess (again, someone give me a research budget) would be that the questions built into an easier read would be frustrating.
They said: They felt self conscious about leaving comments. Were they being graded (aka judged) for those comments? They weren't sure what to say. They seemed to feel like the kind of marginalia they might make in a book would be deemed "stupid." I don't think I agree, but that feeling is valid.
"Publicizing" their margin comments caused some anxiety.
I say: I wonder if Actively Learn could have a function where they left comments that only they could see. So, there would be three options: private to them, shown only to me, or visible to the whole class. Right now, the latter two options are the only ones.
They said: They liked seeing their classmates' (anonymous, per my settings) answers to the questions. They can only see the answers of other after they submit their own answers.
I say: I want to ask them next class how it felt to see their own answers affirmed. Did they realize the either strength or weakness of their own answers as a result of reading their peers' answers?
Okay, now let me tell you how it went on my end.
I found the grading pretty fast. I saw all of the answer to each question in a list. I could click one of four choices: Incomplete, Basic, Proficient, Advanced.
If I clicked "Basic" I added a comment as to why.
Personally I had to think about the different between Proficient and Advanced. I was looking for a stretch, a reach, or an especially well supported idea. I was looking for a deeper understanding, a more thorough explanation. I looked for students to take an analytical risk. They all asked what those words would translate into as far as grades go. Then I remembered the class settings. Here are the defaults, which I kept:
Which looks like this so far for the first 14 questions:
A quick note, if I don't push any button on a particular student's answer, it doesn't even count that question in their total. I have a student who had some technical difficulties and left 4 questions blank. I didn't click anything for her on those and it didn't penalize her for those blanks.
My reaction is positive. I was feeling a little skeptical yesterday and not totally sold. I still haven't made my mind up yet, but the scales are currently tipped toward the positive.
I want to also add how awesome the team at Actively Learn has been throughout this process. I have emailed them with questions and comments, they have helped me upload custom texts and helped me troubleshoot problems. They are very helpful and friendly and really listen to what I have to say. I can't say enough about how great our interactions have been. I am willing to take this risk and try this software because I know I have their ear and their support through it.