Feedback and Critique — User Testing Stories

I recently posted the last episode of my serial novel, Razor Mountain. Finishing a novel is a fantastic achievement, so the first thing I did was congratulate myself and take a little break from the book. However, the work isn’t done yet. I still need to edit and polish it to really call it finished.

Writing is often thought of as a solitary process, the lone writer hunched over a keyboard in a dark basement. It can be that way sometimes, but editing is much more effective if it incorporates reader feedback.

User Testing

In my day job as a software developer, we are constantly creating, changing, or improving features in our software. Those changes then go through a gamut of testing, with developers, with quality assurance, and with users. This process gives us feedback to understand whether the people who use the software understand the new features, and what they like or dislike. We can take that feedback and make features easier to use, less confusing, simpler, or more powerful, depending on what the feedback tells us. While there are best practices, acting on feedback like this is equal parts art and science.

Game makers (video games, board games, and table-top RPGs) also often incorporate this kind of user feedback into their creative process. Where business software is all about maximizing efficiency, ease of use and costs, testing and feedback in games is usually about maximizing fun. That might entail fixing bugs or broken rule sets, but it often involved blurrier concepts, like balancing different factions or ramping up tension from the start to the end of a match.

It may seem odd to apply these ideas of testing to a story that you’ve slaved over and poured your heart into, but feedback can be just as valuable for fiction.

Auteur or Aoidos?

There is a popular conception these days of movie directors, show-runners and novelists as genius auteurs who produce intricate stories all at once, from whole cloth. In that worldview, the story is an artifact handed down from author to audience. The audience appreciates the work or dislikes it, and that’s the end of the interaction.

On the opposite end of the spectrum is stand-up comedy. Successful stand-ups often do many shows per week, trying out different jokes in different sets, changing or throwing away what doesn’t work and polishing what does. Some will take their best material and craft a broader story as a through-line. Material may carry through hundreds of performances, with each one being unique. This kind of performance-first attitude isn’t so different from the ancient oral poetry performed by Greek aoidos thousands of years ago.

Both kinds of artists have a story that they want to tell to an audience. The cloistered auteur firmly believes that they are crafting the one, true version of their work, and will brook no other opinions. If the audience doesn’t connect with it, that’s the audience’s problem. The advantage that the performer has over the auteur is that the performer can see exactly what effect their work has on the audience. They can improve and adjust the bits that don’t connect with the audience.

As an author, it’s hard to test your work against a mass audience like a stand-up, but getting feedback from beta readers can achieve some of the same effects at a smaller scale.

Understanding Readers

One of the advantages of a smaller pool of feedback readers is that you can better understand them and categorize their feedback. Not all readers are the same.

Many writers will have family members or friends who are happy to read for them, but will thoroughly sugar-coat any feedback they give because they don’t want to hurt the author’s feelings. Readers who don’t often read your genre may offer to help, but will have a hard time grasping genre conventions that a reader deep in that genre would breeze past. Fellow writers in a writing group will likely have a much better idea of the kind of feedback you want, because it’s the same kind of feedback they want on their own work.

When gathering potential readers, segmenting your audience can be very helpful. It may be useful to adjust what you ask of different types of readers, and it is absolutely necessary to adjust your own expectations. If a random family member wants to read, but you know they’ll only say nice things, feel free to let them. They’ll feel like they’re helping, and you may still get some tidbits out of it. On the other hand, a writer friend in the same genre might be happy to take a list of your concerns for a story and provide a detailed and harshly honest response.

Preparing Readers

You may want to give your readers a set of questions to inform their feedback, especially if you know their particular strengths and weaknesses. You may also have different concerns for different stories.

The good folks over at the Writing Excuses podcast suggest a set of general questions that can apply to any story:

• What parts were especially awesome, boring or confusing?
• Were there any parts where it was difficult to suspend disbelief?
• When did you feel most absorbed in the story?

Often, readers will offer possible fixes for the problems they perceive. It’s up to you whether you want to solicit that kind of feedback, but it’s likely to happen anyway. However, the reader’s feelings are more valuable feedback than their suggested fixes. The reader is always correct about how the story makes them feel. They know exactly where they got confused or bored or excited. They’re just not usually very good at figuring out what to do about it.

Don’t feel obligated to accept a reader’s suggested fix for a problem. Firstly, you may not think it’s a problem. Even if it is, the source of that problem may be somewhere that the reader doesn’t understand—this often happens when different readers point out different issues that stem from the same root cause. You, as the author, have the best understanding of the story your trying to tell, and that expert view will help you triage any problems.

Making an Editing Plan

Soliciting reader feedback is just one of several ways to decide what to change in the edit. In my next post, I’ll talk about making an editing plan and tackling actual changes to the story.