Feedback and Critique — User Testing Stories

I recently posted the last episode of my serial novel, Razor Mountain. Finishing a novel is a fantastic achievement, so the first thing I did was congratulate myself and take a little break from the book. However, the work isn’t done yet. I still need to edit and polish it to really call it finished.

Writing is often thought of as a solitary process, the lone writer hunched over a keyboard in a dark basement. It can be that way sometimes, but editing is much more effective if it incorporates reader feedback.

User Testing

In my day job as a software developer, we are constantly creating, changing, or improving features in our software. Those changes then go through a gamut of testing, with developers, with quality assurance, and with users. This process gives us feedback to understand whether the people who use the software understand the new features, and what they like or dislike. We can take that feedback and make features easier to use, less confusing, simpler, or more powerful, depending on what the feedback tells us. While there are best practices, acting on feedback like this is equal parts art and science.

Game makers (video games, board games, and table-top RPGs) also often incorporate this kind of user feedback into their creative process. Where business software is all about maximizing efficiency, ease of use and costs, testing and feedback in games is usually about maximizing fun. That might entail fixing bugs or broken rule sets, but it often involved blurrier concepts, like balancing different factions or ramping up tension from the start to the end of a match.

It may seem odd to apply these ideas of testing to a story that you’ve slaved over and poured your heart into, but feedback can be just as valuable for fiction.

Auteur or Aoidos?

There is a popular conception these days of movie directors, show-runners and novelists as genius auteurs who produce intricate stories all at once, from whole cloth. In that worldview, the story is an artifact handed down from author to audience. The audience appreciates the work or dislikes it, and that’s the end of the interaction.

On the opposite end of the spectrum is stand-up comedy. Successful stand-ups often do many shows per week, trying out different jokes in different sets, changing or throwing away what doesn’t work and polishing what does. Some will take their best material and craft a broader story as a through-line. Material may carry through hundreds of performances, with each one being unique. This kind of performance-first attitude isn’t so different from the ancient oral poetry performed by Greek aoidos thousands of years ago.

Both kinds of artists have a story that they want to tell to an audience. The cloistered auteur firmly believes that they are crafting the one, true version of their work, and will brook no other opinions. If the audience doesn’t connect with it, that’s the audience’s problem. The advantage that the performer has over the auteur is that the performer can see exactly what effect their work has on the audience. They can improve and adjust the bits that don’t connect with the audience.

As an author, it’s hard to test your work against a mass audience like a stand-up, but getting feedback from beta readers can achieve some of the same effects at a smaller scale.

Understanding Readers

One of the advantages of a smaller pool of feedback readers is that you can better understand them and categorize their feedback. Not all readers are the same.

Many writers will have family members or friends who are happy to read for them, but will thoroughly sugar-coat any feedback they give because they don’t want to hurt the author’s feelings. Readers who don’t often read your genre may offer to help, but will have a hard time grasping genre conventions that a reader deep in that genre would breeze past. Fellow writers in a writing group will likely have a much better idea of the kind of feedback you want, because it’s the same kind of feedback they want on their own work.

When gathering potential readers, segmenting your audience can be very helpful. It may be useful to adjust what you ask of different types of readers, and it is absolutely necessary to adjust your own expectations. If a random family member wants to read, but you know they’ll only say nice things, feel free to let them. They’ll feel like they’re helping, and you may still get some tidbits out of it. On the other hand, a writer friend in the same genre might be happy to take a list of your concerns for a story and provide a detailed and harshly honest response.

Preparing Readers

You may want to give your readers a set of questions to inform their feedback, especially if you know their particular strengths and weaknesses. You may also have different concerns for different stories.

The good folks over at the Writing Excuses podcast suggest a set of general questions that can apply to any story:

  • What parts were especially awesome, boring or confusing?
  • Were there any parts where it was difficult to suspend disbelief?
  • When did you feel most absorbed in the story?

Often, readers will offer possible fixes for the problems they perceive. It’s up to you whether you want to solicit that kind of feedback, but it’s likely to happen anyway. However, the reader’s feelings are more valuable feedback than their suggested fixes. The reader is always correct about how the story makes them feel. They know exactly where they got confused or bored or excited. They’re just not usually very good at figuring out what to do about it.

Don’t feel obligated to accept a reader’s suggested fix for a problem. Firstly, you may not think it’s a problem. Even if it is, the source of that problem may be somewhere that the reader doesn’t understand—this often happens when different readers point out different issues that stem from the same root cause. You, as the author, have the best understanding of the story your trying to tell, and that expert view will help you triage any problems.

Making an Editing Plan

Soliciting reader feedback is just one of several ways to decide what to change in the edit. In my next post, I’ll talk about making an editing plan and tackling actual changes to the story.

Asking For Feedback

No matter what I’m writing — short story, novel, or something else — I’ll start with a first draft, do some amount of editing, and then feel the need for feedback. No matter how great you are at editing and revision, you can’t catch everything. In fact, if you’re me, you can’t catch a lot of things.

As I’m working on my serial novel, Razor Mountain, feedback is going to be interesting. While I’m going to start with a buffer of a couple completed chapters, I’ll be publishing as I write. Unlike my normal process, I’ll be interleaving the first draft writing, editing, and incorporating feedback for different chapters.

Regardless of the project you’re working on, getting feedback is critical to making your writing the best it can be. However, it’s important to understand that you’re not just throwing a manuscript over the wall to your reader and expecting them to toss back some notes. To get the most out of your readers, it can and should be a collaboration!

Who Is Your Reader?

When you’re asking for feedback, consider who you’re asking. If you have friends and family who are willing to read, that’s a fantastic resource. Many writers have a spouse or trusted friends who act as beta readers. You might also have writer friends, a critique group, or fellow writers on a critique website.

The largest differentiator between your early readers will probably be between “regular” readers and fellow writers. Readers tend to look at what they like or dislike about a story, and point out typos and grammar issues. Writers are much more likely to think about story structure or word choice, and to think about how they would do it were they writing your story.

If you use the same readers for several projects, you’ll get to know what feedback they’re good at giving. If you use a big online critique group or service, you might get different people every time. In either case, there’s a simple way to stack the deck in your favor and get more of the feedback that you want. Ask for it.

Know Your Weaknesses

First, think about what your own weaknesses are. What mistakes do you make? Writer, know thyself! The easiest way to do this is to pay attention when you’re editing. Keep track of the errors you fix and the things you improve.

For example, I love asides in the middle of sentences — like this one — and I have to restrain myself when it comes to em-dashes, parentheses, and sometimes colons.

I also tend to hedge when I’m not entirely sure about a moment in the story. For example, I might say that a character felt angry when or seemed upset when it would be more forceful to just say that the character was angry or upset. And then, I usually try to do away with that telling entirely, and show that the character is angry or upset through their actions or words.

If you don’t already pay attention to your editing like this, taking inventory of your foibles as a writer is a great way to improve. It’s also a way to build up a list of things for your early readers to look for.

What Are You Worried About?

When I write, there are some parts of the story that are rock solid. They’re straightforward and I know exactly what I want to do. I write them, and it comes out pretty well. Then there are other parts of the story where I’m less certain that I’m doing the right thing. I know there’s room for improvement. I feel like the character’s actions don’t quite match their personality, or the story is taking a detour, or the words just don’t fit together in the way I’d like.

You’ve probably had similar feelings. We all have parts of the work that we’re worried about, for one reason or another. That’s great. Those are perfect targets for your beta readers. Let them tell you whether you’re right to be worried, or doing better than you thought.

Asking For What You Want

Now we get to the crux of it. You have a list of your writerly tics and foibles. You know the parts of your story that you’re worried about. And you have some readers waiting in the wings.

If you have readers with a particular set of skills, you can always sic them on specific problems. Maybe you have a reader who is great with grammar and spelling. Don’t feel bad telling them to focus on those things. Don’t prevent them from bringing other issues to your attention, but cater to their strengths.

If you have readers who are generalists, or you’re not sure what their feedback strengths are, you can always include a few bullet point notes with your manuscript to guide them. Have them pay attention to a particular character that you’re unsure about, or particular scenes. Also consider whether you want to put these notes up-front at the start, guiding your reader to pay more attention to that particular thing, or at the end where they will prompt your reader to reflect on your concerns after they’ve finished reading.

You don’t always have to be extremely specific either. Maybe you’re worried that your comedic sidekick character, Phil, is unlikable. Rather than asking that directly, you might just ask how the reader feels about Phil. You can suss out their feelings without guiding them too much in one direction or another.

Guided Feedback is Great Feedback

Almost any beta reader feedback is going to be beneficial. When you find good readers, you need to take care of them and nurture them as a precious resource. You’ll find that they’re even more effective when you ask them for the kind of feedback you want.

Nobody knows your story-in-progress better than you do. If you have concerns about some particular part, there’s a good chance they’re justified. Use your beta readers to shore up those weaknesses and turn them into strengths, and your stories will be better for it.