As artificial intelligence tools become more common in the writing world, the debate around AI vs human writing is heating up. Many authors are asking the same questions:

Can AI write a novel that feels human?
Will AI replace writers?

My personal answer is that if we keep reminding readers and publishers what makes human-authored books special, then no, it won’t replace us. Readers will always want meaningful stories, and most won’t be excited about paying for books written by a computer.

That means developing your storytelling craft through stronger characterization, richer world-building, thoughtful research that makes scenes come alive, and most importantly, by honing your voice and writing the stories only you can tell.

To test this in a practical way, Jeremy Esekow, co-founder of Storywise, ran a fascinating experiment: a writing competition where human authors competed against AI-generated chapters.

In this guest post, Jeremy shares what happened when AI vs human writing went head-to-head and the five lessons writers can take from the results.

By Jeremy Esekow

A few months ago, my company, Storywise, launched a writing competition that felt a little reckless—but also necessary. We pitted humans against AI. I approached this experiment from two personal perspectives.

First, as an author. I’ve sent out countless query letters over the years. Most were met with silence. Second, as an entrepreneur and employer. I’ve also sat behind the other side of that inbox, staring at hundreds of job applications I simply didn’t have the capacity to answer. I know what it feels like to wait. And I know what it feels like to be overwhelmed.

And lately, another question has been nagging at me.

AI vs Human Writing: Why We Ran This Storytelling Experiment

If AI can generate entire manuscripts in minutes, what happens when submissions to agents and publishers suddenly multiply? What happens when slush piles triple? Will it become dramatically harder for human authors to stand out? Will original voices be buried under a tidal wave of competent, machine-generated slop?

So instead of wondering, we decided to test it. This allowed us to see how AI vs human writing compared when both were given the same story premise. We created a submission page, established the contest rules, and opened the competition to writers.(including a strict no-AI-assistance policy for the authors). Then we assembled judges, secured prizes (first prize was a publishing contract), designed ads, and got banned by reddit… 

The goal wasn’t to declare a winner once and for all, but to see how human storytelling compared with AI-generated writing under the same conditions.

5 Lessons From the AI vs Human Writing Experiment

Each author submitted one entirely human written chapter from a new manuscript. We then took the logline from the authors chapter, fed it into an AI writing tool, and generated an AI chapter. 

Our human judges were tasked with two jobs:

• For each submission, decide whether the author wrote a better chapter than the AI generated version. We gave the judges specific guidelines.
• And from there, choose which were the three best written chapters submitted overall.

The results turned out to be both encouraging and a little unsettling.

We received genuinely wonderful entries. Many chapters were brave and distinctive, feeling undeniably human. In the end, the prizes went to three human authors, leaving me proud. And relieved.

But there were moments when the AI chapter held its own. When they were compelling, mimicking structure and pacing convincingly. And if AI can produce something “good enough” at scale, and submissions grow exponentially, then the challenge for human authors may become insurmountable.

After everything wrapped up, we asked our judges what they had learned. Had the experiment changed their view of AI writing? Were they more optimistic? More concerned?

Their answers were thoughtful. The results of this AI vs human writing test revealed several patterns. Here are the five biggest takeaways from the competition:

1. Human Dialogue Outperforms AI Dialogue

One of the biggest differences in AI vs human writing appeared in dialogue scenes. AI-generated dialogue often lacks human-like emotional nuance and authenticity. Readers often sensed something slightly artificial about the dialogue, and it created distance instead of genuine character interaction. The AI generated chapters consistently underperformed in scenes requiring dialogue. Whether crafting distinctive and believable messaging, original intonations, or mannerisms, a good human author seemed to deliver the goods better.

2. AI Struggles With Story Pacing

We struggled to get an LLM to write even one chapter longer than 2,000 words. And when it did succeed lengthwise, it generally told most of the story, leaving little content for the rest of the book. Pacing is another area where AI tends to struggle. The narrative often moves too quickly.

AI is great when you need to move things along, but as soon as slow burn is required, it collapses. When shocking readers with a terrifying scene, a good author will have you sweating for pages, not just a paragraph.

3. Author Voice Is What Sets Human Writing Apart

When comparing AI vs human writing, one thing the judges kept returning to was voice. Judges repeatedly gravitated toward chapters that carried a distinctive and recognizable author voice. We’ve seen this pattern before.

Many of Storywise’s customers, when setting up their taste profiles, don’t just describe genres or themes. They describe voices, such as sharp, lyrical, commanding, comforting, or intimate. They want to feel the person behind the page. That truth became even clearer in a competition where we were comparing human writing to AI-generated prose.

AI can produce structure and coherence. It can even produce elegance. But I don’t believe it can produce a voice that feels owned and truly fresh. In several cases, the judges chose the human chapter even when it was less polished or less “publisher-ready.”

4. Editors Need a Reason to Keep Reading

The strongest predictor of a high score was surprisingly simple: did the judge want to keep reading and to know what happens next? Interestingly, authors who tried to pack too much into chapter one often scored lower. Overcrowded openings with too many characters, too many events, too much backstory left judges feeling overwhelmed rather than intrigued.

Some chapters had the opposite problem. They opened brilliantly, with tension and promise, but then wrapped things up a little too neatly by the final page. Judges found themselves enjoying the chapter without feeling compelled to turn the page. Others lingered too long in scene-setting with beautifully drawn worlds but weren’t able to pull the judge into a compelling narrative. Delivering an intriguing opening or creating an unmissable hook at the closing were great ways to leave our judges begging for more.

5. AI Is Improving Rapidly

One of the most surprising aspects of the AI vs human writing experiment was how often judges struggled to tell the difference. At times, it was genuinely difficult to tell which chapter was written by a human and which by AI. We even ran blind tests, presenting the two versions side by side without labels. In more than a few cases, judges guessed wrong. That alone was sobering.

For the anti-AI hardliner, there are clues. One telltale sign of machine-generated prose is over-describing details that don’t carry any narrative significance. Confident writers won’t describe the color and quantity of flowers stuffed into a vase in a corridor that the protagonists briefly passed through. If it’s not important to the story, a good author will know not to waste ink and reader attention on it. 

And then there’s the EM-dash. AI adores it. Find me a ChatGPT response that doesn’t include an Em-dash. Sadly, authors are starting to shy away from the EM-dash so as not to have their writing labelled as AI generated. 

The bottom line though is that AI is getting very good at creative writing. Not independently and not magically. Especially when it’s guided by a skilled storyteller who knows how to prompt it effectively. Good prompters know  what they are doing and how to get the most out of AI assistance and editing tools.

Key Lessons From the AI vs Human Writing Contest

Looking back at the results of this AI vs human writing experiment, human authors ultimately came out ahead. It was close. And we learned five clear lessons that you, as an author, can take with you, as you continue to thrive amidst rapidly changing dynamics:

1. Human dialogue is better than AI-generated dialogue. Invest in your dialogue and give your characters distinctive voices.

2. AI doesn’t do well with pacing. It can’t do slow burn and left to its own devices, rushes through the plot. Master the art of sustaining tension. Learn to draw readers forward without resolving everything too soon and you’ll not only endure in the age of AI, you’ll thrive.

3. Judges want a distinctive authors voice, especially when they are being swamped with AI-generated ‘slop’. Focus on delivering content with the best version of your own unique style.

4. Keep your reader wanting more with a great hook. Get the reader invested in your characters right out of the blocks, or build towards a heart-stopping cliffhanger. Otherwise, you risk your readers not wanting to turn to the next chapter.

5. And finally, AI is getting very good at creative writing. It still has blind spots, struggling with originality, lived emotional complexity, and the unexpected twists that make a story powerful. But as a tool for researching, drafting, refining, and editing, it is improving quickly.

 FAQs About AI Vs Human Writing

Can AI write a novel as well as a human?
AI can generate structured stories, but it still struggles with emotional depth, distinctive voice, and long-form pacing. Human writers bring lived experience and storytelling instinct that machines can’t easily replicate.

Will AI replace fiction writers?
Writers who develop strong voice, character development, and storytelling craft will continue to stand out.

What is the biggest difference between AI writing and human writing?
The biggest difference is voice and emotional nuance. AI can mimic structure and style, but human authors bring originality, perspective, emotion, and lived experience.

 About the Author

About Storywise