A study of 20 ads across 10 brands reveals a paradox at the heart of the AI revolution: the technology can fool consumers, but not their wallets. Researchers at Ipsos and Syracuse University's S.I. Newhouse School of Public Communications conducted the first-of-its-kind comparison of human-made advertising against AI-generated counterparts, asking a simple question that the industry has circled but avoided: Can artificial intelligence replace creative teams?
The answer, surprisingly, is almost—but not quite. When 3,000 U.S. consumers viewed the ads, they struggled to tell the difference. Only 13% of viewers who saw an AI-generated ad felt confident it was made by machine, exactly matching the share who mistakenly suspected human-made work was AI-produced. With 40% entirely uncertain, the line between human creativity and algorithmic output is visibly blurring.
But the moment researchers measured what actually matters—whether an ad predicts short-term sales—the gap widened. Using Ipsos's sales-validated performance measures, human-made ads outperformed their benchmark by 11 points on average, while AI-made ads underperformed by five points. That 16-point spread represents the difference between moving consumers to buy and missing the mark entirely. Human-made ads created work that was predicted to drive stronger sales impact. AI could produce credible work, but it did not move the needle the same way.
The research paired existing human-made ads created before 2021—ensuring no AI influence—with fully AI-generated alternatives built from the same strategic brief. Brands tested included Cheerios, Chewy, Febreze, Fiat, H&M, Old Navy, Herbal Essences, Ray-Ban Meta, TurboTax, and Visa, spanning consumer packaged goods, fashion, automotive, and technology. The only variable changed was who created the work.
AI performed best when given straightforward, product-driven briefs but stumbled when the creative challenge demanded storytelling, emotion, or genuine perspective. Cheerios produced the study's strongest result, where a deeply human brief yielded the highest combined effectiveness scores across both versions. This finding matters enormously: as consumers grow numb to transactional messaging, the ability to connect emotionally becomes the competitive edge.
Carrie Riby, professor of practice in advertising at Newhouse, observed something telling in her classroom. "Every semester, I watch students create AI ads about themselves, and not one of them has ever loved their output enough to put it on their refrigerator," she said. That reaction—the honest underwhelm even creators feel toward their AI output—turned out to predict consumer response. If the people who built the ads lacked confidence in them, why would consumers feel differently? The data confirmed it.
The research addresses pressure mounting across corporate America. Chief marketing officers face constant questions about replacing creative agencies, while creative directors wonder about their futures. Ryan Barthelmes, senior vice president of creative excellence at Ipsos, frames what the study actually shows: AI is a powerful tool, but the human capacity for storytelling and emotional connection still creates measurable competitive advantage. The conversation is not whether humans or AI will win. It is how they work together.
Adam Peruta, director of the advanced media management program at Newhouse who oversaw the technical side, emphasizes what made the study rigorous: "The human ads and the AI ads started from the same brief. The only thing that changed was who made them, and that's exactly what we wanted to measure." That clarity matters as industries reckon with AI's real capabilities, not its promises.