After a realistic AI-generated image of Pope Francis in a puffy coat went viral on social media last year, the Pope himself apparently took notice, reports Reuters. In a message for the 58th World Day of Social Communications, Francis writes, “We need but think of the long-standing problem of disinformation in the form of fake news, which today can employ ‘deepfakes,’ namely the creation and diffusion of images that appear perfectly plausible but false (I too have been an object of this).”
The Pope also warns about audio messages that “use a person’s voice to say things which that person never said,” he continues. “The technology of simulation behind these programs can be useful in certain specific fields, but it becomes perverse when it distorts our relationship with others and with reality.”
In March 2023, a Twitter user named “skyferrori” used the Midjourney v5 image synthesis service to create a convincing fake photo of Pope Francis wearing a long white puffer coat and posted it on the service. It quickly went viral and today stands at over 197,000 likes and 28.1 million views. Many people thought it was a real photo, and it was notable at the time for being one of the first AI-generated images that fooled a large audience online.
“I was having this discussion with a friend, and I’ll be honest, I didn’t think it was fake,” wrote a commenter named “thrillgore” on the Ars Technica forums at the time. “I thought it was genuine even though earlier in the day I had read that Pope Francis is a frugal fella, and doesn’t flaunt the wealth of the Vatican… It was funny yesterday, now it’s absolutely horrifying.”
Since the launch of Stable Diffusion in 2022, we’ve frequently covered deepfakes and worries about them undermining social trust, lowering the quality of information online by injecting noise, fueling online harassment, and possibly disrupting the historical record. It’s an unsolved problem, with watermarking technology often deemed unreliable and metadata-tagging projects not yet widely supported. Fundamentally, our ability to trust what we see online will come down to how much we trust the messenger.
“The development of systems of artificial intelligence, to which I devoted my recent Message for the World Day of Peace, is radically affecting the world of information and communication and through it, certain foundations of life in society,” the Pope warns. “These changes affect everyone, not merely professionals in those fields. The rapid spread of astonishing innovations, whose workings and potential are beyond the ability of most of us to understand and appreciate, has proven both exciting and disorienting.”
