Artificial Intelligence and Automatic Writing

Can this machine write an article without you?


Automatic Writing - The New Face of Journalism

There is a specter haunting the world of writers - the specter of automatic writing. That's right, an article or report generated by a computer algorithm without human input. An algorithm is a "step-by-step procedure for solving a problem or accomplishing some end especially by a computer." This is a natural outgrowth of the science of Artificial Intelligence. So new is this topic of automatic writing that there are very few Google or Bing searches on the subject. People are only gradually becoming aware of it. This will change soon, because automatic writing will revolutionize journalism, not to mention freelance writing. And it will happen quickly.

How’s this for a snappy piece of sports writing?

“WISCONSIN appears to be in the driver’s seat en route to a win, as it leads 51-10 after the third quarter. Wisconsin added to its lead when Russell Wilson found Jacob Pedersen for an eight-yard touchdown to make the score 44-3 .” As with many sports columns, the article, as discussed in The New York Times, was written 60 seconds after the end of the game. So what? Why am I telling you this? Well, the article was written by a computer. Yes, computer generated writing is here, and it's not going away.

As a writer I think I hate this development. Writers, especially freelance writers, are a worrisome crowd. They have to find the next assignment, create a story line, meet a deadline, and oh yes, pay the bills. I hate to give writers something else to worry about, but facing reality is always a healthy thing. Yes, a lot of the staple subjects of article writing will soon migrate to computer algorithms. Full disclosure – I wrote this article myself. I used a computer, but the computer didn’t write it. I will also write any future updates to this article. Maybe.

Article spinning is a type of automatic writing using rudimentary artificial intelligence algorithms. Article spinning means taking an article, putting it through spinning software, and voila - out comes an article that has changed the words with synonyms so as not to engage the wrath of the Google prohibition against searchable duplicate content. Unless the article involves a simple subject in simple language, the outcome can look like yesterday's corn beef hash.

Narrative Science's Kris Hammond

The Beginnings of Automatic Writing

Automated systems have changed the way we do things since the invention of the printing press. and now, the act of writing itself is becoming automated. Narrative Science, a start-up company in Chicago, is using artificial intelligence to generate articles. The company formerly launched in 2010. It began in Evanston, Illinois as a joint research project with the Northwestern University Schools of Journalism and Engineering. The three founders were Stuart Frankel, CEO, formerly with Doubleclick; Kris Hammond. Chief Technology Officer and professor of Computer Science and Journalism at Northwestern University and the founder of the University of Chicago’s Artificial Intelligence Laboratory; Larry Birnbaum, Chief Scientific Advisor and professor of Computer Science and Journalism at Northwestern. For an interesting description of this development, see: ”Steve Lohr, “In Case You Wondered, a Real Human Wrote This Column,” NY Times, September 10, 2011.

This new company is rewriting the history of journalism. The basic idea of computer generated writing is simple. First, develop a huge database of information on a subject using data mining techniques. Sports and finance are natural areas of inquiry because any discussion of either subject requires a lot of numbers, people, comparisons and history. Once the database is built, then write an algorithm to go in and extract data and put it into intelligible narratives. Using baseball as an example, the algorithm is taught to understand that the most runs scored wins, that an inning is over after three outs and all of the other rules that run the game. Set loose on the huge database, the algorithm soon is able to figure out that batter X has only a 10 percent chance of getting a hit off of pitcher Y, based on the historical information in the database. The algorithm also learns the lingo of the game, so that when it generates a report it says things like Jones "smashed one" over the left field wall, or that a batter was "thrown out looking." And what's most shocking is that the algorithm and its pal the database can generate a story within seconds of the end of a game, with journalistic grace and incredible accuracy.

The world of finance, awash in facts and figures, is also fertile ground for automatic writing. A report, written for a business magazine, may read: "XYZ Corp.'s last quarter was a bitter disappointment, with revenues off of its previously stellar chart climbing stats, and profits are also in the tank. Investors will head for the exit door."

Are you concerned that computer algorithms will replace the need for your work?

  • Yes, definitely
  • I worry about it but just keep on writing
  • Not worried. Computers will never replace the human writer
See results without voting

How Automatic Writing Will Change Journalism

Technical writer Steven Levy, writing for Wired Magazine, has penned an excellent article on automatic writing and the future of journalism entitled: "Can an Algorithm Write a Better News Story Than a Human Reporter?" He discusses how the programmers are learning how to make the algorithm figure out things faster. Writing restaurant reviews, for example, requires that the algorithm look at the database of restaurant information and zero in on certain critical metrics like high review scores, good service, good food and a couple of customer reviews. Within hours, according to Levy, the database could crank out pithy little articles like “The Best Italian Restaurants in Atlanta” or “Great Sushi in Milwaukee.” Does this remind you of a HubPages article or a Textbroker assignment? Levy talks about a competitor of Narrative Science that began as a company known as Statsheet, which concentrated on reporting sports contests. As the excitement unfolded, the company founder changed its name to Automated Insights. Levy quotes Robbie Allen, the founder, about its previous thinking that the company would limit its mission to data-rich industries: "Now I think ultimately the sky is the limit." When interviewing Kris Hammond, the Chief Technology Officer of Narrative Science, Levy asked him what percentage of news articles would be written by computers in 15 years. Hammonds answer may send shivers into the spines of writers. Hammond said "More than 90 percent." Are the reports accurate? Levy talked to Lewis Dvorkin, Forbes Media chief products officer , and asked about the accuracy of the computer generated articles from Narrative Science. Although reporters are known to get things wrong, he did not find one instance of an error in any Narrative Science articles. Algorithms don't miss things. Jeopardy fans the world over looked with nervousness as an IBM computer named Watson (after IBM's founder) took on two previous Jeopardy champions in February 2011. Watson won hands down and sent the two champs packing. Artificial intelligence had hit prime time.

Breakthroughs have a way of expanding and changing things. In the early 1980s the primordial jungle of the computer revolution, we were amazed at how you could highlight a paragraph or word then copy or cut and paste it. The early PC enabled us to do more with what we had. Artificial Intelligence, on the other hand, goes beyond what we have. For looking up data, correlating it and making relevant conclusions, we can't compete with algorithms.


Should Writers Be Worried?

Ayn Rand once famously said: "You can avoid reality, but you can't avoid the consequences of avoiding reality." Some who may be reading this article may think that the province of writers is safe, that a computer program, no matter how sophisticated its algorithm, can never replace the analysis that a human being can bring to bear on an issue. What about the article that you are reading right now? I have looked at the reports of the amazing new companies on the scene, I have selected a few telling quotes, and I have given it my analysis, which is what I am doing right now in this paragraph. But suppose the Narrative Science people put all of the data they have and that which they can get their hands on into a database devoted to the subject of artificial intelligence as it applies to automatic writing. Do you think their algorithm would not alight upon the quotes with the predictions of automatic writing being responsible for as much of 90 percent of articles in a few years? Do you think that the algorithm can't look at the numbers and make mathematical projections far better than me? Yes, I do think writers have something to worry about, unless they write strictly for pleasure. Are only nonfiction article writers at risk? A computer program can be stuffed with basic plots and characters, and the algorithm can pick and choose, just like a writer does, and come up with a novel. I have favorite novelists who I read not because I like them, but because I like their writing. Show me an algorithm that can weave a good plot with exciting characters who say compelling and funny things, and I will send him (it?) fan mail.

Will a computer ever win a Pulitzer Prize? Narrative Science's Kris Hammond thinks so. He referred to a pundit's prediction that a computer will win the Pulitzer in 20 years, and disagreed. Hammond thinks a computer program will win the Pulitzer Prize in five years (that would be 2016).

What's a writer to make of this? Do you think a computer could write a sentence like an Ernest Hemingway, a George Will, a Tom Wolfe or a Joan Didion? I, for one, can't conceive of this. But then I thought the idea of an online auction site (Ebay) was dumb, and that nothing could replace the keyboard and mouse. So I'm not making any predictions. I'm just contemplating how one sends a note of congratulations to a computer that just won the Pulitzer.

Will computers and their algorithms ever form principled opinions and share them with us? Just ask Hal, the spacecraft computer in Kubrick's movie 2001(in 1969): "I'm concerned about the mission Dave."

Copyright © 2012 by Russell F. Moran

Comments 30 comments

Kenja profile image

Kenja 3 years ago from Long Island, NY

Just what we need, AI taking over our writing function. That just leaves me as a lawn mower, jogger and sex machine...

Mr. Moran has an amazing cornucopia of information here in his Hubs, and I'm looking forward to the new one on journaling. Excellent stuff from a first-rate fellow...

That Grrl profile image

That Grrl 3 years ago from Barrie, Ontario, Canada

A computer can gather together facts and be programmed to present them. But, it can't bring human emotion into the story. The computer can write the news headlines but it won't be able to write the editorial or the features, anything more in depth will need a real person to put feeling and opinions, idealism, etc into the facts.

rfmoran profile image

rfmoran 3 years ago from Long Island, New York Author

Thanks Ken. Yes, it's true and it's scary.

rfmoran profile image

rfmoran 3 years ago from Long Island, New York Author

I wish it were so Laura, but , although computers can't get into emotion or passion, they can choose words that show these feelings. Just look at the football game article I mention in my hub.

KawikaChann profile image

KawikaChann 3 years ago from Northwest, Hawaii, Anykine place

Nicely done - as a writer, I think this development will continually narrow our writing field - diminishing markets always get into every profession... it is appalling though that we are near that stage where AI will eventually earn a pulitzer. Ah, the soul of a writer flickers. Peace. Kawi.

rfmoran profile image

rfmoran 3 years ago from Long Island, New York Author

I'm going to keep writing until I get fan mail from a computer.

L.L. Woodard profile image

L.L. Woodard 3 years ago from Oklahoma City

I felt a chill run down my spine as I read about automatic writing. I realize there is change in any and every field, but there is something just a touch sinister about this concept.

I am not normally a conspiracy theorist, but I can foresee data base info being subverted for propaganda to a reading public that might question even less than they do now when articles are computer-generated.

A great, thought-provoking hub; voted up and Shared.

wtaylorjr2001 profile image

wtaylorjr2001 3 years ago from Binghamton NY

One can fear or one can prepare. Technology inevitably destroys certain markets in response to its advancement. Technology inevitably creates certain markets with its advancement. Just as writers learned the rules of grammar, character development, and dialog, we should be prepared to learn additional grammars such as Python, and C++. These programming languages are just grammars. As abstraction improves and natural language processing matures, we will be able to write programs in pseudo code that compiles into a movie. This is the direction of the future. It should not be feared but embraced.

rfmoran profile image

rfmoran 3 years ago from Long Island, New York Author

Dynamite point my friend! You should write a hub on this. This whole thing is an amazing development. Thank you for commenting in such a substantive way.

rfmoran profile image

rfmoran 3 years ago from Long Island, New York Author

Thanks Ken. I missed this post. My computer can beat up your computer.

skeltop profile image

skeltop 3 years ago from Denver, Colorado

I agree with wtaylorjr2001. I already use forms of automation in writing that were not available to me when I learned to type (such as the computer itself). Each advance was haled as the end of writing as we knew it. It was not. Perhaps there are some types of writing (such as the sports writing cited) that should be automated, leaving the true sports writer to provide creative analysis.

rfmoran profile image

rfmoran 3 years ago from Long Island, New York Author

hgm dgkj

rfmoran profile image

rfmoran 3 years ago from Long Island, New York Author

I wish I could be so optimistic. It isn't just sportas and finance. It will be basically everything. google this artice that I cite in my hub: "Can an Algorithm Write a Better News Story Than a Human Reporter?"

Mickey Flynn profile image

Mickey Flynn 3 years ago from Folsom CA

Another way to do propaganda. Who's going to keep it truthful?

rfmoran profile image

rfmoran 3 years ago from Long Island, New York Author

Thanks for your comment Mickey. Only a supervising computer can keep things truthful. Uh, oh. We may be doomed!

Joey1058 2 years ago

There is a crap-ton of AI occurring in the background of humanity's lives, which only the tip of the iceberg ever gets commented on. The bots are here. They just don't have arms and legs, yet.

rfmoran profile image

rfmoran 2 years ago from Long Island, New York Author

Thanks for your comment, Joey. Imagine a bunch of bots replacing the Sunday Morning talking heads.

Kristen Howe profile image

Kristen Howe 16 months ago from Northeast Ohio

Russ, what a compelling hub on AI and automatic writing. It could pave the way to our future. Voted up! Congrats on HOTD!

Jay C OBrien profile image

Jay C OBrien 16 months ago from Houston, TX USA

How do you challenge artificial intelligence, AI? How do you reason with it. I am afraid algorithms have already started judging writing on a grand scale. Example is Hubpages itself. Hubbers complained of my posts when I quoted Jesus to Christian ministers. What is wrong with that?

Dressage Husband profile image

Dressage Husband 16 months ago from Pine Grove, Nova Scotia, Canada

I find it odd that it has taken the HP editors over two years to award this Hub the HOTD award. Obviously they need a better algorithm or HAL of their own. A machine would never have taken so long to find this stellar article! Voted up for all the right reasons. Yes I rather think a lot of articles are already machine written. Sports reports and reviews in a lot of papers.

Kylyssa profile image

Kylyssa 16 months ago from Overlooking a meadow near Grand Rapids, Michigan, USA

I think that fiction will stay safe for at least five years past the point at which AI generated factual content takes over. I'm fairly sure people will prefer AI generated content because pieces can be skewed to match the individual who reads them if an AI generates them from some sort of information cluster which can include tracking information from the reader's device.

Eventually, humans will be obsolete in all jobs. AI will make better surgeons, better doctors, better teachers, better engineers, better scientists, and pretty much better everything. I just hope the oligarchy falls before then because we'll be in deep trouble if the wealthy humans who own our societies can't recognize other humans as more than labor devices before then. We'll be living in preserves starving to death if humans can't break away from money worship before computers take over all jobs that serve real functions. All that would be left would be politics and the manipulation of inherited money.

rfmoran profile image

rfmoran 16 months ago from Long Island, New York Author

Thanks, Kristen. The future id closer than we think.

rfmoran profile image

rfmoran 16 months ago from Long Island, New York Author

Thanks, Jay. What you note about the HP complaint about your hub reminds us that there's a big difference between the artificial intelligence of some algorithms and artificial stupidity!

rfmoran profile image

rfmoran 16 months ago from Long Island, New York Author

Thanks, Dressage. Yes, I think the HP algorithm needs a few squirts of oil in its joints.

rfmoran profile image

rfmoran 16 months ago from Long Island, New York Author

Thanks Kylyssa. I'm not sure that we won't see best selling novels soon written by bots. Big selling authors go by strict formulas, so why can't AI do the same? It can.

mikeydcarroll67 16 months ago

I have actually built bots like this in the past. It's kinda amazing what you can do with a lot of it.

rfmoran profile image

rfmoran 16 months ago from Long Island, New York Author

I just hope the bots will be kind to us when they take over.

Education fundoos profile image

Education fundoos 16 months ago

I'm a computer engineer, and I know, we'll do something about it, like creation of some kind of an anti-bot. Well, there are anti-bots software available in the market.

theBAT profile image

theBAT 15 months ago

Great article that made writers think more about the craft. Yet, writing will always be a human endeavor as it requires creativity and passion. Thanks for a great hub.

rfmoran profile image

rfmoran 15 months ago from Long Island, New York Author

Thanks for stopping by, theBat. A lot of pulp fiction is just manufactured, from plot to sub plots to scenes. That's what worries me.

    Sign in or sign up and post using a HubPages Network account.

    0 of 8192 characters used
    Post Comment

    No HTML is allowed in comments, but URLs will be hyperlinked. Comments are not for promoting your articles or other sites.

    Click to Rate This Article