On July 1, OpenAI announced it utilizes publicly available data, including internet-sourced books and articles, to train ChatGPT. In light of this, content creators and organizations are now seeking compensation for their work. This training data is crucial for the development of leading AI models, with major companies like Google, Meta, OpenAI, Anthropic, and Microsoft competing to secure new data sources. Notably, Meta is even contemplating the acquisition of Simon & Schuster, a prominent publisher.
Publishers have accused these tech giants of unlawfully using copyrighted material, demanding fair compensation for their intellectual property. In submissions to the U.S. Copyright Office, both Meta and OpenAI claim that making copyrighted content publicly available online falls under fair use. However, they are preparing to contest this assertion in court amid ongoing lawsuits related to copyright infringement.
One significant lawsuit has been brought against OpenAI and Microsoft by the Center for Investigative Reporting (CIR), which recently merged with Mother Jones and Reveal. CIR alleges that OpenAI and Microsoft exploited its copyrighted work without consent or compensation. Monika Bauerlein, CIR's CEO, stated, "OpenAI and Microsoft took our news to enhance their products without ever seeking our permission, unlike other organizations that obtain permission for our materials. This free-riding is not only unfair but also infringes on our copyright."
The lawsuit claims OpenAI's WebText training set includes over 16,000 URLs from the Mother Jones domain. Additionally, in a separate class-action lawsuit from the Authors Guild, two authors assert that OpenAI used excerpts from their books to train ChatGPT. The New York Times has also initiated legal proceedings against OpenAI.
Documents from May 2023 revealed that OpenAI deleted two major datasets used to train GPT-3, which may have contained over 100,000 published books. Reports indicated that two employees who managed this data are no longer with OpenAI.
In response to these legal challenges, OpenAI has begun establishing licensing agreements with various news organizations, including the Associated Press, The Wall Street Journal, The New York Post, The Atlantic, Prisa Media, El Mundo, the Financial Times, and Axel Springer, the parent company of Business Insider. However, the volume of content needed for ongoing machine learning significantly exceeds what these agreements can cover.
To combat data shortages, OpenAI is exploring synthetic data, which is generated artificially rather than sourced from real-world materials. While considering synthetic data as a potential solution, CEO Sam Altman has expressed concerns regarding its quality. At a tech conference in May 2023, Altman noted that ensuring the model can create quality synthetic data is essential for success. OpenAI is also investigating collaborative frameworks where one AI system generates data while another evaluates its quality.
As of now, OpenAI has not issued any comments regarding these developments.