Apple, Anthropic, and different main synthetic intelligence (AI) corporations have reportedly skilled AI fashions on information from a whole bunch of 1000’s of YouTube movies. A brand new report claims that a number of AI corporations used a publicly out there dataset referred to as Pile which contained the plain textual content of movies’ subtitles with none video imagery. The information was collected from well-liked YouTube creators similar to MrBeast, Marques Brownlee, and PewDiePie in addition to Indian YouTube creators similar to CarryMinati, BB ki Vines, and Ashish Chanchlani.
A number of AI Fashions Reportedly Skilled on YouTube Movies
Proof Information performed an investigation to search out that subtitles information from as many as 1,73,536 YouTube movies have been taken from greater than 48,000 channels. As per the report, EleutherAI, a non-profit AI analysis lab, curated this dataset. Later, it was utilized by corporations similar to Apple, Anthropic, Nvidia, Salesforce, and extra. Notably, the AI lab printed a analysis paper highlighting the small print of the dataset.
EleutherAI created a knowledge repository of 800GB dubbed Pile and made it publicly out there for many who needed to coach AI fashions however couldn’t afford massive datasets. Nearly all of the dataset was taken from publicly out there sources similar to English Wikipedia, e-books, and extra. Nonetheless, it additionally contained the subtitles from all of the movies compiled in a dataset referred to as YouTube Subtitles.
The report claimed that the Pile was used to coach Apple’s OpenELM AI mannequin, on the premise of the analysis paper’s description. Salesforce, Nvidia, and Anthropic’s AI fashions’ analysis papers additionally reportedly point out the utilization of the dataset.
Anthropic spokesperson Jennifer Martinez informed the publication in an announcement, “The Pile features a very small subset of YouTube subtitles. YouTube’s phrases cowl direct use of its platform, which is distinct from use of the Pile dataset. On the purpose about potential violations of YouTube’s phrases of service, we would should refer you to the Pile authors.”
Notably, YouTube’s phrases of service prohibit anybody from accessing the movies on the platform utilizing automated means similar to robots, botnets or scrapers. YouTube Subtitles will fall beneath the scraping class. A Google spokesperson informed Proof Information in an electronic mail response that the tech big has taken “motion through the years to forestall abusive, unauthorised scraping.” Nonetheless, no feedback have been made about AI corporations’ utilization of the information.
In a publish on X (previously referred to as Twitter), Marques Brownlee referred to as out Apple for sourcing information from corporations that included his movies’ transcripts, however he additionally highlighted that it was not the iPhone maker’s fault since they didn’t gather the information.
Apple has sourced information for his or her AI from a number of corporations
Considered one of them scraped tons of information/transcripts from YouTube movies, together with mine
Apple technically avoids “fault” right here as a result of they are not those scraping
However that is going to be an evolving drawback for a very long time https://t.co/U93riaeSlY
— Marques Brownlee (@MKBHD) July 16, 2024
Whereas this dataset was collected and distributed publicly, there could possibly be different cases of information scraping on platforms similar to YouTube. With AI corporations scrambling to search out extra information to coach their massive language fashions (LLMs), information procurement would possibly proceed to enter related legally gray areas.
