This Thursday Facebook announced a research project in which he collected 2,200 hours of first-person footage around the world to train models of artificial intelligence next generation.
The project is called Ego4D and it could prove crucial to the division Reality Labs of Facebook, which is working on numerous projects that could benefit from trained artificial intelligence models using video footage taken from a human’s perspective. This includes smart glasses, such as Ray-Ban Stories which were launched by Facebook last month, and virtual reality, which Facebook has invested heavily in since its acquisition of Oculus for 2 billion in 2014.
The footage could teach artificial intelligence to understand or identify something in the real world, or in a virtual world, that it could see from a first-person perspective through a pair of glasses or an Oculus visor.
Facebook said it will put the Ego4D dataset available to the public for researchers in November.
“This release, which is an open dataset and research challenge, will catalyze progress for us internally, but also broadly externally in the academic community and [permitirá] that other researchers endorse these new problems, but now they will be able to do so in a more meaningful way and on a larger scale, “he told CNBC. Kristen Grauman, Principal Scientific Researcher at Facebook.
The dataset could be implemented into artificial intelligence models used to train technology like robots to more quickly understand the world, Grauman said.
“Traditionally, a robot learns by doing things in the world or by being literally portable to be taught how to do things,” Grauman said. “There are opportunities for them to learn from the videos only from our own experience.”
Facebook and a consortium of 13 partner universities had more than 700 participants in nine countries to capture the first person images. Facebook says that Ego4D has more than 20 times more hours of footage than any other data set of its kind.
Facebook university partners included Carnegie Mellon in the EE. UU., the Bristol University at United Kingdom, the National University of Singapore, the University of tokyo on Japan and the International Institute of Information Technology on India, among others.
The footage was captured in the US, UK, Italy, India, Japan, Singapore, and Saudi Arabia. Facebook said it hopes to expand the project to more countries, including Colombia and Rwanda.
“An important design decision for this project is that we wanted partners who were leading experts in the field in the first place, interested in these issues and motivated to pursue them, but also geographically diverse,” said Grauman.
Ego4D announcement comes at an interesting time for Facebook
Facebook has been steadily increasing its hardware efforts. Last month, he released Ray-Ban Stories for $ 299, his first smart glasses. And in July, Facebook announced the formation of a product team to specifically work on the “metaverse,” which is a concept that involves creating digital worlds that multiple people can inhabit at the same time.
However, during the past month, Facebook has been affected by a barrage of news derived from a set of internal investigations of the company leaked by Frances Haugen, a former Facebook product manager who became a whistleblower. Among the published research were slides showing that Instagram it was detrimental to the mental health of adolescents.
For the sake of privacy, Facebook said participants were instructed to avoid capturing personally identifiable characteristics when collecting images indoors. This includes people’s faces, conversations, tattoos, and jewelry. Facebook said it removed personally identifiable information from the videos and removed the faces of passersby and vehicle license plate numbers. Audio was also removed from many of the videos, the company said.
“The college partners who did this video collection, step number one for all of them, was quite an intense and important process to create a policy for proper collection,” said Grauman, in The Truth News we will follow the latest news from Facebook as it will change the rules on attacks on public figures on its platforms.