由买买提看人间百态

boards

本页内容为未名空间相应帖子的节选和存档,一周内的贴子最多显示50字,超过一周显示500字 访问原贴
Programming版 - Facebook’s AI tech mimics how humans learn
相关主题
zhaoce你要做skynet的话最好跟我学请教程序
几十层的神经网络用小机器能不能训练出来?大牛们说话看,哪种计算机编程语言最接近自然语言呢
keras or tensorflowee这个行当是不是就是搞点电器之类的?
一个C++语法问题新技术
一个multithreading 问题堆机器才是王道
post increment利用聪明才智,设计一个系统如何?
expert level C++If you say that a is 5, you can't say it's something else l
operator overloading (C++)市场上是IOS难找还是Android难找?
相关话题的讨论汇总
话题: ai话题: facebook话题: schroepfer话题: memory话题: networks
进入Programming版参与讨论
1 (共1页)
a*****g
发帖数: 19398
1
By Roland Moore-Colyer
Mon Nov 16 2015, 07:20
http://www.theinquirer.net/inquirer/feature/2434242/facebook-s-
FACEBOOK IS A COMPANY known primarily for its social feed of emotional
statuses, endless emojis, pictures of 'hols with the ladz', and, of course,
a big blue thumbs-up.
Normally associated with tech giants like IBM, Google and Apple, or some
disruptive Tech City startup, artificial intelligence (AI) is not the first
thing to spring to mind when pondering Zuckerberg's 1.5 billion-strong
social network.
Yet alongside solar-powered drones, virtual reality headsets and a wealth of
coding tech, Facebook is also building its own deep learning and cognitive
computing AI.
mike-schroepfer"The core goal here is to build systems that can better
understand and perceive the world the way we as people do, so it can help us
manage that world," said Mike Schroepfer (pictured) Facebook's chief
technical officer.
This may sound like Facebook is just making another virtual assistant with a
few smart moves and dry witticisms. But the social networking giant
actually appears to be pushing the boundaries of AI tech that could leave
Siri and Cortana scratching their digital heads.
Memory Networks, the moniker Facebook has given its AI technology, is what
Schroepfer sees as the key to unlocking the door that separates deep
learning machines which need to be taught, from intelligent systems that
learn by themselves.
"[Memory] is in my opinion a fundamentally missing component of AI; there's
no way we could view AI systems that can do the sorts of things we want
without the capability to learn and retain new facts that they've never seen
before," he said.
"One of the challenges with AI systems is many of the existing systems are
dumb pattern matchers; you ask it a question, it gives you an answer, it
doesn't learn as it goes.
"So one of the challenges with Memory Networks is can we take a neural net,
this thing that you train, and can we attach a short-term memory to it so
that it can take in data and answer questions based on that data."
Schroepfer described standard deep learning systems as just ways to create a
black box of data for pattern matching after lengthy training.
But where Memory Networks differs is the ability to ingest new data and use
machine learning to effectively get incrementally smart over time, rather
than rely on being taught by a human.
In practice, this works by having a deep learning neural network to act as a
‘reasoning' system, which uses logical techniques like deduction, applied
to data in a separate memory to turn it into knowledge that can be used to
answer questions.
Through a form of associative memory - the ability to learn and remember the
relationship between unrelated items such as the name of a place and its
appearance - Memory Networks can then store and retrieve internal answers,
observations and knowledge, thus getting smarter.
Schroepfer used the example of feeding Memory Networks the basic script of a
film. Through natural language comprehension, Memory Networks can reason
the movie's events and timeline to answer general questions without being
specifically taught to answer exact queries.
In effect, the neural network is applying logic and reasoning to its
memories, learning from knowledge and experience, not unlike our own fleshy
human brains.
Photographic memory
Robot artificial intelligence
Applying Memory Networks to natural text-based language is only one half of
Facebook's AI research.
Schroepfer explained that adding image recognition into the mix is the way
to help Memory Networks better perceive the world, or most likely pictures
uploaded onto social media.
Facebook's image recognition tech analyses photos at a pixel level, and has
been trained to recognise patterns among them to better distinguish separate
different objects in a photo even if they overlap. This process of
segmentation then allows the AI tech to identify each object in the picture.
Schroepfer noted Facebook's image recognition system can do this 30 percent
faster than most other systems and through using 10 times less training data.
But the magic happens when image recognition is combined with Memory
Networks. This produces Visual Q&A, an AI system that answers questions
posed to it via manual or voice inputs by people with impaired vison who
want to know what a picture is composed of and what is happening in it.
Think smart, look sharp
AI brain
Schroepfer highlighted how the company's AI research was exploring how it
can use image recognition to teach neural networks to perceive whether
something is going to happen from observation, rather than have an innate
understanding of the situation. This is similar to how children work out
when something is going to fall without understanding the physics behind it.
"That's how people learn; they learn by messing around with the world and
seeing what happens. And we have computer systems now that are brilliant on
a lot of things but don't understand basic physics and don't understand
operations of the world because they haven't been able to observe it," he
explained.
"So one of the other things we're trying to do is to teach computers some
basic common sense about the world, and one way we are doing this is by
stacking blocks together and showing an image of that to a computer and
asking it to determine is this stack of blocks going to fall in this case or
stand up."
According to Schroepfer, Facebook's techs were able to build a classifier
that is over 90 percent accurate at identifying when said block was going to
fall, and can in fact beat most humans at the task.
"It's one of many different ways we're trying to help systems understand
what's going to happen in the future and help us think about not just
reacting to what's happened but helping me plan things in the future,"
Schroepfer added. He noted how the elements of this AI research were being
added into the M assistant to make it more capable or understanding complex
requests.
Beating the human
inside-brain-mind
You could question why Facebook is effectively looking to create an AI with
'common sense' rather than relying on strict logic systems, which can often
work their way through all possible outcomes to come up with the right
answer.
As ever, Schroepfer provided a compelling reason, backed up by an example;
in this case, pitting a computer against a human in the Chinese board game
Go, a game people consistently win over computers.
This is because unlike chess, where a computer can trump humans by working
through all the possibilities of board configurations, Go has significantly
more moves. For example, after the first two moves in chess there are 400
possible next moves; with Go there are 130,000. This is too much information
for AI to crunch without bursting into a silicon sweat.
So Facebook looked to combine traditional AI tech designed to apply deep
learning methods with Go and connect this with image recognition.
Schroepfer said that this approach gave the AI the ability to work out from
patterns on the board what's a good move, instead of crunching thousands
upon thousands of potential moves. In short, Facebook created a Go AI that
has intuition.
"We've built up some of the image recognition technology and connected that
together to some deep learning systems about possible good moves, and
basically in a short number of months we've built a Go AI that can beat some
of the AIs that were designed specifically for the purpose of playing Go,
and it's as good as a very good amateur player," said Schroepfer, without
sounding smug.
While the idea of beating humans may send a chill up some people's spines
and send others running deep into the internet-free zones of Wales while
screaming ‘Skynet', an army of Facebook-branded remembering, reasoning and
predicating AIs is some way off; 10 years or more according to Schroepfer.
But the social media company, which is now very much a major technology
industry player, and its AI research is a good indication of how neural
networks and smart systems in the near future will be developed.
"The lesson really here is that by combining the different technologies, you
could very rapidly build something that was better than the thing that
people have been working on for many, many years, and I think this will be
one of the many ways we will see advances in AI in the future," said
Schroepfer.
He concluded with Facebook's ultimate AI destiny: "When these AI systems get
good enough, we can afford to scale it to the entire planet; it's a super
power we can give to every person on the planet."
We only hope everyone remembers that with great power comes great
responsibility. μ
h**********c
发帖数: 4120
2
can it learn how human forgets
1 (共1页)
进入Programming版参与讨论
相关主题
市场上是IOS难找还是Android难找?一个multithreading 问题
zhaoce怎么回事?post increment
哎,本来想从讨论中学些东西expert level C++
app过时了吧 下一波大发展估计是机器人用什么编程?operator overloading (C++)
zhaoce你要做skynet的话最好跟我学请教程序
几十层的神经网络用小机器能不能训练出来?大牛们说话看,哪种计算机编程语言最接近自然语言呢
keras or tensorflowee这个行当是不是就是搞点电器之类的?
一个C++语法问题新技术
相关话题的讨论汇总
话题: ai话题: facebook话题: schroepfer话题: memory话题: networks