Gul Deniz Salali
What Do Machine Learning and Hunter-Gatherer Children Have in Common?*
They acquire knowledge in remarkably similar ways
*This article was first published in Scientific American
When DeepMind’s AlphaGo program defeated its human competitor at the ancient board game Go, it made a big splash in the AI scene. AlphaGo was not trained through a set of pre-written instructions, but rather through practice and feedback. It turns out that there are striking similarities between new generation machine learning technologies and how children learn skills in the absence of formal education.
Let me explain. Hunter-gatherer communities in Congo, where I do my field research, do not often give direct instructions when teaching their children. Instead, they create a learning opportunity, like providing a tool, and monitor the child’s action without interfering. The child then adjusts her behaviour according to the feedback she receives based on her performance. Likewise, neural networks work by giving an opportunity for the machine to learn (i.e. input) and providing feedback based on the output obtained by the network structure.
The ultimate goal in AI research is to generate general artificial intelligence (AGI), that is a machine that can understand and learn as we humans do. Many AI researchers, like the DeepMind team, believe that this will be possible through more independent learning strategies. In unsupervised learning, for example, machines learn by observing data without a predetermined goal or explicit guidance. This form of learning is parallel to how hunter-gatherer children learn most skills.
I have been visiting the Mbendjele hunter-gatherers, who are a subgroup of BaYaka Pygmies living across the Congo Basin, for the last six years. Mbendjele children develop skills like using knives, caring for infants and gathering wild plants as young as three years old. Our observations show that Mbendjele toddlers learn these skills mostly by freely exploring their environment, observing and copying others. Learning by being taught accounts for only a small portion of (6% to be precise) learning episodes that we observed.
I am interested in how we learn and transmit skills in the absence of formal education because understanding these can help us understand how complex cultural practices such as the Go Game evolve. We have evolved a great capacity for learning by imitating others. This in turn, allows us to transmit information with great accuracy. Researchers found that when information is transmitted faithfully cultural practices remain in the population long enough so that they can be modified to generate more complex practices. This is how human culture progresses. Our cultural traits are built upon the legacies of the past information. But this means they are also restricted by them.
While new training algorithms in machine learning have parallels with how human children learn, they have a capacity for surpassing human culture. This is because those new algorithms are not restricted by the legacies of our cultural history. In 2017, DeepMind team introduced the AlphaGo Zero- the new version of the AlphaGo that became its own teacher by learning from self-play. Now it is considered the best Go player in the world. Human Go players have been building their game strategies on the 3,000 years of accumulated knowledge. AlphaGo Zero became the best Go player by setting itself free from this knowledge.
What can we learn from the success of AlphaGo Zero? The program starts from scratch, plays against itself, then the outcome is combined with a powerful search algorithm to select the next move. Last year, the DeepMind team developed a general version of AlphaGo Zero which taught itself to play not only Go, but also chess and shogi (a Japanese version of chess) and defeated the best programs specializing in these three games. The former world chess champion, Garry Kasparov said “we can actually learn from the new knowledge the machines produce”. I think the way these programs work, through reinforcement learning from self-play, should also inspire us on how to raise curious pupils: allow them to explore great deals and provide feedback when it is needed.
How to improve the “search space” in Western childrearing
Young children imitate what they see in their caregivers. So, it is perfectly normal to see a 13-month old toddler playing with a macheteif she sees people using machetes every day. Of course, I am not saying we should give sharp tools to babies. We can, however, create an environment for children to explore the world by themselves and learn by observing others. For example, if you want your child to read more books, you can try reading more books yourself. I remember seeing Dostoyevsky’s Crime and Punishment on my parent’s bedside table when I was a young child. I was very intrigued by the title and the name of the author that did not sound like anything in Turkish. Later on, Dostoyevsky became one of my favourite authors.
Letting children explore their environment does not mean leaving them alone. On the contrary, hunter-gatherer children are constantly surrounded with community members, not only parents, and rarely left alone. Similarly, a community space where elderly people and children interact may benefit the wellbeing of the elderly and give children more learning opportunities.
In our studies, we find that older siblings and children play an important role in childcare. For example, a 3-year-old is perfectly capable of soothing an infant, and the infants learn skills by copying older children. In fact, from age four hunter-gatherer children mostly learn through unsupervised play in mixed-aged playgroups. We can improve wellbeing of children, especially city-dwelling children, by creating outdoor playing areas where children of different ages can engage in unsupervised activities. Projects like forest kindergartens are great examples. Here is a blog post with some practical suggestions.
Once hunter-gatherer children acquire skills through observing others, they start practicing. This is why an Mbendjele girl as young as six-years-old can accompany other women in the forest and gather her own yams. Of course, teaching is necessary to learn complex subjects like maths, but our education systems do not have enough room for practice. I took hours of statistics when I was an undergraduate student, and forgot it all. I truly learnt why and how to do statistics only when I had to do it for my research.
I think we should all start brain storming about the future of education: how can we create an environment where learning is guided by students’ interests, exploration and practice? We can look to hunter-gatherer childhoods and new machine learning strategies for inspiration.