Bildtext får vara max två rader text. Hela texten ska högerjusteras om den bara ska innehålla fotobyline! Photo: B. Christensen/Azote
Strategies for sustainable management
Learning by doing
New modeling approach can help boost learning to deal with unexpected changes in management of renewable resources
- Management strategies that can deal with unexpected change in resource dynamics are becoming increasingly important
- Model results show that 'a learning by doing' strategy in the management of renewable resources can obtain high resilience to shocks and disturbances
- Adaptive management, as in learning by doing, should strive for: high learning rates to new knowledge, high valuation of future outcomes and modest exploration around what is perceived as optimal action
Back in 1916, Robert Frost spent an entire day ruminating about which path to take on a hike. Even after deciding, he spent an even longer time uncertain that he made the right choice and eventually wrote a poem about it entitled, The Road Not Taken.
More than a hundred years later and we are still trying to figure out: how does one make a decision when plagued by uncertainty?
A small group of researchers from the Stockholm Resilience Centre and the KTH Royal Institute of Technology might be getting closer to an answer.
In a study published in The Royal Society, centre researchers Emilie Lindkvist and Jon Norberg along with their colleague Örjan Ekeberg from KTH present a novel approach to understand how to simultaneously manage and learn about a system when its dynamics are unknown.
While climate change effects on species’ distributions and abundance is a known uncertainty, how climate change will disturb harvested species’ growth rates is often overlooked. Ignoring this latter type of uncertainty may have detrimental consequences such as eventual stock collapse
Emilie Lindkvist, lead author
Rising uncertainties pose additional challenges to the management of renewable resources. This means that management strategies that can deal with unexpected change are becoming increasingly important.
Adaptive management proposes the practice of learning-by-doing (LBD) to improve management during periods of uncertainty such as sudden fluctuations in an ecosystem. In their study, Lindkvist and her colleagues provide a useful insight into different aspects of learning-by-doing (LBD) and to identify robust strategies to improve adaptive management during turbulent times.
Creating an intelligent agent
The researchers used methods from reinforcement learning to create an artificially intelligent agent. This programmed agent then attempted to learn sustainable management of a renewable resource.
The conceptual model of the agent-resource system is made up of three learning components: a learning model, a mental model and a decision-making model. Each component of the conceptual model can be set to influence the LBD process by varying their parameter values (γ, α, τ). First, the agent decides on an action, next the harvest is received, and in the last step the agent learns from its experience and updates its mental model. The learning goal is to optimise harvests between current and future time steps. (See methodology section below for more information)
They focused on modeling the trade-offs in decision-making with respect to choosing optimal actions (harvest efforts) for sustainable management during change.
The researchers found that different kinds of learning will be useful in three different scenarios of increasing, decreasing and fluctuating resource growth rates.
Increasing resource growth rates provides a tolerant system in which to learn. A fixed strategy can be efficient for increasing growth because adaptation to change is less critical. This activity risks promoting shortsightedness, sticking to past beliefs about the system and modest exploration.
Declining growth rates provides a more unforgiving resource system. This scenario requires faster adaption to lower harvest rates. Learning in this system can only be done efficiently with discount factors, high learning rates and modest exploration.
During periods of fluctuating growth rates, having a fixed strategy that does not respond to growth chances suffered the lowest performance. Management strategies that promoted specialized learning had a higher performance. High value on outcomes, higher learning and modest exploration were all favourable during these uncertain scenarios.
Advice for management
However, the researchers warn, because of the uncertainty inherent to the dynamics of resource systems, we can never accurately predict how the resource dynamics will change. To accommodate this, the researchers propose three key aspects renewable resource managers should consider amid increasing uncertainty:
● Place the same value for present and future outcomes
In most economic decision-making the value of expected future outcomes plays a large role. The results of this work show that a high value of future outcomes is crucial for effectively learning sustainable resource use.
● Strive for higher learning rates to new knowledge.
Change your understanding of what action is more sustainable when harvests are unexpected. For resources with an increasing growth rate, slower adaptation is adequate, however, faster adaptation is advantageous for resources with declining or inconsistent growth rates.
● Conduct modest exploration around what is perceived as the optimal strategy.
To increase the efficiency of the learning strategy in a stable period, a relatively high exploration rate is favourable. For the fluctuating scenarios a relatively low exploration rate was enough. This indicates that during unstable periods, learning by adapting to feedbacks is sufficient.
Based on this, Lindkvist and her colleagues believe this study makes a strong first step to operationalise selected core principles in sustainability science. These include dealing with unexpected events, surprise and radical uncertainty, and incorporate these operationalised principles into enhanced management practice by bridging adaptive management theory and practice.
The researchers applied a novel approach to studying resource growth problems using a computed form of adaptive management to find optimal strategies for prevalent natural resource management dynamics.
The agent model was created through the combination of three learning components, each of which is associated with a specific learning parameter. The mental model stores the agent’s subjective estimate of the total long-term reward for every possible pair of states and next actions. For the decision-making model, they used a weighted random method to select an action at each time step specifically, the softmax policy. For the learning method, they used a temporal difference method where the agent updates its mental model after each interaction with its environment. The resource system was represented by the Gordon-Schaefer model, a nonlinear function with logistic growth, in discrete time.
Lindkvist E., Ekeberg O. , Norberg J.. 2017. Strategies for sustainable
management of renewable resources during environmental change. Proc. R. Soc. B 284:20162762.
Emilie Lindkvist’s research interests are focused on using novel simulation models to understand diverse aspects of sustainability in social-ecological systems. Her first line of research explores the emergence of self-organized governance, and the dynamics of trust among fishers.
Jon Norberg works with conceptual development of the resilience and complex adaptive systems (CAS) frameworks. His work spans theoretical ecology, such as the interaction between different response processes such as evolution, species sorting and dispersal, as well as the role of human information networks in solving complex management tasks.
Research news | 2023-06-02
More freshwater experts needed in the IPBES biodiversity panel
Centre researcher Jan Kuiper lists why and how more freshwater experts could contribute to the Intergovernmental Science–Policy Platform on Biodiversity and Ecosystem Services
General news | 2023-06-01
Centre researcher Juan Rocha elected into Young Academy of Sweden
Centre researcher Juan Rocha joins the Young Academy of Sweden, a junior version of the prestigious Royal Swedish Academy of Sciences, for a five-year term
Research news | 2023-05-31
Groundbreaking study quantifies safe and just Earth system boundaries
International commission proposes new safe and just boundaries for maintaining a healthy planet and protecting people from significant harm
Research news | 2023-05-25
AI could create a perfect storm of climate misinformation
The speed and the way misinformation about climate change and sustainability issues moves around the world is rapidly changing. Now, the Centre presents a new synthesis on AI and climate misinformation in connection to the Nobel Prize Summit 2023, "Truth, Trust and Hope"
Research news | 2023-05-22
Financial actors and academia join forces to build back biodiversity
Today is International Biodiversity Day! This year with the theme “From agreement to action: build back biodiversity”, and for us, that is a good reason to highlight the potential of the finance sector in reviving biodiversity
General news | 2023-05-17
Maria Tengö appointed special professor at Wageningen University
Maria Tengö is the most recently appointed professor at the Stockholm Resilience Centre