NERS publishes report on machine learning and microreactors

July 9, 2025, 9:31AMANS Nuclear Cafe
The compact, transportable Holos-Quad microreactor, developed by HolosGen, is shown housed within a standard 40-foot ISO container. (Image: HolosGen)

The University of Michigan’s Department of Nuclear Engineering and Radiological Sciences (NERS) has published a summary of a study on nuclear microreactors and machine learning (ML) that was conducted by researchers from NERS and Idaho National Laboratory. The full paper, “Nuclear Microreactor Transient and Load-Following Control with Deep Reinforcement Learning,” was featured in the July issue of Energy Conversion and Management: X.

Automated control: The study examined a new ML approach for modeling the adjustment of nuclear microreactor power output to meet grid demand, based on the design of HolosGen’s Holos-Quad microreactor. According to the researchers, their ML approach, called multiagent reinforcement learning (RL), allows for more efficient training and reduced training time than previous approaches, helping researchers model reactors faster.

Holos-Quad microreactor: The high-temperature, gas-cooled micoreactor is designed for scalable, self-contained power generation. Its architecture was reportedly inspired by closed-loop turbo jet engines, replacing conventional combustion chambers with sealed nuclear fuel cartridges, which integrate fuel, moderation, heat exchange, and power conversion within individual pressure vessels.

Its compact design can fit inside a 40-foot International Organization for Standardization (ISO) container.

Load-following simulation: The research team focused on simulating load-following, which is the increase or decrease in electricity output to match the demand of the grid. The Holos-Quad system is designed to adjust power through the position of eight control drums that center around the reactor’s central core. One side of the control drum’s circumference is lined with a neutron-absorbing material that, when the drum is rotated inward, absorb neutrons from the core, causing the neutron population and the power to decrease. Meanwhile, rotating the cores outward keeps more neutrons in the core, increasing power output.

In the investigators’ multiagent RL approach, the eight control drums of the Holos-Quad reactor core were modeled as eight independent agents, with specific drums being controlled independently, while information about the core as a whole was also obtained.

Comparisons: Tests comparing the results of the team’s multiagent RL model approach with a single-agent approach (in which a single agent controls all eight drums) and the industry standard proportional-integral-derivative (PID) approach (with a feedback-based control loop) showed benefits for the RL model.

Main conclusions: The researchers noted that their ML model will need extensive validation in more complex and realistic conditions before it can be commercially applied by the nuclear power industry. Nevertheless, their findings “establish a more efficient path forward for reinforcement learning in autonomous nuclear microreactors.”


Related Articles

ANFM 2025 is on the horizon

May 1, 2025, 3:01PMANS News

The first Advances in Nuclear Fuel Management (ANFM) conference in eight years is being held July 20–23, 2025, at the Sheraton Sand Key Resort in Clearwater Beach, Fla....

Sam Altman steps down as Oklo board chair

April 24, 2025, 2:52PMNuclear News

Advanced nuclear company Oklo Inc. has new leadership for its board of directors as billionaire Sam Altman is stepping down from the position he has held since 2015. The move is meant to open...

Nuclear education and training

March 13, 2025, 7:02AMNuclear News

This year's ANS Conference on Nuclear Training and Education (CONTE), held in early February, tackled emerging approaches to nuclear skills and the workforce. How do we attract, retain, and...

Wisconsin lawmakers push nuclear support

February 13, 2025, 3:00PMNuclear News

A joint resolution under consideration in the Wisconsin legislature aims to declare and promote the state’s support for nuclear power and willingness to deploy additional sources....