← All accepted papers

Accepted paper · NeurIPS 2026 workshop

Metamorphic testing of learned AC optimal power flow surrogates reveals representation dependence

Stephen Peng, Vineet Jagadeesan Nair

Poster presentation · session and time TBD

13 December 2026 · Paris, France

Abstract

Changing bus order or an angle reference leaves the AC optimal power flow (AC-OPF) problem unchanged, but can change a learned surrogate's prediction. We test this dependence with thirteen metamorphic relations, each specifying when a transformation is valid and how to compare its outputs. Our screen covers 17 configurations: two released trained checkpoints and 15 random-weight architecture or mechanism controls. Every configuration fails at least six relations, including at tolerances ten times tighter or looser. For \texttt{GridSFM-Open v1.1}, source inspection and intermediate-tensor tests point to an indexing bug and three preprocessing choices; a repaired checkpoint remains untested. In a separate case500 experiment, augmentation reduces transformed-input error in three of four models and median discrepancy and constraint-violation P95 in all four. Most of the large Laplacian-model accuracy gain comes from a GPU/CPU eigensolver mismatch. Some relations worsen, and every evaluated prediction remains AC infeasible. Evaluating multiple encodings exposes failures that accuracy and feasibility scores on one encoding can miss. These results show why evaluations of learned physical surrogates should test consistency across equivalent representations alongside accuracy, optimality, and feasibility. For learned power-grid models, including foundation-model checkpoints, these are the criteria by which foundation-model claims should be evaluated under realistic conditions.

Paper

Open PDF in a new tab ↗

Your browser cannot display this PDF. Open the paper PDF.