1

Lie Algebra Canonicalization: Equivariant Neural Operators under arbitrary Lie Groups

The quest for robust and generalizable machine learning models has driven recent interest in exploiting symmetries through equivariant …

Z. Shumaylov, P. Zaika, J. Rowbottom, F. Sherry, M. Weber, C.-B. Schönlieb

Shared Global and Local Geometry of Language Model Embeddings

Researchers have recently suggested that models share common representations. In this work, we find that the token embeddings of …

A. Lee, M. Weber, F. Viegas, M. Wattenberg

Performance Heterogeneity in Graph Neural Networks: Lessons for Architecture Design and Preprocessing

Graph Neural Networks have emerged as the most popular architecture for graph-level learning, including graph classification and …

L. Fesser, M. Weber

Enhancing the Utility of Higher-Order Information in Relational Learning

Higher-order information is crucial for relational learning in many domains where relationships extend beyond pairwise interactions. …

R. Pellegrin, L. Fesser, M. Weber

Unitary convolutions for learning on graphs and groups

Group-convolutional architectures, which encode symmetries as inductive bias, have shown great success in applications, but can suffer …

B. T. Kiani, L. Fesser, M. Weber

Hardness of Learning Neural Networks under the Manifold Hypothesis

The manifold hypothesis presumes that high-dimensional data lies on or near a low-dimensional manifold. While the utility of encoding …

B. T. Kiani, J. Wang, M. Weber

Contrastive Poincaré Maps for single-cell data analysis

Complex hierarchies and branching patterns underlie numerous biological processes, from organismic development to signal divergence …

N. Bhasker, H. Chung, L. Boucherie, V. Kim, S. Speidel, M. Weber

Effective Structural Encodings via Local Curvature Profiles

Structural and Positional Encodings can significantly improve the performance of Graph Neural Networks in downstream tasks. Recent …

L. Fesser, M. Weber

On the Hardness of Learning under Symmetries

We study the problem of learning equivariant neural networks via gradient descent. A recent line of learning theoretic research has …

B. T. Kiani, T. Le, H. Lawrence, S. Jegelka, M. Weber

Mitigating Over-Smoothing and Over-Squashing using Augmentations of Forman-Ricci Curvature

While Graph Neural Networks (GNNs) have been successfully leveraged for learning on graph-structured data across domains, several …

L. Fesser, M. Weber