Do We Still Need Rotation-Invariant Architectures? A Statistical Robustness Benchmark for Point Cloud Classification

Winter Conference on Applications of Computer Vision (WACV 2027)

Abdulla Nasir Chowdhury, Gulpi Qorik Oktagalu Pratamasunu, Kazuhiro Fukui

University of Tsukuba

Scatter plot of mean noise drift against mean pose drift for the 10 backbones. RI and equivariant models sit near zero pose drift with high noise drift; most standard backbones sit at higher pose drift and lower noise drift.
The pose/noise trade-off measured in this paper. Each point is one backbone: mean embedding drift D across all 5 domains, with pose pooled over the three single-axis rotations. No backbone reaches the bottom-left corner.

Abstract

A substantial line of work builds rotation invariance directly into point cloud architectures. We benchmark 10 architectures (PointNet, PointNet++, DGCNN, RIConv, RIConv++, RISurConv, PointMLP, PointTransformer, and the equivariant VN-PointNet and VN-DGCNN) across 5 domains under pose, noise, and occlusion, and analyze the results with confirmatory hypothesis tests rather than point estimates. The three rotation-invariant (RI) architectures achieve the best pose robustness but rank among the lowest on noise robustness in 4 of 5 domains. We ask whether this cost is intrinsic to invariance or specific to how invariance is obtained. We retrain all 10 architectures unchanged, with a simple invariance loss on the embedding and three training seeds each, and evaluate all models on the independently designed ModelNet40-C. Invariance training transfers narrowly but reliably. It improves exactly the corruption families its perturbations target wherever the baseline has headroom (mean occlusion +10.5, lidar +13.4 percentage points of accuracy). At matched training budget the best standard backbone and the best RI architecture end on par on unseen corruptions (within 2.5 percentage points in every seed), and invariance-trained RIConv++ is the most seed-stable top model. Once rotation augmentation is widened, standard backbones concede only a flat, angle-independent accuracy offset under full-sphere rotation. We release the benchmark along with a package for analyzing point cloud robustness and reproducing our results.

The benchmark

Three perturbations, each at five severity levels, applied to 1024-point clouds from five domains. Three of the five levels are shown here.

Pose rotation angle

Chair rotated 40 degrees
40°
Chair rotated 80 degrees
80°
Chair rotated 120 degrees
120°

Noise Gaussian σ

Chair with noise sigma 0.005
0.005
Chair with noise sigma 0.02
0.02
Chair with noise sigma 0.05
0.05

Occlusion camera distance multiplier; dark points are kept, light points removed

Chair under hidden point removal, camera multiplier 0.3
0.3
Chair under hidden point removal, camera multiplier 1.2
1.2
Chair under hidden point removal, camera multiplier 6.0
6.0

Domains

ModelNet40 sample
ModelNet40
synthetic CAD
ShapeNet sample
ShapeNet
synthetic CAD
ABO sample
ABO
product scans
ScanObjectNN sample
ScanObjectNN
real indoor scans
S3DIS sample
S3DIS
real building scans

Results

Three panels of severity curves for pose, noise, and occlusion, by architecture family.
Severity scaling for the standard (blue), RI (green), and equivariant (orange) families. Lower is better. Bold lines are the mean of the 5 domain-level family means, and thin lines are individual domains. The RI and equivariant families' advantage on pose and disadvantage on noise hold at every severity level. Occlusion shows no comparable family-level pattern.
Two panels showing accuracy gain and headroom by ModelNet40-C severity for lidar and occlusion.
Severity-resolved transfer, averaged over all 10 architectures: accuracy gain (left) and headroom (right) by ModelNet40-C severity for the two target corruption types. Gains are severity-stable. Headroom rises at the harshest severity without the gains following.
Four panels of classification accuracy against rotation angle over 360 degrees for yaw, tilt, roll, and free SO(3).
Classification accuracy at 10-degree resolution through the full 360-degree sweep, with the five standard backbones retrained with pose augmentation widened to ±270 degrees (all 300 held-out ModelNet40 test instances). The RI family holds flat bands at every angle on every axis. The widened-augmentation backbones hold flat bands of their own below the RI ceiling, showing offsets rather than troughs.

Package

pcrobust packages the corruption generators, the 10 architectures, the evaluation protocol, the statistical pipeline, the training recipes, and all 193 trained checkpoints. The version evaluated in the paper is v1.0.0.

pip install pcrobust

# Rebuild a paper table from the bundled data and check every number (no GPU)
pcrobust reproduce tab:noise --compare-paper
import numpy as np
import pcrobust

pts = np.random.rand(1024, 3).astype(np.float32)
occluded = pcrobust.corrupt(pts, "occlusion", severity=3)

# Checkpoints download on first use and are verified by SHA256
model, classes = pcrobust.load_model("modelnet40/riconvpp_invreg_rep1.pth")

MIT for code. Checkpoints and result CSVs: CC BY 4.0.

BibTeX

@inproceedings{chowdhury2027rotation,
  title={Do We Still Need Rotation-Invariant Architectures? A Statistical Robustness Benchmark for Point Cloud Classification},
  author={Chowdhury, Abdulla Nasir and Pratamasunu, Gulpi Qorik Oktagalu and Fukui, Kazuhiro},
  booktitle={Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
  year={2027},
  eprint={2611.03952},
  archivePrefix={arXiv},
  doi={10.48550/arXiv.2611.03952}
}