Neural Cosmic Drift