PulseAugur
EN
LIVE 09:42:04

SPADE transformer advances high-granularity calorimeter simulation

Researchers have developed SPADE, a novel autoregressive transformer model designed for simulating high-granularity calorimeter data in particle physics. Unlike previous methods that embed multiple features jointly, SPADE embeds them independently and introduces a delay between feature streams. This approach allows the standard self-attention mechanism to learn intra-token correlations effectively. SPADE demonstrates competitive performance against existing models for photon shower generation in the ILD detector and offers a new pathway for applying LLM-style pretraining to complex, multi-feature datasets. AI

IMPACT Introduces a new transformer architecture applicable to complex scientific simulation, potentially enabling LLM-style pretraining for high-dimensional data.

RANK_REASON The cluster contains a new academic paper detailing a novel model for scientific simulation. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.LG →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

COVERAGE [1]

  1. arXiv cs.LG TIER_1 English(EN) · Joschka Birk, Frank Gaede, Anna Hallin, Gregor Kasieczka, Martina Mozzanica, Henning Rose ·

    SPADE: Split-and-Delay Embeddings for Autoregressive High-Granularity Calorimeter Simulation

    arXiv:2606.11304v1 Announce Type: cross Abstract: We introduce SPADE (SPlit And Delay Embeddings), an autoregressive transformer for sequences whose tokens carry multiple features. Rather than embedding these features jointly, SPADE embeds them independently. Delaying each featur…