The paper presents Hiformer, an innovative Transformer-based model tailored for recommender systems, emphasizing efficient heterogeneous feature interaction learning. Traditional Transformer architectures face significant hurdles in recommender systems, notably in capturing the complex interplay of diverse features and achieving acceptable serving latency for web-scale applications. …