AICurious Logo

What is: AutoInt?

SourceAutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networks
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

AutoInt is a deep tabular learning method that models high-order feature interactions of input features. AutoInt can be applied to both numerical and categorical input features. Specifically, both the numerical and categorical features are mapped into the same low-dimensional space. Afterwards, a multi-head self-attentive neural network with residual connections is proposed to explicitly model the feature interactions in the low-dimensional space. With different layers of the multi-head self-attentive neural networks, different orders of feature combinations of input features can be modeled.