Architecture
DCPM-ADMET
Quickly and accurately predict about 100 kinds of Administration, Distribution, Metabolism, Excretion and Toxicity properties of chemicals with DCPM-ADMET, a pretrained AI model leveraging permutation operation and two-stream self-attention mechanism to enhance drug discovery.
Features
Permutation & Auto Regression
Permutation randomly shuffles the order of the atoms. This allows model to learn from all possible combinations of the atoms in a sequence and capture bidirectional dependencies.
Two-stream Self-attention
Two-stream self-attention consists of content attention and query attention. With two-stream self-attention, model can learn from all possible contexts of each token and capture bidirectional dependencies.
