In the field of cybersecurity, most research on unknown attack detection still faces challenges such as low detection accuracy, slow detection speed, and imprecise category identification. Therefore, we propose the first combination of vertical language models with unknown scenario attack detection to predict binary and multi-class attacks. Two improved architectures based on the SecureBERT vertical model are built into our method: the fine-tuned FTSecureBert and the lightweight BLWSecureBert. The evaluation results show that our fine-tuned FTSecureBert outperforms the other comparative algori...