Tech Xplore

Model steering is a more efficient way to train AI models

Training artificial intelligence models is costly. Researchers estimate that training costs for the largest frontier models ...
IEEE

P-BERT: Toward Long Sequence Modeling by Enabling Language Representation With Prefix Sequence Compression, Soft Position Embedding, and Data Augmentation for Patent Relevance ...

Abstract: Recent works have increasingly adopted pre-trained language models, such as BERT, to model technical semantics for patent relevance assessment. However, existing truncation and divide-merge ...
IEEE

Temporal Modeling With Frozen Vision–Language Foundation Models for Parameter-Efficient Text–Video Retrieval

Abstract: Temporal modeling plays an important role in the effective adaption of the powerful pretrained text–image foundation model into text–video retrieval. However, existing methods often rely on ...