Semiconductor Engineering

Toward Software-Equivalent Accuracy on Transformer-Based Deep Neural Networks With Analog Memory Devices

“Recent advances in deep learning have been driven by ever-increasing model sizes, with networks growing to millions or even billions of parameters. Such enormous models call for fast and ...
EurekAlert!

A novel deep learning model for medical image segmentation with convolutional neural network and transformer

Accurate segmentation of medical images is essential for clinical decision-making, and deep learning techniques have shown remarkable results in this area. However, existing segmentation models that ...
Channel NewsAsia Singapore

Top ex-Google Brain researchers start AI research company in Tokyo

Two prominent former Google researchers, one of whom was a co-inventor of the “transformer” artificial intelligence architecture that paved the way for the generative AI boom, announced on Thursday ...
IEEE

A Hybrid Deep Learning Framework Combining Convolutional, Transformer, and GRU Models with Mixture of Experts for RNA Sequence Analysis

Abstract: This work proposes a novel hybrid deep learning model that incorporates CNNs, Transformer models, and GRU layers, further extended with an MoE model, for advanced sequence analysis. The ...