Attention is all you need

Basic Information

• NIPS 2017 (former NeuralPS)
• Ashish Vaswani, Noam Shazeer, Niki Parmar et al. from Google Brain and Google Research

問題描述

RNN

近年來自然語言處理(Natural Language Processing, NLP)與機器翻譯等任務上時常使用 Recurrent Neural Network(RNN), Long Short-Term Memory(LSTM), Gated Recurrent Neural Network 等模型架構，我們也看到使用 Recurrent 模型以及 Encoder-Decoder 架構蔚為流行。

PiPa: Pixel- and Patch-wise Self-supervised Learning for Domain Adaptative Semantic Segmentation

Basic Information

• Mu Chen, Zhedong Zheng, Yi Yang, Tat-Seng Chua
• 2022 ACM Multimedia

問題描述

這一篇與過去看過的 DACS, ProDA, DAFormer, HRDA 同樣都是以 Unsupervised 的方式解決 Semantic Segmentationb 的 Domain Adaptation問題。

HRDA: Context-Aware High-Resolution Domain-Adaptive Semantic Segmentation

Basic Information

• Lukas Hoyer, Dengxin Dai, Luc Van Gool @ ETH Zurich & MPI for Informatics
• 2022 ECCV

問題描述

這篇 paper 如同 DAFormer 關注在 UDA for semantic segmentation 。

AlexNet: ImageNet Classifications with Deep Convolutional Neural Networks

Basic Information

• Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton @ University of Toronto
• 2012 NeurIPS

Problem Description

這是一篇將Deep Learning(深度學習)與Convolutional Neural Networks(卷積神經網路，以下簡稱CNN)運用在Computer Vision(計算機視覺)領域的開拓性論文。作者們train了一個Deep Convolutional Neural Network來分類ImageNet ILSVRC-2010資料集中的120萬張高解析度圖像，並得到了相較前人方法顯著優異許多的表現。

DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentation

Basic Information

• Lukas Hoyer, Dengxin Dai, Luc Van Gool @ ETH Zurich & MPI for Informatics
• 2022 CVPR

Image from Lukas Hoyer, Dengxin Dai, Luc Van Gool (2022)

Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic Segmentation

Basic Information

• Pan Zhang1, Bo Zhang, Ting Zhang, Dong Chen, Yong Wang, Fang Wen @ University of Science and Technology of China, Microsoft Research Asia
• 2021 CVPR

DACS: Domain Adaptation via Cross-domain Mixed Sampling

Basic Information

• 2020 Release
• 2021 WACV(Winter Conference on Applications of Computer Vision)
• Chalmers University of Technology(查爾摩斯理工大學)與 Volvo Cars 共同發表

What is Domain Adaption