Weixuan Sun (孙伟轩)
I am a Ph.D. student in Australian National University in Canberra, Australia, supervised by Prof. Nick Barnes. I am currently doing research intern at Shanghai AI Lab in Shanghai. I have also worked in SenseTime and OPPO as research intern. I received my Bachelors from Beijing Institute of Technology(mechanics) and Australian National University(mechatronics). My research interests include, effieicnt transformer networks, large language model, weakly supervised semantic segmentation and multimodal learning.
My Email: weixuansun7@outlook.com
News
- Scaling TransNormer to 175 Billion Parameters
Our new LLM work with a much more efficient structure!
paper
Selected Pubblications
- Vicinity Vision Transformer
Weixuan Sun, Zhen Qin, Hui Deng, Jianyuan Wang, Yi Zhang, Kaihao Zhang, Nick Barnes, Stan Birchfield, Lingpeng Kong, Yiran Zhong
TPAMI 2023 | paper - Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learning
Weixuan Sun, Jiayi Zhang, Jianyuan Wang, Zheyuan Liu, Yiran Zhong, Tianpeng Feng, Yandong Guo, Yanhao Zhang, Nick Barnes
CVPR 2023 | paper - All-pairs Consistency Learning for Weakly Supervised Semantic Segmentation
Weixuan Sun, Yanhao Zhang, Zhen Qin, Zheyuan Liu, Lin Cheng, Fanyi Wang, Yiran Zhong, Nick Barnes
ICCV Workshop 2023 | paper - Linearized Relative Positional Encoding
Zhen Qin, Weixuan Sun, Kaiyue Lu, Hui Deng, Dongxu Li, Xiaodong Han, Yuchao Dai, Lingpeng Kong, Yiran Zhong
TMLR 2023 | paper - Toeplitz Neural Network for Sequence Modeling
Zhen Qin, Xiaodong Han, Weixuan Sun, Bowen He, Dong Li, Dongxu Li, Yuchao Dai, Linpeng Kong, Yiran Zhong
ICLR 2023 | paper - The Devil in Linear Transformer
Zhen Qin, Xiaodong Han, Weixuan Sun, Dong Li, Lingpeng Kong, Nick Barnes, Yiran Zhong
EMNLP 2022 | paper - Audio-Visual Segmentation
Jinxing Zhou, Jianyuan Wang, Jiayi Zhang, Weixuan Sun, Jing Zhang, Stan Birchfield, Dan Guo, Lingpeng Kong, Meng Wang, Yiran Zhong
ECCV 2022 | paper - cosFormer: Rethinking Softmax in Attention
Zhen Qin, Weixuan Sun, Hui Deng, Dongxu Li, Yunshen Wei, Baohong Lv, Junjie Yan, Lingpeng Kong, Yiran Zhong
ICLR 2022 | paper - GETAM: Gradient-weighted Element-wise Transformer Attention Map for Weakly-supervised Semantic segmentation
Weixuan Sun, Jing Zhang, Zheyuan Liu, Yiran Zhong, Nick Barnes
paper - Inferring the Class Conditional Response Map for Weakly Supervised Semantic Segmentation
Weixuan Sun, Jing Zhang, Nick Barnes
WACV 2022 | paper - 3d guided weakly supervised semantic segmentation
Weixuan Sun, Jing Zhang, Nick Barnes
ACCV 2020 paper - Structural edge detection: a dataset and benchmark
Weixuan Sun, Shaodi You, Janine Walker, Kunming Li, Nick Barnes
DICTA 2018 paper