Följ
Shuai Zheng
Shuai Zheng
Amazon Web Services
Verifierad e-postadress på connect.ust.hk - Startsida
Titel
Citeras av
Citeras av
År
Gluoncv and gluonnlp: Deep learning in computer vision and natural language processing
J Guo, H He, T He, L Lausen, M Li, H Lin, X Shi, C Wang, J Xie, S Zha, ...
Journal of Machine Learning Research 21 (23), 1-7, 2020
2062020
Communication-efficient distributed blockwise momentum SGD with error-feedback
S Zheng, Z Huang, J Kwok
Advances in Neural Information Processing Systems 32, 2019
1232019
Fast-and-Light Stochastic ADMM.
S Zheng, JT Kwok
IJCAI, 2407-2613, 2016
672016
Alexa teacher model: Pretraining and distilling multi-billion-parameter encoders for natural language understanding systems
J FitzGerald, S Ananthakrishnan, K Arkoudas, D Bernardi, A Bhagia, ...
Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and …, 2022
622022
Asynchronous Distributed Semi-Stochastic Gradient Optimization
R Zhang, S Zheng, JT Kwok
AAAI, 2323-2329, 2016
46*2016
Partial and asymmetric contrastive learning for out-of-distribution detection in long-tailed recognition
H Wang, A Zhang, Y Zhu, S Zheng, M Li, AJ Smola, Z Wang
International Conference on Machine Learning, 23446-23458, 2022
372022
Removing batch normalization boosts adversarial training
H Wang, A Zhang, S Zheng, X Shi, M Li, Z Wang
International Conference on Machine Learning, 23433-23445, 2022
342022
Cser: Communication-efficient sgd with error reset
C Xie, S Zheng, S Koyejo, I Gupta, M Li, H Lin
Advances in Neural Information Processing Systems 33, 12593-12603, 2020
342020
MiCS: Near-linear scaling for training gigantic model on public cloud
Z Zhang, S Zheng, Y Wang, J Chiu, G Karypis, T Chilimbi, M Li, X Jin
arXiv preprint arXiv:2205.00119, 2022
252022
Follow the moving leader in deep learning
S Zheng, JT Kwok
International Conference on Machine Learning, 4110-4119, 2017
232017
Accelerated large batch optimization of bert pretraining in 54 minutes
S Zheng, H Lin, S Zha, M Li
arXiv preprint arXiv:2006.13484, 2020
182020
Stochastic variance-reduced admm
S Zheng, JT Kwok
arXiv preprint arXiv:1604.07070, 2016
152016
Prompt pre-training with twenty-thousand classes for open-vocabulary visual recognition
S Ren, A Zhang, Y Zhu, S Zhang, S Zheng, M Li, AJ Smola, X Sun
Advances in Neural Information Processing Systems 36, 2024
132024
Lightweight Stochastic Optimization for Minimizing Finite Sums with Infinite Data
S Zheng, JT Kwok
International Conference on Machine Learning, 5932-5940, 2018
92018
Gemini: Fast failure recovery in distributed training with in-memory checkpoints
Z Wang, Z Jia, S Zheng, Z Zhang, X Fu, TSE Ng, Y Wang
Proceedings of the 29th Symposium on Operating Systems Principles, 364-381, 2023
82023
Compressed communication for distributed training: Adaptive methods and system
Y Zhong, C Xie, S Zheng, H Lin
arXiv preprint arXiv:2105.07829, 2021
72021
Spt: Semi-parametric prompt tuning for multitask prompted learning
MS Bari, A Zhang, S Zheng, X Shi, Y Zhu, S Joty, M Li
arXiv preprint arXiv:2212.10929, 2022
42022
Context, language modeling, and multimodal data in finance
S Das, C Goggins, J He, G Karypis, S Krishnamurthy, M Mahajan, ...
The Journal of Financial Data Science, 2021
32021
Vcc: Scaling Transformers to 128K Tokens or More by Prioritizing Important Tokens
Z Zeng, C Hawkins, M Hong, A Zhang, N Pappas, V Singh, S Zheng
Advances in Neural Information Processing Systems 36, 2024
22024
SMILE: Scaling Mixture-of-Experts with Efficient Bi-level Routing
C He, S Zheng, A Zhang, G Karypis, T Chilimbi, M Soltanolkotabi, ...
arXiv preprint arXiv:2212.05191, 2022
22022
Systemet kan inte utföra åtgärden just nu. Försök igen senare.
Artiklar 1–20