Research Scientist in Large Multimodal Models Applications - San Jose

Team Introduction Multimedia Lab's mission is to promote cutting-edge research in multimedia (including, but not limited to image/video data processing, compression and transmission), and to transfer technologies into our products for better serving our hundreds of millions of users. We are looking for exceptional individuals from all area of multimedia processing/compression/transmission, who have a track record of research excellence, a passion to shape the future of multimedia processing, and the potential to become an outstanding leader in the field.

Responsibilities

1. Contribute to the research and development of multimedia algorithms based on large multimodal models, including but not limited to video understanding, quality assessment, video processing and enhancement, and video compression.
2. Optimize and accelerate the performance of algorithms related to large multimodal models.
3. Explore the implementation of large multimodal models in multimedia applications, such as short video streaming, video transcoding, live streaming, etc.
4. Conduct advanced academic research on large multimodal models and publish findings in international conferences and journals.Minimum Qualification
5. Proficiency in Diffusion, LLM, and other advanced large multimodal models; experience with model training, tuning, and application.
6. Familiarity with computer vision (CV) algorithms, including GAN, VAE, and Diffusion for AIGC.

Preferred Qualification

1. Experience with NLP and RL algorithms, and knowledge of models such as Transformer, BERT, and GPT is preferred.
2. A history of leading impactful projects in large multimodal models or publishing in conferences (NeurIPS, ICLR, ICML, etc.) is advantageous.