Full time - Researcher / Natural Language Processing (NLP) for Multimodal Machine Learning
At a glance
Mid-level AI Research role at Sonyjapan. Tokyo · full-time.
Pay not stated AI Research salary
aimlroles summary, based on the employer's posting.
What you'll do
- Investigate NLP topics such as multimodal models, music and video understanding, reasoning, and controllable generation
- Prepare research for leading conferences and work with universities or business groups on joint projects
- Bring research into Sony or external products alongside product teams
- Develop R&D tools that help creators make music, movies, and games more efficiently
What you bring
- A relevant master's degree or equivalent practical experience in NLP, AI, machine learning, or a close field
- At least three years using Python, C or C++, and Linux or Unix
- At least two years in machine learning and NLP, with frameworks such as PyTorch or TensorFlow
- Research evidence such as conference papers, open-source software, or other scientific work
- Fluent, natural spoken and written English
Who this fits
This role suits a mid-career researcher who wants to take NLP work from research through product deployment. You’ll collaborate with university or business groups and product teams, and the job is based in Tokyo, Japan.
From the employer
Technology Field
Natural Language Processing
Machine Learning
Position Summary
We are an R&D organization dedicated to the research and development of large-scale generative AI technologies for content creation and production in the entertainment domain, including music, film, and games. Generative AI technologies have the potential to transform both consumer lifestyles and the workflows of professional creators, and are expected to become an essential component of the music, film, and gaming industries in the years ahead. By leveraging opportunities to collaborate directly with world-leading entertainment groups across these industries, our team engages in cutting-edge research and development to contribute to Sony Group’s businesses. For more information about our research activities and publications, please visit: https://sony.github.io/creativeai
Responsibilities
Fundamental research in natural language processing such as multimodal learning, multimodal LLM, music/video understanding, agent, reasoning, controllable generative modeling, deep generative models for discrete data, image/audio captioning, text-to-image/audio, vision-language pre-training, commonsense knowledge graphs, large-scale data development, etc.
You will be responsible for a wide range of activities, including paper submissions to top conferences (e.g. ACL, EMNLP, NeurIPS, ICLR, CVPR, etc.), collaborative research with universities and/or business groups, deployment of developed technologies within Sony and/or to third-party products together with product teams, etc.
You will also contribute to improving the efficiency of content creation in Sony's studios for music, movies, and game services by delivering AI-assisted tools developed by R&D.
Required qualifications
All of the following criteria are required.
■ Master's degree in natural language processing, artificial intelligence, machine learning, or closely related areas OR equivalent practical experience.
■ 3 years of experience with Python, C/C++, and Linux/Unix.
■ 2 years of experience in machine learning fields and NLP, using common frameworks such as PyTorch and TensorFlow.
■ Research ability, as demonstrated by a track record of conference papers, open-source software, or other scientific activities.
■ Ability to speak and write in English fluently and idiomatically.
Preferred qualifications
Qualifiction at the Ph.D level or higher in natural language processing, artificial intelligence, or machine learning is desirable.
Product, Service
Content creation support for movies/music/games, robots (Aibo), etc.
Development Environment
■OS: Windows and Linux
■Language: Python, C/C++, etc.
■PC, Server, Cloud Computing
Application Requirements
Essay: Not Required
Coding Test: Not Required
Required Skills:
Optional Skills: