Deep Learning Scientist – Foundation Models

Vedi l’offerta su Go Lavoro: golavoro.it/annuncio-lavoro/7grytx

ph3About Translated /h3pTranslated is on a mission to allow everyone to understand and be understood, in their own language. We are a technology-powered professional translation provider. We partner with over 200,000 professional translators worldwide, in 200 languages. Our 310,000 clients range from private individuals who need their CV translated to some of the world's largest companies, such as Uber and Airbnb. /ph3About Translated /h3pTranslated is on a mission to allow everyone to understand and be understood, in their own language. We are a technology-powered professional translation provider. We partner with over 200,000 professional translators worldwide, in 200 languages. Our 310,000 clients range from private individuals who need their CV translated to some of the world's largest companies, such as Uber and Airbnb. /ppOur progress is largely powered by our ability to leverage scientific progress and realize the best synergy between humans and machines. We invest heavily in RD, including Large Language Models, Machine Translation, expressive speech synthesis, and privacy-preserving training. We operate as a science-driven company, where scientific innovations quickly make their way into production and have a measurable impact on our products and operations. /ph3We are looking for a Deep Learning Scientist to join our Foundation Models team, working on the development of large-scale textual language models from scratch. /h3pThe ideal candidate has a strong interest in Large Language Models, large-scale deep learning, and experimental research, and is excited about pushing the state of the art in multilingual language modeling. /ph3The Project: Foundation Models /h3pTranslated is building its own generation of bmultilingual Foundation Models /b, with the ambition of advancing the state of the art in open Large Language Models, particularly in multilingual capabilities. /ppOur work covers the complete LLM pre-training lifecycle: from data selection and curation to model architecture, scaling experiments, large-scale distributed training, evaluation, and continued training. /ppA central research question for the team is how to build models that perform strongly not only in English, but across a broad range of languages, including languages that are traditionally underrepresented in large-scale pre-training datasets. /ph3This Involves Research Across Areas Such As /h3ullilarge-scale language model pre-training /lilimultilingual language modeling /lilidata curation, filtering, scoring,



and mixture design /liliscaling laws and training dynamics /lilimodel architecture and optimization /lilidistributed and multi-GPU training /lilievaluation and benchmarking of Large Language Models /lilicontinued pre-training and mid-training strategies /li /ulpYou will work in the bFoundation Models team /b, a multidisciplinary group of scientists and engineers responsible for designing, training, and evaluating Translated’s next generation of Large Language Models. /ppThe team works closely with Translated's AI Research and Engineering organizations, combining experimental research with the engineering required to train models at scale on large GPU clusters and HPC infrastructure. /ph3Responsibilities /h3ullidesign and conduct research on Large Language Model pre-training /lilidesign experiments, implement them in code, run them at scale, and analyze their results /liliinvestigate model architectures, optimization strategies, training dynamics, and scaling behavior /liliresearch and develop multilingual training strategies /liliwork on data selection, quality, composition, and data mixture experiments for LLM pre-training /lilievaluate models across multilingual and general-purpose benchmarks /lilimonitor and benchmark the state of the art in Large Language Models /lilirun experiments on large-scale GPU and HPC infrastructure /lilitranslate research hypotheses into measurable experiments and actionable decisions for large-scale training /li /ulh3Requirements /h3ulli3+ years of research/industry experience in a relevant area of Deep Learning, Machine Learning, Natural Language Processing, or Large Language Models /lilistrong understanding of modern deep learning and Transformer-based language models /liliexcellent programming skills in Python /liliexperience designing and running machine learning experiments /lilifamiliarity with GPU-based training environments and Unix/Linux systems /liliability to analyze experimental results and make research decisions based on empirical evidence /liliinterest in large-scale experimental research and language model pre-training /liliability to follow, understand, and reproduce recent scientific literature /liliexcellent written and spoken English /liliability to work effectively with both researchers and engineers /li /ul h3Bonus points if...



/h3ulliyou have direct experience pre-training or continuing the pre-training of Large Language Models /liliyou have experience with distributed and multi-GPU training /liliyou have worked with large-scale training frameworks such as Megatron Bridge /liliyou have experience optimizing GPU utilization, throughput, memory consumption, or large-scale training stability /liliyou have worked on multilingual NLP or multilingual language models /liliyou have experience with large-scale dataset curation, filtering, deduplication, or data mixture design /liliyou have experience with LLM evaluation and benchmarking /liliyou have experience working with HPC environments /li /ulh3Our Offer /h3pDepending on expertise, the offered salary typically ranges between €40.000,00 and €55.000,00. Compensation generally grows quickly as experience leads to greater contributions. Exceptionally strong candidates may be offered salaries above this range to acknowledge their higher potential impact. /ppWe offer a flexible smart-working policy, while requiring regular presence at our Rome headquarters. /ph3Headquarter /h3pTranslated is hosted at Pi Campus, a working environment immersed in nature where six luxury villas in Rome, Italy, have been converted into functional offices designed to foster talent growth. Pi Campus is also a venture firm created by Translated to reinvest part of its profits into promising AI startups. /ph3Benefits And Perks /h3pAt Translated, we see our people as athletes, and Pi Campus as the place where they can reach their full potential. This vibrant environment fosters talent aggregation and continuous growth of mind, body, and spirit. /ppWe nurture and support the team's personal and professional development every day through growth-oriented initiatives such as personalized learning paths and networking events with industry leaders; health-oriented initiatives including massages, sauna, workouts in our gym and swimming pool; as well as relaxation rooms, open meeting rooms, a cafeteria, and fully equipped kitchens in every villa. /ppIn case of need, every team member has access to psychological, legal, and financial support. /ppLearn more about our company: /ph3Diversity Statement /h3pAt Translated, we proudly embrace and celebrate each individual's unique qualities, regardless of race, sexual orientation, gender identity, or any other differences. We recognize that diverse perspectives empower us to overcome challenges, foster innovation, and drive excellence. /ppAs an inclusive and equal-opportunity employer, we are committed to cultivating an environment where everyone feels welcome, valued, and supported to achieve their full potential. /ph3Privacy Policy /h3 /p #J-18808-Ljbffr

Vedi l’offerta su Go Lavoro: golavoro.it/annuncio-lavoro/7grytx