Dubai PR Network, Online Press Release from Dubai and Middle East
 
Business, Banking and Investments(Banking & Investments)
Filter PR by
  

Meet “Jais”, The World's Most Advanced Arabic Large Language Model Open Sourced by G42's Inception

 
Meet “Jais”, The World's Most Advanced Arabic Large Language Model Open Sourced by G42's Inception

Developed in partnership with MBZUAI, Jais was trained on the 

Condor Galaxy 1 AI supercomputer on 116 billion Arabic tokens and 279 billion English tokens of data.

Abu Dhabi, August 30 — Inception, the pioneering G42 company dedicated to pushing the boundaries of AI, announced the open-source release of Jais, the world’s highest quality Arabic Large Language Model. Jais is a 13-billion parameter model trained on a newly developed 395-billion-token Arabic and English dataset. 

With a name inspired by UAE’s highest peak, Jais will bring the advantages of generative AI across the Arabic-speaking world. The model is the result of a collaboration between Inception, Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) -- the world’s first graduate research university dedicated to AI -- and Cerebras Systems. It was trained on Condor Galaxy, the recently announced multi-exaFLOP AI supercomputer built by G42 and Cerebras. 

Jais’ release marks a significant milestone in the realm of AI for the Arabic world. It is a model homegrown in the UAE’s capital, Abu Dhabi, offering more than 400 million Arabic speakers the opportunity to harness the potential of generative AI. It will facilitate and expedite innovation, highlighting Abu Dhabi’s leading position as a hub for AI, innovation, culture preservation, and international collaboration. 

By open-sourcing Jais, Inception aims to engage the scientific, academic, and developer communities to accelerate the growth of a vibrant Arabic language AI ecosystem. This can serve as a model for other languages currently underrepresented in mainstream AI.

'We believe that innovation thrives when we collaborate,' says Andrew Jackson, CEO of Inception. 'With this release, we are setting a new standard for AI advancement in the Middle East and ensuring that the Arabic language, with its depth and heritage, finds its voice within the AI landscape. Jais is a testament to our commitment to excellence and our dedication to democratizing AI and promoting innovation.'

Jais outperforms existing Arabic models by a sizable margin. It is also competitive with English models of similar size despite being trained on significantly less English data. This exciting result shows that the model’s English component learned from the Arabic data and vice versa, opening a new era in LLM’s development and training.

MBZUAI President and University Professor Eric Xing said, ”Developing such a high-caliber Arabic LLM demanded cutting-edge AI research in addition to an in-depth and nuanced understanding of the Arabic language, its diversity and heritage, and the growing importance of LLMs across all echelons of society. Thanks to our research and partnerships with Inception and other top regional and global organizations, MBZUAI will continue pioneering LLMs that are efficient, effective, and accurate.”

In tandem with the model release, Inception and MBZUAI also established an academic partnership to give early-release access to current and future Arabic LLMs developed by the team for testing purposes. Academic partners for the launch included Carnegie Mellon University, Ecole Polytechnique, Hamad bin Khalifa University, Sorbonne Paris Nord - LIPN, NYU Abu Dhabi’s CAMeL Lab, and The University of Edinburgh. Several organizations, including the UAE Ministry of Foreign Affairs, the UAE Ministry of Industry and Advanced Technology, The Department of Health – Abu Dhabi, Abu Dhabi National Oil Company (ADNOC), Etihad Airways, First Abu Dhabi Bank (FAB), and e& will start utilizing Jais, offering valuable insights to further enhance the model. 

Jais’ development and training

Jais is a transformer-based large language model that incorporates many cutting-edge features, including ALiBi position embeddings, which enables the model to extrapolate to much longer inputs, providing better context handling and accuracy. Other state-of-the-art techniques include SwiGLU and maximal update parameterization to improve the model’s training efficiency and accuracy. 

Jais’ training, fine-tuning, and evaluation were undertaken by an Inception/MBZUAI joint team on the Condor Galaxy 1 (CG-1), the recently announced, state-of-the-art AI supercomputer co-developed by G42 and Cerebras Systems. The 13-billion parameter open-source model was trained on a unique and purpose-built dataset of 116 billion Arabic tokens designed to capture the complexity, nuance, and richness of Arabic. It also included 279 billion English word tokens aimed at increasing the model’s performance through cross-language transfer. Inception and MBZUAI will continue to expand and refine Jais as its user community grows.

“Our strategic partnership with G42 is already delivering pioneering results. A few weeks ago, we introduced the first multi-exaFLOP AI supercomputer, Condor Galaxy 1 (CG-1). Now, the partnership delivers another key breakthrough: the leading Arabic LLM for the open-source community,” said Andrew Feldman, co-founder and CEO of Cerebras Systems. “At Cerebras our passion is building groundbreaking technology. One of the great rewards is seeing the innovative ways it is used. Jais is a significant contribution to the international open-source community. It is also a testament to how incredibly easy CG-1 is to use and how it enables extremely rapid AI model development.” 

Today, Inception sits at the intersection of the academic, business, and regulatory realms to unlock synergies, foster collaboration, and accelerate the commercialization of AI across industries.

Jais is available for download on Hugging Face. Users can also try Jais online upon registering interest on Jais’ website and receiving an invite to access the playground environment. To know more about Jais and how it benchmarks against other models, you can read the Jais white paper.


Posted by : DubaiPRNetwork.com Editorial Team
Viewed 24571 times
PR Category : Banking & Investments
Posted on : Thursday, August 31, 2023  11:39:00 AM UAE local time (GMT+4)
Replication or redistribution in whole or in part is expressly prohibited without the prior written consent of DubaiPRNetwork.com.
Previous Story : Multiply Group Secures 55% Majority Stake in Media 247, Stre...
Next Story : ADX Launches Investment Outlook Report in Partnership with F...
Email this article Print this article

Share this article with your friends and followers
NewsVine
Back to Section Home

Related Stories



 
 
Most Viewed Press Release posted in the last 7 days
2023 Safest Year for Flying By Several Parameters [24051-Views]
Mr. Arjun Dhanak of Kanz Jewels Clinches Youngest MD Award at The Retail Jeweller Dubai Fo... [14293-Views]
Xiaomi 14 Ultra Makes a Big Entrance in the UAE for the First Time [9639-Views]
Nabtih Debuts Ramadan Gift Baskets, Highlighting Palestinian Craftsmanship and Tradition [8626-Views]
UAE's Newest Home-Grown Fragrance Brand –FARIDAH– Unveiled, Complements The $12.4 bn Perfu... [6835-Views]
SANTONI SETS THE TONE FOR THE NEXT FALL/WINTER SEASON DURING MILAN FASHION WEEK [6724-Views]
Dyson unveils new pop-up experience at Dubai International Airport [6605-Views]
Union Coop Strengthens Support for Local farmers [6166-Views]
Dubai government entities review ambitious 'Dubai 10X' projects [5847-Views]
All-New Ford Territory Dark Edition Elevates Crossover SUV Style in the Middle East [5740-Views]
Bluewaters Sets Scene for Ramadan with Stunning Weekend Fireworks This March [5728-Views]
Dubai Culture celebrates Burj Rashid's 45th anniversary, showcasing its rich history [5576-Views]
Clinique La Prairie To Showcase Longevity Lounge At Art Dubai 2024 [5539-Views]
Eaton to Showcase Cutting-Edge Sustainable Energy Solutions at LEAP 2024 in Saudi Arabia [5498-Views]
BENTAYGA EWB – INFINITE CHOICE, CURATED BY MULLINER [5494-Views]
NBF's new Ramadan campaign provides new financing opportunities for customers [5478-Views]
A total of 360 riders qualify for world cycling event in Aalborg, Denmark at the end of Au... [5309-Views]
ATP STARS EBDEN AND BOPANNA MAKE A GRAND SLAM IMPACT AT DUBAI DUTY FREE TENNIS CHAMPIONSHI... [5199-Views]
SPORTMAX FW 2024 FASHION SHOW [5137-Views]
Environment Agency – Abu Dhabi Launches an Odorous Gas Monitoring Network [4969-Views]
Natuzzi Italia Unveils the Colle Sofa, a Design Collaboration with BIG Studio – Bjarke Ing... [4895-Views]
DSO and MIT Honour Winner of MIT DesignX Dubai Accelerator's First Cohort [4871-Views]
Malabar Gold & Diamonds Set to Launch 10 New Showrooms; Global Store Count to Reach 350 by... [4863-Views]
Arabian Automobiles Elevating Luxury and Safety [4842-Views]
Debut of the New Maserati GranCabrio The Trident's New Spyder: Iconic Design and Open-Top... [4813-Views]
 
RSS Facebook Twitter LinkedDin DubaiPRNetwork.com on Instagram
 
Top Sections
 
Top Stories