Generative AI

Snowflake Integrates AI21 Labs’ Jamba-Instruct to Empower Enterprises with Advanced Document Processing

25 July 2024

|

Zaker Adham

Summary

Data cloud leader Snowflake has announced a significant enhancement to its Cortex AI service by integrating the Jamba-Instruct large language model (LLM) from Israeli AI startup AI21 Labs. Starting today, this powerful model will enable Snowflake’s enterprise customers to develop generative AI applications, such as chatbots and summarization tools, specifically designed to handle long documents with exceptional quality and accuracy.

Expanding AI Capabilities

The addition of Jamba-Instruct marks a new milestone for Snowflake, offering its customers a versatile tool for creating AI solutions. These applications can manage extensive documents without compromising on performance, a crucial capability for enterprises dealing with large volumes of data.

Alongside Jamba-Instruct, Snowflake’s fully managed service now includes a diverse range of LLMs, featuring its own Arctic model and those from tech giants like Google, Meta, Mistral AI, and Reka AI.

Flexible and Comprehensive Solutions

"We aim to provide our customers with the flexibility to choose from either open-source or commercial models, selecting the best model to meet their specific use case, cost, and performance requirements — without having to set up complex integrations or move data from where it is already governed within the AI Data Cloud," said Gultekin, Snowflake’s AI head.

Snowflake plans to expand this list further, incorporating more advanced models from AI21 and other developers in the coming months. The integration process is driven by customer feedback to ensure that each model meets specific requirements and use cases effectively.

Strict Integration Guidelines

Gultekin emphasized the rigorous guidelines and processes Snowflake follows for integrating LLMs into Cortex AI. "We want to make sure the model offering covers a broad range of use cases from automated BI to conversational assistants to text processing and summarization. And the model should have unique capabilities — for example, Jamba-Instruct has the largest context window amongst the models that we offer to date," he added.

Enhanced Decision-Making Tools

To help enterprises navigate the expanding array of AI models, Snowflake recently acquired TruEra. This acquisition allows companies to leverage TruEra’s TruLens offering to conduct LLM experiments and identify the best models for their needs.

Broad Adoption and Use Cases

Currently, over 5,000 enterprises utilize Snowflake’s AI capabilities, including Cortex AI and related features. The top use cases span automated business intelligence, conversational assistants, and text summarization, highlighting the versatile applications of Snowflake’s AI integrations.