Snowflake Cortex: Industry-leading AI Models And LLMs In Snowflake | Snowday 2023
Вставка
- Опубліковано 29 лис 2024
- Snowflake Cortex, available in private preview, is an intelligent, fully managed service that offers access to industry-leading AI models, LLMs, and vector search functionality, making it easy to securely run LLMs inside Snowflake. Snowflake Cortex makes it possible to run tasks, such as translating text, in seconds or build contextualized apps in minutes by combining Meta AI’s Llama 2 model and vector functions, all inside Snowflake Cortex.
@SnowflakeDevelopers Are there any storage limitations for documents/knowledge that will train the retreival augmented generation? Also, if those documents are needing to be updated, will this need to be re-embedded for Cortex to access the new data? Thank you!
Are OpenAI models supported as well? Are they priced more than OpenAI token costs?
is cortex available now ?
Check the details out here! docs.snowflake.com/en/guides-overview-ml-powered-functions
Is there a general compute cost that these LLAMA model queries cost? Something we can use as a rule of thumb when exploring data with these LLM models would be great? If it's $1 per 1000 characters ingested that's very different than $0.01 per 1000 characters for example. Thanks!
Hi @okstuv! Great question. In the early preview, using these models is free. Keep an eye out for updated pricing in the very near future. The market rate for Llama2-70B / GPT3.5-type models is on the order of ~$0.001 to $0.002 per 1K tokens. I hope that's helpful!
placing a lot of trust in your AI summariser - assuming it will always produce the correct results.. (it won't)
where can I download sample database
How do I get notebooks for my account?
Hi @ericpad! Notebooks are currently in Private Preview. Reach out to your Snowflake account representative for more information.
can anyone share source code