AI-Powered Alchemy: Transforming Financial Data into Strategic Gold

Discover the transformative power of RAG and LLMs in financial analytics with our latest deep-dive into Generative AI! "AI-Powered Alchemy: Transforming Financial Data into Strategic Gold" unlocks the secrets to leveraging untapped data within your firm. Use zero-shot and one-shot learning; make use of vector databases and RAG to coral the corpora of often discarded wisdom in your firm. This information is a goldmine of value. See you easy it is to transform this unstructured, often discarded information into valuable reports and analysis.
🔑 Timestamps:
00:00 - Introduction to RAG & LLMs, and underutilised data
01:31 - Case Study: Real-World Application
04:03 - Examples of thrown-away valuable data
05:19 - Live Demonstration
07:48 - Requirements and Architecure
11:06 - How to Access the Source Code
🚀 What You'll Learn:
The basics of Retrieval Augmented Generation (RAG)
Leveraging Large Language Models (LLMs) for data analysis
Building applications with Generative AI for strategic insights
Transforming unstructured data into valuable reports
💡 Engage with Us:
Have thoughts on the future of Generative AI? Drop a comment below! For more in-depth analysis, check out our website: www.lucidate.co.uk
📥 Get the Source Code:
Ready to harness the power of AI in your firm? Access the full source code mentioned in the video by joining Lucidate's UA-cam membership at the MD or CEO levels: www.youtube.com/@lucidateAI/m...
✨ Subscribe for More Insights:
Stay ahead of the curve in financial technology. Subscribe now and never miss our expert analysis on cutting-edge tools like RAG and LLMs.
Alternative titles? Which would you choose?
"Unlocking Wisdom: How AI Transforms Financial Data into Gold"
"From Chaos to Clarity: AI's Role in Shaping Financial Insights"
"AI Revolution in Finance: Turning Chat Logs into Strategy"
"Generative AI: The Secret Weapon for Financial Foresight"
"Odysseus in the Office: AI-Powered Analysis for Financial Experts"

[@neurojitsu]

Quick question: does Claude2 have a similar capability to turn text into a vectorised docstore in order to do what it does? If so, then is the added value of your app the the eradication of the context window limit, or better 'tuning' of the workflows for this purpose, or some other magic sauce?! Trying to get my head round the value of your MD tier beyond the tools I'm learning to use at the moment. Thanks in advance.

[@lucidateAI]

Hi @neurojitsu All LLMs will use embeddings, transforming words (or more precisely sub-words called tokens) into vectors. If you are unfamiliar with this process then these videos will get you up to speed - ua-cam.com/video/6XLJ7TZXSPg/v-deo.html and ua-cam.com/video/RAIUJ3VFXmI/v-deo.html.
But that is different from taking a document, vector using it and putting it into a docstore or vector database. I use FAISS in this video but other vector databases include Pincone, Weviate and Chroma.
So Claude2 (nor GPT, Gemini, LLama2, Coral etc.) natively creat a docstore. This is separate action and you can link the docstore to the LLM using an AI framework like LangChain or AutoGen.
With large context windows; currently GPT has a 125k token context window, Claude2 200k and Gemini 1MM, there are a lot of documents that you can load into the prompt of an LLM for zero-shot or one-shot learning. ZSL and OSL are simple techniques whereby you temporarily “train” an LLM with content in its prompt. Think of it like a short term memory.
So you are 100% correct with a large enough context window you would not need to use a docstore. However if the size of your documents in tokens exceeds the size of the context window your LLM will “forget” some of the material. Furthermore if you are using a chat model and repeatedly querying and questioning the corpus of data in the prompt then the context window will fill up and again the LLM will forget some of the earlier content. Both of these problems are eliminated by using a docstore which acts as a longer term memory for crucial information.
Whether my MD tier is worthwhile is a tough question to answer as I’m biased. Sadly the only way to find out for real if it is useful for you is to try it out. With over 7Bn people on the planet and only a tiny, tiny fraction signed up as MDs the overwhelming vote from humanity is that the Lucidate MD tier is useless and a waste of time. So if you want to go with the herd then my advice is to avoid it like the plague. But the good news is that you can cancel at any time and only pay up to the month you have cancelled. So if you want to take a chance to find out if there are useful pieces of information in there then my advice might be different and I’d say give it a go! What have you got to lose other than one month’s subscription? (But as I said, I’m biased). Probably not the answer you were looking for, and 100% unhelpful, but honest.

[@neurojitsu]

@@lucidateAI many thanks for the detailed answer, that's very helpful. Happy to give your MD service a whirl I think, but it's not the cost so much as the utility/time savings in research and accelerated learning that I'm weighing up; are there other small company MDs in the community? I'm guessing frankly - since we're being honest - that I'm unlikely to become a consulting client of yours, so the value to me is also in learning from a community of others like me. And accessing help when I get stuck, plus some inspiration/guidance for how to adopt the right AI tools as things are moving so fast. My background field professionally is learning/talent and organisational change, and I'm currently researching and working on product development for my own business. I'll take a look at your tiers info...

[@lucidateAI]

Frankly I do not know what the make up of the Lucidate membership is. But you raise a good point and perhaps I should ask a question / set up a poll on the Lucidate Discord and find out. Thanks for the motivation to set up a poll!.
The key benefit of being an MD over a VP is access to some sample code in private GitHub repos along with some exclusive content (largely code walkthrough videos). If your prime motivation is to learn from others in the community then the VP level grants access to the Discord, no need to be a VP.
You can of course game the system a little. Join as a VP, and if you want access to the videos and code you can join as an MD for a month, clone the latest code from the repos, watch the MD-only videos and then downgrade your account to a VP at the end of the month, still retaining access to the community discussions on the Discord.

[@neurojitsu]

@@lucidateAI many thanks again! I'll give it a whirl...

[@lucidateAI]

See you on the Discord!