FALCON LLM in LangChain and HuggingFace. Is Falcon the OpenAI Alternative?

[@ashmitbhattarai7884]

Nice to see AI enthusiast from Nepal. If resources for running LLM etc were discussed, it would have been better. Overall, good summary.

[@brainybotnlp]

Great 🎉

[@WhisperingAI]

Thanks man

[@Neenad-x1e]

I tried to run exact same way as you shown in video, but encountered with ValueError: Could not load model tiiuae/falcon-7b-instruct with any of the following classes: (, )
this error . may you please help me to resolve this?

[@WhisperingAI]

Can be due to Version issue. Could you uninstall your Transformer and reinstall it again. Also check huggingface.co/tiiuae/falcon-7b/discussions/18. Hope it helps

[@Imran-Alii]

@Superb!!! Loved it!!!!

[@WhisperingAI]

Glad you liked it ❤️

[@deepakkrishna837]

getting the error while inferencing from falcon-7b model - '
AttributeError: module 'torch.nn.functional' has no attribute 'scaled_dot_product_attention'. transformers version ==4.27.2 & torch version == 2.0.1. - any idea why is this so?

[@WhisperingAI]

It might be issue in torch version
Try uninstalling torch and downgrade it

[@stabilitylabs]

Thanks for your tutorial. So, can you suggest me what's the best model for non English and free?

[@WhisperingAI]

Problem with opensource model is its not best for non english. Have check some model but result doesnot seem quite good for non english. So i guess it need to fine tuned in order to use it for multilingual.

[@Florentin3]

Nice video. Where did you get the leaderboard chart from?

[@WhisperingAI]

I got it from linkdln and open source model leaderboard can be found in huggingface

[@pleabargain]

Code or Notebook URL?

[@WhisperingAI]

Thanks for watching.
here you go colab.research.google.com/drive/1AFg9z1II64yGD3s3A4VCeCeJddWjeO_X