Це відео не доступне.
Перепрошуємо.
Text Extraction From a Corpus Using BERT (AKA Question Answering)
- Додати в
- Мій плейлист
- Переглянути пізніше
- Поділитися
Поділитися
Вставка
Розмір відео:
- Опубліковано 19 сер 2024
КОМЕНТАРІ • 80
Наступне
Автоматичне відтворення
Training BERT Language Model From Scratch On TPUsAbhishek Thakur
Переглядів 30 тис.
Applying BERT to Question Answering (SQuAD v1.1)ChrisMcCormickAI
Переглядів 57 тис.
Deep learning for (almost) any text classification problem (binary, multi-class, multi-label)Abhishek Thakur
Переглядів 30 тис.
«Синку, ти не переживай. Сюди вона не впаде, вони всі повз летять»: військовий про перші дні війниСуспільне Запоріжжя
Переглядів 757 тис.
SCHOOLBOY. Последняя часть🤓⚡️КАН АНДРЕЙ⚡️
Переглядів 12 млн
Арестович: Операция ВСУ в Курской области. @A.ShelestAlexey Arestovych
Переглядів 3 млн
⚡️ "Пятки сверкали" аж до КУРСКА! "Кадыровцы" БЕЖАЛИ, оголив фронт!FREEДOM. LIVE
Переглядів 1,1 млн
Question-Answering in NLP (Extractive QA and Abstractive QA)James Briggs
Переглядів 8 тис.
S1 E1: Approaching Visual Question Answering (VQA) - Vision Language Modelling Series.Donkey Stereotype by PrithiviDa
Переглядів 7 тис.
BERT explained: Training, Inference, BERT vs GPT/LLamA, Fine tuning, [CLS] tokenUmar Jamil
Переглядів 36 тис.
Using spaCy with Hugging Face Transformers | Matthew HonnibalDSAI by Dr. Osbert Tay
Переглядів 15 тис.
4 ways to do question answering in LangChain | chat with long PDF docs | BEST methodSophia Yang
Переглядів 39 тис.
How to extract semantic and meaningful keywords with BERTAhmed Besbes
Переглядів 20 тис.
Use LLMs To Extract Data From Text (Expert Mode)Greg Kamradt (Data Indy)
Переглядів 56 тис.
AI, Machine Learning, Deep Learning and Generative AI ExplainedIBM Technology
Переглядів 73 тис.
I've been using Redis wrong this whole time...Dreams of Code
Переглядів 352 тис.
НАСТУП ЗСУ НА БЄЛГОРОД. Залужного підставили! Новий план Сирського. Евакуація з Курщини! КорчинськийДмитро Корчинський
Переглядів 415 тис.
ПЕТРО ЧЕРНИК ПОВЕРНУВСЯ! Про Курськ, реакцію Путіна та стратегічний переламСпецпроєкти Сергія Мамаєва
Переглядів 173 тис.
Як на КУРЩИНІ ПАДАВ АКВАФРЕШ РФТСН
Переглядів 630 тис.
How I Did The SELF BENDING Spoon 😱🥄 #shortsWian
Переглядів 35 млн
⚡"УДАЧІ, БАТЯ!": воїни ЗСУ і місцевий мешканець у м. Суджа Курської областіYanina Sokolova
Переглядів 955 тис.
На РФ паніка. Путін б'є ІСКАНДЕРАМИ по Курщині #shorts24 Канал онлайн
Переглядів 516 тис.
Sad To Announce I Did Not Qualify For Mens 2024 Olympic Gymnastics TeamThe Rock
Переглядів 28 млн
«Ми так війну не закінчимо ніколи»: 22-річний морпіх про те, чому їм потрібні молоді #війна #зсуСлідство.Інфо | Розслідування, репортажі, викриття
Переглядів 704 тис.
Kernel is available here: www.kaggle.com/abhishek/text-extraction-using-bert-w-sentiment-inference
Could you share all the code including training scripts? I'd be really grateful for that! (Because I haven't found kernel with training process on Kaggle)
Can you please share the Training code also?
I have bought the book and it's on it's way. So just want to know, does your book contains this part too ? and also let me know.. if any other book written by you
Chapters (Powered by ChapterMe) -
00:02 - Introduction
02:35 - Designing the DataLoader
10:34 - Implementing the DataLoader
44:13 - Implementing the model
01:24:40 - Kernel walkthrough
I had high expectations for this video, but somehow you managed to surpass them!
You're a legend Abhishek, thank you
Wow! Your comment just made my day :)
I had a stop in my learning process for a while and this videos resumed my interest again. Thanks for the video abhishek
Really enjoying these BERT videos. Great to see how you go about creating dataloaders for tasks that have a sequence as a target.
Found gold! Nice work ma guy
It's a privilege to learn from first 4GM...please include some CV topics too.. Thank you for making these videos as a free content..Subscribed..
thank you very much for your explanations. You made hard concepts/implementations easy to understand. 👍
Congratulations for gaining 10k subscribers .. Your videos are practical and advanced ..Looking forward to more such videos ..
it would be great help for beginners like me if you explain the things a little bit more, like why you are using something(like why you have taken 2 outputs in output layer or why you are choosing a particular evaluation matrix).
Great video! Thanks a lot Abhishek. I'm your subscriber. Please make more videos!!
Excellent
Good to learn from you appreciate your work. I have small request that explain a little more then it will be helpful for people like me with intermediate knowledge
Thanks for this amazing tutorial on BERT it's very useful for me
Thanks, it helps to understand the steps in your Kaggle kernel.
Thanks so much for including the inference section.
Thank you for taking time to create this. :)
Thanks for this amazing video !
Just did my first Kaggle Submission with the same ARCH in tensorflow .
Fantastic!
Thank you for your time and effort. Keep the good work going on.
Thanks very much for the video.
I believe it would be of great help to provide a outline of code first showing what we will be doing and why we are doing them.
wonderful video
Thank you for sharing your knowledge. Your videos help me a lot. I still have a question regarding how the BERT works for QA. Could you (or anyone who knows ) please explain me in the prediction mode when you have a new sentence how are question's tokens take into account to predict embedding of context's tokens ?² Thank you in advance for your reply !
Thanks a lot for your kernel and video! Subscribed and voted your kernel) Keep doing good stuff)
Thank you so much!
Thanks a lot for this video. Please make a video on forecasting model creation
Thank you Abhishek for sharing. Can you please share some examples on speech to text and text to speech too.
Hi Abhishek, Thanks for your helpful videos. I have a question. Are you aware of fast.ai module? If yes, why you don't use it? Just asking out of curiosity because I'm watching your platform videos.
Please keep updating your playlists
Thanks!
Could you please write the name of coding environment that you use? Or make video about best coding environments for NLP ?
@Abishek Thakur We could have used model BERTQuestionAndAnswering and sorry if the question is inappropriate i am a newbie to deeplearning
hi, i have a dataset which contains three features like word, tag,seq and I want to apply bert model for ner So how can I proceed with that.
Hello ! Big thanks ! Learning a lot from your videos. If you have time please can you please make a short video on how you use GCP/AWS services
Thank you very much! GCP/AWS is huge. Are there any particular areas you are interested in?
@@abhishekkrthakur amazon sage maker may be ?
In the model, can't we change self.lo layer to nn.Linear(768, num_tokens). Will there be any difference in output accuracy ?
2 linear layers( l0, l1), for start and end tokens separate
sir can we apply bert in other programming language like java or c#?
Hey, so I had two small queries. Firstly, can we use softmax instead of sigmoid as suggested in the original BERT paper (Devlin et al 2019) (application on SQuAD)? Secondly, rather than using the first start and end index (with value> threshold) would it improve the performance to choose start and end based on the indices having maximum sum of index scores (with condition start
Really fantastic video. Thanks so much. How did you mirror / record your iPad to your linux desktop? What software did you use?
Realised you might have just recorded locally and then imported and synced the video in post. Is that right?
hi sir,Can we compare the same problem with NER? I know this is more similar to problems like Squad dataset but I also feel it is similar to NER.
What is the software you are using for whiteboarding, it is good.. though it is bad question in this context
Hi Abhishek, Thanks for the video. I have one doubt it would be great if you can help me with this. How much big corpus can bert handle to extract the text also in SQuAD when we provide the corpus how big can it accept to find the answer? do we have any hyperparameter for that so that we can tune it?
First , thanks for this great work , i have a question : why padding_len :tensor(93)
Hi Abhishek
I am working on NLG model for data to text. I am getting problems like out of vocabulary word for testing and also some diverse field like data of birth is always predicting wrong in output.How to overcome this problem any suggestion
how to create wuestion-answer pairs from a piece of text
Could really help with an XLNET video. . .
Hi.Hope you ask.Sometimes: word != tokenizer.decode(tokenizer.encode(word )). we get different values sometimes and they are important to calculate jaccard metric.Any ideas how to fix it? Also why you use seq_out if can use pool out?
Can you suggest some other datasets for question answering tasks.
how can you write all python function to fast, this is great, you are to tez like your library
This video is based on sentiment analysis, right?
i want to make QA system retrieval of legal information domain how can i start
Can I use encode_plus() to get input id, attention id and token id.... JUST ASKING
Which editor is he using in the video?
may i know the editor please ... someone let me know ...
can you tell how we can perform question answering using bert for SQuAD dataset v2.0?
ill make a video about it
Which IDE do you use?
Thanks, Abhishek. It's a good tutorial. However, after running it, I got an error in line number 78 in engine.py file. The error message is:
78. fin_padding_lens.extend(padding_len.cpu().detach().numpy().tolist()) # [engine.py file]
AttributeError: 'tuple' object has no attribute 'cpu'
Can you please help me to resolve it.
Thanks,
Bhavika
Thanks for sharing it, I did OCR using two different python libraries on huge data.can u suggest the best possible metric and approach to compare the two python libraries outputs(text files) in terms of quality of text and content including spaces , special characters..etc .so that i choose one of them to proceed for my further tasks.awaiting for your reply:)
Hi Abhishek.. Which code editor are you using?
It's VS Code.
@@jirokaze6380 Thanks Jiro
Does anyone know why using tokenizer package instead of tokenizer built-in Bert?
The built-in tokenizer of transformers does not offer "offsets" which are used in preparing the target vectors.
@@JaskaranSingh-hp3zy Hi, I am new to NLP and don't know the meaning of 'Offsets' in terms of NLP. Can you please help me by elaborating it a bit in terms of NLP? like why/where/when it is used, and what are the scenarios where we need to have offsets? thanks for your patience and kind help! :)
@@kumarsundaram4659 github.com/huggingface/tokenizers#quick-examples-using-python
Follow this. It might help you :)
Hi Abhishek,
I really like how you organize your work. I
have been using your structure with create_folds, engine, config, etc. myself since your Bengali video and I’m a big fan of it.
I’m now at this point where I want to experiment with different models, hyperparameters and post-processing for the Tweet Sentiment Kaggle competition.
I struggle a bit with keeping track of my modifications to make sure I can reproduce the models.
How do you keep track of changes to your scripts throughout a competition?
Do you still use the model dispatcher from your Bengali video?
I had the idea of relying on Git by making a branch of my repo each time I train a model.
Other Kagglers suggest making a copy of the entire repo each time.
I think both solutions have their drawbacks, given that 99% of the code doesn’t change.
I found some great ideas in this Kaggle thread but I wanted to know how you manage it:
www.kaggle.com/c/porto-seguro-safe-driver-prediction/discussion/42416
I realize this is a vast subject. Perhaps you could just share a few tips?
I believe this would be a subject for a very interesting UA-cam video as well!
Thanks again for putting so much effort in your videos, I learn a lot from your code!
edit: formatting
Why is Valid batch size twice, since there is no backprop in valid, isn't it better to have it the other way around. Based on discussion here...forums.fast.ai/t/different-batch-size-for-train-and-valid-data-loaders/30691
You doing great work by doing this kinds of tutorial for people like me. I would like to request one think that when you explain a code portion please add a sample example like you use in this video at ua-cam.com/video/XaQ0CBlQ4cY/v-deo.html
Why don't you type on the keyboard, its MUCH faster and clearer
where is he typing?
(base) self-made-lol@selfmadelol:~/Desktop/sentiment analysis/src$ python dataset.py
Errors: Os { code: 2, kind: NotFound, message: "No such file or directory" }
Traceback (most recent call last):
File "dataset.py", line 1, in
import config
File "/home/self-made-lol/Desktop/sentiment analysis/src/config.py", line 16, in
lowercase=True
File "/home/self-made-lol/anaconda3/lib/python3.7/site-packages/tokenizers/implementations/bert_wordpiece.py", line 30, in __init__
tokenizer = Tokenizer(WordPiece(vocab_file, unk_token=str(unk_token)))
Exception: Error while initializing WordPiece anyone knows how to solve this