Відео

One of the greatest explanation for QA I have ever seen! There are lots of garbage and confusing explanations in Huggingface. But you are the hero!

Wow, what a high value channel. Thank you for the effort you put into these videos, the are brilliant.

BEST explanation of ATTENTION I have seen on the Net.

Sir, multilingual extraction from clinical notes I need this dataset where can I download this dataset

hi Chris, given i have news dataset, is there any parameters in the model, that i can fine tune it? so i can train and test it?

I think one of the best ways to think about steps is like solving a jigsaw puzzle. The AI starts with a big jumble of pieces with seemingly no coherence and then moves a number of those pieces at a time to try and create the puzzle image. If you give the AI say 5 steps, but it's a 512 piece puzzle (a 512 x 512 image would have 512 pixels of width and 512 pixels of length) it has to move the pieces in big handfuls. It's only got 5 moves to solve the puzzle and 512 pieces to move, so it moves 100 at a time. It might be able to group colours and rough textures and such together to make more educated guesses at what should go where, but it's generally a pretty crude approach. Results often sort of resemble the completed puzzle image, but are usually a way off the mark. By contrast, if you give the AI 10,000 steps, well now it has to cut the pieces up into tiny smaller pieces so it has enough to move every step. This means the ai can get carried away creating details which shouldn't exist, since it's too focused on tiny pieces to see the big picture. Somewhere in there will be the perfect step count, where the AI creates the puzzle like a human would, moving each piece in turn until it's perfectly arranged. Now obviously this isn't quite how software like stable diffusion works, but it is a simple way to understand how step count can influence generation. Low step counts force the AI to make bolder decisions about what it puts where. Tiny variance in the initial 'noise' can lead to huge variance in the final picture, as the AI has to make very significant decisions at each step even though it doesn't really have much information to go on. On the other hand, high step counts force the AI to make very small changes - the problem here really is luck. A string of 'bad' decisions is much harder for the AI to undo before it finishes. Take the 'wizard portrait' example in this video - at 50 steps the hair is defined but clearly hair. This is because it has jumped to the most logical conclusion at what should be there and then not been able to keep guessing. By 100 steps it has guessed itself into the wrong answer, by continuing to chase it's own 'refinement' of individual strands of hair which has lead to these more tendril like spiky things. At 150 steps I wouldn't be surprised if the hair becomes a helmet of sorts.

can we do bert as retriver as bloom as generator . RAG model on custom data

I am a master's student at Columbia. Your explanation is so much better that the explanation that I had from my faculty. Keep doing what you are doing

It is great tutorial!!! however loading dataset part is broken.. getting "ValueError: setting an array element with a sequence. The requested array has an inhomogeneous shape after 1 dimensions" error unfortunately... shapes are not matching properly. It is great tutorial though!

Thank you. Good explanation. Some questions: 1. At 2:40. Why are we interested in getting the sum as 1, which softmax provides? What's wrong with using existing output values, we already have the weight for 8 higher than others, so we have the answer. Why do we need the extra work at all? 2. At 9:49. What is this "word vector"? Is it still one-hot vector for the word from the dictionary or something else? How is this vector represented in this case? 3. At 15:00. That's fine, but if we trained for "cpupacabra", what would be with the weights when we train for the other words? Wouldn't it just blend or "blur" the coefficients making them closer to "white noise"?

Why are we using learning rate schedulers when we have adam optimizer?i thought that should handle it internally

04:00 Super useful! I didn't know how to generate those grids!

🔥 thank you for this top tier series!

in the collab im seeing an error at: chunked = np.array([doc.reshape(-1, chunk_size) for doc in clipped]) ValueError Traceback (most recent call last) <ipython-input-64-7f02340de32c> in <cell line: 1>() ----> 1 chunked = np.array([doc.reshape(-1, chunk_size) for doc in clipped]) ValueError: setting an array element with a sequence. The requested array has an inhomogeneous shape after 1 dimensions. The detected shape was (3401,) + inhomogeneous part.

What an impressive video! It seems this is precisely why certain Large Language Models (LLMs) can handle context lengths of up to 200k.

Hallelujur!

so start must be a vector then of the same dimension as the dimension of the final output from encoder ?

At the end when you are bringing out the heads dimension out of the resulting relative_position_values matrix shouldn't the operation be relative_position_values.transpose(1, -1).transpose(0, 1).unsqueeze(0) so we end up with (batch, heads, sequence, context) instead of (batch, heads, context, sequence)?

Just commenting to say that this series is appreciated and I took the weekend to follow along! Time well spent. Hopefully continue next weekend

Thank you very much! Lot of knowledge very concisely (and enjoyably) delivered. Following along and coding my own version, learned a lot already! I knew all of this at a theoretical level but this brings me up to a new dimension (pun intended, haha). Also for broadcasting, I suppose .masked_fill() also broadcasts because at first I thought I'll have to create a 4D mask

awesome!

Thank you.

I m unable to get data, can anyone share the link of SQuad dataset

You're videos are sooo good. Please keep making more of these!

Optimizer.step() needs to be outside the segment loop right?

Excellent ..very good...Chris i hope i found this video channel sooner.

great videos, hate when they end!

Finally, somebody who knows what he's talking about... Just to mention, we appreciate your efforts ❤

excellent video brother

Thank you.

Man go till the end don’t stop this series. I was waiting for that for so long

Long live the Algorithm for recommending this to me.

thanks, really good videos

Thanks for these videos. What will the course cover that these videos won't? Will you be guiding us in implementing multiple papers or only one?

Best Instructor!!!

Sir, I'm new to this field, my research topic is about automatically evaluating essay answers using Bert what should I learn in advance so that I pick up only the main points related only to my research in order not to be distracted by too much information and could please give me your email I want to consult you And thank you

°∆ I believe we are meant to be like Jesus in our hearts and not in our flesh. But be careful of AI, for it knows only things of the flesh such as our fleshly desires (without fear of God) and cannot comprehend things of the Spirit such as true love and eternal joy that comes from obeying God's Word [Galatians 5:16-26]. Man is a spirit and has a soul but lives in a body which is flesh. When you go to bed it is the flesh that sleeps, but your spirit never sleeps and that is why you have dreams, unless you have died in peace physically. More so, true love that endures and last is a thing of the heart. When I say 'heart', I mean 'spirit'. But fake love, pretentious love, love with expectations, love for classic reasons, love for material reasons (love because of material needs) and love for selfish reasons outside God those are things of the flesh. In the beginning God said let us make man in our own image, according to our likeness. Take note, God is Spirit and God is Love. As Love He is the source of it. We also know that God is Omnipotent, for He creates out of nothing and He has no beginning and has no end. That means, our love is but a shadow of God's Love. True love looks around to see who is in need of your help, your smile, your possessions, your money, your strength, your quality time. Love forgives and forgets. Love wants for others what it wants for itself. However, true love works in conjunction with other spiritual forces such as patience and faith - in the finished work of our Lord and Savior, Jesus Christ, rather than in what man has done such as science, technology and organizations which won't last forever. To avoid sin and error which leads to the death of your body and your spirit-soul in hell fire (second death), you must make God's Word the standard for your life, not AI or your flesh. If not, God will let you face AI on your own (with your own strength) and it will cast the truth down to the ground, it will be the cause of so much destruction like never seen before, it will deceive many and take many captive in order to enslave them into worshipping it and abiding in lawlessness. We can only destroy ourselves but with God all things are possible. God knows us better because He is our Creater and He knows our beginning and our end. The prove texts can be found in the book of John 5:31-44, 2 Thessalonians 2:1-12, Daniel 2, Daniel 7-9, Revelation 13-15, Matthew 24-25 and Luke 21. *HOW TO MAKE GOD'S WORD THE STANDARD FOR YOUR LIFE?* You must read your Bible slowly, attentively and repeatedly, having this in mind that Christianity is not a religion but a Love relationship. It is measured by the love you have for God and the love you have for your neighbor. Matthew 5:13 says, "You are the salt of the earth; but if the salt loses its flavor, how shall it be seasoned? It is then good for nothing but to be thrown out and trampled underfoot by men." Our spirits can only be purified while in the body (while on earth) but after death anything unpurified (unclean) cannot enter Heaven Gates. Blessed are the pure in heart, for they shall see God [Matthew 5:8]. No one in his right mind can risk or even bare to put anything rotten into his body nor put the rotten thing closer to the those which are not rotten. Sin makes the heart unclean but you can ask God to forgive you, to save your soul, to cleanse you of your sin, to purify your heart by the blood of His Son, our Lord and Savior, Jesus Christ which He shed here on earth because Isaiah 53:5 says, "But He was wounded for our transgressions, He was bruised for our iniquities; the chastisement for our peace was upon Him, and by His stripes we are healed". Meditation in the Word of God is a visit to God because God is in His Word. We know God through His Word because the Word He speaks represent His heart's desires. Meditation is a thing of the heart, not a thing of the mind. Thinking is lower level while meditation is upper level. You think of your problems, your troubles but inorder to meditate, you must let go of your own will, your own desires, your own ways and let the Word you read prevail over thinking process by thinking of it more and more, until the Word gets into your blood and gains supremacy over you. That is when meditation comes - naturally without forcing yourself, turning the Word over and over in your heart. You can be having a conversation with someone while meditating in your heart - saying 'Thank you, Jesus...' over and over in your heart. But it is hard to meditate when you haven't let go of offence or past hurts because you need a free spirit to believe His Word and meditate on it. Your pain of the past, leave it for God, don't worry yourself, Jesus is alive, you can face tomorrow, He understands what you are passing through today. Begin to meditate on this prayer day and night (in all that you do), "Lord take more of me and give me more of you. Give me more of your holiness, faithfulness, obedience, self-control, purity, humility, love, goodness, kindness, joy, patience, forgiveness, wisdom, understanding, calmness, perseverance... Make me a channel of shinning light where there is darkness, a channel of pardon where there is injury, a channel of love where there is hatred, a channel of humility where there is pride..." The Word of God becomes a part of us by meditation, not by saying words but spirit prayer (prayer from the heart). Take note, God is Spirit and those who worship Him should do so in spirit and truth (genuinely by living the Word). When the Word becomes a part of you, it will by its very nature influence your conduct and behavior. You become a new creation, guided by the Holy Spirit and not just what you hear or see. Your bad habits, you will no longer have the urge to do them. You will think differently, dream differently, act differently and talk differently - if something does not qualify for meditation, it does not qualify for conversation. *THE BATTLE BETWEEN LIGHT AND DARKNESS (GOOD AND EVIL)* Heaven is God's throne and the dwelling place for God's angels and the saints. Hell was meant for the devil (satan) and the fallen angels. Those who torture the souls in hell are demons (unclean spirits). Man's spirit is a free moral agent. You can either yield yourself to God or to the devil because God has given us discretion. If one thinks he possesses only his own spirit, he is lying to himself and he is already in the dark. God is light while the devil is darkness. Light (Holy Spirit) and darkness (evil spirit) cannot stay together in a man's body. God is Love (Love is light) and where there is no love is hell, just as where there is no light is darkness. The one you yield yourself to, you will get his reward. The reward of righteousness to man's spirit is life (abundant life) and the reward of sin to man's spirit is death. Sin and satan are one and the same. Whatever sin can cause, satan also can cause. Sin is what gives the devil dominion or power over man's spirit. When God's Word becomes a part of you, sin power over you is broken, you become the righteousness of God through Christ Jesus. Where Jesus is, you are and when He went (to the Father), you went. In the book of John 8:42-47, Jesus said to them, “If God were your Father, you would love Me, for I proceeded forth and came from God; nor have I come of Myself, but He sent Me. Why do you not understand My speech? Because you are not able to listen to My word. You are of your father the devil, and the desires of your father you want to do. He was a murderer from the beginning, and does not stand in the truth, because there is no truth in him. When he speaks a lie, he speaks from his own resources, for he is a liar and the father of it. Which of you convicts Me of sin? And if I tell the truth, why do you not believe Me? He who is of God hears God’s words; therefore you do not hear, because you are not of God.” My prayer is, "May God bless His Word in the midst of your heart." Glory and honour be to God our Father, our Lord and Savior Jesus Christ and our Helper the Holy Spirit. Watch and pray!... Thank you for your time and may God bless you as you share this message with others.

Epic! Ready for the next video!

this is a first thing I did when I got gpt 3 access - so great to see it automated online and now running locally

Thank you so much for making this playlist! It isn't just BEST OF ALL for bert, but for transformers intuition as well. Great way to go!!!

Hi Chris hope you are well, Would love to see an update on RAG, best practices or frameworks. Especially, on live changing data. For example in this video you use GoT discussions which don't change. But lets do advance RAG on data that is updated constantly, like items and costs in a warehouse. Availability and costs change, so we need to make sure to update/delete previous chunks which have now the wrong details. Thanks a lot & all the best

Excellent work.

There is a tight correlation between the quality of sources cited and the quality of material produced. The quality is high all around here

"The Talent Code" is one of my favorite books. So much gold in the domain of self-pedegogy and instruction.

Looking forward to part 2, but I suspect this will be much longer, thanks a lot for the trouble of explaining all this to noobs!

Waiting for the next part

this is so insightful, really glad i found this channel

Thanks!

Hopefully the next episode will come soon

How many episodes in total ?