Jin Choi, PhD
Jin Choi, PhD
  • 15
  • 24 444
Algorithmic Trading Using A Combination Of Convolutional Neural Networks And LSTMs
I trained the following families of machine learning models on stock market minute bar data
- Standalone convolutional neural networks
- Standalone LSTMs
- Convolutional LSTMs (A combination of convolutional neural nets and LSTMs as described in the video)
I explain what a minute bar is, and discuss the intution behind combining convolutional neural nets and LSTMs for the last family of models mentioned. I then present the theoretical performance of each of the families of models, and then show some real world performance.
Here's the link to my short book on investments: www.eddywealth.com/e-books/
00:00 Introduction
00:23 Minute bar data
01:07 Families of machine learning models
02:47 Data segmentation
04:34 Model assessment
05:04 Backtested model performances
08:24 Real money performance
11:06 Final remarks
Disclaimer: This video is for educational purposes only. It doesn't constitute advice.
Переглядів: 2 792

Відео

How Warren Buffett Actually Picks Stocks
Переглядів 19110 місяців тому
Warren Buffett is one of the greatest investors of all time - his investment skills enabled him to become one of the wealthiest people in the world. So, how does Buffett invest? Thankfully, he made no secret of his methodologies, and in this video, Jin explains his core philosophy using quotes from Buffett and his partners. To learn more about investing, visit us at www.eddywealth.com/ 00:00 Bu...
How To Save Up To $50,000 In Taxes Using AI
Переглядів 41810 місяців тому
It's true. Being smart about how you withdraw from your RRSPs, TFSAs, and taxable accounts can make a $50,000 difference, even for the middle class. In this video, Jin uses a hypothetical scenario to illustrate how AI can help save such an amount. For easy-to-understand explanations of RRSPs and TFSAs, read Jin's free e-book, available at www.eddywealth.com/e-books/ To contact Jin about creatin...
3 Investing Mistakes I've Learned To Avoid At All Costs
Переглядів 29411 місяців тому
Some investment mistakes are VERY costly, not just in terms of monetary damage but also on your mental health. I talk about three such mistakes I've experienced personally, and they are: 00:00 Making bets that are too concentrated 01:56 Letting recent experiences unduly influence your decisions 04:14 Avoiding the psychological pain of losses 06:12 Common thread among all mistakes To learn more ...
Can Machine Learning Produce Superior Stock Market Predictions?
Переглядів 740Рік тому
Machine learning powers incredible AI technologies such as ChatGPT and Midjourney. But many financial professionals are skeptical that machine learning models can ever predict the directions of stocks. In this video, Jin explains why financial pros hold that belief, and present an important paper that challenges that belief. To accept that machine learning models CAN predict stocks, we need to ...
Beginner's Guide To Quantitative Investing, The Data-Driven Approach To Investing In Stocks
Переглядів 504Рік тому
Quantitative investing is a relatively new style of investing that's been gaining popularity due to its reliance on data and statistics to select stocks and bonds. In this video, Dr. Jin Choi explains how quantitative investing differs from the more traditional styles of investing, and he lists the pros and cons of taking a quantitative approach. He then explains the different types of quantita...
Can Convolutional Neural Networks Predict Stock Prices?
Переглядів 10 тис.Рік тому
Follow this link to read my written articles on applying data science to investing: www.eddywealth.com/articles/?author=1 Github repository containing the code: github.com/moneygeek/cnn-stock-prediction 00:00 Introduction 00:10 Concepts 02:28 Code 11:23 Results Convolutional neural networks (CNNs) are one of the most popular machine learning architectures, used most famously for image recogniti...
Using LSTMs to Predict Stock Prices
Переглядів 9 тис.Рік тому
I walk through sample code that implements a Long Short-Term Memory (LSTM) model that predicts stock price movements, highlighting and discussing the important sections. I also talk about whether the model could be used to trade stocks profitably. Github repo: github.com/moneygeek/lstm-stock-prediction You can contact me through: www.eddywealth.com/contact/ Disclaimer: This video is for educati...
Why Are There So Few Machine Learning-Driven Financial Products?
Переглядів 375Рік тому
Few financial products (such as mutual funds, hedge funds, and ETFs) in Canada rely heavily on machine learning. In this video, I explain one major reason why machine learning-driven products have failed to gain traction. To learn more about some products that we find interesting, contact us at www.eddywealth.com/contact/
Efficient Market Hypothesis Joke
Переглядів 116Рік тому
The efficient market hypothesis (EMH) posits that no one can consistently pick stocks that beat the market. I tell a joke that pokes fun at this theory.
What The AIAE Model Says About Future Stock Market Returns
Переглядів 99Рік тому
The Aggregate Investor Allocation to Equities (AIAE) model is the best model that I know of that predicts what the stock markets will return over the next 10 years. I explain how that model works and what it says about returns we can expect from today. To learn more about the strategies that I use, contact me at www.eddywealth.com/contact/
Why Hedge Funds Are Betting Against Long-Term Treasuries
Переглядів 115Рік тому
A record number of hedge funds have shorted (i.e. betted against) long term treasuries. I explain one important aspect as of their thinking. For a basic explanation of treasuries and other investing concepts, check out my free e-book on investing at www.eddywealth.com/e-books/ Disclaimer: I am neither long nor short on long-term US treasuries when I took this video.

КОМЕНТАРІ

  • @KilgoreTroutAsf
    @KilgoreTroutAsf 13 днів тому

    Classic

  • @Vlad-e9u
    @Vlad-e9u 14 днів тому

    Is it possible to train a model using computer vision to recognize trading patterns and candlesticks on screen, and then use reinforcement learning to train an agent that can trade based on what's happening in real-time on the chart?

  • @DanielGarcia-d6t
    @DanielGarcia-d6t 18 днів тому

    Why are the RMSE values so low?

  • @doords
    @doords 22 дні тому

    Hey Jin, do you think transformers can do a better job than LSTM on stock prediction

  • @dtex_zero
    @dtex_zero 25 днів тому

    I always feel like Neural networks are overkill for trading. Feeding it random things like OHLC and technical signals will not get you very far, they almost always overfit them to the training peroid as well, and will often only see them perform for a couple months at best. Contextually markets change, markets do not stay static it's why almost all algorithmic systems must be monitored and swapped out due to different contexts. There are not random things in the market but trying to fit models to bar data isn't one of them... it will get you nowhere.

  • @mitchcook5252
    @mitchcook5252 Місяць тому

    Hey Dr Choi, great video. Would love to hear more detail about any data driven value investing approaches you are aware of. Also would be interested to hear you compare the uses and popularity statistical modelling vs machine learning in quantitative analysis.

  • @depodtech
    @depodtech Місяць тому

    Hey Jin, if I want to add volume tick & RSI, what the best way to shape the data?

  • @pythoncoding1092
    @pythoncoding1092 Місяць тому

    Since this is the last video on the channel and it came out 6 months ago, I'm assuming the model works :DD

  • @HiltonFernandes
    @HiltonFernandes 2 місяці тому

    Congratulations for being very clear in your explanations and very honest in the model evaluation.

    • @HiltonFernandes
      @HiltonFernandes 2 місяці тому

      It would be nice, though, that you could be more conclusive and show either a case where LSTM does help predict stock prices, or state that it's not useful at all to predict them.

  • @ndeutsch
    @ndeutsch 2 місяці тому

    8:57 how did you link this code of your model to the main code?! Because the cod of your model is in another file!!

  • @Paul.Lisanti
    @Paul.Lisanti 2 місяці тому

    We learn more from mistakes than successes, so thanks for sharing Jin!

  • @Paul.Lisanti
    @Paul.Lisanti 2 місяці тому

    Interesting concept! Thanks Jin

  • @dennisdmenace2416
    @dennisdmenace2416 3 місяці тому

    Torch 2.0 isn't available anymore and changing it to torch 2.2 causes the program to crash.

  • @dennisdmenace2416
    @dennisdmenace2416 3 місяці тому

    I wonder if you chose stocks for your model that didn't have many or few options contracts if it would remove some of the randomness.

  • @devanshkm
    @devanshkm 3 місяці тому

    would using a transformer based model be better? would love a video on that topic

  • @adamfillion755
    @adamfillion755 3 місяці тому

    Amazing video! is the code available like your other videos?

  • @VidaVoltaSoftware
    @VidaVoltaSoftware 3 місяці тому

    Great video! How is the model doing?

  • @trhtkify
    @trhtkify 3 місяці тому

    This is amazing, im just starting out with testing my own model and your points are clarifying, would love more videos on this

  • @PolarTheIcebear-xl8ts
    @PolarTheIcebear-xl8ts 3 місяці тому

    The videos you produce are super helpful for me, since I am working hard on understanding the math and logic behind neural networks. When you were talking about it not being suitable for predicting just the next it got me thinking. You could try and predict the price tomorrow and the day after with the same input data. If the price is down tomorrow you do an close market order otherwise you could buy at market open. I am curious what you would think of such trading strategy and maybe issues that arise like for example it being harder to train maybe? Also won't this model perform much better if you were to add loads of extra data like indicators and such. I am so happy I found you, you are super helpful on this journey with your videos!

  • @mundhiralmamari2006
    @mundhiralmamari2006 4 місяці тому

    I did a similar project using CPC + GRU. The results were great for training, evaluation and testing, however the problem is with the trades for I used RL with PPO to simulate a trading environment and to make the agent make his decisions based on the policy optimization, despite my good hardware training the PPO was very long and the results didn’t work that well but it was a fun experiment

  • @yangchong2358
    @yangchong2358 5 місяців тому

    Great video

  • @jeraldgooch6438
    @jeraldgooch6438 5 місяців тому

    Insightful video. As you point out, certain things may be simple in concept but complex and difficult in execution. You make a comment about using AI to predict future values to be derived from a company. I presume you are talking about future free cashflow predictions using some form of an ML model? Have you done any videos on this? Thanks!

  • @dishcleaner2
    @dishcleaner2 6 місяців тому

    Great video, Jin. I'm collecting minute data on the total microcap market right now (over 11 GB a month) to train my first neural network model. In my previous attempts with random forest models, I was able to get about 60-70% precision on live data, but as my dataset grew, my model performance got worse. It made me think there may be some merit in having a model that is only trained on short term data, like the last 30 trading days for example. Do you think such a model could be viable?

    • @dtex_zero
      @dtex_zero 25 днів тому

      You're going to find this doesn't work. Contextually markets change, bar data is random. Everytime the markets change, your model is going to break as its constantly overfit to the current peroid. Something will work for 2-3 months then break and then again and again.

  • @josugutierrez7810
    @josugutierrez7810 6 місяців тому

    you should use better input variables maybe related to technical indicators and macroeconomic ones

  • @josugutierrez7810
    @josugutierrez7810 6 місяців тому

    Hope you find the model that make you money!! Hard work pays off, if it was easy everyone would be rich. Well done!

  • @mohamedhassanmohamed1175
    @mohamedhassanmohamed1175 6 місяців тому

    I love your content but I wish you made more videos and explain the codes

  • @sweealamak628
    @sweealamak628 7 місяців тому

    Stumbled upon your video today after learning about backpropagation. Really appreciate the clarity in your presentation and being honest about the model's results. Sadly, 53% success rate is no better than flipping a coin. Another factor that lead to many fund managers giving up on Machine Learning in recent years is market reflexivity. Quants are able to predict with high probability using an ensemble of algos but once they place a trade, the prediction goes haywire, due to the trade meddling with the chart pattern. Stock Price prediction is possibly the only ML endeavour that the analyst "poisons" the data after acting on it. Weather prediction on the other hand, a time series I believe where LSTM is deployed, successfully makes predictions because meteorologists are simply observing the atmosphere. Still early days, but I have seen publishings about success predicting an Emerging Market: Vietnam, claiming that it was achieved through multiple inputs from Closing Price to Technical Indicators. No evidence of people profiting from it so it seems like just theory at this point in time... like you mentioned, these papers are meant to make the PhDs look good.

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 6 місяців тому

      You raise many good points. The reflexivity of the market is what makes this challenge so hard. However, a 53% accuracy would be more than enough to make billions with. RenTec supposedly only achieves 50.75% accuracy on each trade.

  • @eitan71
    @eitan71 7 місяців тому

    that's exactly the reason why i am an algorithmic trader...

  • @emmang2010
    @emmang2010 7 місяців тому

    Great video. Thank you.

  • @zhangjason2879
    @zhangjason2879 7 місяців тому

    Awesome! Look forward to the upcoming videos regarding LSTM + CNN!

  • @EloisaBassett
    @EloisaBassett 7 місяців тому

    I love your content 🫶 please do moreee

  • @anthony-som
    @anthony-som 8 місяців тому

    Looking forward to your future videos Mr. Choi. Really interested in creating one of these models myself. Do you have any book recommendations to learn this type of stuff?

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 8 місяців тому

      Thank you for your kind words. The Deep Learning book is one of the best I've read. It's math heavy but there's unfortunately no way around that. www.deeplearningbook.org/

    • @anthony-som
      @anthony-som 8 місяців тому

      This is exactly what I needed 🥲! I appreciate you so much for sharing this with me@@jinchoi-moneygeek

  • @FalconerCH
    @FalconerCH 8 місяців тому

    Love your vids Dr Choi

  • @koonsickgreen6272
    @koonsickgreen6272 8 місяців тому

    enjoyed the content.

  • @celeb99mu
    @celeb99mu 8 місяців тому

    Great to see hybrid models in action. Would love to have the code available to look through offline.

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 8 місяців тому

      Thank you. I'll see about releasing some code in the future.

  • @MrPotatoHeadFX
    @MrPotatoHeadFX 8 місяців тому

    Hey bro. I love your content. Could you create a video showing what a ML model would look like for a classification Ny session bias problem. Thank you in advanced.

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 8 місяців тому

      Thanks for the support. Could you elaborate on what you mean by the 'classification Ny session bias' problem?

    • @MrPotatoHeadFX
      @MrPotatoHeadFX 8 місяців тому

      @@jinchoi-moneygeek Train a model that will say if price closes above or below the session opening price

  • @SauersML
    @SauersML 8 місяців тому

    Goated

  • @OkSid300
    @OkSid300 8 місяців тому

    In other words. I need to develop the solution myself. And it have to be out of the box, groundbreaking strategy that nobody would guess for. Interesting challenge even though that sounds impossible. But still the biggest question is still remains. How do regular traders are still earning money on market if mathematicians and data scientists are swarming WallStreet with all fancy tehnology?

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 8 місяців тому

      That's a good question. I have two answers to your question. One, very few traders actually make money consistently. I read one statistic that says only 3% of day traders make money - though I don't know how accurate that statistic is. Two, we should give more credit to the human mind, which can reason much better than machines can. Machines are really good at detecting repeated patterns, but they're not so good at contextualizing the patterns. Are stocks falling because of Federal Reserve action or because of Covid? Such contexts are hard for machines to comprehend, especially if the contexts are new.

  • @christopherrose626
    @christopherrose626 8 місяців тому

    Really very practical. A lot of people try to predict price instead of return which might appear to give results but is an illusion and is not what we trade on. It sounds like you are not a big believer in the utility of these models but I am curious as to how well they might do at predicting return over a week or a month. It seems counterintuitive that they would be more successful at this but then if looking for patterns that might work and in some ways looking over a time period might actually eliminate some of the noise. In addition I am thinking some of the other potential inputs like sentiment, interest rate future prices, equity option prices might then have more relevance as inputs. Thoughts?

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 8 місяців тому

      Hi Chris, thanks for the kind words. Predicting price instead of returns never made any sense to me either. I think you raise some good points on using longer timeframes. But there are also downsides to doing that. For one, you either have to choose between using fewer data points (there are fewer weeks than days in a year) or using data that overlaps (Mon-Fri and Tue-Mon would share 4 days). I'm not sure there are any downsides to using overlapping data, but there might be. You could use longer histories of data, but then you risk using data that's not relevant anymore (the behaviour of market participants change). There are no easy answers. That's one of the frustrating things about applying machine learning to finance. As for using a variety of different inputs, I support the idea. But a word of caution from someone who's trodden that road before - extracting actionable insights from those inputs won't be easy.

  • @larryvanwallendael2453
    @larryvanwallendael2453 8 місяців тому

    Great video! I appreciate how you delve into various aspects, unlike other videos that skim over crucial details. One aspect that caught my attention is the delay in prediction. Correct me if I'm wrong, but you utilize a sequence of returns up until a certain date, let's say February 16th in your example, to forecast the return on February 18th (calculated as the closing price on the 18th minus the closing price on the 17th, divided by the closing price on the 17th). My concern is practicality. If the model predicts a +10% return, does it mean one should buy the stock at the closing price on the 17th? But is it feasible to execute a trade at the exact closing price on the 17th? I'm curious about how this works in real trading scenarios.

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 8 місяців тому

      That's a great question. Yes, if the model predicts a +10% return, it would be best to buy at the closing price on the 17th - doing so would be most consistent with the model. You can actually execute at that price by using the market-on-close order type with your broker. www.investopedia.com/terms/m/marketonclose.asp

  • @zhangjason2879
    @zhangjason2879 9 місяців тому

    Thanks for the great video Jin! Would like to see a future video about how to incorporate CNN with bi-directional LSTM to predict the stock prices. Keep up with the great content, all the best!

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 9 місяців тому

      Thanks for your support! I'll see about combining CNNs and LSTMs in a future video.

    • @amirghorbani7922
      @amirghorbani7922 8 місяців тому

      Predict stocks using ICDST AI PREDICT.

    • @Scalykams
      @Scalykams 5 місяців тому

      Damn, this is the project I'm currently working on. Hahaha. Ltsm for direction and CNN for the entry pattern. Mine is for trading. Im just happy to see that it's being thought about

  • @thoainguyen-s4u
    @thoainguyen-s4u 9 місяців тому

    Can you predict the low and high of the next day?

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 9 місяців тому

      That's an interesting thought. I can try, but I don't know how accurate or actionable the predictions would be.

  • @raphamejias
    @raphamejias 9 місяців тому

    Hi thanks for the tutorial very useful! I think all are waiting for the version with multiple stock

  • @kyleganse4978
    @kyleganse4978 9 місяців тому

    Dude this is great. Its funny I was watching videos of people making LSTM's speaking about the issues. One guy in comments pretty much said what you explained. He has been getting great results with a very complex LSTM, lots of dropout & batchNorm. Leaky relu activation and then uses Mean Squared Error %. I found it interesting. Then I find your video! Going to go play around with some models now :D

  • @christosmaroulis132
    @christosmaroulis132 9 місяців тому

    Could you please make a follow-up video or reference materials where you trained an LSTM using multiple stocks?

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 9 місяців тому

      I'll consider making a video if I get more similar requests.

    • @castral349
      @castral349 9 місяців тому

      Please🥺 @@jinchoi-moneygeek

    • @doords
      @doords 22 дні тому

      @@jinchoi-moneygeek I am just repeating the code for the main part for other stocks, keep the other parts like the training and NN parts and just save it as a different model. Is there a more convenient way to go about.

  • @christosmaroulis132
    @christosmaroulis132 9 місяців тому

    This is an extremely useful tutorial; very clear and info-rich. Two questions: The two-week time-sequences you use seem to all be the same length. Could you please share any thoughts that you may have on: a) using varying-length time-sequences, ie different history lengths and b) using time-sequences w/ varying history lengths initially, but that are subsequently padded with zeros so that we end up with the same fixed history length across all time-sequences?

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 9 місяців тому

      Thanks for the kind words! You can indeed use variable lengths. You'd want a clear rationale for having some inputs being longer than others, though. I'm not aware of a good rationale, but maybe you or others would have. You shouldn't need to pad inputs with 0s. LSTMs can handle variable lengths natively.

    • @christosmaroulis132
      @christosmaroulis132 9 місяців тому

      @@jinchoi-moneygeekThanks again! I also appreciated how you demonstrated that (vanilla) LSTMs can predict multiple timesteps. In your experience, do you find multiple timestep predictions to be more (or less) reliable from a vanilla LSTM vs an Encoder-Decoder LSTM?

  • @paulrelf
    @paulrelf 9 місяців тому

    I really enjoyed the clarity in your video. It would be interesting to see how this model performs with dollar bars. I am new to this area and have been reading time bar sampling has inherent limitations. Thank you for sharing your code, I'd like to dig deeper and this helps tremendously.

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 9 місяців тому

      Thanks for the kind words, Paul. Applying dollar bars would be interesting indeed. I'll think about making a video about it.

  • @shivanjaydj5565
    @shivanjaydj5565 9 місяців тому

    incredible video, where can i discuss more about this with you ?

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 9 місяців тому

      Thank you! If you'd like to contact me, go to www.eddywealth.com/contact/

  • @muhammednihal2410
    @muhammednihal2410 9 місяців тому

    Can you explain what you mean by overfitting

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 9 місяців тому

      Take a look at this other video I made ua-cam.com/video/kbCv4Pyy00M/v-deo.html

    • @lokeshkumar-dq7yl
      @lokeshkumar-dq7yl 3 місяці тому

      Over fitting is too much bias on training data and not performing well in testing data

    • @rkedits_alone
      @rkedits_alone 3 місяці тому

      Over fitting means memorizing if give 1-1=0 next if give any other its doesn't able to do it

  • @sirrobinhood3409
    @sirrobinhood3409 9 місяців тому

    I'd love to see a 0DTE model based on tick data LOL Either way Thanks for the tutorial explanation!

    • @jinchoi-moneygeek
      @jinchoi-moneygeek 9 місяців тому

      That would be interesting. Might also be a lot of work though. I'll consider it. Thanks for the support