- 15
- 24 444
Jin Choi, PhD
Приєднався 16 сер 2023
Investment education and news for Canadian millennials who want to invest their savings wisely. Specifically, I
- Explain financial concepts, products, and news in everyday language
- Give thoughts on financial issues from a research and data-driven perspective
- Answer common questions
I have a PhD in financial mathematics, and I've spent many years creating quantitative investment algorithms for investment managers. I'm a fee-only financial advisor with Eddy Wealth, a division of Polaris Financial. I believe in the power of systematic investment processes to deliver results.
Views in these videos are mine and mine only. They don't represent Eddy Wealth or Polaris Financial's. They also don't constitute advice; they are purely educational. Those who wish to act upon information in these videos should talk to their advisor.
- Explain financial concepts, products, and news in everyday language
- Give thoughts on financial issues from a research and data-driven perspective
- Answer common questions
I have a PhD in financial mathematics, and I've spent many years creating quantitative investment algorithms for investment managers. I'm a fee-only financial advisor with Eddy Wealth, a division of Polaris Financial. I believe in the power of systematic investment processes to deliver results.
Views in these videos are mine and mine only. They don't represent Eddy Wealth or Polaris Financial's. They also don't constitute advice; they are purely educational. Those who wish to act upon information in these videos should talk to their advisor.
Algorithmic Trading Using A Combination Of Convolutional Neural Networks And LSTMs
I trained the following families of machine learning models on stock market minute bar data
- Standalone convolutional neural networks
- Standalone LSTMs
- Convolutional LSTMs (A combination of convolutional neural nets and LSTMs as described in the video)
I explain what a minute bar is, and discuss the intution behind combining convolutional neural nets and LSTMs for the last family of models mentioned. I then present the theoretical performance of each of the families of models, and then show some real world performance.
Here's the link to my short book on investments: www.eddywealth.com/e-books/
00:00 Introduction
00:23 Minute bar data
01:07 Families of machine learning models
02:47 Data segmentation
04:34 Model assessment
05:04 Backtested model performances
08:24 Real money performance
11:06 Final remarks
Disclaimer: This video is for educational purposes only. It doesn't constitute advice.
- Standalone convolutional neural networks
- Standalone LSTMs
- Convolutional LSTMs (A combination of convolutional neural nets and LSTMs as described in the video)
I explain what a minute bar is, and discuss the intution behind combining convolutional neural nets and LSTMs for the last family of models mentioned. I then present the theoretical performance of each of the families of models, and then show some real world performance.
Here's the link to my short book on investments: www.eddywealth.com/e-books/
00:00 Introduction
00:23 Minute bar data
01:07 Families of machine learning models
02:47 Data segmentation
04:34 Model assessment
05:04 Backtested model performances
08:24 Real money performance
11:06 Final remarks
Disclaimer: This video is for educational purposes only. It doesn't constitute advice.
Переглядів: 2 792
Відео
How Warren Buffett Actually Picks Stocks
Переглядів 19110 місяців тому
Warren Buffett is one of the greatest investors of all time - his investment skills enabled him to become one of the wealthiest people in the world. So, how does Buffett invest? Thankfully, he made no secret of his methodologies, and in this video, Jin explains his core philosophy using quotes from Buffett and his partners. To learn more about investing, visit us at www.eddywealth.com/ 00:00 Bu...
How To Save Up To $50,000 In Taxes Using AI
Переглядів 41810 місяців тому
It's true. Being smart about how you withdraw from your RRSPs, TFSAs, and taxable accounts can make a $50,000 difference, even for the middle class. In this video, Jin uses a hypothetical scenario to illustrate how AI can help save such an amount. For easy-to-understand explanations of RRSPs and TFSAs, read Jin's free e-book, available at www.eddywealth.com/e-books/ To contact Jin about creatin...
3 Investing Mistakes I've Learned To Avoid At All Costs
Переглядів 29411 місяців тому
Some investment mistakes are VERY costly, not just in terms of monetary damage but also on your mental health. I talk about three such mistakes I've experienced personally, and they are: 00:00 Making bets that are too concentrated 01:56 Letting recent experiences unduly influence your decisions 04:14 Avoiding the psychological pain of losses 06:12 Common thread among all mistakes To learn more ...
Can Machine Learning Produce Superior Stock Market Predictions?
Переглядів 740Рік тому
Machine learning powers incredible AI technologies such as ChatGPT and Midjourney. But many financial professionals are skeptical that machine learning models can ever predict the directions of stocks. In this video, Jin explains why financial pros hold that belief, and present an important paper that challenges that belief. To accept that machine learning models CAN predict stocks, we need to ...
Beginner's Guide To Quantitative Investing, The Data-Driven Approach To Investing In Stocks
Переглядів 504Рік тому
Quantitative investing is a relatively new style of investing that's been gaining popularity due to its reliance on data and statistics to select stocks and bonds. In this video, Dr. Jin Choi explains how quantitative investing differs from the more traditional styles of investing, and he lists the pros and cons of taking a quantitative approach. He then explains the different types of quantita...
Can Convolutional Neural Networks Predict Stock Prices?
Переглядів 10 тис.Рік тому
Follow this link to read my written articles on applying data science to investing: www.eddywealth.com/articles/?author=1 Github repository containing the code: github.com/moneygeek/cnn-stock-prediction 00:00 Introduction 00:10 Concepts 02:28 Code 11:23 Results Convolutional neural networks (CNNs) are one of the most popular machine learning architectures, used most famously for image recogniti...
Using LSTMs to Predict Stock Prices
Переглядів 9 тис.Рік тому
I walk through sample code that implements a Long Short-Term Memory (LSTM) model that predicts stock price movements, highlighting and discussing the important sections. I also talk about whether the model could be used to trade stocks profitably. Github repo: github.com/moneygeek/lstm-stock-prediction You can contact me through: www.eddywealth.com/contact/ Disclaimer: This video is for educati...
Why Are There So Few Machine Learning-Driven Financial Products?
Переглядів 375Рік тому
Few financial products (such as mutual funds, hedge funds, and ETFs) in Canada rely heavily on machine learning. In this video, I explain one major reason why machine learning-driven products have failed to gain traction. To learn more about some products that we find interesting, contact us at www.eddywealth.com/contact/
Efficient Market Hypothesis Joke
Переглядів 116Рік тому
The efficient market hypothesis (EMH) posits that no one can consistently pick stocks that beat the market. I tell a joke that pokes fun at this theory.
What The AIAE Model Says About Future Stock Market Returns
Переглядів 99Рік тому
The Aggregate Investor Allocation to Equities (AIAE) model is the best model that I know of that predicts what the stock markets will return over the next 10 years. I explain how that model works and what it says about returns we can expect from today. To learn more about the strategies that I use, contact me at www.eddywealth.com/contact/
Why Hedge Funds Are Betting Against Long-Term Treasuries
Переглядів 115Рік тому
A record number of hedge funds have shorted (i.e. betted against) long term treasuries. I explain one important aspect as of their thinking. For a basic explanation of treasuries and other investing concepts, check out my free e-book on investing at www.eddywealth.com/e-books/ Disclaimer: I am neither long nor short on long-term US treasuries when I took this video.
Classic
Is it possible to train a model using computer vision to recognize trading patterns and candlesticks on screen, and then use reinforcement learning to train an agent that can trade based on what's happening in real-time on the chart?
Why are the RMSE values so low?
Hey Jin, do you think transformers can do a better job than LSTM on stock prediction
I always feel like Neural networks are overkill for trading. Feeding it random things like OHLC and technical signals will not get you very far, they almost always overfit them to the training peroid as well, and will often only see them perform for a couple months at best. Contextually markets change, markets do not stay static it's why almost all algorithmic systems must be monitored and swapped out due to different contexts. There are not random things in the market but trying to fit models to bar data isn't one of them... it will get you nowhere.
Hey Dr Choi, great video. Would love to hear more detail about any data driven value investing approaches you are aware of. Also would be interested to hear you compare the uses and popularity statistical modelling vs machine learning in quantitative analysis.
Hey Jin, if I want to add volume tick & RSI, what the best way to shape the data?
Since this is the last video on the channel and it came out 6 months ago, I'm assuming the model works :DD
Congratulations for being very clear in your explanations and very honest in the model evaluation.
It would be nice, though, that you could be more conclusive and show either a case where LSTM does help predict stock prices, or state that it's not useful at all to predict them.
8:57 how did you link this code of your model to the main code?! Because the cod of your model is in another file!!
We learn more from mistakes than successes, so thanks for sharing Jin!
Interesting concept! Thanks Jin
Torch 2.0 isn't available anymore and changing it to torch 2.2 causes the program to crash.
I wonder if you chose stocks for your model that didn't have many or few options contracts if it would remove some of the randomness.
would using a transformer based model be better? would love a video on that topic
Amazing video! is the code available like your other videos?
Great video! How is the model doing?
This is amazing, im just starting out with testing my own model and your points are clarifying, would love more videos on this
The videos you produce are super helpful for me, since I am working hard on understanding the math and logic behind neural networks. When you were talking about it not being suitable for predicting just the next it got me thinking. You could try and predict the price tomorrow and the day after with the same input data. If the price is down tomorrow you do an close market order otherwise you could buy at market open. I am curious what you would think of such trading strategy and maybe issues that arise like for example it being harder to train maybe? Also won't this model perform much better if you were to add loads of extra data like indicators and such. I am so happy I found you, you are super helpful on this journey with your videos!
I did a similar project using CPC + GRU. The results were great for training, evaluation and testing, however the problem is with the trades for I used RL with PPO to simulate a trading environment and to make the agent make his decisions based on the policy optimization, despite my good hardware training the PPO was very long and the results didn’t work that well but it was a fun experiment
Great video
Insightful video. As you point out, certain things may be simple in concept but complex and difficult in execution. You make a comment about using AI to predict future values to be derived from a company. I presume you are talking about future free cashflow predictions using some form of an ML model? Have you done any videos on this? Thanks!
Great video, Jin. I'm collecting minute data on the total microcap market right now (over 11 GB a month) to train my first neural network model. In my previous attempts with random forest models, I was able to get about 60-70% precision on live data, but as my dataset grew, my model performance got worse. It made me think there may be some merit in having a model that is only trained on short term data, like the last 30 trading days for example. Do you think such a model could be viable?
You're going to find this doesn't work. Contextually markets change, bar data is random. Everytime the markets change, your model is going to break as its constantly overfit to the current peroid. Something will work for 2-3 months then break and then again and again.
you should use better input variables maybe related to technical indicators and macroeconomic ones
Hope you find the model that make you money!! Hard work pays off, if it was easy everyone would be rich. Well done!
I love your content but I wish you made more videos and explain the codes
Stumbled upon your video today after learning about backpropagation. Really appreciate the clarity in your presentation and being honest about the model's results. Sadly, 53% success rate is no better than flipping a coin. Another factor that lead to many fund managers giving up on Machine Learning in recent years is market reflexivity. Quants are able to predict with high probability using an ensemble of algos but once they place a trade, the prediction goes haywire, due to the trade meddling with the chart pattern. Stock Price prediction is possibly the only ML endeavour that the analyst "poisons" the data after acting on it. Weather prediction on the other hand, a time series I believe where LSTM is deployed, successfully makes predictions because meteorologists are simply observing the atmosphere. Still early days, but I have seen publishings about success predicting an Emerging Market: Vietnam, claiming that it was achieved through multiple inputs from Closing Price to Technical Indicators. No evidence of people profiting from it so it seems like just theory at this point in time... like you mentioned, these papers are meant to make the PhDs look good.
You raise many good points. The reflexivity of the market is what makes this challenge so hard. However, a 53% accuracy would be more than enough to make billions with. RenTec supposedly only achieves 50.75% accuracy on each trade.
that's exactly the reason why i am an algorithmic trader...
Great video. Thank you.
My pleasure!
Awesome! Look forward to the upcoming videos regarding LSTM + CNN!
I love your content 🫶 please do moreee
Thank you for your support!
Looking forward to your future videos Mr. Choi. Really interested in creating one of these models myself. Do you have any book recommendations to learn this type of stuff?
Thank you for your kind words. The Deep Learning book is one of the best I've read. It's math heavy but there's unfortunately no way around that. www.deeplearningbook.org/
This is exactly what I needed 🥲! I appreciate you so much for sharing this with me@@jinchoi-moneygeek
Love your vids Dr Choi
Thanks for your kind words
enjoyed the content.
thank you
Great to see hybrid models in action. Would love to have the code available to look through offline.
Thank you. I'll see about releasing some code in the future.
Hey bro. I love your content. Could you create a video showing what a ML model would look like for a classification Ny session bias problem. Thank you in advanced.
Thanks for the support. Could you elaborate on what you mean by the 'classification Ny session bias' problem?
@@jinchoi-moneygeek Train a model that will say if price closes above or below the session opening price
Goated
In other words. I need to develop the solution myself. And it have to be out of the box, groundbreaking strategy that nobody would guess for. Interesting challenge even though that sounds impossible. But still the biggest question is still remains. How do regular traders are still earning money on market if mathematicians and data scientists are swarming WallStreet with all fancy tehnology?
That's a good question. I have two answers to your question. One, very few traders actually make money consistently. I read one statistic that says only 3% of day traders make money - though I don't know how accurate that statistic is. Two, we should give more credit to the human mind, which can reason much better than machines can. Machines are really good at detecting repeated patterns, but they're not so good at contextualizing the patterns. Are stocks falling because of Federal Reserve action or because of Covid? Such contexts are hard for machines to comprehend, especially if the contexts are new.
Really very practical. A lot of people try to predict price instead of return which might appear to give results but is an illusion and is not what we trade on. It sounds like you are not a big believer in the utility of these models but I am curious as to how well they might do at predicting return over a week or a month. It seems counterintuitive that they would be more successful at this but then if looking for patterns that might work and in some ways looking over a time period might actually eliminate some of the noise. In addition I am thinking some of the other potential inputs like sentiment, interest rate future prices, equity option prices might then have more relevance as inputs. Thoughts?
Hi Chris, thanks for the kind words. Predicting price instead of returns never made any sense to me either. I think you raise some good points on using longer timeframes. But there are also downsides to doing that. For one, you either have to choose between using fewer data points (there are fewer weeks than days in a year) or using data that overlaps (Mon-Fri and Tue-Mon would share 4 days). I'm not sure there are any downsides to using overlapping data, but there might be. You could use longer histories of data, but then you risk using data that's not relevant anymore (the behaviour of market participants change). There are no easy answers. That's one of the frustrating things about applying machine learning to finance. As for using a variety of different inputs, I support the idea. But a word of caution from someone who's trodden that road before - extracting actionable insights from those inputs won't be easy.
Great video! I appreciate how you delve into various aspects, unlike other videos that skim over crucial details. One aspect that caught my attention is the delay in prediction. Correct me if I'm wrong, but you utilize a sequence of returns up until a certain date, let's say February 16th in your example, to forecast the return on February 18th (calculated as the closing price on the 18th minus the closing price on the 17th, divided by the closing price on the 17th). My concern is practicality. If the model predicts a +10% return, does it mean one should buy the stock at the closing price on the 17th? But is it feasible to execute a trade at the exact closing price on the 17th? I'm curious about how this works in real trading scenarios.
That's a great question. Yes, if the model predicts a +10% return, it would be best to buy at the closing price on the 17th - doing so would be most consistent with the model. You can actually execute at that price by using the market-on-close order type with your broker. www.investopedia.com/terms/m/marketonclose.asp
Thanks for the great video Jin! Would like to see a future video about how to incorporate CNN with bi-directional LSTM to predict the stock prices. Keep up with the great content, all the best!
Thanks for your support! I'll see about combining CNNs and LSTMs in a future video.
Predict stocks using ICDST AI PREDICT.
Damn, this is the project I'm currently working on. Hahaha. Ltsm for direction and CNN for the entry pattern. Mine is for trading. Im just happy to see that it's being thought about
Can you predict the low and high of the next day?
That's an interesting thought. I can try, but I don't know how accurate or actionable the predictions would be.
Hi thanks for the tutorial very useful! I think all are waiting for the version with multiple stock
Noted
Dude this is great. Its funny I was watching videos of people making LSTM's speaking about the issues. One guy in comments pretty much said what you explained. He has been getting great results with a very complex LSTM, lots of dropout & batchNorm. Leaky relu activation and then uses Mean Squared Error %. I found it interesting. Then I find your video! Going to go play around with some models now :D
Could you please make a follow-up video or reference materials where you trained an LSTM using multiple stocks?
I'll consider making a video if I get more similar requests.
Please🥺 @@jinchoi-moneygeek
@@jinchoi-moneygeek I am just repeating the code for the main part for other stocks, keep the other parts like the training and NN parts and just save it as a different model. Is there a more convenient way to go about.
This is an extremely useful tutorial; very clear and info-rich. Two questions: The two-week time-sequences you use seem to all be the same length. Could you please share any thoughts that you may have on: a) using varying-length time-sequences, ie different history lengths and b) using time-sequences w/ varying history lengths initially, but that are subsequently padded with zeros so that we end up with the same fixed history length across all time-sequences?
Thanks for the kind words! You can indeed use variable lengths. You'd want a clear rationale for having some inputs being longer than others, though. I'm not aware of a good rationale, but maybe you or others would have. You shouldn't need to pad inputs with 0s. LSTMs can handle variable lengths natively.
@@jinchoi-moneygeekThanks again! I also appreciated how you demonstrated that (vanilla) LSTMs can predict multiple timesteps. In your experience, do you find multiple timestep predictions to be more (or less) reliable from a vanilla LSTM vs an Encoder-Decoder LSTM?
I really enjoyed the clarity in your video. It would be interesting to see how this model performs with dollar bars. I am new to this area and have been reading time bar sampling has inherent limitations. Thank you for sharing your code, I'd like to dig deeper and this helps tremendously.
Thanks for the kind words, Paul. Applying dollar bars would be interesting indeed. I'll think about making a video about it.
incredible video, where can i discuss more about this with you ?
Thank you! If you'd like to contact me, go to www.eddywealth.com/contact/
Can you explain what you mean by overfitting
Take a look at this other video I made ua-cam.com/video/kbCv4Pyy00M/v-deo.html
Over fitting is too much bias on training data and not performing well in testing data
Over fitting means memorizing if give 1-1=0 next if give any other its doesn't able to do it
I'd love to see a 0DTE model based on tick data LOL Either way Thanks for the tutorial explanation!
That would be interesting. Might also be a lot of work though. I'll consider it. Thanks for the support