Project: Data Analysis and Visualizations and Predicting Future Energy Consumption using LSTM Predic

Поділитися
Вставка
  • Опубліковано 16 січ 2025

КОМЕНТАРІ • 103

  • @sanjeetmohanty3894
    @sanjeetmohanty3894 3 роки тому +4

    How do you predict future dates?

  • @bhawnasgn
    @bhawnasgn 4 роки тому +4

    It was a wonderful demonstration !! Hope to have more videos on electrical dataset.

    • @SoumilShah
      @SoumilShah  4 роки тому

      Thanks

    • @prawinaher1627
      @prawinaher1627 3 роки тому

      @@SoumilShah I am also facing some problems, please give me your maild or mail me --> prawinaher16@gmail.com

  • @prabhats011
    @prabhats011 2 роки тому +2

    from where can i get the dataset to practie?

  • @StephenTete
    @StephenTete Рік тому

    Hey, I can see that the predicted data tends to lead the original data 14:07, what could this mean?

  • @nskarthik220
    @nskarthik220 3 роки тому +2

    From where can we get the csv file?

  • @aryapulkit8886
    @aryapulkit8886 4 роки тому +1

    I have a quick question. why you didn't perform the test to check data is stationary or Augmented Dickey-Fuller Test?

  • @shahad-iiitkottayam5540
    @shahad-iiitkottayam5540 3 роки тому

    Really Superb...Thanks allot

  • @yagosousa7200
    @yagosousa7200 Рік тому +1

    I'm trying to step into this field, Soumil. Do you have any books, websites or anything else to recommend? I understood what you are doing in the video, however, I don't know how to actually do it from scratch.
    Great video, mate!

  • @mellysylveria6051
    @mellysylveria6051 3 роки тому +2

    Hello, thank you a lot for this very helpful video! I was wondering, if we want to use that model for electricity demand forecasts in a few year's time, how can we take into account additional factors such as the increasing use of electrical vehicles?

  • @sivamaniyadav07
    @sivamaniyadav07 11 місяців тому

    what about prototype?
    how will you do for this?
    what is the implementation you do?

  • @nitishdurga2704
    @nitishdurga2704 4 місяці тому

    Where did you get the required dataset

  • @Itsusamabasra
    @Itsusamabasra 4 роки тому +1

    when i execute it for my data is shows this error.
    The section is last one
    CODE:
    fig = plt.figure()
    ax1= fig.add_subplot(111)
    x = dates
    y = True_MegaWatt
    y1 = Predicted_MegaWatt
    plt.plot(x,y, color="green")
    plt.plot(x,y1, color="red")
    # beautify the x-labels
    plt.gcf().autofmt_xdate()
    plt.xlabel('Dates')
    plt.ylabel("Power in MW")
    plt.title("Machine Learned the Pattern Predicting Future Values ")
    plt.legend()
    error:
    float() argument must be a string or a number, not 'Timestamp'

  • @swatipurohitvyas7308
    @swatipurohitvyas7308 3 роки тому

    @soumilshah can I get to understand how was this graph made ... talking about code . Need code to see rate of change of electricity consumption

  • @antonio77italy
    @antonio77italy 3 роки тому

    Did you use other predictors in addition to time of the day?

  • @vatsalsharma02
    @vatsalsharma02 9 місяців тому

    Where can I find this Dataset?

  • @azooofa
    @azooofa 2 роки тому

    Thank you.
    I would like to ask you a question. What about if I have CPU usage and I need to estimate energy consumption for each machine based on resource usage. How can I calculate energy consumption in this scenario to add a new column in my data set as energy consumption, because my data doesn’t show power consumption I need to calculate it my self!

  • @handofmidas42
    @handofmidas42 3 роки тому +2

    Hi Soumil. Nice video. Question though, how do you print the values of next 2 months calculated based on the machine learning model??

  • @vamsikrishnaakula8476
    @vamsikrishnaakula8476 2 роки тому +1

    Hoi bro, bro I am doing a project on big data analytics and the aim of the project is to identify the thefting of electricity.this video is some what related to my project could u give me more information about analysis of big data and how to complete my project

  • @elijahturatsinze1576
    @elijahturatsinze1576 4 роки тому +2

    Thanks for this video, but I have a question; can we predict the next two weeks for example instead of two months? Thanks

    • @ainafaqihah8328
      @ainafaqihah8328 3 роки тому

      Hi, do you have the solution for this?

    •  3 роки тому

      @@ainafaqihah8328 all you have to do Is to resample the data into days or weeks, it depends on the horizon and predict wtv you want

    • @ainafaqihah8328
      @ainafaqihah8328 3 роки тому

      @ Is it possible to perform LSTM on a small dataset?

    •  3 роки тому

      @@ainafaqihah8328 I'm really stuck :( and no you cannot it doesn't predict anything, could we talk in private? will ask some questions if you don't mind, here's my Instagram: zerdest.taifour

    • @ainafaqihah8328
      @ainafaqihah8328 3 роки тому

      @ already contact you on instagram

  • @danielebaldoni2181
    @danielebaldoni2181 Рік тому

    How many data you need to get an accurate prediction with an LSTM model? Very interesting job

  • @mogli6639
    @mogli6639 3 роки тому +1

    Hi,
    Thank you for a good description. I managed to run the code and overcome all error. Now I would like to predict future value and not substract "60 days data" from my df. Where do i change in the code in order to tell the machine to predict the energy consumption in the coming 60 days (ex 2021-06-08)?

    • @varsha9094
      @varsha9094 3 роки тому

      Hey I am getting 'nan' in some places in final table ...how do I fix it? Plz help

    • @mogli6639
      @mogli6639 3 роки тому

      @@varsha9094 Hi, i used
      newdf = df.dropna()

    • @jaypatel1275
      @jaypatel1275 3 роки тому

      Hey i getting error to showing graph "assertion error" how can i fix it plz help me

  • @syedmuslimjameel1792
    @syedmuslimjameel1792 4 роки тому

    Hi!
    Nice work.
    In the energy consumption graph (where you are showing the the concentration) what is y axis?

  • @nikhil2097
    @nikhil2097 Рік тому

    Is this code in R language or a python
    I am beginner so its becoming difficult to understand it ?

  • @ValeriaMaksimovich
    @ValeriaMaksimovich 3 роки тому

    Thanks! awesome explanation

  • @abebewondifraw6810
    @abebewondifraw6810 2 роки тому

    Thank you for sharing your video. In my case, I do have the 'Floodwater' column, but I still get the keyError when try to select the column. Kindly advise please. Thank you sir

  • @pravuchaudhary3904
    @pravuchaudhary3904 3 роки тому

    line 419, when did u call that function- Minmax scaler and transform?

  • @jaypatel1275
    @jaypatel1275 3 роки тому

    I have error to showing the graph of year plz can u help me.... How to contact u,sir

  • @hemantashahi6370
    @hemantashahi6370 4 роки тому +1

    My jupyter notebook doesn't show any output. Could you please help?? 😭😭

  • @kumaramartya1741
    @kumaramartya1741 2 роки тому +1

    Thanks man, this was damn helpful.

  • @ad1tyacodes
    @ad1tyacodes 4 місяці тому

    I'm trying to do that using the research , that how we can implement support vector machine to that same task with more accuracy

  • @parshadpatil1806
    @parshadpatil1806 2 роки тому

    getting error while running the code : cannot reindex from a duplicate axis

  • @anshumanmaurya731
    @anshumanmaurya731 2 роки тому

    Hello Soumil, I wanted to know how did you manage to get the data set of power consumption of the company. Basically, I am also working on the same project just don't know how to or from where I can get tha data set. Urgently required please help.

    • @SoumilShah
      @SoumilShah  2 роки тому +1

      Usually you can get dataset on kaggle or you can also contact the company !

  • @stay-amazed1295
    @stay-amazed1295 5 років тому +2

    Sorry brother i missed live 😢I'll use this model on stock prediction I'll let u inform how the results came

  • @jegatheshwaran1971
    @jegatheshwaran1971 4 роки тому

    I'm jegatheshwaran now I doing ME in power system engineering....Now I start do to my final year project in forecasting.regard this I need some help.....I need prectron neural networks working principle and details about ARIMA,TBATS,MLP,SVR

  • @durgasharma9910
    @durgasharma9910 4 роки тому +1

    I am not able to Energy consumption vs time plot. TypeError: float() argument must be a string or a number, not 'datetime.time'

    • @SoumilShah
      @SoumilShah  4 роки тому +1

      Just convert everything into String

    • @funwith
      @funwith 4 роки тому +1

      add this to your code :
      pd.plotting.register_matplotlib_converters()

    • @ritipatra3559
      @ritipatra3559 4 роки тому

      @@funwith Thanks.. It worked :)

    • @Jay_chy
      @Jay_chy 3 роки тому

      @@SoumilShah can I get your email please

    • @abhishekramekar4271
      @abhishekramekar4271 3 роки тому

      @@funwith where do we have to add this line in the beginning or at the end can you send me full code please that would be really helpful

  • @krishna-club
    @krishna-club 4 роки тому +1

    I am having an error on the last plot "TypeError: float() argument must be a string or a number, not 'Timestamp'.

    • @funwith
      @funwith 4 роки тому +1

      check my version of the code here :
      github.com/drwiiche/electricity-consumption

  • @ROHAN-xs7om
    @ROHAN-xs7om 5 місяців тому

    where's the dataset please provide

  • @sandeepsinghnegi9220
    @sandeepsinghnegi9220 5 років тому

    Great !!!

  • @ArunKumar-kl4eb
    @ArunKumar-kl4eb 4 роки тому

    HI bro , Dataset contains values till august 2018, if we are predicting values 2 months later. it should show predicted values of September and October values of 2018. but here its showing values till August. could you please explain this part

  • @prawinaher1627
    @prawinaher1627 4 роки тому

    from where we can downloasd csv file?

  • @abdullah7891
    @abdullah7891 3 роки тому

    Hey Soumil, I'm trying to re-do the same code on a data set similar to this but apparently its not working, is it okay if i connected with you on Linkedin and you could have a look from there ? Need some help.

  • @LijMati
    @LijMati 3 роки тому

    grate

  • @aadhilist
    @aadhilist 4 роки тому

    hi ..where did u collect this dataset

  • @prajwallh2085
    @prajwallh2085 Рік тому

    Sir can I get this project linkk

  • @stay-amazed1295
    @stay-amazed1295 5 років тому

    Sir I got a error at Training_Set
    It's showing error as MinMax not defined how it can be solved

    • @SoumilShah
      @SoumilShah  5 років тому

      sailoo boini you have not imported min max scalar

    • @SoumilShah
      @SoumilShah  5 років тому +1

      Import min max max scaler do that type that on google

    • @stay-amazed1295
      @stay-amazed1295 5 років тому

      @@SoumilShah thanks I'll try tomorrow

  • @almusawimsc1064
    @almusawimsc1064 Місяць тому

    Hi sir thanks for you
    Can i get programmed file???

  • @amitgaikwad5320
    @amitgaikwad5320 3 роки тому

    How to predict next 2 days AEP_MW value

  • @VishnuVardhan-sy5zu
    @VishnuVardhan-sy5zu 4 роки тому

    How to measure accuracy rate

  • @n613s8
    @n613s8 4 роки тому

    sir, i am having an error in the individual plot of energy consumption. AssertionError:

  • @ruhiruhi9638
    @ruhiruhi9638 Рік тому

    Sir please provide code for exogenous variables

  • @sanaullahsoomro7899
    @sanaullahsoomro7899 2 роки тому

    Sir i am getting error, please help me out
    Training_Set = Training_Set.values
    sc = MinMaxScaler(feature_range=(0, 1))
    Train = sc.fit_transform(Training_Set)
    NameError Traceback (most recent call last)
    Cell In [10], line 1
    ----> 1 Training_Set = Training_Set.values
    2 sc = MinMaxScaler(feature_range=(0, 1))
    3 Train = sc.fit_transform(Training_Set)
    NameError: name 'Training_Set' is not defined

    • @chetansadawarte8567
      @chetansadawarte8567 2 роки тому +1

      Training_Set = NewDataSet.iloc[:,0:1] did u define that?

  • @samayster_3699
    @samayster_3699 Рік тому

    Getting error in 304 block

  • @babitarimal7693
    @babitarimal7693 4 роки тому

    I got some errors trying to run this.Could you please help?

    • @funwith
      @funwith 4 роки тому

      you can have a version of code that works here
      github.com/drwiiche/electricity-consumption

  • @gg123das
    @gg123das 4 роки тому

    Can you please share the dataset?
    Thanks..

    • @funwith
      @funwith 4 роки тому

      github.com/drwiiche/electricity-consumption/blob/master/AEP_hourly.csv

    • @gg123das
      @gg123das 4 роки тому

      @@funwith I can't download it..

  • @parshadpatil1806
    @parshadpatil1806 2 роки тому

    plz share the project file

  • @kothapallianusha3905
    @kothapallianusha3905 5 років тому

    can u please send the link for dataset

    • @SoumilShah
      @SoumilShah  5 років тому

      Its on Kaggle please download from Kaggle

    • @n613s8
      @n613s8 4 роки тому

      @@SoumilShah @sir it is not found on Kaggle, please share the link.

    • @ibtissamelghoual2131
      @ibtissamelghoual2131 4 роки тому +1

      @@n613s8 www.kaggle.com/robikscube/hourly-energy-consumption this is the link

    • @n613s8
      @n613s8 4 роки тому

      @@ibtissamelghoual2131 thanks

  • @prawinaher1627
    @prawinaher1627 3 роки тому

    sir, i am having an error in the individual plot of energy consumption. AssertionError:
    how to resolve it?

  • @amirghorbani7922
    @amirghorbani7922 Рік тому

    Your model has serious flaws use icdst Ai model instead.

  • @n613s8
    @n613s8 4 роки тому

    sir, please share the CSV file

    • @SoumilShah
      @SoumilShah  4 роки тому

      Csv is on kaggle

    • @poojarani2251
      @poojarani2251 3 роки тому

      @@SoumilShah sir when I'm resampling the dataset it's converting a lot of values in null, I don't know why. Can you please help

    • @jjj-zp1op
      @jjj-zp1op Рік тому

      @@SoumilShah what is the name of csv in kaggle sir

  • @samayster_3699
    @samayster_3699 Рік тому

    From where we can download the data set

  • @jjj-zp1op
    @jjj-zp1op Рік тому

    where can i find the data set?