Tutorial 2- End To End ML Project With Deployment-Project Structure, Logging And Exception Handling

Поділитися
Вставка
  • Опубліковано 6 жов 2024

КОМЕНТАРІ • 124

  • @krishnaik06
    @krishnaik06  Рік тому +7

    Join this channel membership to get access to materials and connect with me:
    ua-cam.com/channels/NU_lfiiWBdtULKOw6X0Dig.htmljoin

  • @EnTarr10mentWold
    @EnTarr10mentWold Рік тому +42

    Hi @krish sir, the error in why it wasn't getting logged into the file was because we didn't import the logger.py file as a module in the exception.py file.. Once I did that, it worked for me.. Thanks for the video. Helped a lot in understanding the Project Setup.

    • @madi6901
      @madi6901 8 місяців тому

      I did the same. Working now. Thanks

  • @fazankabir2029
    @fazankabir2029 Рік тому +17

    OMG OMG Your channel is gold mine. No words to thank your effort for explaining such skills while keeping the content so easy and simple. Please keep contributing (Liked, commented, subscribed & shared)

  • @omkarkumbhar3222
    @omkarkumbhar3222 Рік тому +8

    This is the best tutorial of github i ever learn i understood all commands, also about project and things related to project how to set environment and all things ...
    Amazing Krish bhaiya ...thank you very much 💪

  • @arnoldk5415
    @arnoldk5415 Рік тому +3

    Sir. Thank you so much for all the work you do. You are a national treasure!!!

  • @kimerared
    @kimerared 7 місяців тому

    Thank you for the series of videos showing the end-to-end code structure. It is awesome!!!

  • @esfantastic-shorts
    @esfantastic-shorts Рік тому

    Sir.., First you have need to open .log file then we will logging successfully into .log file... Thank you sir ❤❤ to helping a lot..

  • @zzzmd11
    @zzzmd11 9 місяців тому

    Thank you so much for the excellent set of video tutorials. Hats off for the great dedicated work..

  • @radhekrashna2148
    @radhekrashna2148 Рік тому +1

    Thank you so much for working hard to create such a quality content for us
    Really you are great work
    I am very thankful to you
    I will look forward to next video and series of same type

  • @nani543
    @nani543 Рік тому

    So helpful! Thank you so much you are such a good teacher!!!

  • @poojakallure5808
    @poojakallure5808 17 днів тому

    Thank you.

  • @mahdiaspanani8004
    @mahdiaspanani8004 3 місяці тому

    I don't have enough words to say thanks to you.

  • @list10001
    @list10001 8 місяців тому

    Amazing tutorial. Appreciate your effort.

  • @souvikbasak7094
    @souvikbasak7094 Рік тому

    Enjoyed, learned as well as executed it!!! Thank you so much sir!!

  • @bevansmith3210
    @bevansmith3210 6 місяців тому

    Gosh, its like watching a master guitarist play an amazing solo

  • @sujojohn2948
    @sujojohn2948 Рік тому

    Thank you so much for all the effort you took explaining this nicely

  • @ayushimalaviya8416
    @ayushimalaviya8416 Рік тому

    Really like the way you explain. Nice work sir!!

  • @kaushalkumar3017
    @kaushalkumar3017 Рік тому +1

    Thanks

  • @nafeuhassanhelal1581
    @nafeuhassanhelal1581 Рік тому

    Brother,i am from Bangladesh. i am watching your videos.. it's so helpful. keep up good works..

  • @shikharawat8096
    @shikharawat8096 Рік тому

    This is so so so great. Thankyou for this Sir.

  • @photonplus2838
    @photonplus2838 Рік тому

    Beautiful Explanation.

  • @suyashshrivastava8317
    @suyashshrivastava8317 5 місяців тому

    Brilliant!!

  • @robinchriqui2407
    @robinchriqui2407 Рік тому

    Thanks Krish for your tutorial!

  • @shehrozeshahzad4363
    @shehrozeshahzad4363 Рік тому

    Love you Sir Thank You so much!

  • @bivasbisht1244
    @bivasbisht1244 Рік тому

    this is just beautiful , no words for krish

  • @sohelshaikh1171
    @sohelshaikh1171 Рік тому +1

    currently doing a DS internship, it was my first time training an model in the actual industry with real life messy data. if you looked at my task folder you'll probably catch a fever, I know I did (⊙ ⊙;). This video will help me in my future endeavors. Thanks!
    about the error not being logged, we haven't import our logger script

    • @NTISAniruddhSingh
      @NTISAniruddhSingh Рік тому

      can u drop ur linkedin or any other social media here where i can contact u

  • @subhashdixit5167
    @subhashdixit5167 Рік тому

    Thanks once again

  • @sahilpatel2187
    @sahilpatel2187 11 місяців тому

    outstanding

  • @rupindersingh1312
    @rupindersingh1312 Рік тому +2

    thanks for this lecture
    date - 9-7-2023

  • @VishalSingh-wt9yj
    @VishalSingh-wt9yj Рік тому

    you are the best sir

  • @nagrajwellness9720
    @nagrajwellness9720 Рік тому

    Sir you are genious

  • @sandeeppvn0503
    @sandeeppvn0503 Рік тому +4

    Amazing video! Its a solid bridge to transition from academics to industry! Thank you Krish!
    Ther is one issue I encountered, def error_message_details(error, error_detail:sys): in this, the type casting to sys is showing up as an error on vscode: Module cannot be used as a type. Could you please help me out how to resolve this?

    • @themuslimview
      @themuslimview 10 місяців тому

      I am facing the same issue. Any solutions?

    • @GauthamRajS
      @GauthamRajS 2 місяці тому

      import sys

  • @sagarthacker96
    @sagarthacker96 Рік тому +5

    Hello Krish, I enjoyed watching your video and getting to learn new stuff from it. I wanted to ask is there a reason why we created a logs directory structure as `logs/file_name.log/file_name.log`. In the middle there is a directory named same as the filename. Do we actually need the directory or is that a common practice in the industry?
    Thank you! Looking forward for more such videos!

    • @rabeegheni1224
      @rabeegheni1224 Рік тому

      i am wondeing same thing, did you find an answer?

    • @sagarthacker96
      @sagarthacker96 Рік тому

      @@rabeegheni1224 Nope, I still couldn't find an answer for that.

    • @mathsmoz5353
      @mathsmoz5353 Рік тому +1

      Hi, I think it's it was an error he didn't notice.
      I ran it with the code snippet below and it work's well for me:
      LOG_FILE = f"{datetime.now().strftime('%y_%m_%d_%H_%M_%S')}.log"
      logs_path = os.path.join(os.getcwd(),"logs")
      os.makedirs(logs_path,exist_ok=True)
      LOG_FILE_PATH = os.path.join(logs_path, LOG_FILE)
      Hope it will help.

    • @sagarthacker96
      @sagarthacker96 Рік тому

      @@mathsmoz5353 Got it. Thanks!

    • @AmbarGharat
      @AmbarGharat 7 місяців тому

      Basically you didn't join LOG_FILE in logs_path variable. @@mathsmoz5353

  • @SaurabhSingh-oi5ev
    @SaurabhSingh-oi5ev Рік тому

    Import logger into the exception file which will trigger the logger and your log file will be created..

  • @javeedtech
    @javeedtech Рік тому +2

    Waiting..
    Is it an alternate day series..?
    Thanks

  • @rajkachhadiya6192
    @rajkachhadiya6192 Рік тому +3

    Hello @krishnaik06
    I really appreciate your work, it is very helpful for me personally but I have one suggestion if possible then please explain each and every point or command properly so we don't have to take support from others. I can understand your time limit but still little a suggestion for me
    I hope you will work on it.
    Thank you

  • @gnanadeepch5065
    @gnanadeepch5065 10 місяців тому

    DS GOD. He needs to be pushed to TED Talks. He can touch many more insecure Engineer lives.

  • @World_Exploror
    @World_Exploror Рік тому +4

    Dear Krish could you please suggest how do I add sales experience for Data Scientist role will this add any weightage for the resume or should I go completely as a fresher, I have experience in Auto, banking and telecom industry @Krish Naik

    • @akj3344
      @akj3344 Рік тому

      Hey I had some sales experience and switched my career to Software Developement. Your sales experience does not matter at all. Mention it on your resume but apply as fresher.

    • @World_Exploror
      @World_Exploror Рік тому

      Thanks for the suggestion bro I did the same

  • @pandalanhukuk804
    @pandalanhukuk804 3 місяці тому

    First of all, thank you for all the videos and the playlist. I have just one piece of feedback: please avoid using "with respect" in every second sentence. It's often used incorrectly and doesn't add any benefit.

  • @sibaprasadnaikbehera3442
    @sibaprasadnaikbehera3442 Рік тому +1

    just we have to import logger then log file will be created

  • @neilrohra7374
    @neilrohra7374 Рік тому +2

    If anyone is facing issues with Datetime or any library, reinstall the virtual environment.

    • @sameertupe6094
      @sameertupe6094 9 місяців тому

      How to do it can you please explain

    • @RaghavTigadi-de3xv
      @RaghavTigadi-de3xv 5 місяців тому

      am facing this error
      No module named 'datetime'

    • @neilrohra7374
      @neilrohra7374 5 місяців тому

      Reinstall the virtual environment and it'll be done.

    • @RaghavTigadi-de3xv
      @RaghavTigadi-de3xv 5 місяців тому

      @@neilrohra7374 if i re install need to all from beginning?

  • @koblanyamadi8816
    @koblanyamadi8816 Рік тому

    Thanks, Krish for the video it was very helpful. I'm having an error with "levelname" in line 13. error message says Unknown word

  • @gajender6075
    @gajender6075 Рік тому +3

    from src.logger import logging
    ModuleNotFoundError: No module named 'src'PS C:\Users\asdf\Documents\D.S\END-TO-END-PROJECTS\Test>
    find this error that src in not found please anyone can fix it..

    • @jerrinthomas1874
      @jerrinthomas1874 Рік тому

      me also same error, how to fix it

    • @gajender6075
      @gajender6075 Рік тому

      @@jerrinthomas1874 no one reply even not krish sir I totally stuck here ..If you get the solution please ping me

    • @ebrahimbehrouzian6930
      @ebrahimbehrouzian6930 Рік тому

      @@gajender6075 & @Jerrin Thomas , I have the same problem. Please let me know if you could find the solution. Thanks!

    • @gajender6075
      @gajender6075 Рік тому

      @@ebrahimbehrouzian6930 I see the very solution but nothing is working in my case you should try by creting __init__() file in each directory or gave the path in sys of that perticular directory

    • @adityagarg7816
      @adityagarg7816 Рік тому

      Make sure you have __init__.py in every folder.

  • @jamespaz4333
    @jamespaz4333 Рік тому

    We also need Sunny!!!

  • @ayushratan6452
    @ayushratan6452 Рік тому +1

    hey does anyone know why does'nt the logs file show under git status ?

  • @ridj41
    @ridj41 Рік тому

    Very complex to understand..
    Most of the concepts were unclear

  • @vishnukg2058
    @vishnukg2058 Рік тому +1

    Will you use docker, aws?

  • @rishiraj2548
    @rishiraj2548 Рік тому +1

    🙏💯💯

  • @ritikaradh
    @ritikaradh 9 місяців тому +1

    at 26:40, after running python src/logger.py the log folder and the logger file got created but the message "Logging has started" didn't get printed. Can somebody help me pleasee.

    • @shiva-xt2mo
      @shiva-xt2mo 9 місяців тому

      i think you should recheck your code

    • @IsrakJahanSamir
      @IsrakJahanSamir 2 місяці тому

      did you solved it. I am having the same issue

  • @RohiniN08
    @RohiniN08 Рік тому

    Which is the interpreter used?venv is not activating after restarting vs…any help??

  • @IsrakJahanSamir
    @IsrakJahanSamir 2 місяці тому

    my logger is not printing the message. it is creating logs folder and file. But the message is not there in the file. If anyone face the problem and solved it or know the solution, pls reach out to me. Thankyou

  • @enamulhaque7135
    @enamulhaque7135 Рік тому

    Hi @krishnaik06 If I want to develop 10 different projects in 10 different github repositories, do i need to create this setup and environment every time from the beginning?

  • @yohnfhayersiregar8233
    @yohnfhayersiregar8233 10 місяців тому

    hello there,
    have you finished this?
    gender_group = df.groupby('gender').mean()
    gender_group
    I have been trying, but still error
    would you share your? how to solve it?
    thanks

  • @harishs6315
    @harishs6315 Рік тому

    hi krish, why do we need custom exception handeling when we can handle almost all the execptions using the inbuilt python functionality? Are there any specific type of errors or issues in ml workflow where this is used(cases where the inbuilt execption handeling is not enough)?

  • @vKNemesis
    @vKNemesis Рік тому

    i have issue in enviroment even my file is not running and I did the same ways what u are doing still I have environments issues as u getting a new file in vs code after running m not able to get those depressed as hell

  • @parthibanpalanisamy1434
    @parthibanpalanisamy1434 Рік тому

    Please suggest me to resolve the issue which i am getting as below:
    File "src/exception.py", line 2, in
    from src.logger import logging
    ModuleNotFoundError: No module named 'src'

    • @randomshortzz
      @randomshortzz Рік тому

      Same issue brother have you resolved it

    • @hitarthshah8199
      @hitarthshah8199 10 місяців тому

      Try doing "cd src" if you are running it in cmd, it will work@@randomshortzz

    • @AmbarGharat
      @AmbarGharat 2 місяці тому

      from logger import logging use instead src.logger import logging
      Hope it helps!

  • @preetisain1549
    @preetisain1549 Рік тому

    Hlo sir instead of vs code I can make project on jupter or not??

    • @xahidhasan6361
      @xahidhasan6361 10 місяців тому

      Same question here. If you already know the answer please let me know

  • @utkarshkanojia3193
    @utkarshkanojia3193 Рік тому

    Can I do this coding in Google collab

  • @ansharora5698
    @ansharora5698 8 місяців тому

    I am getting the no module named datetime error, while running python src/logger.py

    • @pavankurapati6628
      @pavankurapati6628 5 місяців тому

      import os
      import sys
      # Use a raw string for the file path
      sys.path.append(os.path.abspath(r'C:\Users\xxxx\mlproject\src'))
      from logger import logging
      try this :)

  • @vagheeshmk3156
    @vagheeshmk3156 5 місяців тому

    #KingKrish

  • @barbarafirmino3586
    @barbarafirmino3586 Рік тому

    Krish, I have a simple question but why are you building a project from zero instead of using Kedro or Cookie Cutter pattern? It's just because you are being didactic or there's something else?

    • @naraendrareddy273
      @naraendrareddy273 Рік тому +2

      He wants us to understand the structure of projects I guess

  • @harishs-dm8mm
    @harishs-dm8mm Рік тому

    When the part 3 video gonna come

  • @abhijeetrokade2349
    @abhijeetrokade2349 Рік тому

    What is the problem statement?

    • @krishnaik06
      @krishnaik06  Рік тому

      We will discuss in the next video currently we are discussing the project set up

    • @abhijeetrokade2349
      @abhijeetrokade2349 Рік тому

      @@krishnaik06 Thank you

  • @PavanKumar-ut2lo
    @PavanKumar-ut2lo Рік тому

    Hi sir, do we need any paid version software for this project?

  • @01kumarr
    @01kumarr Рік тому

    where is part 1

  • @ShahbazKhan-ph3vd
    @ShahbazKhan-ph3vd Рік тому

    No. Today Krish will upload 2 videos😅

  • @deepakgoyal1643
    @deepakgoyal1643 Рік тому

    sir kuch bhi samaj me nhi aaya

  • @EvilCherry3
    @EvilCherry3 Рік тому

    16:04 You lost your accent here lol

  • @tejas4054
    @tejas4054 Рік тому +1

    Tum ml sikha rhho ki dara rahe ho itna sara code likh k ,,, backend developer ka kuch kaam nhi hai ml me toh kyu backend developer ka code likh ke dara rhe ho,,, hum data science kare ya na kre phir

    • @beAdevops
      @beAdevops Рік тому +1

      Right, Really Need this all kind of stuff ?

    • @tejas4054
      @tejas4054 Рік тому +1

      @@beAdevops ha na bhai main toh coding dekh k darr gya agar itna hoga toh main to analyst post pe javu

  • @zub3rahmed76
    @zub3rahmed76 Рік тому +1

    MAKSOOOD BHAI @krishnaik06 , Tum bhohot achha kaam krta hai . Apne ko tumko dil se thanks bolne ka hai . Jaadu ki Jhappi from Mumbai.🫂🫂

  • @Maciek17PL
    @Maciek17PL Рік тому

    for logs you created logs/date.log/date.log, did you mean to create this directory in the middle?

  • @naveenkumarP-n9q
    @naveenkumarP-n9q Рік тому

    Hi Sir
    i am constatntly getting this error no matter what i have even checked up with chatgpt
    LOG_FILE=f"{datetime.now().strftime('%m_%d_%Y_%H_%M_%S')}.log"
    ^
    SyntaxError: invalid syntax

  • @rajamsameer
    @rajamsameer 6 місяців тому +1

    I'm not getting log files 🤌

    • @AmbarGharat
      @AmbarGharat 2 місяці тому

      In .gitignore file comment this *.log
      This will only work if you are able to see log files in your file explorer folder but not in vs code.
      Hope this helps!

  • @shalakam1617
    @shalakam1617 Рік тому

    Thank You

  • @mdabdullahalhasib2920
    @mdabdullahalhasib2920 Рік тому

    Thanks.

  • @hmtbt4122
    @hmtbt4122 Рік тому

    thanks