PixInsight stacking. WBPP 2.5 (Weighted Batch PreProcessing Script)
Вставка
- Опубліковано 30 вер 2024
- In this video I take a look at the latest WBPP script 2.5 (weighted batch preprocessing) and demonstrate how to use it and highlight some of the features. WBPP takes all of your data and calibrates, aligns and stacks it for you - all on auto pilot!
Like, comment and subscribe! Thank you :)
Help support the channel! If buying astro gear use these links below and I'll receive a small commission at no cost to you:
OPT (USA): bit.ly/37ZCnzv
High Point Scientific (USA): bit.ly/3CMPKEy
Ontario Telescope (Canada): bit.ly/3cncCjE
All-Star Telescope (Canada) bit.ly/3PZFyxI
New to Pixinsight image processing? Get in touch! I provide one-on-one lessons via Zoom.
Join other supporters of my efforts on Patreon here: bit.ly/3v5dEaB
Proceeds help fund new videos, tutorials and more!
Join me on:
Facebook: / visibledarka. .
Twitter: / visibledark_
TikTok: / visibledark
Thanks for watching! Clear skies!
There's so much conflicting info about which calibration frames are necessary. Some pepole say darks aren't necessary, others say bias aren't necessary. I just use them all lol
Bias are useful for CCD cams. Darks should be taken really. Cmos cams today are low noise, not no noise. If measured SNR using darks will be better. There's also a lot of bad info on UA-cam I find. Have to be careful.
Great video Shawn,
I use a OSC QHY268c camera, and Image at 1.72”/pixel so not over or under sampled, should I used drizzle, will it really benefit me, also I read it’s only good to use drizzle, with very well dithered data, and I don’t either….?? 🤔👍🏻
Drizzle requires a lot of subs and yes well dithered to be effective. It avoids interpolation. CFA drizzle should be used for OSC.
Isn’t there a setting under image integration that you can set to check for bad subs? Like minimum weighting? Or how do you check your subs before running it? Do you just add them all? Like in DSS where you can reject say the bottom 20% of the subs? Thanks
Any way of integrating using different methods. eg I may have rgb for stars and NB for the object. I might have many NB frames and use one type of integration and a different kind for my RGB because I don't have so many of them...? It seems that the choice of integration method has to be universal.
Ya I don't think different integrations methods can be applied manuall depending on type of data. If you leave it set for auto it will decide for each data set the best method to use. You can add rgb data and nb data at the same time into wbpp and it will create masters for both data sets.
At 8:04 I was waiting for you to say "Studentized" but you (wisely) skipped it :)
Yes I did on purpose! Never comes out right. 😆
Great video, Shawn. When running WBPP with 'astrometric solution' and later processing using the CometAlignment module I had issues when trying to select my last comet image. This was repeatable on both my Mac and Windows. If you do run in to an issue, just run WBPP without the astrometric solution, at least this solved the issue for me.
Thanks for the tip!
I am not able to get the updated (2.5.1) WBPP despite my trying to update PixInsight as suggest by you. While I have checked for update, it says "There are no updates currently available for your PixInsight installation" and my WBPP is still version 2.4.1.
Same here
I have had this problem occasionally and renaming the Updates.xri file from the pixinsight directory usually does the trick.
You probably have not install the latest PI version yet. Log in to your account on PI website and download the latest version. The "check updates" won't let you know that the latest version of the software is not installed, it only checks for processes and scripts. I ran into the same issue until I realized I had not installed the latest software version... Hope that helps. Cheers.
Hey Shawn, good video. I normally use APP for pre-processing, but figured I would give PI a whirl on C2022-E3-ZTF.
Just noticed you have a SkyHunter mount in the background. How is it going with that mount? I purchased one since it is becoming increasingly more difficult to lug around my EQ6r with age. I find I can leave everything on it (RedCat, OSC, guider, mini computer) and carry it out, getting set up in minutes. Bonus in that respect. Albeit it is pretty dainty, so you can't disturb it too much after polar alignment. I find it difficult to guide better than about 1.2", with the odd moments at 0.7". How is that going for you?
Hi Richard - I actually don't have the Skyhunter anymore. It couldn't carry the weight of my 71mm and camera etc. It was pushing the limits. I did have a chance to try it though and it worked well. Except for a meridian flip problem. But the firmware update and board replacement for the SKyhunter fixed all that. I don't recall what my guiding was like. I was getting round stars though. It would be good for a redcat or similar size. It was pretty easy to setup and polar align. I think if I did more DSLR and lens night shots I would have kept it for that. But I don't do that really. Cheers.
@@VisibledarkAstro fair enough. I just use mine for the very light gear. I was very lucky ordering it later, so they held my shipment until they sorted out the motherboard issue. It is definitely a good grab and go compared to my old iexos-100
Great video! I've always wondered how to use WBPP. Now I know. I tried it out last night. It ran fine but I have a problem with the final image. I shoot using a DSLR. Problem is that the final image comes out in mono. I tried using the process to change from mono to RGB. Didn't work. I still have a mono image. Is there a way to fix it? Did I miss something? Kinda stuck at the moment. Any help would be greatly appreciated. Thanks.
Not sure entirely, but it sounds like maybe the DSLR lights are not getting debayered within WBPP. Does it see them as OSC? You also may need to manually set the debayer pattern to use, example is RGGB, but this maybe different for your camera.
@@VisibledarkAstro I found the problem. I needed to check the box for CFA images. I found it in the Calibration overscan settings. When I checked it. My light frames showed that they were now RGB not Mono. Worked fine after that. I do though. Have to go into it to make sure it's still checked. I'll get used to it the more times I use it. Thank you for the help. I appreciate it. Keep up the great videos. They're excellent.
Hi Shawn, somehow I don't have WBPP under Script -> Batch Processing. I also can't find it elsewhere. I have the latest version (Core Version 1.8.9-1). Or should it be downloaded somewhere?
This happens to some. I don't think there's ever been a clear answer as to why. You can try closing pixinsight and then in the program files/pixinsight directory, delete the file updates.xri and then open pixinsight again and see if there are updates to install which may include wbpp. Once updates install close pixinsight (so it installs them) and reopen PixInsight. Hope this helps!
@@VisibledarkAstro Thank you. I repaired PI and that actually fixed the issue...
Hi Shawn thanks for your video. I’m currently having a problem with WBPP I haven’t been able to find an answer for. I run my data through WBPP and am finding after I’ve done my normal work flow and combined my RGB to a final image it looks fine until I run Morphology transformation then I end up with grid pattern that almost looks like pixel grid. I also have the same pattern in my rejection frames. I’ve checked my original subs a stretched the heavily but they seem fine. Is there a setting you recommend adjusting in WBPP to tackle this problem? . I haven’t used calibration frames and am using monochrome. Everything at default so far
Hi Michael - sorry for the delay replying. I get swamped with questions from al the videos. Hard to keep up. Why are you using Morphology transformation? I'm not entirely sure what would be causing the grid pattern. Maybe a debayer issue? I'd really have to see a few of the light frames to get a better idea.
@@VisibledarkAstro Thanks for the reply I can only imagine the questions you receive and appreciate your response. I currently use morphology to reduce stars in my image. I’ve tried the scripts you provided in another video but am having some trouble with it most likely user error on my behalf. As for the grid pattern my subs look fine it seems like it happens when I stretch the image in histogram transformation as well. As for the image I’ve posted it on many site without luck.
If it weren't for you Shawn, I'd be struggling! Thank YOU so much for your videos!
Thanks for the video. I am currently doing the trial period of PI and wondering if its worth the investment. Your video certainly is helping me learn what PI can do for my imaging. I do notice that as PI updates some tutorials become harder to follow.
Hello, at instant 4'43" of the video you see two groups of darks: I imagine they are the darks and the flat darks. I have grouped the darks (exposure 8") and the darks flat (0.05") in two distinct folders, as Does the WBPP ever group me darks and flat darks in one group?
I solved it by lowering the exposure tolerance value. Thank you all the same.
Hi Marco - I am not sure I understand your question fully. But WBPP will create seperate groupings of the darks and dark flats as seen in the video. If you still need help, are you able to clarify your question or elaborate?
@@VisibledarkAstro I solved it by lowering the "exposure tolerance" value. Thank you all the same.
@@VisibledarkAstro Thank you all the same. I solved it by lowering the "Exposure tolerance" parameter.
Great, understandable video Shawn. I just started learning PixInsight today (using your 3 hours video tutorial). Got to the WBPP section and hopped onto this video. Awesome. Can hardly wait to continue on my new journey. Thanks for sharing your knowledge! Dr. B from Manitoba, Canada
Thanks Shawn. I hadn't realised you can use master darks with WBPP before seeing this. Adding Drizzle is a useful feature too.
Wbpp creating the drizzle masters is super!
Excellent video Shawn, this is great help for novices like me. One question - the Drizzle - is it the same that we set for the Camera settings when we do autoguiding using ZWO Asi Air?
Also, say my images are already Drizzled while capturing (through ASI Air), do you still suggest I should Drizzle again through Pixinsight?
lovely run through everything, great for a super newbie like this guy.
Thanks!!
Hi, for a newbie really well described without being overwhelming. Ran WBPP the other day, when it then created 2 folders - calibrated, debayered - they have files of a good 25 GB in total.. right now I don't know the point of having them, and can you delete them afterwards.? do they have a function afterwards, other than they master.? otherwise you quickly run out of space.
I’m yet to stack with pixinsight (post processing has been main goal since purchasing). I’m only 10 minutes into video so you may touch on this. How would you stack Osc with multiple night imaging?
If you're using the same flats and darks for all nights then you can just add in all your lights from every night along with the flats/darks and away you go! But if you have different flats/darks for each night then you would want to use keyword grouping. That will be covered in part 2 of thus overview.
@@VisibledarkAstro Thanks for that Shawn, I use the same darks but I shoot my flats/dark flats each night. I’ll finish this video then I might give it a crack. If not I’ll wait for the next episode 👍
Update I followed this video and again you made something that looks daunting easy to pick up and understand, cheers! Waiting on next episode now for the grouping multiple days 👍
I love all your videos. Can you give me a recommendation on the specs for a new laptop? I currently only have 16 gigs of RAM and when I do multiple nights in WBPP, I seem to run out of memory when I get to generating the Lights masterfile.
Good job Shawn 👌
i have one question : can I put directly my Master Bias, dark and flat in WBPP or do I have to take only frames?
Tnahk you for your answer
Shawn..if I separate the rgb channels and select drizzle and auto crop, I get a master for the drizzle and autocrop separately. for each color. How do I then recombine 2 masters of each color?
I use manual registration reference image, as I manually process after calibration in WBPP when combining sets years apart. Although I see you have a newer video out on grouping. Not sure how that will work between to pixel image scales between two set-ups. If I can work, that will be the real game changer for me.
Excellent video Shawn! I have a question, in 8:52 why your flats for the same filter have different exposure times?
jfwiw- I have not yet had a single instance where WPPP didn't fail at the Astrometric Solution stage. I just started un-checking it.
I don't seem to be able to save the settings for WBPP in a way that will fill the user interface with previous values, unlike what can be done with process tools as you illustrate with Cosmetic Correction. WBPP settings always seem to be global. Am I missing something?
Good tut. If using a Zwo OSC camera, do we need to remember to check CFA, or will it know? I figure if you're using the most common astro cams, PixInsight would know and adjust accordingly.
wondering if u would be willing to collab to make a . TNice tutorials would be my first and I would understand and apprehensions you may
Do you have a video for adding multiple nights (using Key Words?)? Thanks!!
I’m so glad that drizzle is now integrated into WBPP. I’ve been waiting for that to occur. thanks for the video
Hi I also need to if u can combine different exposures into one image in WBPP.
Thanks
Wow thanks!
I used to stack with DSS. I tried WBPP thanks to this video and the difference in the resulting image is bigger than I thought. Very helpful.
Keep going with this great channel!
thanks shawn!...agree with others, and looking forward to part 2, combining frames from different days, and different locations that need different associated flat frames.
complete. So I put a few videos up to show what i've got so far, and i'm hoping that soone will take the ti to watch them, let
Another great video. Looking forward to part II
Hey Shawn and thanks again for this useful tutorial! I was wondering, about the drizzle scale with mono cmos cameras: If my sampling is ok (not under or over sampled) should I really use a scale of 2 instead of the default 1? what would be the difference? Thanks for your feedback and cheers from France 🙂
It's a very in depth topic but 1x will give the same size as the pixels and the drizzle integration will not necessarily give a sharper result. Using 2x will produce a pixel grid that has a higher resolution than the original data. BUT you need a lot of subs for drizzle and well dithered. And if your not under sampled then there really isn't need to drizzle at all. Cheers!
@@VisibledarkAstro actually I've tested your method and drizzled 2x, and even though my sampling is quite decent, I've definitely noticed an significant increase in resolution when I zoom a lot in the picture. Of course it 's a little longer to process in Pix but I will definitely use it every time from now...looks better! So thanks again Shawn!
ganda amn npo ng intro LIFERS2NDANNIVERSARY
Thank you for the video, been awhile since I used it so this was a great refresher.
Tl/ DR: keep all the presets as is, set output folder, hit run, and go do something else for a few hours.
learn what they are doing. I would learn how to lay down drums on the channel rack and use so loops, and then once you have your
Great Video Shawn, but I'm confused about cosmetic correction. Adam Block says to ALWAYS use cosmetic correction with CMOS cameras to eliminate hot pixels. Are you sure you're not thinking about "linear defects correction"?
Hmmm, not sure what circumstances Adam would be referring to specifically, but I own several CMOS cameras and never use cosmetic correction. My old CCD camera definitely had hot pixels and needed cosmetic correction applied. But if your CMOS cam does produce a lot of hot pixels for some reason then cosmetic correction can be effective.
Thanks so much for this really very very helpful.
Thank you very much for your key......1000% work :)
Great information. Drizzle wise, this means I don't have to go to Process > DrizzleIntegration and add in the .xdrz file anymore, yes ? Drizzle can be done on the new WBPP.
That's correct! WBPP will do it all now.
this program works great! exactly as I wanted
Hi Shawn! Do you think there's any danger of overcorrection using Bias and Darkflats on CMOS? I am using both but hadn't any troubles, yet.
For CMOS cams bias frames really aren't necessary IMO. If you're shooting flat darks then no need for bias frames. May not hurt anything if using both but no need to. It will though increase the time WBPP takes to finish.
Does the directory import routine recognize file types from the directory label, or do the individual types have to be specified in the FITS header?
Its reading the FITs header to know what is what.
Thank you so much!!! It did work and took less than 5 minutes!
I bought the Fruity Edition and tNice tutorials tutorial helped out a lot!
Wow. Really helpful. Thank you!
thank you so much. tNice tutorials helped a lot
2.6.2 will plate solve now too, which is nice to get out of the way.
Great video as usual , thank you very much
THANX! it was very helfull
ThNks Shawn, great video
Shawn, very well-done video. I've been using WBPP for over a year but with its recent 2.5 release and your video, I learned a lot about the new additions. Thanks for your support to the Astro community!
Thanks!
Hi Shawn! Thank you very much for sharing this valuable info! Quick question please, can I stack a bunch of files with a comet? Ideally, I would like to select a "reference image", so that every file will stack onto it. Thanks!
You would want to use Pixinsights comet stacking process. I have a video showing how to do it. Search my vids for comet and you should come across it.
@@VisibledarkAstro Found it! Thank you very much! 😁
Great videos thank you 👏👏
It's okay. Give more videos like this
Thank you bro I am vary happy again. I am very v
Do u need to have any tutorial plugged in or is all the softs on soft
Can I do different iso like I can exposure time
Thanks Shawn. Does this make subframe selector redundant or should I run the lights through there first?
No need to run through subframe selector. Wbpp will do it and reject as needed.
Flats exposure doesn't care if your light subs are 30sec or 30 min. You don't need different flats for the same filter as you mention at 10:00
Correct. I think I was referring to multiple nights and different data sets of calibration frames. May have not clarified it properly. Thanks for pointing this out. Cheers.
Thank you for this video. One question, how do you stack images from different nights with different flats from each night?
That is part 2 of WBPP overview. You would need to use grouping keywords.
@@VisibledarkAstro ahhh, thanks. I've been looking up grouping keywords. It would be good to work out if you can use them without needing to rename the files and just with folders instead. I can't get that to work. :(
Omg thanks very much ! ✨
Thanks Shawn. I had been using DSS and between this video and Nico Carver's recent review of multiple stacking solutions I decided to give WBPP a go last night for the first time. Its much easier than expected thanks to your video! However, I updated PixInsight before I started, but the WBPP is still showing as version 2.4 and drizzle is not available. I tried checking for updates again, but it says no more updates available. Any idea why I might not be seeing WBPP version 2.5? Thanks.
Thanks for the comment! Did you restart PixInsight after you updated? That needs to be done.
@@VisibledarkAstro I did. I think I may have just figured it out though. I am on PixInsight version 1.8.9 and I think I need to move to 1.8.9-1 to get it. So I'll try that later today. Thanks for the reply and big thanks for all the great content!
I can confirm that updating PixInsight to version 1.8.9-1 worked. I now have WBPP version 2.5.3.
very very gooood, thaaankss maan✨✨✨✨✨✨✨✨✨✨
Look forward for part2
Thanks for posting this -
It worked. Thanks a lot
Excellent Shawn, thank you very much
My pleasure!
Thanks!
BROTHER, YOU ARE THE BEST!!! You oooh really helped me!! THANK YOU VERY MUCH!
Great Video Shawn, wish you were still doing more...Happy 2024 bud 😀
Thanks Shawn - you've been incredibly helpful. Clear skies!!! "Harry"
Hey Shawn, great video! What if I'm stacking just Ha or Oiii in WBPP, in the Post-Calibration tab, under Channels Configuration: Would I leave it with the default Combined RGB for Debayer with R,G,B active?
Thank you very much, your clear and relaxed way of informing is really helpful. Kind regards Jelle (from Luxembourg, Europe)
Hi Shawn, good tip on the Flat issue and dust bunnies, in the Output Pedestal window...I just started using dark flats with my ASI294MC Pro...No more bias, been doing it wrong for three years now, jeez!! Great video, thanks
checked updates v2.3.2 is the latest I have and nothing showing in updates
Close PixInsight and there's a file in the root directory of the Pixinsight folder called "updates.xri" Delete it. Then restart PixInsight. It will re-update everything and will fix your problem. If you found this helpful please consider a tip! visibledark.ca/add-a-tip/
Very helpful, looking for part 2.
Glad it was helpful!
Great overview. I just tried WBPP 2.5.1 now. Question: so with drizzle integration now in WBPP the output master has both a drizzle1x file and a non-drizzled master light. The drizzle1x master light I'm assuming is already drizzed and no other work has to be done with regard to drizzling?
I stumbled across your channel by chance while trying to figure out how to process the comet... I will definitely use your method. I wanted to ask you did or do you plan to update your tutorial with the latest wbpp updates with the latest functions (November-December update if I'm not mistaken) those that include spcc in processing. Thank you
Shawn I couldn’t drizzle with OSC data, the option to drizzle is greyed out when I separate R G and B channels. The drizzle files are there in the registered folder. I used the drizzle integration process and it worked. Maybe it is too complicated to be included in WBPP automatically.
I had a very frustrating time with some Telescope live data in that it had 1.20" 300" and 600" frames that came calibrated. the stack had really bad stars that were red or green huge squares. I finally used drizzle at #2 and it fixed the problem. It was the M51 data bundle. I haven't seen a video on how to process Telescope data yet. It's different in that you get calibrated frames. Telescope Live has a free trail too. They have tutorials but use both photoshop and pixinsight . Pixinsight is difficult enough to learn no need the stress of photoshop. Anyway, nice video.
Can't thank you enough for taking the time and effort to share your knowledge. Excellent video, very professionally presented, this means I am actually starting to understand some of the functions on WBPP rather than just blindly setting up with defaults. Thanks again.
This was excellent !
Thanks a lot for this tutorial. I never used WBPP thinking that it is too complex. I’ll try it now that you have made it simple. CS!
Excellent, as normal. The drizzle 'enable' is very interesting....👍👍👏👏
I ran the new script on 36 Ha frames taken on my EDGE HD 8” and got a whole bunch of wide vertical white stripes down the centre of the image, when I deselected all the ‘goodies’ and took it back to a simpler stack routine it created a normal Master Stack. Any idea what might have caused that❓
Okay, Shawn, you are now my goto guy for any updates in PI! This is an excellent video and a good review too. I kept coming up with questions and then you would answer it during your video. Looking forward to your Keyword video. I’m doing multiple nights now (OSC), but need to learn about aligning my Flats/Dark Flats and Darks. I definitely had forgotten some of the background of WBPP and this has helped refresh my partially fossilized brain. Also, it looks like I should be putting my Dark Flats under the Dark tab (I was putting them under the Bias tab.
Again, great video! Thanks!!
Good stuff. thanks
Great Video, you have a very nice cadence in the topic. I'm in a second lenguage and I was able to follow you very easy. Great and easy tool from PI: Looking forward to see many more of your videos.Tanks.
another excellent tutorial but I have 2.5.1 without the updated script. looking to try it with the new QHY268 data
Hi Shawn just one question can you stack different exposures to form 1 master
I stacked some 300 and 600 sec exposures and I got 1 master 600 and 1 300 master is there a combined image as well ir a setting to do that
Many thanks
Stu
If you change the calibrationexposure tolerance under the lights tab and input in ur case, 600, it will combine the 600 and 300 into one master.
@@VisibledarkAstro Great thanks I probably missed this in your vid
Thanks for this great tutorial, Shawn! WBPP is key for processing and I like the new drizzle function.
CS,
Stephen
Excellent video. I used to do all this manually, but tried WPBB for the first time. Your video really helped sort out the process.
Thanks Shawn. I like the drizzle addition to WBPP. Nice overview and I always learn something when I watch your videos 👍
HI Shawn, great video. Thanks. Is there a way to use calibration exposure tolerance if you have data containing, say, three different exposure lengths? I can see how it is possible with two but not three.