Utilizing Master Calibration Files with this Modified OSC

Utilizing Master Calibration Files with this Modified OSC_Preprocessing Script

Рет қаралды 3,482

Жыл бұрын

If you're using a cooled camera, you don't need to shoot darks and biases after every session. You can start creating a library of master darks and bias instead. The problem is if you use Siril's OSC_Preprocessing script, you can't use those masters, but with this modified version of that script you now can.
Download the Script:
**This script has been moved to Siril's GitHub repository, so the download instructions in the video no longer apply. Simply click the link below and the script will download.**
🗐 gitlab.com/free-astro/siril-s...
👽 Subscribe to my Channel ➔ / @deepspaceastro
Make a channel donation or join one of the membership programs.
👽 KZfaq: / @deepspaceastro
☕ Buy me a Coffee: www.buymeacoffee.com/deepspac...
👕 Deep Space Astro Merch: deepspaceastro.myspreadshop.com/
I make a small commission at no cost to you when you make a purchase through my affiliate links below. It's a great way to help support the channel!
🔭 Astro Gear Affiliate Link: www.astrogear.net/?ref=deepsp...
🔭 High Point Scientific Affiliate Link: www.highpointscientific.com/?...
🔭 Agena Astro Affiliate Link: agenaastro.com/?rfsn=7382644....
🛒 Amazon Affiliate Link: amzn.to/3YWWnwH
📚 Siril Tutorials
🗐 • Siril Tutorials
🏘️ Social Media:
🚪 Facebook ➔ / @deepspaceastro
🚪 Tiktok ➔ / deepspaceastro
#DeepSpaceAstro #astrophotography #siril

Пікірлер: 46

@DeepSpaceAstro Жыл бұрын

Please consider supporting this channel on Buy Me a Coffee!: www.buymeacoffee.com/deepspaceastro

@timbatt4477 4 ай бұрын

I've been using the ASIair Plus for a while now and really love how it streamlines the whole process. I have tried your script and found it very useful with one exception, I'm a live stack user of the ASIair and it creates pre-stacked flats which your script doesn't support. I found a work around by copying the master stacked flats from the ASIair to your flats folder and simply renaming it to flat1. Then copy that file and rename it flat2 and then do another one to flat3. This made your script work. Thanks for your work with Siril. Your videos have helped me a great deal!

@DeepSpaceAstro 4 ай бұрын

Interesting. I suppose if it works then that's an easy workaround. Thanks!

@peterhorrocks12 Жыл бұрын

Awesome, thanks Rich. Looking forward to giving this a run.

@DeepSpaceAstro Жыл бұрын

Thanks man!

@robertferreira3286 Жыл бұрын

I just found your channel two days ago and wow, what awesome tutorials. I almost gave up on Siril and only used it for color calibration and background extraction, but now with the help of your videos I’m now able to do so much post processing with Siril. I can use startet with Siril on my older capture laptop but cannot get it to work on my newer larger screen laptop. Did the same steps you’ve shown, on both laptops and only getting it to work on the older win10.

@DeepSpaceAstro Жыл бұрын

Thank you and glad the channel has been helpful! Any error with Starnet? What OS are you on?

@robertferreira3286 Жыл бұрын

No problem with starnet on my older capture laptop with windows 10, won’t work on my post processing windows 11 laptop. I had issues using my new laptop with ascom, eqmod and connecting with Nina. I finally got it work but no clue what I did this time to get it to work. After watching your video I downloaded astrosharp and it is awesome.

@MrThor49 Жыл бұрын

Thanks again Rich.

@DeepSpaceAstro Жыл бұрын

You're welcome. 👊

@pathdoctor1 11 ай бұрын

Hands down the best Siril tutorials in KZfaq. Thank you! Rich, was there a technical reason why master flat files (as important as they are) were not included in the script? By the way, what it is a “pp_flat” (2:44)? I assume that it is just a master flat, isn’t?

@DeepSpaceAstro 11 ай бұрын

Thanks! Yes the pp_flat is the master flat. I didn't include using an existing master flat because you usually always shoot flats for each session. I think I put a script together for someone that does that though. It may be in these comments. I'm on vacation right so I'll look next week if you don't find it. Shoot me an email next week to remind me.

@pathdoctor1 11 ай бұрын

I found it. Thanks Rich. I was expecting it to have the integration of all the calibration (master) frame types (darks, flats and bias/ dark flats). Is it possible to write a script with all that?

@DeepSpaceAstro 11 ай бұрын

Dark flats, biases are interchangable. You have one or the other, not both. They are used to calibrate the flats. So a script to use all masters doesn't make sense.

@pathdoctor1 11 ай бұрын

@@DeepSpaceAstro That’s correct. That’s why I wrote bias/dark flats meaning either one.

@DeepSpaceAstro 11 ай бұрын

@@pathdoctor1 Sorry what I mean is a script to use all masters isn't needed. If you have all of your masters and you want to reuse them, then you'd just need the dark and flat to stack with your lights.

@lupixus Жыл бұрын

Guess what: same thing like the passed week - sow the title and jumped on the like button without watching the video. Man, you have some magic around your videos. I just felt from the bed but count on me buying you a coffee.

@DeepSpaceAstro Жыл бұрын

Thanks so much!

@MikeyJ 7 ай бұрын

Hey Rich, a couple of questions for you: why do the Siril scripts always 'convert to fit' even when they are already fit files? Also the process directory uses about 92GB on my last imaging run...compared to 7.2GB of lights... any way to reduce that? One other thing.. I often reuse the flats between sessions if i haven't moved anything on the rig.. shame you cant access the check boxes to use the masters in the script like you can under the calibration tab... although i have never done a manual stacking operation so never used this! Lastly, like many others here, just want to say your videos are superb and have helped my adopt SIRIL as my main Astro imaging software, I'm buying you a coffee right now ;-) cheers Mike

@DeepSpaceAstro 7 ай бұрын

If they're fits, they're not being converted, just renamed as they're placed in the process directory. If you're on Windows make sure you enable developer mode so links are created instead of additional files. That saves on disk space. You could modify the script to include the use of a flat master file. Thanks so much for the kind words, and thanks for the coffee!

@boaty1968 Жыл бұрын

Thats excellent , is it possible to adapt the script that could run images from multiple nights where maybe you have different flats and camera orientation and cant put all your lights and flats in one folder ?.

@DeepSpaceAstro Жыл бұрын

Thanks! Sirilic will allow you to stack multiple nights. I haven't tried it with the master files though. kzfaq.info/get/bejne/frB4rZSVqt-aYpc.html

@boaty1968 Жыл бұрын

Yes I’ve tried sirilic I like it a lot, though you can’t specify master Dark flats and if you rename those files to bias and use as bias files it looks like it doesn’t subtract from the flats according to process map but at least master dark saves a bit of work

@cymrych79 2 ай бұрын

Is this script still available? The link in the description returns a 404 error.... Loving your content, Rich. Just discovered you recently, newly subscribed.

@DeepSpaceAstro 2 ай бұрын

Sorry looks like the devs moved it. I fixed the link now. Thanks for pointing it out! Thanks!

@DLMVegas 11 ай бұрын

Hi Rich, A little off topic regarding this subject, but do you know if anyone has processed a Milky Way Pano in SIRIL? I took a 6 shot pano in SIRIL that was merged and also individual files. The shots were with a 16mm lens. Doing the Full Resynthesis wouldn't work. Only found the brightest 17 stars in the images.

@DeepSpaceAstro 11 ай бұрын

I don't, but the the resynthesis is for fixing stretched stars so probably not what you want. What is it you're trying to do in Siril? If it's the preprocessing then ultimately stacking, look at the Dynamic PSF tool & try adjusting the threshold of the star detection.

@DLMVegas 11 ай бұрын

@@DeepSpaceAstro HI Rich, I was trying to fix the wonky stars in SIRIL on my 6 shot Milky Way Pano using the Full Resynthesis. At 16mm the stars are somewhat ugly looking at the edges. At 16mm the stars are also pretty small.

@KJRitch 6 ай бұрын

I have a question about master files in general created by a cooled camera. Isn't the cooling of these cameras reducing the temperature down from the current ambient temperature temperature of the sensor and not down to a specific temperature like -10C (14F)? So if you create these master files inside one evening at home, say a master dark file of -10c at 60sec exposure and gain 120 and the inside temperature is 70F (21C). The sensor will be brought down -10C to 11C (52F). Then you go out in the evening and take lights for two hours but the starting outside temperature is 40F and two hours later the temperature is 30F. If the camera is set to -10C the sensor will not be cooled down to the same temperature as when the dark master was created, so how can you create dark masters ahead of time and indoors and they calibrate fine? What am I not understanding?

@DeepSpaceAstro 6 ай бұрын

When you set the temperature to -10, it's cooling the sensor to -10 not dropping it -10 from the current ambient.

@KJRitch 6 ай бұрын

@@DeepSpaceAstro When I check the ZWO site on a couple of cooled cameras, in this example the ASI0294MC Pro, but other camera model descriptions state cooling is from ambient temperature not absolute: "Thanks to the two-stage TEC cooling, ASI294MC Pro can lower the CMOS sensor temperature to 35-40 degrees Celsius below which can greatly reduce dark current generation and sensor noise even during extended exposure times. *The Delta T 35-40℃ is tested at 30℃ ambient temperature. It might get down when the cooling system is working for a long time. Also, as the ambient temperature falls, the Delta T would also decrease. " Maybe the temperature range isn't that critical for darks?

@KopLamp Жыл бұрын

I don't understand the intro in which you talk about ASIAIR users. I am an avid ASIAIR user and I shoot my calibration files just as anyone else. Are you perhaps referring to people doing live-stacking? I only use "Autorun" mode for shooting darks, flats and biases. My lights I shoot primarily in the "Plan" mode. On my channel you can see many examples of this.

@DeepSpaceAstro Жыл бұрын

So I've been told the air can do master stacks but I haven't played with one myself. Maybe they do come from the live stacking function?

@KopLamp Жыл бұрын

@@DeepSpaceAstro I personally wouldn't bother with having the ASIAIR create master calibration files. Tools like Siril do it reliably and easily as well. And as your video highlights, you only have to do it once in a while when using a cooled camera. All subsequent times you can directly hop on to the calibration tab in Siril.

@chrislee8886 11 ай бұрын

Good to see you here Martin. Of course many of us in AsiAir do imaging using preloaded masters for flats, darks, bias when we image multiple objects a night (say 30-60 mins total exposures each). We use Live Stack for visualisation while doing this. Then faced with multiple images for reprocessing the next day to get the best out of these captures. So always looking for short cuts!

@chrislee8886 Жыл бұрын

Thanks Rick BUT… sorry we ASIAIR users have another way of addressing masters and its very convenient. In the live stacking option we can create master flats as well as master bias (used to create the master flat i believe) and master darks. Since it’s automatic it works out exposures for the flats to get the ave ADU values. I make these during the day and hive off everything to the compute and delete the subframes and just keep the masters. I can get away with 6 months for bias and darks. For flats i can go for a couple of months if i keep the optics clean. Why do this? Easy better quality Live Stacking images! However later i fully preprocess on the PC. These masters mean i cannot use the SiriL scripts. In SiriL i MANUALLY process with JUST the master dark and the master flat boxes ticked (since i already now have these). However it would be great to have a script that allowed the OSC preprocessing to simply use these masters alone (and not the bias and the dark in your video followed by creation of a new master flat). Here’s hoping for a future tweak. I suspect i am not alone!

@DeepSpaceAstro Жыл бұрын

So from what I understand about the ASIAIR (I don't have one) is instead of using the Live option, you could pull all of your individual calibration frames into Siril and use the default OSC_Preprocessing script. Then you could grab the master stacks and store them like you do from the ASIAIR. With that being said, are you looking for a script that would allow you use the master dark, and flat stacks from the ASIAIR?

@chrislee8886 11 ай бұрын

@@DeepSpaceAstro - thanks for taking the time on this and sorry its so convoluted! So with ASiAir it creates a master flat automatically without me ever seeing the flat subs that were used, although they can be retained. That means i never have to go through any later process to create it. For me that’s a win! I believe it uses the separate bias master it has also created (certainly when i use SiriL in manual mode it never works if i tick all three processing “options” for master flat, dark and bias). Yes i can of course later use the separate flat subs used by AsiAir (they are retained) and then process these in SiriL to recreate the flat master and so use your OSC script in SiriL but it would be nice to jump into an auto routine that moves from loading and setting up the “lights” to “use master flat and dark” bit of the preprocessing activity without always having to refer back to separate files of flat subs. I probably need to figure out how to write SiriL scripts!

@DeepSpaceAstro 11 ай бұрын

Try this script. In your Siril home directory put your light frames in a folder named 'lights', and put your master dark & flat files in a folder named 'masters'. They need to be renamed to dark_stacked & flat_stacked. Then run the script. Let me know how it goes. 1drv.ms/u/s!Aii2lourR1D0gaA65FTufqro0tlmpQ?e=sQB9ij

@chrislee8886 11 ай бұрын

@@DeepSpaceAstro well THAT worked! 👍

@DeepSpaceAstro 11 ай бұрын

@@chrislee8886 Great! Thanks for reporting back.

@lupixus Жыл бұрын

Hmmm... Nice workflow but isn't it a little bit unnecessary to use masters? For those who use cooled cameras, wouldn't be sufficient to just make a darks and biases library(not masters) and just the standard stacking script? It just needs a few seconds longer to create master files. It wold be much appreciated if you could explain how to use a master dark file with longer exposure time than the lights and how to adapt that master file to be subtracted from a shorter exposure lights. 😊

@DeepSpaceAstro Жыл бұрын

Yeah you could do it that way as well, but managing one file vs. multiple files is preferred. Also depending where you store those files, it could take longer to copy them over to your next project. Your darks have to be the same exposure time as the lights you're using them with. There's no adjusting them as far as I'm aware.

@lupixus Жыл бұрын

@@DeepSpaceAstro it's something about optimizing darks - as far as i understand, you could use longer darks and somehow use them with your shorter lights. Siril has a check box ☑ for optimizing but i have no ideea how exactly works and it is recommended to use it like this

@DeepSpaceAstro Жыл бұрын

Ah yes I've read about that. I believe it's more directed for users of uncooled cameras, but if it's working for your use case as well, that's awesome.