Forum der Vereinigung der Sternfreunde

Forum of the German Amateur Astronomy Association
Aktuelle Zeit: 07. Februar 2026, 15:43:50 PM

Alle Zeiten sind UTC+02:00




Ein neues Thema erstellen  Auf das Thema antworten  [ 7 Beiträge ] 
Autor Nachricht
 Betreff des Beitrags: Spectroscopy and flat fielding
BeitragVerfasst: 17. November 2010, 14:04:39 PM 
Offline
Meister

Registriert: 31. Juli 2006, 16:43:32 PM
Beiträge: 3468
Hi together!

In our website we have a new paper „Astronomical Spectroscopy“ by Massey and Hanson (see Literature -> Spectroscopy). I strongly recommend reading the paper and especially the description of standard reduction procedures. The text discusses also flat fielding and its necessities (pages 35/36 and 53-58). As most of you know, proper flat fielding has been subject of a number of discussions here and in the French spectro-l. This includes flat normalization and the so-called response function which is mentioned in the text. The S/N considerations and the discussion about the necessary flat quality is something which all ambitious amateurs should know.

Cheers, Thomas


Nach oben
   
 Betreff des Beitrags: Flat fielding
BeitragVerfasst: 17. November 2010, 16:39:50 PM 
Offline
Meister

Registriert: 01. August 2006, 16:20:19 PM
Beiträge: 839
Wohnort: Neumarkt i.d. Oberpfalz
Am Mittwoch, den 17.11.2010, 13:04 +0100 schrieb Thomas Eversberg:
Zitat:
Hi together!

In our website we have a new paper „Astronomical Spectroscopy“ by
Massey and Hanson (see Literature -> Spectroscopy). I strongly
recommend reading the paper and especially the description of standard
reduction procedures. The text discusses also flat fielding and its
necessities (pages 35/36 and 53-58). As most of you know, proper flat
fielding has been subject of a number of discussions here and in the
French spectro-l. This includes flat normalization and the so-called
response function which is mentioned in the text. The S/N
considerations and the discussion about the necessary flat quality is
something which all ambitious amateurs should know.

Cheers, Thomas

Ja, den Artikel sollte man zur Pflichtlekture machen. SEHR schön.
günter

_________________
Im längsten Frieden spricht der Mensch nicht so viel Unsinn und Unwahrheit als im kürzesten Kriege. (Jean Paul)


Nach oben
   
 Betreff des Beitrags:
BeitragVerfasst: 17. November 2010, 18:28:09 PM 
Offline
Meister
Benutzeravatar

Registriert: 01. August 2006, 16:08:56 PM
Beiträge: 3866
Wohnort: 68163 Mannheim
Hi

habe gerade gestern Abend etwas darin gelesen....brav von vorne und gleich in Gl (1) und den nachfolgenden wird eine zentrale Größe, die Gitterkonstante sigma, nirgends als solche definiert. Wird aber fleißig verwendet und man weiß nicht, was sie sein soll (wenn man keine Vorkenntnisse hat). Erst nach mehr als einer Seite (auf Seite 5 in der Mitte) wird einem klar, was sigma evtl. sein könnte. Sowas ärgert mich !

Muß den Ärger ablassen. Sonst ist der Artikel aber wirklich lesens- und studierenswert.

Viele Grüße
Lo (in Meckerstimmung) :D

_________________
Herzliche Grüße / best regards

Lothar

https://lotharschanne.wordpress.com/


Nach oben
   
 Betreff des Beitrags:
BeitragVerfasst: 17. November 2010, 20:59:16 PM 
Offline
Meister

Registriert: 31. Juli 2006, 16:43:32 PM
Beiträge: 3468
Hi all! I will stay with english because I believe this issue to be of larger importance. I agree with you Lothar, the text is often difficult to understand if you have no basic knowledge about the subject. However, that doesn't reduce its quality. I also did not understand parts of the stuff of major importance to me - the flat fielding. For that reason I contacted Phil Massey and here is the discussion. As an important result, the response function as often used in some groups is out of business.

_____________________________________________
On Nov 17, 2010, at 4:29 AM, <Thomas.Eversberg> wrote:

Hi Phil,

as a former student of Tony Moffat I am still active in spectroscopy, although as an amateur (see http://www.stsci.de/index_e.htm andhttp://www.stsci.de/wr140/index_e.htm) and supporting the german amateur spectroscopists (http://spektroskopie.fg-vds.de/index_e.htm). I now discovered your and Margaret Hanson’s text Astronomical Spectroscopy in astro-ph. I have some questions about the flat fielding procedure and especially about the response function and its necessity.

Until now I understand the flat as being necessary for getting rid of the local bumps and wiggles in the CCD image, due to the CCD window, grating or other optics inside the instrumental chain. The flat counts should be high enough not to degenerate the original spectra, as you said in your paper.

However, I had a number of discussions about flat normalization and the instrumental response function, and I still do not understand the necessity of both.

From my point of view, wavelength dependent effects as described in page 35 (bottom) (e.g. different color temperature) would only change the slope of the flat reduced spectra. This slope can then be flattened by standard rectification to 1. The bumps are gone and fine. The only problem I can imagine is the reduced S/N at low counts in the flat so that the spectral S/N is degraded at the low count pixel regions as described on pages 55-57. I thought normalizing the flat is a kind of a try to make spectral rectification easy and did not consider it as an always necessary standard procedure. Am I right here or do I miss something?

Second, the response function, obtained from a standard star spectrum would help finding the continuum in broad emission line stars like WR. However, I do not understand the advantage to introduce an additional normalization procedure with the S/N effects described in your paper for other stars than WR. Neglecting the color temperature and the spectral slope to be rectified, a dome flat should do a good job. What do I miss here? Is this procedure only for extremely difficult cases?

I would highly appreciate if you could give me some ideas.

Cheers, Thomas


Von: Philip Massey [mailto:massey@lowell.edu]
Gesendet: Mittwoch, 17. November 2010 16:15
An: Eversberg, Thomas
Betreff: Re: AW: flat fielding
Zitat:
Hi, Thomas---

I'm not exactly sure I understand your two concerns/questions, so let me just try to restate it in different words. Flat-fielding spectra accomplishes three things: (a) it takes out the pixel-to-pixel sensitivity response of the chip, (b) it makes the spatial profile flat, or at least uniform (non-lumpy) in order to make it easier to perform decent sky subtraction, and (c) it also can be used to take out the low-order sensitivity variations with wavelength to make it easier to either normalize the final stellar spectrum or easier to calibrate to flux using standard stars.

I understand and agree with all issues. I am only confused by the “spatial profile”. The direction perpendicular to the dispersion is somewhat negligible from my point of view. A gradient over some pixel perpendicular to the dispersion should not be problem. But the 2D consideration includes the 1D, of course. So, basically, I agree.
Zitat:
This step is actually pretty critical if you are in the regime where good sky subtraction matters. Most spectrographs have vignetting so that the peak counts will be in the middle. So, you want to make sure that when you go to subtract sky by interpolating from either side of your object that you're not making a mistake. In other words, the spatial direction should be flat after flat fielding.
Ah, now I understand that the sky is the target of this procedure and I fully agree. In fact, during the recent years I did only work on bright stars of at least 8 mag and sky subtraction was not critical.

_____________________________________________
Zitat:
We need to normalize the flat field in the wavelength and spatial direction so as to not mess with the Poisson statistics in order to apply optimal extraction or to co-add the spectra properly---in other words, we want to preserve the original counts (more or less).

I try to understand this but I am not sure if I do. S/N should be larger at higher flat values than at lower ones for a non-normalized flat. And sigma should be the same, even if you do not normalize. So, you want to take the RELATIVE counts properly into account having an almost constant S/N in the flat?
Zitat:
No. The S/N in the flat is not changed by normalizing. What you want to do is preserve the absolute counts in the stellar spectrum.

Oh yes, of course. I was mixed up here. That means I do not want to affect the stellar counts by a non perfect flat, right?

_____________________________________________


Zitat:
If the spectrum of the flat field has the same bumps and wiggles as the spectrum of the star, then simply normalizing the flat field by a constant satisfies this.

What exactly do you mean with a constant? Just a number? Why not dividing the spectral data by the original flat. The spectral gradient will normally change but the bumps are also gone. [/color]
Zitat:
Yes, by a constant I mean just a number. Why you need to do that is as per above: you want the counts in your stellar spectrum to be reserved. In other words, if you have 5000 ADUs in a pixel in your stellar spectrum, and the gain is 1.5, then you know what the variance is going to be sqrt(5000*1.5)/1.5 in ADUs. You need to know this if you are to do anything like optimal extraction.

However, it could be that the flat field exposure has bumps in it that aren't
intrinsic to the spectrograph and detector. In that case dividing by the flat field exposure normalized by a constant will ADD bumps, not remove them.

Ok, I definitely need to distinguish between intrinsic features in the optical chain and spectroscopic feature introduced by external sources. Right?

_____________________________________________

Zitat:
However, often dome flat exposures have bumps and wiggles that the stellar exposure doesn't have because the reflectivity of the paint used on the spot is not uniform in wavelength: i.e., how much the spot reflects at 4000A is not going to be the same that it reflects at 8000A---the spot
is not truly "white". Worse, there may be appreciable bumps and wiggles (when plotted against wavelength) due to the paint having dips or peaks in its reflectivity. In that case one wants to fit a higher order function to the flat-field and remove those bumps and wiggles.

I understand and agree. This is something I never realized in detail. But why should I then apply a high order fit to get rid of the bumps in the lat? I could do the same after flat division in the stellar spectrum. Is it because flat fit is easier to perform? In addition, if I apply a high order fit to get rid of those spectral dips how can I then get rid of the bumps introduced by optical features (e.g., dust on the CCD window or on the grating, vignetting). Can I do both? If yes, how?
Zitat:
No. You don't know a priori how flat and smooth your stellar spectrum should be. It's not just Wolf-Rayet stars that have features.

OK, that is what I expected.

_____________________________________________
Zitat:
If standard stars had wavelength calibration at every 1 A rather than at every 50A (typically) then indeed you could take out bumps and wiggles by using the response curve. However, just like spectral normalization, you usually want to use a low order curve (5th or 6th cubic spline, say) to fit the response function. You can't go to 30th or 50th or something, which is what you would need to take out the bumps and wiggles you might introduce by the flat field.

Yes, I agree. But what is the response function for, in detail? I can imagine that the color temperature difference between target star and incandescent lamp and screen is a problem. But that should only introduce a final gradient after division of the spectrum by the flat. And that gradient will be rectified by a low order spline anyway. Neglecting different color temperatures I still do not understand the necessity of a response function from a standard star (which has not necessarily the same color temperature as the target).
Zitat:
Many of us flux our data; i.e., we are not interested in just normalizing the spectrum at the end of the process, but actually need ergs/sec/A. You need the standard star spectrum for that. I agree if you are just normalizing your spectrum at the end then using a response function will just make things a little easier for you.
Ok, that is what I expected. This is a hot discussion issue in the amateur domain. Many permanently use a response function and apply it to the data. And then they rectify the spectra. I believe that are unnecessary remainings from absolute measurements of the stellar flux.

_____________________________________________
Zitat:
Using low order to normalize stellar spectra is important not just with Wolf-Rayet stars with broad features, but particularly with early-type stars where the features can be very weak, if you want to then do anything quantitative with the data.

Yes, I understand
Zitat:
I hope this has helped.

cheers,
phil


Thanks a lot, Phil, I really learned something. As the webmaster of our spectroscopy section (http://spektroskopie.fg-vds.de/index_e.htm) I placed your paper to the literature and marked it as a recommended one (also in the news ticker). This paper is very helpful. Very good work, indeed.

Cheers, Thomas

Zitat:
Hi, Thomas---

It sounds like we are now both on the same wavelength. I'm glad my responses were useful, and I'm glad you liked our paper! Good luck in your work!!

cheers,
phil
Yes, that’s right. I will also announce our email in our respective discussion forum. This paper is of high use for everybody!

Cheers from Bonn and thanks again, Thomas


Nach oben
   
 Betreff des Beitrags:
BeitragVerfasst: 18. November 2010, 13:54:38 PM 
Offline
Meister
Benutzeravatar

Registriert: 25. Oktober 2006, 23:43:13 PM
Beiträge: 741
Wohnort: Cumbria England
Hi Thomas,

It is time for a confession. :oops: :lol:

I take flats but rarely use them because for some reason they do not accurately represent what happens to the star light passing through the system. I am not alone in this problem. Lothar also sees this and I suspect many amateurs are in the same position but are too embarrassed to admit they cannot take a good flat. (The main problem for me is the magnitude of fringes which is not the same for the star and the flat) If there is anyone who has found a way of taking reliable spectroscopic flats using the LHIRES I would be pleased to hear how they do it.

Instead I use a standard hot star, divided by the library spectrum of that star as a "flat". It is not ideal as you have to make sure that the same rows of pixels are covered and the S/N is not as good as a proper flat (It also wastes some observing time) but for me it gives much better quality spectra at the end compared with using any flat that I have been able to produce.

Cheers
Robin


Nach oben
   
 Betreff des Beitrags:
BeitragVerfasst: 18. November 2010, 14:23:19 PM 
Offline
Meister

Registriert: 31. Juli 2006, 16:43:32 PM
Beiträge: 3468
Hi Robin!

First: On their page 31 Massey & Hanson (M&H) say the following:
Zitat:
The basic premise throughout this section is that one should neither observe nor reduce data by rote. Simply subtracting biases because all of one’s colleagues subtract biases is an inadequate reason for doing so. One needs to examine the particular data to see if doing so helps or harms. Similarly, unless one is prepared to do a little math, one might do more harm than good by flat-fielding. Software reduction packages, such as IRAF or ESO-MIDAS are extremely useful tools—in the right hands. But, one should never let the software provide a guide to reducing data. Rather, the astronomer should do the guiding. One should strive to understand the steps involved at the level that one could (in principle) reproduce the results with a hand calculator!
I believe it to be a nice reflection about the difficulties everybody might experience in data reduction. And even more important, that the guideline should be the individual data and instrumentation and not fixed procedures.

Second: As I said, the response function is not necessary when a proper flat is available. If no proper flat is available, you can also use a standard star and call it response function although it is a flat, obtained from a stellar source.

In generall we all should encourage people frankly talking about dificulties to circumnavigate them. M&H clearly describe flat fielding as a delicate affair. It's a matter of a difficult procedure not of an incabable observer.

For your case you should read the chapter 3.2.6. about "Long-Slit Flat-Fielding Issues" and check both parts about "Featureless Flats" and "Illumination Correction Flats" in detail. M&H say that the former is used to remove pixel-to-pixel gain and dust grains in the optical path. The latter can potentially be used to get rid of external and wavelength dependend flat features from the white flat screen or external filters/lamps. A potential solution could be a twighlight flat.

Cheers, Thomas


Nach oben
   
 Betreff des Beitrags:
BeitragVerfasst: 19. November 2010, 15:18:27 PM 
Offline
Meister

Registriert: 31. Juli 2006, 16:43:32 PM
Beiträge: 3468
Hi Robin! On page 64 I read the following:

Long experience at the 2.1-m had taught the observers that the dome flat exposures do a far better job at matching the illumination of the night sky in the spatial direction than do the internal quartz exposures. But, even superficial inspection of the bad pixel mask data revealed that there were significant, 10-20% fringes in the red (>7000°A) region. How to remove these? ...


Cheers, Thomas


Nach oben
   
Beiträge der letzten Zeit anzeigen:  Sortiere nach  
Ein neues Thema erstellen  Auf das Thema antworten  [ 7 Beiträge ] 

Alle Zeiten sind UTC+02:00


Wer ist online?

Mitglieder in diesem Forum: 0 Mitglieder und 1 Gast


Du darfst keine neuen Themen in diesem Forum erstellen.
Du darfst keine Antworten zu Themen in diesem Forum erstellen.
Du darfst deine Beiträge in diesem Forum nicht ändern.
Du darfst deine Beiträge in diesem Forum nicht löschen.
Du darfst keine Dateianhänge in diesem Forum erstellen.

Suche nach:
Gehe zu:  
Powered by phpBB® Forum Software © phpBB Limited
Deutsche Übersetzung durch phpBB.de