Fitting using weights which are not standard deviation
hiallen72
I have a question regarding weighted fitting, and will really appreciate any help.
I have a set of data from several different cells, and each cell has different number of data points (say, voltage vs temperatures for several cells). Now I want to impose a single sigmoid fit to all these data (voltage vs temperature), but it will only be reasonable to give the same weight to each cell for this fit.
A weight wave can be assigned in the Curve Fitting dialogue. However, according to how fitting is done by calculating chi-square, the weight wave is interpreted as a form of standard deviation. What can I do if the weighting I want to use is not a measurement error?
Here is a passage from the Help document which seems to be relevant, but I don't really understand:
"In some cases, it is desirable to use weighting but you know only proportional weights, not absolute measurement errors. In this case, you can use weighting and after the fit is done, calculate reduced chi-square. The reduced chi-square can be used to adjust the reported error estimates for the fit coefficients."
Thank you very much in advance!
Allen
Here's an idea for a workaround: interpolate the original data so that all the cells have the same number of data points used for the fit.
December 6, 2016 at 08:53 am - Permalink
I should add that my suggestion of 1/N weighting is only a suggestion. I don't know if it is the appropriate way to accomplish what you want to do. There may be some other weighting that is more accepted by statisticians.
John Weeks
WaveMetrics, Inc.
support@wavemetrics.com
December 6, 2016 at 11:21 am - Permalink
Thank you for your suggestion. A concern of this workaround is that there's nonlinear relationship (between V and T) in this dataset, which would make a simple interpolation problematic.
Dear John,
It's not clear to me what "adjust the errors after the fit" means. The original passage in the Help says:
"The reduced chi-square can be used to adjust the reported error estimates for the fit coefficients"
Doesn't it mean the reduced chi-square (how this is calculated is not clear to me either) is used to adjust the "error estimates" for fit coefficients, instead of the fit coefficients themselves?
Big thanks!
Allen
December 6, 2016 at 03:39 pm - Permalink
Read all the way through, including the example. What you need is at the end:
Duplicate W_sigma, reducedSigma
reducedSigma = W_sigma*sqrt(reducedChiSquare)
John Weeks
WaveMetrics, Inc.
support@wavemetrics.com
December 7, 2016 at 01:12 pm - Permalink
DisplayHelpTopic "Proportional Weighting" returned "the topic was not found after searching all Igor help files in the Igor Pro folder and subfolders". My Igor version is 6.1.2.1 (6.12A). Is this a version thing?
Thanks!
Allen
December 7, 2016 at 02:26 pm - Permalink
Here is the part from the IP7 help:
HJ
December 9, 2016 at 08:58 am - Permalink
John Weeks
WaveMetrics, Inc.
support@wavemetrics.com
December 9, 2016 at 11:05 am - Permalink