[jira] Created: (MATH-217) OLS regression should use QR decomposition

View: New views
5 Messages — Rating Filter:   Alert me  

[jira] Created: (MATH-217) OLS regression should use QR decomposition

by JIRA jira@apache.org :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

OLS regression should use QR decomposition
------------------------------------------

                 Key: MATH-217
                 URL: https://issues.apache.org/jira/browse/MATH-217
             Project: Commons Math
          Issue Type: Improvement
            Reporter: Phil Steitz


Inverting the normal equations to estimate OLS regression parameters does not give good numerics.  The newly added QR decomposition implementation in commons math could be used to improve performance and numerics.  

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MATH-217) OLS regression should use QR decomposition

by JIRA jira@apache.org :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message


    [ https://issues.apache.org/jira/browse/MATH-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12613132#action_12613132 ]

Phil Steitz commented on MATH-217:
----------------------------------

Here is what I have in mind:
Start with the normal equations
X^T X b = X^T y
Let QR be decomp of X.  Then
(QR)^T (QR) b = (QR)^T y
R^T (Q^T Q) R b = R^T Q^T y
R^T R b = R^T Q^T y
(R^T)^{-1} R^T R b = (R^T)^{-1} R^T Q^T y
R b = Q^T y
Solve this directly by back-substitution.
 

> OLS regression should use QR decomposition
> ------------------------------------------
>
>                 Key: MATH-217
>                 URL: https://issues.apache.org/jira/browse/MATH-217
>             Project: Commons Math
>          Issue Type: Improvement
>            Reporter: Phil Steitz
>
> Inverting the normal equations to estimate OLS regression parameters does not give good numerics.  The newly added QR decomposition implementation in commons math could be used to improve performance and numerics.  

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MATH-217) OLS regression should use QR decomposition

by JIRA jira@apache.org :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message


     [ https://issues.apache.org/jira/browse/MATH-217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Phil Steitz updated MATH-217:
-----------------------------

    Affects Version/s:     (was: 1.0)
                           (was: 1.2)
                           (was: 1.1)
                       2.0

> OLS regression should use QR decomposition
> ------------------------------------------
>
>                 Key: MATH-217
>                 URL: https://issues.apache.org/jira/browse/MATH-217
>             Project: Commons Math
>          Issue Type: Improvement
>    Affects Versions: 2.0
>            Reporter: Phil Steitz
>             Fix For: 2.0
>
>
> Inverting the normal equations to estimate OLS regression parameters does not give good numerics.  The newly added QR decomposition implementation in commons math could be used to improve performance and numerics.  

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MATH-217) OLS regression should use QR decomposition

by JIRA jira@apache.org :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message


     [ https://issues.apache.org/jira/browse/MATH-217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Phil Steitz updated MATH-217:
-----------------------------

    Affects Version/s: 1.0
                       1.1
                       1.2
        Fix Version/s: 2.0

> OLS regression should use QR decomposition
> ------------------------------------------
>
>                 Key: MATH-217
>                 URL: https://issues.apache.org/jira/browse/MATH-217
>             Project: Commons Math
>          Issue Type: Improvement
>    Affects Versions: 2.0
>            Reporter: Phil Steitz
>             Fix For: 2.0
>
>
> Inverting the normal equations to estimate OLS regression parameters does not give good numerics.  The newly added QR decomposition implementation in commons math could be used to improve performance and numerics.  

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MATH-217) OLS regression should use QR decomposition

by JIRA jira@apache.org :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message


    [ https://issues.apache.org/jira/browse/MATH-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12617324#action_12617324 ]

Phil Steitz commented on MATH-217:
----------------------------------

Changes in beta computation committed in r 680162.

Leaving open, as there is still work to do on the variance estimation.

> OLS regression should use QR decomposition
> ------------------------------------------
>
>                 Key: MATH-217
>                 URL: https://issues.apache.org/jira/browse/MATH-217
>             Project: Commons Math
>          Issue Type: Improvement
>    Affects Versions: 2.0
>            Reporter: Phil Steitz
>             Fix For: 2.0
>
>
> Inverting the normal equations to estimate OLS regression parameters does not give good numerics.  The newly added QR decomposition implementation in commons math could be used to improve performance and numerics.  

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.