Which model to chose based on learning curveEstimating expected revenue generationWill cross validation performance be an accurate indication for predicting the true performance on an independent data set?Model selection and assessment using leave-one-out cross validationOverfitting XGBoostValidation curve unlike SKLearn sampleValidation of a model generated by automated deep learning systemvery large difference between cross_val and (multiple) r2 model evaluationOptimizing decision threshold on model with oversampled/imbalanced dataBias-variance tradeoff in practice (CNN)How to recognise when to stop training based on Overfitting/Underfitting?
Was Hulk present at this event?
How can I fairly adjudicate the effects of height differences on ranged attacks?
How could a planet have most of its water in the atmosphere?
Map one pandas column using two dictionaries
Why is Arya visibly scared in the library in S8E3?
Is lying to get "gardening leave" fraud?
I’ve officially counted to infinity!
How to efficiently calculate prefix sum of frequencies of characters in a string?
Who died in the Game of Thrones episode, "The Long Night"?
Entropy as a function of temperature: is temperature well defined?
Floor tile layout process?
How to creep the reader out with what seems like a normal person?
Why debootstrap can only run as root?
Was the ancestor of SCSI, the SASI protocol, nothing more than a draft?
Copy line and insert it in a new position with sed or awk
How can I close a gap between my fence and my neighbor's that's on his side of the property line?
Feels like I am getting dragged into office politics
How did Arya get back her dagger from Sansa?
Problems with numbers (result of calculations) alignment using siunitx package inside tabular environment
When do aircrafts become solarcrafts?
Topological Spaces homeomorphic
Any examples of headwear for races with animal ears?
Accidentally deleted the "/usr/share" folder
An 'if constexpr branch' does not get discarded inside lambda that is inside a template function
Which model to chose based on learning curve
Estimating expected revenue generationWill cross validation performance be an accurate indication for predicting the true performance on an independent data set?Model selection and assessment using leave-one-out cross validationOverfitting XGBoostValidation curve unlike SKLearn sampleValidation of a model generated by automated deep learning systemvery large difference between cross_val and (multiple) r2 model evaluationOptimizing decision threshold on model with oversampled/imbalanced dataBias-variance tradeoff in practice (CNN)How to recognise when to stop training based on Overfitting/Underfitting?
$begingroup$
I trained my model using different regression techniques, and I'm not sure which model to choose based on the learning curve.
1) Should I choose Lasso, since train and CV converge at the end
2) Should I choose Gradient Boosting since train and CV converge in the middle, and achieves a lower RMSE score than Lasso

cross-validation overfitting
New contributor
user13432 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
add a comment |
$begingroup$
I trained my model using different regression techniques, and I'm not sure which model to choose based on the learning curve.
1) Should I choose Lasso, since train and CV converge at the end
2) Should I choose Gradient Boosting since train and CV converge in the middle, and achieves a lower RMSE score than Lasso

cross-validation overfitting
New contributor
user13432 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
add a comment |
$begingroup$
I trained my model using different regression techniques, and I'm not sure which model to choose based on the learning curve.
1) Should I choose Lasso, since train and CV converge at the end
2) Should I choose Gradient Boosting since train and CV converge in the middle, and achieves a lower RMSE score than Lasso

cross-validation overfitting
New contributor
user13432 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
I trained my model using different regression techniques, and I'm not sure which model to choose based on the learning curve.
1) Should I choose Lasso, since train and CV converge at the end
2) Should I choose Gradient Boosting since train and CV converge in the middle, and achieves a lower RMSE score than Lasso

cross-validation overfitting
cross-validation overfitting
New contributor
user13432 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
user13432 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
user13432 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked Apr 26 at 8:46
user13432user13432
132
132
New contributor
user13432 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
user13432 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
user13432 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
You should go for LightGBM which has the lowest training and cross validation RMSE. By the way, score is a bad name for RMSE because you would expect a higher score to mean that your model is better but here the opposite is true.
$endgroup$
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
user13432 is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f50967%2fwhich-model-to-chose-based-on-learning-curve%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
You should go for LightGBM which has the lowest training and cross validation RMSE. By the way, score is a bad name for RMSE because you would expect a higher score to mean that your model is better but here the opposite is true.
$endgroup$
add a comment |
$begingroup$
You should go for LightGBM which has the lowest training and cross validation RMSE. By the way, score is a bad name for RMSE because you would expect a higher score to mean that your model is better but here the opposite is true.
$endgroup$
add a comment |
$begingroup$
You should go for LightGBM which has the lowest training and cross validation RMSE. By the way, score is a bad name for RMSE because you would expect a higher score to mean that your model is better but here the opposite is true.
$endgroup$
You should go for LightGBM which has the lowest training and cross validation RMSE. By the way, score is a bad name for RMSE because you would expect a higher score to mean that your model is better but here the opposite is true.
answered Apr 26 at 10:27
Robin NicoleRobin Nicole
33611
33611
add a comment |
add a comment |
user13432 is a new contributor. Be nice, and check out our Code of Conduct.
user13432 is a new contributor. Be nice, and check out our Code of Conduct.
user13432 is a new contributor. Be nice, and check out our Code of Conduct.
user13432 is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f50967%2fwhich-model-to-chose-based-on-learning-curve%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown