Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Influencers: simplify hyper-opt/cache setup #119

Open
3 tasks
lefnire opened this issue Nov 22, 2020 · 0 comments
Open
3 tasks

Influencers: simplify hyper-opt/cache setup #119

lefnire opened this issue Nov 22, 2020 · 0 comments
Labels
🤖AI All the ML issues (NLP, XGB, etc) 📊Behaviors Fields / influencers issues help wanted Extra attention is needed

Comments

@lefnire
Copy link
Collaborator

lefnire commented Nov 22, 2020

Now that top x hyper-parameters are saved to DB #77 per user, no need for the complex early-stopping logic & high n_trials. The more days pass & influencers() gets run each day, the more accurate the model becomes over time anyway. So we should just be able to depend on that, forget about beating prior scores, and keep n_trials low (either static low value like 30, or dynamic low value based on number of user's days with field_entries).

  • Lower xgb.py n_trials. Either dynamic based on n_field_entries (few entries high value like 300, high entries low value like 10 - since by the time they have high entry-count, hyper-opt will have gotten pretty solid)
  • Remove early-stopping logic. Just depend on the small n_trials
  • Use eval_metric=mape rather than mae (docs) so trials based on different good_target can be compared; and different users can be compared.
@lefnire lefnire added help wanted Extra attention is needed 📊Behaviors Fields / influencers issues 🤖AI All the ML issues (NLP, XGB, etc) labels Nov 22, 2020
@lefnire lefnire moved this to Beta in Gnothi Nov 6, 2022
@lefnire lefnire added this to Gnothi Nov 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🤖AI All the ML issues (NLP, XGB, etc) 📊Behaviors Fields / influencers issues help wanted Extra attention is needed
Projects
Status: Next
Development

No branches or pull requests

1 participant