Gradient Boosting (with trees)

class: center, middle, inverse, title-slide

# Gradient Boosting (with trees)
## Implementation
### Daniel Anderson
### Week 9, Class 2

---

# Agenda
* Quick review on boosting
* Implementation with **{tidymodels}**
* Using **{xgboost}** directly

---
# Quick group discussion

* What is boosting?

* How does boosting compare to bagging?

* What is gradient descent?

* How does gradient descent relate to boosted trees?

---
# Hyperparameters

Standard boosted tree models include four hyperparameters These are... ?

* Tree depth (number of splits)

* Minimum `$n$` for a terminal node

* `$n$` trees

* Learning rate

---
# Quick example w/learning rate

https://developers.google.com/machine-learning/crash-course/fitter/graph

---
# Stochastic parameters

Using **{xgboost}** we can introduce additional randomness, including

* Random proportion of the data for each tree

* Random proportion of the columns by:
  + tree
  + level .g[Not implemented in tidymodels but easy to add]
  + node (split) .g[Not implemented in tidymodels but easy to add]

---
# Other hyperparameters
* Loss reduction
  + stops growing a tree if change in cost function doesn't surpass a given threshold
  
* L1 & L2 penalties (probably only needed if you have evidence your model is overfitting)

---
# Early stopping
While not technically a hyperparameter,  early stopping can help during model tuning

* Early stopping works by evaluating the objective function against the validation set. If no improvements have been made after *n* iterations, stop the model fitting process.

* Remember - optimal number of trees depends on other model parameters. Using early stopping allows the number of trees to be somewhat adaptive.

* Once you've finalized your model, conduct your final fit (on your training data) and test fit with the actual number of trees you used (from the best model found through early stopping)

---
# Other options

The [documentation](https://xgboost.readthedocs.io/en/latest/parameter.html) is the best place to look into **{xgboost}** further.

There are even more hyperparameters, and even different model fitting procedures (e.g., [DART](https://xgboost.readthedocs.io/en/latest/tutorials/dart.html))

---
# Tuning an XGBoost model
* Early stopping changes the way we approach tuning our model

--
* Instead of first assessing how many trees are needed, we'll specify a large number of trees to be built, but specify an early stopping rule

--
* Tune the learning rate, then tree-specific parameters, then stochastic components

--
* Re-tune learning rate if you find values that are really different than defaults

--
* If CV error suggests substantial overfitting, crank up regluarization

---
# Implementation options

* We've used **{tidymodels}** throughout the term, and we'll keep doing that here. However, I'll also show a few examples of working with **{xgboost}** directly

---
class: inverse center middle
# Implementation w/{tidymodels}

---
# {parsnip}
* When we set a model, we just use `boost_tree()` for our model, and `set_engine("xgboost")`

* Essentially everything else is the same

```r
boosted_tree_spec <- boost_tree() %>% 
  set_engine("xgboost") %>% 
  set_mode("regression") %>% # or classification, of course
  set_args(...)
```

---
# Quick note on performance
By default, **{xgboost}** will use all the processors on your computer

You can override this with the `nthread` argument when you `set_engine()`, e.g., `set_engine("xgboost", nthread = 2)`

The `xgboost` package is *highly* performant compared to other similar algorithms, and it works great on the cluster

---
# Hyperparameters
See the full documentation for the **{parsnip}** implementation [here](https://parsnip.tidymodels.org/reference/boost_tree.html)

![](img/boost_tree-params.png)

---
# Load & split data

```r
library(tidyverse)
library(tidymodels)
set.seed(41920)
d <- read_csv(here::here("data", "train.csv")) %>% 
  select(-classification) %>% 
  sample_frac(0.05) # Just a tiny amount of the data to make it faster

splt <- initial_split(d)
train <- training(splt)
cv <- vfold_cv(train)
```

---
# Develop a basic recipe

```r
rec <- recipe(score ~ ., train) %>% 
  step_mutate(tst_dt = as.numeric(lubridate::mdy_hms(tst_dt))) %>% 
  update_role(contains("id"), -ncessch, new_role = "id vars") %>%
  step_zv(all_predictors()) %>% 
  step_novel(all_nominal()) %>% 
  step_unknown(all_nominal()) %>% 
  step_medianimpute(all_numeric(), 
                    -all_outcomes(), 
                    -has_role("id vars"))  %>% 
  step_dummy(all_nominal(), 
             -has_role("id vars"),
             one_hot = TRUE) %>% 
  step_nzv(all_predictors(), freq_cut = 995/5)
```

---
# Specify your model
* Basically everything we've done so far (minus creating the `$k$`-fold cross-validation object) we would do whether we were using the **{parsnip}** wrapper or **{xgboost}** directly.

* Let's start with **{tidymodels}**

```r
mod <- boost_tree() %>% 
  set_engine("xgboost") %>% 
  set_mode("regression") %>% 
  set_args(stop_iter = 20) # early stopping
```

---
# Optional: Create a workflow
### default model specs

```r
wf_df <- workflow() %>% 
  add_recipe(rec) %>% 
  add_model(mod)
```

---
# Estimate

### Fit to the resampled data

```r
library(tictoc)
tic()
fit_default <- fit_resamples(wf_df, cv)
toc()
```

```
## 15.275 sec elapsed
```

--
### Show performance

```r
collect_metrics(fit_default)
```

```
## # A tibble: 2 x 5
##   .metric .estimator       mean     n     std_err
##   <chr>   <chr>           <dbl> <int>       <dbl>
## 1 rmse    standard   89.27369      10 1.077161   
## 2 rsq     standard    0.4313016    10 0.007383733
```

---
# XGBoost directly
We'll just use the default parameters again (note - I'm not sure the defaults are the same if you're not using **{parsnip}**; my guess is they are not).

--
### Bake your recipe
* Similar to when we were working with the OOB samples when using bagged trees, we'll want to *bake* our training data and work with it directly.

---
# Bake

```r
processed_train <- rec %>% 
  prep() %>% 
  bake(train)
```

We then need to transform this into a *feature matrix*. Importantly, this *cannot* include the outcome. We also don't want to keep the other ID variables. So, we drop these variables and convert the rest to a matrix.

```r
features <- processed_train %>% 
  select(-score, -contains("id"), -ncessch) %>% 
  as.matrix()
```

And we define the outcome separately.

```r
outcome <- processed_train$score
```

---
# Cross validation
The **{xgboost}** package will do the cross validation for you automatically with `xgboost::xgb.cv()`.

```r
library(xgboost)
tic()
fit_default_xgb <- xgb.cv(
  data = features,
  label = outcome,
  nrounds = 5000, # number of trees
  objective = "reg:squarederror", # 
  early_stopping_rounds = 20, 
  nfold = 10,
)
```

```
## [1]	train-rmse:1752.993604+0.340800	test-rmse:1753.043103+4.249717 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1229.434350+0.238570	test-rmse:1229.466211+3.989493 
## [3]	train-rmse:863.579388+0.150035	test-rmse:863.618127+3.776024 
## [4]	train-rmse:608.282123+0.098287	test-rmse:608.252777+3.426655 
## [5]	train-rmse:430.883771+0.089486	test-rmse:430.982040+3.198254 
## [6]	train-rmse:308.418292+0.095965	test-rmse:308.724093+2.954950 
## [7]	train-rmse:224.852565+0.134303	test-rmse:225.566252+2.557513 
## [8]	train-rmse:169.018280+0.171998	test-rmse:170.351468+2.206550 
## [9]	train-rmse:132.958690+0.210931	test-rmse:135.164502+1.995069 
## [10]	train-rmse:110.729051+0.239927	test-rmse:113.947584+2.081653 
## [11]	train-rmse:97.555577+0.273146	test-rmse:101.750581+2.231247 
## [12]	train-rmse:90.100829+0.300919	test-rmse:95.146415+2.579637 
## [13]	train-rmse:85.837923+0.324237	test-rmse:91.735694+2.847196 
## [14]	train-rmse:83.368744+0.337160	test-rmse:89.930705+2.975003 
## [15]	train-rmse:81.914993+0.344558	test-rmse:89.088780+3.118010 
## [16]	train-rmse:80.843390+0.390418	test-rmse:88.685002+3.184969 
## [17]	train-rmse:80.125204+0.400739	test-rmse:88.552148+3.317863 
## [18]	train-rmse:79.524999+0.422560	test-rmse:88.432825+3.339281 
## [19]	train-rmse:79.135016+0.371373	test-rmse:88.408032+3.404025 
## [20]	train-rmse:78.692106+0.433624	test-rmse:88.396508+3.304076 
## [21]	train-rmse:78.314765+0.509197	test-rmse:88.418365+3.318703 
## [22]	train-rmse:77.854494+0.546732	test-rmse:88.418549+3.353946 
## [23]	train-rmse:77.454060+0.533620	test-rmse:88.494813+3.307453 
## [24]	train-rmse:77.069339+0.456050	test-rmse:88.531262+3.235086 
## [25]	train-rmse:76.749841+0.481458	test-rmse:88.546969+3.262272 
## [26]	train-rmse:76.397295+0.498561	test-rmse:88.616715+3.275697 
## [27]	train-rmse:76.151732+0.559950	test-rmse:88.637186+3.264733 
## [28]	train-rmse:75.859276+0.645578	test-rmse:88.669326+3.231950 
## [29]	train-rmse:75.602308+0.718969	test-rmse:88.678990+3.230258 
## [30]	train-rmse:75.260957+0.679902	test-rmse:88.700238+3.242936 
## [31]	train-rmse:74.947404+0.645424	test-rmse:88.737470+3.264964 
## [32]	train-rmse:74.585984+0.607740	test-rmse:88.824619+3.278517 
## [33]	train-rmse:74.281887+0.551749	test-rmse:88.785787+3.296341 
## [34]	train-rmse:73.910462+0.613140	test-rmse:88.827882+3.321082 
## [35]	train-rmse:73.600247+0.555908	test-rmse:88.900333+3.371946 
## [36]	train-rmse:73.300332+0.517342	test-rmse:88.890093+3.334360 
## [37]	train-rmse:72.956733+0.496319	test-rmse:88.964109+3.376516 
## [38]	train-rmse:72.662582+0.506950	test-rmse:88.987619+3.363565 
## [39]	train-rmse:72.382696+0.476802	test-rmse:88.968846+3.371151 
## [40]	train-rmse:72.091759+0.462093	test-rmse:88.985957+3.334307 
## Stopping. Best iteration:
## [20]	train-rmse:78.692106+0.433624	test-rmse:88.396508+3.304076
```

```r
toc()
```

```
## 8.786 sec elapsed
```

---
# Check out the metrics

```r
fit_default_xgb$best_iteration
```

```
## [1] 20
```

```r
fit_default_xgb$evaluation_log %>% 
  dplyr::slice(fit_default_xgb$best_iteration)
```

```
##    iter train_rmse_mean train_rmse_std test_rmse_mean test_rmse_std
## 1:   20        78.69211      0.4336242       88.39651      3.304076
```

---
# Full evaluation log

```r
fit_default_xgb$evaluation_log
```

```
##     iter train_rmse_mean train_rmse_std test_rmse_mean test_rmse_std
##  1:    1      1752.99360     0.34080019     1753.04310      4.249717
##  2:    2      1229.43435     0.23856991     1229.46621      3.989493
##  3:    3       863.57939     0.15003474      863.61813      3.776024
##  4:    4       608.28212     0.09828687      608.25278      3.426655
##  5:    5       430.88377     0.08948578      430.98204      3.198254
##  6:    6       308.41829     0.09596534      308.72409      2.954950
##  7:    7       224.85257     0.13430340      225.56625      2.557513
##  8:    8       169.01828     0.17199765      170.35147      2.206550
##  9:    9       132.95869     0.21093078      135.16450      1.995069
## 10:   10       110.72905     0.23992659      113.94758      2.081653
## 11:   11        97.55558     0.27314589      101.75058      2.231247
## 12:   12        90.10083     0.30091932       95.14642      2.579637
## 13:   13        85.83792     0.32423686       91.73569      2.847196
## 14:   14        83.36874     0.33715974       89.93070      2.975003
## 15:   15        81.91499     0.34455846       89.08878      3.118010
## 16:   16        80.84339     0.39041792       88.68500      3.184969
## 17:   17        80.12520     0.40073915       88.55215      3.317863
## 18:   18        79.52500     0.42256029       88.43282      3.339281
## 19:   19        79.13502     0.37137258       88.40803      3.404025
## 20:   20        78.69211     0.43362424       88.39651      3.304076
## 21:   21        78.31477     0.50919681       88.41837      3.318703
## 22:   22        77.85449     0.54673186       88.41855      3.353946
## 23:   23        77.45406     0.53362025       88.49481      3.307453
## 24:   24        77.06934     0.45605020       88.53126      3.235086
## 25:   25        76.74984     0.48145832       88.54697      3.262272
## 26:   26        76.39729     0.49856111       88.61672      3.275697
## 27:   27        76.15173     0.55995014       88.63719      3.264733
## 28:   28        75.85928     0.64557803       88.66933      3.231950
## 29:   29        75.60231     0.71896851       88.67899      3.230258
## 30:   30        75.26096     0.67990222       88.70024      3.242936
## 31:   31        74.94740     0.64542366       88.73747      3.264964
## 32:   32        74.58598     0.60773974       88.82462      3.278517
## 33:   33        74.28189     0.55174919       88.78579      3.296341
## 34:   34        73.91046     0.61314001       88.82788      3.321082
## 35:   35        73.60025     0.55590822       88.90033      3.371946
## 36:   36        73.30033     0.51734186       88.89009      3.334360
## 37:   37        72.95673     0.49631898       88.96411      3.376516
## 38:   38        72.66258     0.50694966       88.98762      3.363565
## 39:   39        72.38270     0.47680224       88.96885      3.371151
## 40:   40        72.09176     0.46209251       88.98596      3.334307
##     iter train_rmse_mean train_rmse_std test_rmse_mean test_rmse_std
```

---
# Transform a bit

```r
log_def <- fit_default_xgb$evaluation_log %>% 
  pivot_longer(-iter,
               names_to = c("set", "metric", "measure"),
               names_sep = "_") %>% 
  pivot_wider(names_from = "measure",
              values_from = "value")
log_def
```

```
## # A tibble: 80 x 5
##     iter set   metric      mean        std
##    <dbl> <chr> <chr>      <dbl>      <dbl>
##  1     1 train rmse   1752.994  0.3408002 
##  2     1 test  rmse   1753.043  4.249717  
##  3     2 train rmse   1229.434  0.2385699 
##  4     2 test  rmse   1229.466  3.989493  
##  5     3 train rmse    863.5794 0.1500347 
##  6     3 test  rmse    863.6181 3.776024  
##  7     4 train rmse    608.2821 0.09828687
##  8     4 test  rmse    608.2528 3.426655  
##  9     5 train rmse    430.8838 0.08948578
## 10     5 test  rmse    430.9820 3.198254  
## # … with 70 more rows
```

---
# Learning curve

```r
ggplot(log_def, aes(iter, mean)) +
  geom_line(aes(color = set)) 
```

![](w9p2-boosted-trees-2_files/figure-html/unnamed-chunk-9-1.png)

---
# Tuning
### Step 1: Learning rate

Let's start again with **{tidymodels}**

```r
tune_lr <- mod %>% 
  set_args(trees = 5000,
           learn_rate = tune(),
           stop_iter = 20)

wf_tune_lr <- wf_df %>% 
  update_model(tune_lr)

grd <- expand.grid(learn_rate = seq(0.0001, 0.3, length.out = 30))

tic()
tune_tree_lr <- tune_grid(wf_tune_lr, cv, grid = grd)
toc()
```

```
## 31689.437 sec elapsed
```

---
# Evaluate

```r
to_plot <- tune_tree_lr %>% 
  unnest(.metrics) %>% 
  group_by(.metric, learn_rate) %>% 
  summarize(mean = mean(.estimate, na.rm = TRUE)) %>% 
  filter(learn_rate != 0.0001)

highlight <- to_plot %>% 
  filter(.metric == "rmse" & mean == min(mean)) %>%
  ungroup() %>% 
  select(learn_rate) %>% 
  semi_join(to_plot, .)
```

---
# Plot

```r
ggplot(to_plot, aes(learn_rate, mean)) +
  geom_point() +
  geom_point(color = "#de4f69", data = highlight) +
  facet_wrap(~.metric, scales = "free_y")
```

![](w9p2-boosted-trees-2_files/figure-html/tune-plot1-1.png)

---
# Check out metrics

```r
tune_tree_lr %>% 
  collect_metrics() %>% 
  group_by(.metric) %>% 
  arrange(mean) %>% 
  dplyr::slice(1)
```

```
## # A tibble: 2 x 7
## # Groups:   .metric [2]
##   learn_rate .metric .estimator       mean     n     std_err .config
##        <dbl> <chr>   <chr>           <dbl> <int>       <dbl> <chr>  
## 1 0.01044138 rmse    standard   91.76752      10 1.112080    Model02
## 2 0.2896586  rsq     standard    0.2957935    10 0.008761419 Model29
```

---
Let's look only at the model with the best RMSE

```r
best_rmse <- tune_tree_lr %>% 
  select_best(metric = "rmse")

tune_tree_lr %>% 
  collect_metrics() %>% 
  semi_join(best_rmse)
```

```
## # A tibble: 2 x 7
##   learn_rate .metric .estimator       mean     n     std_err .config
##        <dbl> <chr>   <chr>           <dbl> <int>       <dbl> <chr>  
## 1 0.01044138 rmse    standard   91.76752      10 1.112080    Model02
## 2 0.01044138 rsq     standard    0.4018032    10 0.009693599 Model02
```

---
# Try again w/XGBoost

```r
tic()
tune_tree_lr_xgb <- map(grd$learn_rate, ~ {
 xgb.cv(
   data = features,
   label = outcome,
   nrounds = 5000, # number of trees
   objective = "reg:squarederror", # 
   early_stopping_rounds = 20, 
   nfold = 10,
*  params = list(eta = .x)
 ) 
})
```

```
## [1]	train-rmse:2501.323462+0.335324	test-rmse:2501.321362+3.015531 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:2501.075611+0.335016	test-rmse:2501.071924+3.015307 
## [3]	train-rmse:2500.825391+0.335107	test-rmse:2500.822681+3.015144 
## [4]	train-rmse:2500.575049+0.335067	test-rmse:2500.573047+3.015051 
## [5]	train-rmse:2500.325146+0.334959	test-rmse:2500.324194+3.014692 
## [6]	train-rmse:2500.077026+0.335233	test-rmse:2500.074683+3.014609 
## [7]	train-rmse:2499.827319+0.335167	test-rmse:2499.824829+3.014332 
## [8]	train-rmse:2499.575000+0.334990	test-rmse:2499.574951+3.014216 
## [9]	train-rmse:2499.331030+0.334964	test-rmse:2499.325976+3.014223 
## [10]	train-rmse:2499.076855+0.334749	test-rmse:2499.076050+3.014075 
## [11]	train-rmse:2498.829834+0.334837	test-rmse:2498.826880+3.013687 
## [12]	train-rmse:2498.580176+0.334884	test-rmse:2498.577783+3.013897 
## [13]	train-rmse:2498.330664+0.334740	test-rmse:2498.328174+3.013680 
## [14]	train-rmse:2498.081836+0.334614	test-rmse:2498.078491+3.013514 
## [15]	train-rmse:2497.831152+0.334991	test-rmse:2497.829761+3.013009 
## [16]	train-rmse:2497.582983+0.334425	test-rmse:2497.580396+3.012823 
## [17]	train-rmse:2497.336059+0.334868	test-rmse:2497.331348+3.012827 
## [18]	train-rmse:2497.083472+0.334660	test-rmse:2497.082617+3.012723 
## [19]	train-rmse:2496.834912+0.334560	test-rmse:2496.832886+3.012549 
## [20]	train-rmse:2496.587183+0.334855	test-rmse:2496.584302+3.012476 
## [21]	train-rmse:2496.338306+0.334386	test-rmse:2496.334912+3.012010 
## [22]	train-rmse:2496.085986+0.334753	test-rmse:2496.085401+3.011800 
## [23]	train-rmse:2495.837964+0.334700	test-rmse:2495.836719+3.012155 
## [24]	train-rmse:2495.591089+0.334646	test-rmse:2495.587622+3.011417 
## [25]	train-rmse:2495.339111+0.334375	test-rmse:2495.338965+3.011179 
## [26]	train-rmse:2495.093237+0.334384	test-rmse:2495.090478+3.011435 
## [27]	train-rmse:2494.842432+0.334342	test-rmse:2494.841138+3.011109 
## [28]	train-rmse:2494.596704+0.334714	test-rmse:2494.591894+3.011061 
## [29]	train-rmse:2494.345337+0.334538	test-rmse:2494.342993+3.010870 
## [30]	train-rmse:2494.095459+0.334222	test-rmse:2494.093945+3.010650 
## [31]	train-rmse:2493.847852+0.334222	test-rmse:2493.844873+3.010624 
## [32]	train-rmse:2493.598950+0.334341	test-rmse:2493.596460+3.010503 
## [33]	train-rmse:2493.349365+0.334216	test-rmse:2493.347583+3.010313 
## [34]	train-rmse:2493.102051+0.334060	test-rmse:2493.098682+3.010125 
## [35]	train-rmse:2492.850708+0.334137	test-rmse:2492.850171+3.009938 
## [36]	train-rmse:2492.603882+0.334353	test-rmse:2492.601343+3.009962 
## [37]	train-rmse:2492.355420+0.333689	test-rmse:2492.352637+3.009424 
## [38]	train-rmse:2492.107862+0.333974	test-rmse:2492.103735+3.009296 
## [39]	train-rmse:2491.855908+0.333840	test-rmse:2491.855249+3.009243 
## [40]	train-rmse:2491.608106+0.333796	test-rmse:2491.606836+3.008645 
## [41]	train-rmse:2491.358130+0.333721	test-rmse:2491.358252+3.008848 
## [42]	train-rmse:2491.113062+0.333996	test-rmse:2491.109082+3.008510 
## [43]	train-rmse:2490.861767+0.333289	test-rmse:2490.860913+3.008407 
## [44]	train-rmse:2490.617138+0.333882	test-rmse:2490.612378+3.008290 
## [45]	train-rmse:2490.363232+0.333808	test-rmse:2490.363843+3.008075 
## [46]	train-rmse:2490.117114+0.333919	test-rmse:2490.115601+3.007888 
## [47]	train-rmse:2489.871313+0.333854	test-rmse:2489.866675+3.007784 
## [48]	train-rmse:2489.619580+0.333482	test-rmse:2489.618872+3.007767 
## [49]	train-rmse:2489.371338+0.334138	test-rmse:2489.370117+3.007773 
## [50]	train-rmse:2489.124878+0.333151	test-rmse:2489.121997+3.007031 
## [51]	train-rmse:2488.875586+0.333878	test-rmse:2488.873877+3.007189 
## [52]	train-rmse:2488.626050+0.333302	test-rmse:2488.624805+3.007018 
## [53]	train-rmse:2488.377710+0.333292	test-rmse:2488.376611+3.006921 
## [54]	train-rmse:2488.129883+0.333481	test-rmse:2488.128687+3.006677 
## [55]	train-rmse:2487.882861+0.333331	test-rmse:2487.879859+3.006525 
## [56]	train-rmse:2487.632984+0.333624	test-rmse:2487.631836+3.006540 
## [57]	train-rmse:2487.386475+0.333322	test-rmse:2487.383691+3.006103 
## [58]	train-rmse:2487.135547+0.333547	test-rmse:2487.135547+3.005837 
## [59]	train-rmse:2486.891504+0.333452	test-rmse:2486.887402+3.005273 
## [60]	train-rmse:2486.638061+0.333191	test-rmse:2486.639184+3.005361 
## [61]	train-rmse:2486.393433+0.333229	test-rmse:2486.390918+3.005329 
## [62]	train-rmse:2486.145532+0.333412	test-rmse:2486.143042+3.005389 
## [63]	train-rmse:2485.899414+0.333648	test-rmse:2485.895020+3.005105 
## [64]	train-rmse:2485.649390+0.333530	test-rmse:2485.646753+3.005019 
## [65]	train-rmse:2485.400635+0.332898	test-rmse:2485.398633+3.004917 
## [66]	train-rmse:2485.152490+0.332770	test-rmse:2485.150733+3.004488 
## [67]	train-rmse:2484.905591+0.333016	test-rmse:2484.902954+3.004749 
## [68]	train-rmse:2484.657202+0.333071	test-rmse:2484.654809+3.004459 
## [69]	train-rmse:2484.409546+0.333074	test-rmse:2484.407178+3.004184 
## [70]	train-rmse:2484.160596+0.333339	test-rmse:2484.159131+3.003787 
## [71]	train-rmse:2483.914478+0.331978	test-rmse:2483.911206+3.003787 
## [72]	train-rmse:2483.664477+0.333099	test-rmse:2483.663721+3.003765 
## [73]	train-rmse:2483.418286+0.332145	test-rmse:2483.415503+3.003215 
## [74]	train-rmse:2483.167773+0.332761	test-rmse:2483.167871+3.003121 
## [75]	train-rmse:2482.922730+0.332179	test-rmse:2482.920190+3.002778 
## [76]	train-rmse:2482.675464+0.332116	test-rmse:2482.672095+3.003028 
## [77]	train-rmse:2482.423633+0.332671	test-rmse:2482.424854+3.002671 
## [78]	train-rmse:2482.179077+0.332533	test-rmse:2482.176953+3.002561 
## [79]	train-rmse:2481.934204+0.332338	test-rmse:2481.929077+3.002425 
## [80]	train-rmse:2481.681128+0.332338	test-rmse:2481.681934+3.002429 
## [81]	train-rmse:2481.435181+0.332467	test-rmse:2481.434375+3.002041 
## [82]	train-rmse:2481.188110+0.332519	test-rmse:2481.186572+3.001932 
## [83]	train-rmse:2480.941528+0.332494	test-rmse:2480.938843+3.001722 
## [84]	train-rmse:2480.691333+0.331976	test-rmse:2480.691040+3.001541 
## [85]	train-rmse:2480.445166+0.332386	test-rmse:2480.444190+3.001344 
## [86]	train-rmse:2480.199365+0.332318	test-rmse:2480.196533+3.001024 
## [87]	train-rmse:2479.950024+0.332210	test-rmse:2479.948706+3.001005 
## [88]	train-rmse:2479.703565+0.332618	test-rmse:2479.701587+3.000791 
## [89]	train-rmse:2479.456250+0.332214	test-rmse:2479.454053+3.001030 
## [90]	train-rmse:2479.206787+0.332264	test-rmse:2479.206641+3.000307 
## [91]	train-rmse:2478.960425+0.332005	test-rmse:2478.959546+3.000295 
## [92]	train-rmse:2478.712817+0.332233	test-rmse:2478.711939+3.000039 
## [93]	train-rmse:2478.465869+0.331827	test-rmse:2478.465039+3.000263 
## [94]	train-rmse:2478.220361+0.332128	test-rmse:2478.217334+2.999808 
## [95]	train-rmse:2477.971021+0.332343	test-rmse:2477.969922+2.999802 
## [96]	train-rmse:2477.722754+0.331897	test-rmse:2477.722388+2.999615 
## [97]	train-rmse:2477.478320+0.331894	test-rmse:2477.475488+2.999463 
## [98]	train-rmse:2477.231372+0.332048	test-rmse:2477.228760+2.999236 
## [99]	train-rmse:2476.980591+0.331718	test-rmse:2476.981299+2.999052 
## [100]	train-rmse:2476.736646+0.331914	test-rmse:2476.733594+2.999005 
## [101]	train-rmse:2476.489062+0.331898	test-rmse:2476.486889+2.998367 
## [102]	train-rmse:2476.243018+0.331976	test-rmse:2476.239624+2.998695 
## [103]	train-rmse:2475.991968+0.331792	test-rmse:2475.992871+2.998585 
## [104]	train-rmse:2475.747144+0.331756	test-rmse:2475.745508+2.998114 
## [105]	train-rmse:2475.501074+0.331752	test-rmse:2475.498340+2.998243 
## [106]	train-rmse:2475.252905+0.331510	test-rmse:2475.251465+2.997948 
## [107]	train-rmse:2475.005469+0.331338	test-rmse:2475.004712+2.997601 
## [108]	train-rmse:2474.761499+0.331884	test-rmse:2474.757324+2.997453 
## [109]	train-rmse:2474.509595+0.331841	test-rmse:2474.510425+2.997401 
## [110]	train-rmse:2474.266235+0.331385	test-rmse:2474.263550+2.997260 
## [111]	train-rmse:2474.018750+0.331545	test-rmse:2474.016919+2.996714 
## [112]	train-rmse:2473.769727+0.331667	test-rmse:2473.769824+2.996664 
## [113]	train-rmse:2473.524951+0.331317	test-rmse:2473.522852+2.996918 
## [114]	train-rmse:2473.280176+0.331381	test-rmse:2473.276514+2.996465 
## [115]	train-rmse:2473.031567+0.331198	test-rmse:2473.029687+2.996537 
## [116]	train-rmse:2472.781494+0.331424	test-rmse:2472.782959+2.995967 
## [117]	train-rmse:2472.539380+0.331007	test-rmse:2472.535913+2.995990 
## [118]	train-rmse:2472.294385+0.331119	test-rmse:2472.289502+2.995775 
## [119]	train-rmse:2472.040820+0.331172	test-rmse:2472.042700+2.995561 
## [120]	train-rmse:2471.797266+0.331586	test-rmse:2471.795972+2.995124 
## [121]	train-rmse:2471.553638+0.331648	test-rmse:2471.549438+2.995491 
## [122]	train-rmse:2471.305786+0.331249	test-rmse:2471.302808+2.995212 
## [123]	train-rmse:2471.054785+0.331176	test-rmse:2471.056567+2.994765 
## [124]	train-rmse:2470.812890+0.330868	test-rmse:2470.809595+2.994684 
## [125]	train-rmse:2470.566358+0.331146	test-rmse:2470.563037+2.994763 
## [126]	train-rmse:2470.316748+0.331202	test-rmse:2470.316528+2.994690 
## [127]	train-rmse:2470.071655+0.330944	test-rmse:2470.070044+2.994230 
## [128]	train-rmse:2469.826050+0.331131	test-rmse:2469.823657+2.994088 
## [129]	train-rmse:2469.578784+0.330730	test-rmse:2469.577173+2.993811 
## [130]	train-rmse:2469.331885+0.331276	test-rmse:2469.330981+2.993960 
## [131]	train-rmse:2469.086475+0.331119	test-rmse:2469.084839+2.993550 
## [132]	train-rmse:2468.839844+0.330556	test-rmse:2468.837622+2.993610 
## [133]	train-rmse:2468.591992+0.330831	test-rmse:2468.591626+2.993573 
## [134]	train-rmse:2468.347876+0.330402	test-rmse:2468.345337+2.993154 
## [135]	train-rmse:2468.101538+0.330920	test-rmse:2468.099292+2.992686 
## [136]	train-rmse:2467.853638+0.330695	test-rmse:2467.853223+2.992801 
## [137]	train-rmse:2467.606641+0.330019	test-rmse:2467.606201+2.992608 
## [138]	train-rmse:2467.366260+0.330746	test-rmse:2467.360718+2.992765 
## [139]	train-rmse:2467.114429+0.330212	test-rmse:2467.114429+2.992424 
## [140]	train-rmse:2466.869971+0.330500	test-rmse:2466.867920+2.992312 
## [141]	train-rmse:2466.625879+0.330070	test-rmse:2466.622168+2.992005 
## [142]	train-rmse:2466.377270+0.330374	test-rmse:2466.376074+2.991804 
## [143]	train-rmse:2466.131152+0.330566	test-rmse:2466.129761+2.991826 
## [144]	train-rmse:2465.884424+0.330971	test-rmse:2465.883691+2.991523 
## [145]	train-rmse:2465.641138+0.330274	test-rmse:2465.637915+2.991470 
## [146]	train-rmse:2465.392554+0.329887	test-rmse:2465.391919+2.991356 
## [147]	train-rmse:2465.146020+0.329903	test-rmse:2465.145923+2.990921 
## [148]	train-rmse:2464.901831+0.330775	test-rmse:2464.899560+2.990725 
## [149]	train-rmse:2464.654468+0.329485	test-rmse:2464.653979+2.990828 
## [150]	train-rmse:2464.412109+0.330932	test-rmse:2464.408081+2.990765 
## [151]	train-rmse:2464.163086+0.329542	test-rmse:2464.162036+2.990187 
## [152]	train-rmse:2463.915967+0.330259	test-rmse:2463.916138+2.990139 
## [153]	train-rmse:2463.671777+0.329483	test-rmse:2463.670410+2.990108 
## [154]	train-rmse:2463.426465+0.330511	test-rmse:2463.424854+2.989763 
## [155]	train-rmse:2463.180786+0.329642	test-rmse:2463.178833+2.989904 
## [156]	train-rmse:2462.934082+0.329964	test-rmse:2462.933105+2.989364 
## [157]	train-rmse:2462.689941+0.329899	test-rmse:2462.687256+2.989609 
## [158]	train-rmse:2462.444214+0.329863	test-rmse:2462.441577+2.989181 
## [159]	train-rmse:2462.194556+0.329900	test-rmse:2462.195850+2.988887 
## [160]	train-rmse:2461.953638+0.329731	test-rmse:2461.950122+2.988979 
## [161]	train-rmse:2461.707202+0.330026	test-rmse:2461.704810+2.988390 
## [162]	train-rmse:2461.458740+0.329792	test-rmse:2461.458740+2.988335 
## [163]	train-rmse:2461.215942+0.329266	test-rmse:2461.213184+2.988085 
## [164]	train-rmse:2460.970972+0.329732	test-rmse:2460.967847+2.988330 
## [165]	train-rmse:2460.721607+0.329834	test-rmse:2460.722437+2.987934 
## [166]	train-rmse:2460.479346+0.329616	test-rmse:2460.476684+2.987652 
## [167]	train-rmse:2460.232520+0.329005	test-rmse:2460.231274+2.987826 
## [168]	train-rmse:2459.987964+0.329552	test-rmse:2459.986011+2.987545 
## [169]	train-rmse:2459.741455+0.329052	test-rmse:2459.740454+2.987422 
## [170]	train-rmse:2459.495703+0.329448	test-rmse:2459.494653+2.987301 
## [171]	train-rmse:2459.252490+0.329527	test-rmse:2459.249048+2.987058 
## [172]	train-rmse:2459.005005+0.329801	test-rmse:2459.004224+2.986983 
## [173]	train-rmse:2458.760327+0.329369	test-rmse:2458.758789+2.986683 
## [174]	train-rmse:2458.513550+0.329435	test-rmse:2458.513037+2.986593 
## [175]	train-rmse:2458.273877+0.329447	test-rmse:2458.268067+2.986385 
## [176]	train-rmse:2458.024097+0.329572	test-rmse:2458.022608+2.986077 
## [177]	train-rmse:2457.778662+0.329286	test-rmse:2457.777734+2.985844 
## [178]	train-rmse:2457.535083+0.329392	test-rmse:2457.532202+2.985757 
## [179]	train-rmse:2457.290747+0.329688	test-rmse:2457.287134+2.985684 
## [180]	train-rmse:2457.041138+0.329505	test-rmse:2457.041895+2.985380 
## [181]	train-rmse:2456.797632+0.328891	test-rmse:2456.796631+2.985425 
## [182]	train-rmse:2456.554907+0.329213	test-rmse:2456.551733+2.985373 
## [183]	train-rmse:2456.308862+0.329526	test-rmse:2456.306421+2.984987 
## [184]	train-rmse:2456.062036+0.329405	test-rmse:2456.061474+2.984706 
## [185]	train-rmse:2455.820142+0.329113	test-rmse:2455.816431+2.984802 
## [186]	train-rmse:2455.572754+0.329284	test-rmse:2455.571313+2.984800 
## [187]	train-rmse:2455.327710+0.328950	test-rmse:2455.326538+2.984442 
## [188]	train-rmse:2455.082788+0.328634	test-rmse:2455.081616+2.984245 
## [189]	train-rmse:2454.837427+0.329179	test-rmse:2454.836328+2.983934 
## [190]	train-rmse:2454.592578+0.328706	test-rmse:2454.591724+2.983970 
## [191]	train-rmse:2454.347949+0.329074	test-rmse:2454.346582+2.983557 
## [192]	train-rmse:2454.105322+0.328788	test-rmse:2454.101660+2.983664 
## [193]	train-rmse:2453.856787+0.328656	test-rmse:2453.857031+2.983301 
## [194]	train-rmse:2453.614160+0.328594	test-rmse:2453.612427+2.983164 
## [195]	train-rmse:2453.370093+0.329202	test-rmse:2453.367041+2.983094 
## [196]	train-rmse:2453.121753+0.328430	test-rmse:2453.122485+2.982701 
## [197]	train-rmse:2452.879297+0.328952	test-rmse:2452.877905+2.982905 
## [198]	train-rmse:2452.634009+0.328039	test-rmse:2452.632764+2.982421 
## [199]	train-rmse:2452.390674+0.328653	test-rmse:2452.388208+2.982402 
## [200]	train-rmse:2452.146362+0.328167	test-rmse:2452.143359+2.982319 
## [201]	train-rmse:2451.900440+0.328344	test-rmse:2451.898877+2.981725 
## [202]	train-rmse:2451.655786+0.328596	test-rmse:2451.654004+2.981646 
## [203]	train-rmse:2451.410522+0.328167	test-rmse:2451.409326+2.981610 
## [204]	train-rmse:2451.168677+0.327897	test-rmse:2451.165259+2.981544 
## [205]	train-rmse:2450.919971+0.327949	test-rmse:2450.920312+2.980929 
## [206]	train-rmse:2450.678076+0.328649	test-rmse:2450.675610+2.981250 
## [207]	train-rmse:2450.434692+0.328071	test-rmse:2450.431397+2.980855 
## [208]	train-rmse:2450.188745+0.327940	test-rmse:2450.186743+2.980702 
## [209]	train-rmse:2449.943115+0.327880	test-rmse:2449.942041+2.980581 
## [210]	train-rmse:2449.698999+0.327947	test-rmse:2449.698047+2.980383 
## [211]	train-rmse:2449.455762+0.328203	test-rmse:2449.453516+2.980278 
## [212]	train-rmse:2449.211206+0.328060	test-rmse:2449.209375+2.980114 
## [213]	train-rmse:2448.965381+0.327746	test-rmse:2448.964624+2.980169 
## [214]	train-rmse:2448.724097+0.328025	test-rmse:2448.720606+2.979873 
## [215]	train-rmse:2448.476416+0.327206	test-rmse:2448.476367+2.979580 
## [216]	train-rmse:2448.233765+0.328425	test-rmse:2448.231738+2.979757 
## [217]	train-rmse:2447.991186+0.328210	test-rmse:2447.987451+2.979378 
## [218]	train-rmse:2447.745068+0.327768	test-rmse:2447.743555+2.979319 
## [219]	train-rmse:2447.497412+0.327140	test-rmse:2447.499390+2.979001 
## [220]	train-rmse:2447.257764+0.328371	test-rmse:2447.254956+2.978789 
## [221]	train-rmse:2447.013867+0.327612	test-rmse:2447.010522+2.978490 
## [222]	train-rmse:2446.766919+0.327662	test-rmse:2446.766650+2.979038 
## [223]	train-rmse:2446.523096+0.327476	test-rmse:2446.522534+2.978593 
## [224]	train-rmse:2446.280957+0.327402	test-rmse:2446.278345+2.978164 
## [225]	train-rmse:2446.037134+0.326992	test-rmse:2446.034131+2.978107 
## [226]	train-rmse:2445.790015+0.327064	test-rmse:2445.790210+2.977968 
## [227]	train-rmse:2445.549097+0.327934	test-rmse:2445.546191+2.977846 
## [228]	train-rmse:2445.303955+0.327547	test-rmse:2445.302222+2.977654 
## [229]	train-rmse:2445.063062+0.327751	test-rmse:2445.057983+2.977455 
## [230]	train-rmse:2444.813598+0.328077	test-rmse:2444.814185+2.977091 
## [231]	train-rmse:2444.571484+0.327698	test-rmse:2444.570410+2.977181 
## [232]	train-rmse:2444.328906+0.327171	test-rmse:2444.326562+2.976942 
## [233]	train-rmse:2444.083862+0.326875	test-rmse:2444.082642+2.977096 
## [234]	train-rmse:2443.838232+0.327902	test-rmse:2443.838550+2.976604 
## [235]	train-rmse:2443.595117+0.327287	test-rmse:2443.595044+2.976327 
## [236]	train-rmse:2443.352979+0.327633	test-rmse:2443.351099+2.976233 
## [237]	train-rmse:2443.108814+0.327633	test-rmse:2443.107349+2.976074 
## [238]	train-rmse:2442.865478+0.327039	test-rmse:2442.863648+2.976079 
## [239]	train-rmse:2442.622046+0.327155	test-rmse:2442.619678+2.975788 
## [240]	train-rmse:2442.376758+0.326939	test-rmse:2442.375952+2.975644 
## [241]	train-rmse:2442.134375+0.327306	test-rmse:2442.132568+2.975324 
## [242]	train-rmse:2441.889209+0.327057	test-rmse:2441.888623+2.975353 
## [243]	train-rmse:2441.646313+0.326707	test-rmse:2441.644824+2.974940 
## [244]	train-rmse:2441.403052+0.327084	test-rmse:2441.401294+2.975126 
## [245]	train-rmse:2441.161231+0.327339	test-rmse:2441.157788+2.974839 
## [246]	train-rmse:2440.916748+0.326902	test-rmse:2440.913965+2.974494 
## [247]	train-rmse:2440.672339+0.327012	test-rmse:2440.671045+2.974739 
## [248]	train-rmse:2440.428638+0.326939	test-rmse:2440.427222+2.974155 
## [249]	train-rmse:2440.185693+0.326821	test-rmse:2440.183618+2.973876 
## [250]	train-rmse:2439.942432+0.327045	test-rmse:2439.940430+2.974039 
## [251]	train-rmse:2439.697876+0.327001	test-rmse:2439.697095+2.973700 
## [252]	train-rmse:2439.454712+0.327194	test-rmse:2439.453540+2.973596 
## [253]	train-rmse:2439.210742+0.327531	test-rmse:2439.209863+2.973724 
## [254]	train-rmse:2438.969483+0.326970	test-rmse:2438.966748+2.973211 
## [255]	train-rmse:2438.725464+0.327175	test-rmse:2438.723559+2.973141 
## [256]	train-rmse:2438.481152+0.326148	test-rmse:2438.480078+2.973040 
## [257]	train-rmse:2438.236890+0.326204	test-rmse:2438.236914+2.972884 
## [258]	train-rmse:2437.995532+0.326693	test-rmse:2437.993359+2.972469 
## [259]	train-rmse:2437.750855+0.326003	test-rmse:2437.749902+2.972423 
## [260]	train-rmse:2437.507080+0.326942	test-rmse:2437.507031+2.972254 
## [261]	train-rmse:2437.265234+0.326479	test-rmse:2437.263550+2.972187 
## [262]	train-rmse:2437.022534+0.326800	test-rmse:2437.020606+2.971982 
## [263]	train-rmse:2436.778394+0.326221	test-rmse:2436.777344+2.972051 
## [264]	train-rmse:2436.536402+0.326387	test-rmse:2436.534326+2.971600 
## [265]	train-rmse:2436.293115+0.326184	test-rmse:2436.291016+2.971411 
## [266]	train-rmse:2436.049536+0.326488	test-rmse:2436.048389+2.971642 
## [267]	train-rmse:2435.807153+0.326206	test-rmse:2435.805225+2.971013 
## [268]	train-rmse:2435.563233+0.325689	test-rmse:2435.561938+2.970884 
## [269]	train-rmse:2435.321216+0.326780	test-rmse:2435.318921+2.970669 
## [270]	train-rmse:2435.077026+0.326522	test-rmse:2435.076001+2.970494 
## [271]	train-rmse:2434.835107+0.325356	test-rmse:2434.832886+2.970407 
## [272]	train-rmse:2434.593896+0.326237	test-rmse:2434.590064+2.970225 
## [273]	train-rmse:2434.346607+0.326028	test-rmse:2434.347217+2.970035 
## [274]	train-rmse:2434.106836+0.326656	test-rmse:2434.104517+2.969824 
## [275]	train-rmse:2433.862622+0.325931	test-rmse:2433.861401+2.970001 
## [276]	train-rmse:2433.621362+0.326793	test-rmse:2433.618823+2.969709 
## [277]	train-rmse:2433.375977+0.326001	test-rmse:2433.375976+2.969377 
## [278]	train-rmse:2433.133862+0.326377	test-rmse:2433.132959+2.969404 
## [279]	train-rmse:2432.893042+0.326020	test-rmse:2432.890357+2.969310 
## [280]	train-rmse:2432.648584+0.325428	test-rmse:2432.647729+2.969026 
## [281]	train-rmse:2432.407373+0.325481	test-rmse:2432.405249+2.969009 
## [282]	train-rmse:2432.161767+0.325744	test-rmse:2432.162427+2.968825 
## [283]	train-rmse:2431.923706+0.325652	test-rmse:2431.919360+2.968668 
## [284]	train-rmse:2431.678809+0.325573	test-rmse:2431.677002+2.968094 
## [285]	train-rmse:2431.435645+0.325743	test-rmse:2431.434082+2.968437 
## [286]	train-rmse:2431.192920+0.325249	test-rmse:2431.191895+2.967755 
## [287]	train-rmse:2430.950073+0.325354	test-rmse:2430.949097+2.967680 
## [288]	train-rmse:2430.707568+0.325994	test-rmse:2430.706714+2.967773 
## [289]	train-rmse:2430.466504+0.325973	test-rmse:2430.464331+2.967868 
## [290]	train-rmse:2430.224341+0.325522	test-rmse:2430.221509+2.967527 
## [291]	train-rmse:2429.980347+0.325198	test-rmse:2429.979272+2.967227 
## [292]	train-rmse:2429.736890+0.324902	test-rmse:2429.736938+2.967204 
## [293]	train-rmse:2429.498340+0.325466	test-rmse:2429.494116+2.966948 
## [294]	train-rmse:2429.251929+0.325256	test-rmse:2429.252051+2.966611 
## [295]	train-rmse:2429.010523+0.325932	test-rmse:2429.009326+2.966202 
## [296]	train-rmse:2428.770337+0.325707	test-rmse:2428.767212+2.966354 
## [297]	train-rmse:2428.526050+0.325661	test-rmse:2428.524829+2.966389 
## [298]	train-rmse:2428.284741+0.324612	test-rmse:2428.282617+2.966080 
## [299]	train-rmse:2428.039453+0.324946	test-rmse:2428.039990+2.965721 
## [300]	train-rmse:2427.801147+0.324754	test-rmse:2427.797998+2.965641 
## [301]	train-rmse:2427.555420+0.324884	test-rmse:2427.556006+2.965436 
## [302]	train-rmse:2427.315601+0.325024	test-rmse:2427.313672+2.965425 
## [303]	train-rmse:2427.072388+0.325255	test-rmse:2427.071729+2.965274 
## [304]	train-rmse:2426.831152+0.325263	test-rmse:2426.829272+2.965231 
## [305]	train-rmse:2426.587891+0.325309	test-rmse:2426.587256+2.964882 
## [306]	train-rmse:2426.346704+0.325773	test-rmse:2426.345191+2.965179 
## [307]	train-rmse:2426.105615+0.324312	test-rmse:2426.102857+2.964558 
## [308]	train-rmse:2425.862500+0.324438	test-rmse:2425.861157+2.964606 
## [309]	train-rmse:2425.620239+0.325278	test-rmse:2425.619189+2.964447 
## [310]	train-rmse:2425.378711+0.324985	test-rmse:2425.376758+2.964154 
## [311]	train-rmse:2425.137476+0.325171	test-rmse:2425.134961+2.964099 
## [312]	train-rmse:2424.894580+0.324825	test-rmse:2424.892725+2.964067 
## [313]	train-rmse:2424.652002+0.324104	test-rmse:2424.650830+2.963944 
## [314]	train-rmse:2424.411157+0.324618	test-rmse:2424.409180+2.963323 
## [315]	train-rmse:2424.168408+0.324758	test-rmse:2424.167163+2.963494 
## [316]	train-rmse:2423.927441+0.324974	test-rmse:2423.925488+2.963019 
## [317]	train-rmse:2423.684277+0.324473	test-rmse:2423.683447+2.962911 
## [318]	train-rmse:2423.442456+0.325090	test-rmse:2423.441675+2.962963 
## [319]	train-rmse:2423.201611+0.324562	test-rmse:2423.199683+2.962486 
## [320]	train-rmse:2422.960913+0.324781	test-rmse:2422.957934+2.962427 
## [321]	train-rmse:2422.716211+0.324791	test-rmse:2422.716553+2.962559 
## [322]	train-rmse:2422.477173+0.324452	test-rmse:2422.474682+2.962174 
## [323]	train-rmse:2422.233130+0.324732	test-rmse:2422.233154+2.962095 
## [324]	train-rmse:2421.993872+0.324757	test-rmse:2421.991406+2.962099 
## [325]	train-rmse:2421.750293+0.324138	test-rmse:2421.749805+2.961477 
## [326]	train-rmse:2421.511255+0.324757	test-rmse:2421.507812+2.961594 
## [327]	train-rmse:2421.267822+0.324314	test-rmse:2421.266333+2.961376 
## [328]	train-rmse:2421.025806+0.323678	test-rmse:2421.024951+2.961263 
## [329]	train-rmse:2420.785547+0.323903	test-rmse:2420.783423+2.961004 
## [330]	train-rmse:2420.542822+0.324169	test-rmse:2420.541650+2.960938 
## [331]	train-rmse:2420.301318+0.323844	test-rmse:2420.300244+2.960720 
## [332]	train-rmse:2420.059888+0.324164	test-rmse:2420.058691+2.960674 
## [333]	train-rmse:2419.820435+0.324667	test-rmse:2419.817358+2.960375 
## [334]	train-rmse:2419.577246+0.323924	test-rmse:2419.575854+2.959942 
## [335]	train-rmse:2419.335083+0.324440	test-rmse:2419.334717+2.960246 
## [336]	train-rmse:2419.093994+0.323884	test-rmse:2419.093091+2.959976 
## [337]	train-rmse:2418.855151+0.323917	test-rmse:2418.852075+2.959766 
## [338]	train-rmse:2418.611426+0.324198	test-rmse:2418.610376+2.959846 
## [339]	train-rmse:2418.371045+0.324082	test-rmse:2418.369165+2.959334 
## [340]	train-rmse:2418.129614+0.324288	test-rmse:2418.127979+2.959456 
## [341]	train-rmse:2417.887476+0.323787	test-rmse:2417.886767+2.959180 
## [342]	train-rmse:2417.646240+0.323896	test-rmse:2417.645679+2.958938 
## [343]	train-rmse:2417.404810+0.323353	test-rmse:2417.404224+2.958984 
## [344]	train-rmse:2417.165503+0.323719	test-rmse:2417.163062+2.958656 
## [345]	train-rmse:2416.923120+0.323238	test-rmse:2416.921509+2.958324 
## [346]	train-rmse:2416.683081+0.323208	test-rmse:2416.680908+2.958270 
## [347]	train-rmse:2416.440698+0.323806	test-rmse:2416.439429+2.958148 
## [348]	train-rmse:2416.199561+0.324121	test-rmse:2416.198462+2.957945 
## [349]	train-rmse:2415.956860+0.323208	test-rmse:2415.957324+2.957743 
## [350]	train-rmse:2415.718359+0.324050	test-rmse:2415.716455+2.957466 
## [351]	train-rmse:2415.478516+0.323484	test-rmse:2415.475317+2.957368 
## [352]	train-rmse:2415.236060+0.323109	test-rmse:2415.234473+2.957567 
## [353]	train-rmse:2414.994629+0.323365	test-rmse:2414.993506+2.957089 
## [354]	train-rmse:2414.753320+0.323896	test-rmse:2414.752295+2.956783 
## [355]	train-rmse:2414.513843+0.324157	test-rmse:2414.511719+2.957080 
## [356]	train-rmse:2414.271802+0.323224	test-rmse:2414.270483+2.956571 
## [357]	train-rmse:2414.031323+0.323275	test-rmse:2414.029810+2.956686 
## [358]	train-rmse:2413.789282+0.322954	test-rmse:2413.788794+2.956479 
## [359]	train-rmse:2413.552319+0.323389	test-rmse:2413.547802+2.956177 
## [360]	train-rmse:2413.308423+0.323142	test-rmse:2413.307153+2.955947 
## [361]	train-rmse:2413.069092+0.323664	test-rmse:2413.066577+2.955856 
## [362]	train-rmse:2412.825854+0.323390	test-rmse:2412.825879+2.955764 
## [363]	train-rmse:2412.586792+0.323939	test-rmse:2412.584936+2.955737 
## [364]	train-rmse:2412.346191+0.323676	test-rmse:2412.344140+2.955142 
## [365]	train-rmse:2412.105054+0.322669	test-rmse:2412.103955+2.955200 
## [366]	train-rmse:2411.866211+0.322058	test-rmse:2411.862915+2.955154 
## [367]	train-rmse:2411.623120+0.323014	test-rmse:2411.622461+2.954593 
## [368]	train-rmse:2411.380396+0.322974	test-rmse:2411.381519+2.955041 
## [369]	train-rmse:2411.143067+0.323121	test-rmse:2411.141309+2.954740 
## [370]	train-rmse:2410.901611+0.322325	test-rmse:2410.900513+2.954514 
## [371]	train-rmse:2410.662207+0.322993	test-rmse:2410.660132+2.954449 
## [372]	train-rmse:2410.419556+0.322868	test-rmse:2410.419580+2.954532 
## [373]	train-rmse:2410.182959+0.322061	test-rmse:2410.179297+2.954239 
## [374]	train-rmse:2409.940283+0.322237	test-rmse:2409.938867+2.953902 
## [375]	train-rmse:2409.697705+0.322576	test-rmse:2409.698486+2.954107 
## [376]	train-rmse:2409.459082+0.322928	test-rmse:2409.457764+2.953619 
## [377]	train-rmse:2409.218872+0.322920	test-rmse:2409.217627+2.953661 
## [378]	train-rmse:2408.978760+0.322494	test-rmse:2408.977173+2.953484 
## [379]	train-rmse:2408.737598+0.322834	test-rmse:2408.736694+2.953556 
## [380]	train-rmse:2408.497827+0.322193	test-rmse:2408.496387+2.953143 
## [381]	train-rmse:2408.257153+0.322600	test-rmse:2408.256323+2.953048 
## [382]	train-rmse:2408.016968+0.322797	test-rmse:2408.015967+2.952907 
## [383]	train-rmse:2407.778369+0.321509	test-rmse:2407.775855+2.952505 
## [384]	train-rmse:2407.537329+0.322387	test-rmse:2407.535571+2.952713 
## [385]	train-rmse:2407.296387+0.322360	test-rmse:2407.295654+2.952557 
## [386]	train-rmse:2407.056201+0.322222	test-rmse:2407.055249+2.952320 
## [387]	train-rmse:2406.817651+0.323252	test-rmse:2406.815210+2.952385 
## [388]	train-rmse:2406.574854+0.322520	test-rmse:2406.574902+2.952396 
## [389]	train-rmse:2406.336938+0.321694	test-rmse:2406.334985+2.951986 
## [390]	train-rmse:2406.096069+0.322037	test-rmse:2406.094580+2.951732 
## [391]	train-rmse:2405.855469+0.321587	test-rmse:2405.854785+2.951626 
## [392]	train-rmse:2405.617139+0.321954	test-rmse:2405.614966+2.951254 
## [393]	train-rmse:2405.373657+0.322055	test-rmse:2405.374658+2.951533 
## [394]	train-rmse:2405.136987+0.321967	test-rmse:2405.134814+2.951178 
## [395]	train-rmse:2404.894238+0.321853	test-rmse:2404.894751+2.951169 
## [396]	train-rmse:2404.657788+0.322634	test-rmse:2404.655102+2.951412 
## [397]	train-rmse:2404.415771+0.321216	test-rmse:2404.414966+2.950620 
## [398]	train-rmse:2404.176953+0.322237	test-rmse:2404.175195+2.950859 
## [399]	train-rmse:2403.936182+0.321612	test-rmse:2403.935034+2.950906 
## [400]	train-rmse:2403.694873+0.321529	test-rmse:2403.695312+2.950516 
## [401]	train-rmse:2403.457764+0.321808	test-rmse:2403.455908+2.950625 
## [402]	train-rmse:2403.216333+0.321399	test-rmse:2403.215723+2.950225 
## [403]	train-rmse:2402.977002+0.321945	test-rmse:2402.976318+2.950286 
## [404]	train-rmse:2402.737109+0.321182	test-rmse:2402.736328+2.950084 
## [405]	train-rmse:2402.497168+0.321966	test-rmse:2402.496728+2.949700 
## [406]	train-rmse:2402.260059+0.321432	test-rmse:2402.257276+2.949857 
## [407]	train-rmse:2402.017383+0.321927	test-rmse:2402.017358+2.949568 
## [408]	train-rmse:2401.779785+0.322146	test-rmse:2401.777661+2.949588 
## [409]	train-rmse:2401.537646+0.321086	test-rmse:2401.538061+2.949403 
## [410]	train-rmse:2401.299878+0.321988	test-rmse:2401.298755+2.949089 
## [411]	train-rmse:2401.060498+0.320861	test-rmse:2401.058765+2.949109 
## [412]	train-rmse:2400.818896+0.321329	test-rmse:2400.819238+2.948969 
## [413]	train-rmse:2400.580835+0.320805	test-rmse:2400.579834+2.948661 
## [414]	train-rmse:2400.340552+0.321862	test-rmse:2400.340625+2.949237 
## [415]	train-rmse:2400.103222+0.320967	test-rmse:2400.100659+2.948506 
## [416]	train-rmse:2399.862671+0.321888	test-rmse:2399.861474+2.948540 
## [417]	train-rmse:2399.621899+0.321183	test-rmse:2399.621802+2.947997 
## [418]	train-rmse:2399.384009+0.321285	test-rmse:2399.382642+2.948215 
## [419]	train-rmse:2399.143945+0.321650	test-rmse:2399.143359+2.947890 
## [420]	train-rmse:2398.904224+0.320886	test-rmse:2398.903809+2.947715 
## [421]	train-rmse:2398.664551+0.320909	test-rmse:2398.664477+2.947406 
## [422]	train-rmse:2398.426392+0.321126	test-rmse:2398.425269+2.947548 
## [423]	train-rmse:2398.187768+0.320627	test-rmse:2398.186108+2.947512 
## [424]	train-rmse:2397.948145+0.320478	test-rmse:2397.946826+2.947182 
## [425]	train-rmse:2397.707983+0.321100	test-rmse:2397.707617+2.947330 
## [426]	train-rmse:2397.468603+0.321132	test-rmse:2397.468579+2.947034 
## [427]	train-rmse:2397.230127+0.321629	test-rmse:2397.229077+2.946754 
## [428]	train-rmse:2396.991406+0.321499	test-rmse:2396.989819+2.946695 
## [429]	train-rmse:2396.750562+0.320332	test-rmse:2396.751099+2.946644 
## [430]	train-rmse:2396.513526+0.321506	test-rmse:2396.511475+2.946690 
## [431]	train-rmse:2396.272095+0.320634	test-rmse:2396.272632+2.946085 
## [432]	train-rmse:2396.033765+0.320810	test-rmse:2396.033765+2.946075 
## [433]	train-rmse:2395.795312+0.319621	test-rmse:2395.794360+2.946239 
## [434]	train-rmse:2395.557764+0.321415	test-rmse:2395.555615+2.945955 
## [435]	train-rmse:2395.318603+0.320648	test-rmse:2395.316504+2.946092 
## [436]	train-rmse:2395.076367+0.320177	test-rmse:2395.077661+2.945600 
## [437]	train-rmse:2394.839966+0.320080	test-rmse:2394.838965+2.945448 
## [438]	train-rmse:2394.600952+0.321427	test-rmse:2394.599756+2.945466 
## [439]	train-rmse:2394.361646+0.320303	test-rmse:2394.360620+2.945308 
## [440]	train-rmse:2394.122046+0.319638	test-rmse:2394.121997+2.944887 
## [441]	train-rmse:2393.884180+0.321229	test-rmse:2393.883008+2.944996 
## [442]	train-rmse:2393.645483+0.320256	test-rmse:2393.644531+2.945015 
## [443]	train-rmse:2393.405444+0.319533	test-rmse:2393.405566+2.944601 
## [444]	train-rmse:2393.168628+0.320319	test-rmse:2393.166455+2.944624 
## [445]	train-rmse:2392.928101+0.320130	test-rmse:2392.928149+2.944813 
## [446]	train-rmse:2392.690796+0.320370	test-rmse:2392.689063+2.944221 
## [447]	train-rmse:2392.449023+0.320316	test-rmse:2392.450171+2.944367 
## [448]	train-rmse:2392.213501+0.320293	test-rmse:2392.211792+2.943898 
## [449]	train-rmse:2391.972998+0.320718	test-rmse:2391.972925+2.943955 
## [450]	train-rmse:2391.735522+0.320560	test-rmse:2391.734424+2.944009 
## [451]	train-rmse:2391.496240+0.319755	test-rmse:2391.495801+2.943868 
## [452]	train-rmse:2391.259741+0.320816	test-rmse:2391.257520+2.943291 
## [453]	train-rmse:2391.019434+0.319799	test-rmse:2391.018726+2.943352 
## [454]	train-rmse:2390.780688+0.319663	test-rmse:2390.780176+2.943185 
## [455]	train-rmse:2390.541992+0.319370	test-rmse:2390.541577+2.942921 
## [456]	train-rmse:2390.302930+0.320115	test-rmse:2390.302881+2.942836 
## [457]	train-rmse:2390.066480+0.319910	test-rmse:2390.064770+2.942751 
## [458]	train-rmse:2389.826245+0.319055	test-rmse:2389.826367+2.942902 
## [459]	train-rmse:2389.588281+0.320846	test-rmse:2389.587769+2.942578 
## [460]	train-rmse:2389.349976+0.319587	test-rmse:2389.349414+2.942510 
## [461]	train-rmse:2389.111475+0.319282	test-rmse:2389.111084+2.942170 
## [462]	train-rmse:2388.873950+0.319735	test-rmse:2388.872729+2.942240 
## [463]	train-rmse:2388.635010+0.320496	test-rmse:2388.634717+2.942169 
## [464]	train-rmse:2388.397656+0.319443	test-rmse:2388.396362+2.941973 
## [465]	train-rmse:2388.158447+0.319047	test-rmse:2388.157666+2.941679 
## [466]	train-rmse:2387.920361+0.320332	test-rmse:2387.919678+2.941788 
## [467]	train-rmse:2387.682813+0.319691	test-rmse:2387.681470+2.941379 
## [468]	train-rmse:2387.443799+0.318906	test-rmse:2387.443335+2.941469 
## [469]	train-rmse:2387.205664+0.319663	test-rmse:2387.204736+2.941405 
## [470]	train-rmse:2386.967139+0.318773	test-rmse:2386.966797+2.940901 
## [471]	train-rmse:2386.729858+0.319566	test-rmse:2386.728613+2.941085 
## [472]	train-rmse:2386.490698+0.319410	test-rmse:2386.490479+2.941020 
## [473]	train-rmse:2386.251953+0.319288	test-rmse:2386.252393+2.940746 
## [474]	train-rmse:2386.014746+0.319275	test-rmse:2386.014551+2.940420 
## [475]	train-rmse:2385.776977+0.318913	test-rmse:2385.776196+2.940296 
## [476]	train-rmse:2385.539429+0.318861	test-rmse:2385.538330+2.939934 
## [477]	train-rmse:2385.302002+0.319688	test-rmse:2385.300147+2.940118 
## [478]	train-rmse:2385.061548+0.319195	test-rmse:2385.062353+2.940040 
## [479]	train-rmse:2384.824976+0.319459	test-rmse:2384.824365+2.939916 
## [480]	train-rmse:2384.587451+0.318843	test-rmse:2384.586426+2.939690 
## [481]	train-rmse:2384.349170+0.319045	test-rmse:2384.348560+2.939660 
## [482]	train-rmse:2384.111450+0.319001	test-rmse:2384.110938+2.939692 
## [483]	train-rmse:2383.873145+0.319289	test-rmse:2383.873120+2.939443 
## [484]	train-rmse:2383.635352+0.319186	test-rmse:2383.634937+2.939336 
## [485]	train-rmse:2383.397314+0.319029	test-rmse:2383.397217+2.939315 
## [486]	train-rmse:2383.160718+0.318961	test-rmse:2383.159473+2.939036 
## [487]	train-rmse:2382.922583+0.318827	test-rmse:2382.921826+2.938950 
## [488]	train-rmse:2382.684204+0.318294	test-rmse:2382.683960+2.938855 
## [489]	train-rmse:2382.447022+0.318483	test-rmse:2382.446314+2.938545 
## [490]	train-rmse:2382.210229+0.318737	test-rmse:2382.208594+2.938468 
## [491]	train-rmse:2381.971411+0.318925	test-rmse:2381.970801+2.938535 
## [492]	train-rmse:2381.734399+0.317864	test-rmse:2381.733496+2.937965 
## [493]	train-rmse:2381.496484+0.319981	test-rmse:2381.495703+2.938308 
## [494]	train-rmse:2381.258862+0.317997	test-rmse:2381.257861+2.937797 
## [495]	train-rmse:2381.019897+0.319020	test-rmse:2381.020532+2.937861 
## [496]	train-rmse:2380.783618+0.319280	test-rmse:2380.782959+2.937753 
## [497]	train-rmse:2380.544800+0.318238	test-rmse:2380.545679+2.937612 
## [498]	train-rmse:2380.308423+0.318578	test-rmse:2380.308057+2.937406 
## [499]	train-rmse:2380.070972+0.317750	test-rmse:2380.070801+2.937254 
## [500]	train-rmse:2379.834424+0.317882	test-rmse:2379.833081+2.937308 
## [501]	train-rmse:2379.596021+0.318353	test-rmse:2379.595654+2.936761 
## [502]	train-rmse:2379.359790+0.317738	test-rmse:2379.358301+2.936603 
## [503]	train-rmse:2379.122485+0.318459	test-rmse:2379.121069+2.936753 
## [504]	train-rmse:2378.883276+0.318089	test-rmse:2378.883545+2.936442 
## [505]	train-rmse:2378.647729+0.318468	test-rmse:2378.646606+2.936481 
## [506]	train-rmse:2378.409009+0.318303	test-rmse:2378.408740+2.936419 
## [507]	train-rmse:2378.173779+0.318201	test-rmse:2378.171313+2.936278 
## [508]	train-rmse:2377.933789+0.318611	test-rmse:2377.934351+2.936244 
## [509]	train-rmse:2377.699023+0.318094	test-rmse:2377.697412+2.935951 
## [510]	train-rmse:2377.459497+0.318033	test-rmse:2377.459741+2.936100 
## [511]	train-rmse:2377.223486+0.318147	test-rmse:2377.222852+2.935532 
## [512]	train-rmse:2376.986377+0.318337	test-rmse:2376.985815+2.935805 
## [513]	train-rmse:2376.747559+0.317385	test-rmse:2376.748462+2.935066 
## [514]	train-rmse:2376.512232+0.317646	test-rmse:2376.511401+2.935507 
## [515]	train-rmse:2376.274854+0.318469	test-rmse:2376.274365+2.934669 
## [516]	train-rmse:2376.038037+0.317500	test-rmse:2376.037183+2.934985 
## [517]	train-rmse:2375.800561+0.316820	test-rmse:2375.800220+2.935075 
## [518]	train-rmse:2375.564160+0.317414	test-rmse:2375.563330+2.934678 
## [519]	train-rmse:2375.326758+0.317924	test-rmse:2375.326074+2.934744 
## [520]	train-rmse:2375.088770+0.317283	test-rmse:2375.089404+2.934222 
## [521]	train-rmse:2374.853394+0.318286	test-rmse:2374.852295+2.934570 
## [522]	train-rmse:2374.616040+0.317746	test-rmse:2374.615210+2.934222 
## [523]	train-rmse:2374.378247+0.316899	test-rmse:2374.378223+2.934143 
## [524]	train-rmse:2374.142871+0.316898	test-rmse:2374.141211+2.934292 
## [525]	train-rmse:2373.906152+0.317543	test-rmse:2373.904419+2.933637 
## [526]	train-rmse:2373.666870+0.317545	test-rmse:2373.668042+2.933853 
## [527]	train-rmse:2373.431714+0.316959	test-rmse:2373.431177+2.933135 
## [528]	train-rmse:2373.194629+0.317544	test-rmse:2373.194189+2.933577 
## [529]	train-rmse:2372.957690+0.317707	test-rmse:2372.957666+2.933088 
## [530]	train-rmse:2372.721045+0.317580	test-rmse:2372.720947+2.933203 
## [531]	train-rmse:2372.485181+0.317544	test-rmse:2372.483960+2.933216 
## [532]	train-rmse:2372.246826+0.316594	test-rmse:2372.247607+2.932842 
## [533]	train-rmse:2372.010767+0.318159	test-rmse:2372.010791+2.933003 
## [534]	train-rmse:2371.773559+0.316721	test-rmse:2371.774243+2.932527 
## [535]	train-rmse:2371.538525+0.317310	test-rmse:2371.537549+2.932589 
## [536]	train-rmse:2371.300073+0.317620	test-rmse:2371.300879+2.932459 
## [537]	train-rmse:2371.065454+0.318208	test-rmse:2371.064307+2.932782 
## [538]	train-rmse:2370.827612+0.316035	test-rmse:2370.827490+2.932078 
## [539]	train-rmse:2370.591992+0.316256	test-rmse:2370.591211+2.932184 
## [540]	train-rmse:2370.354614+0.317477	test-rmse:2370.354468+2.932245 
## [541]	train-rmse:2370.119409+0.316351	test-rmse:2370.117969+2.932306 
## [542]	train-rmse:2369.882251+0.316656	test-rmse:2369.881689+2.931969 
## [543]	train-rmse:2369.645752+0.316416	test-rmse:2369.645508+2.931794 
## [544]	train-rmse:2369.409082+0.316028	test-rmse:2369.408618+2.931509 
## [545]	train-rmse:2369.172607+0.316626	test-rmse:2369.172510+2.931498 
## [546]	train-rmse:2368.937793+0.317555	test-rmse:2368.936108+2.931689 
## [547]	train-rmse:2368.699805+0.316544	test-rmse:2368.699731+2.931519 
## [548]	train-rmse:2368.464770+0.316117	test-rmse:2368.463208+2.931372 
## [549]	train-rmse:2368.227637+0.316334	test-rmse:2368.226782+2.931027 
## [550]	train-rmse:2367.991333+0.316840	test-rmse:2367.990771+2.931344 
## [551]	train-rmse:2367.754321+0.317006	test-rmse:2367.754395+2.930973 
## [552]	train-rmse:2367.520044+0.316409	test-rmse:2367.518359+2.930729 
## [553]	train-rmse:2367.282251+0.316919	test-rmse:2367.281909+2.930981 
## [554]	train-rmse:2367.047461+0.316174	test-rmse:2367.045508+2.930632 
## [555]	train-rmse:2366.809326+0.316725	test-rmse:2366.809595+2.930696 
## [556]	train-rmse:2366.576416+0.316444	test-rmse:2366.573267+2.930481 
## [557]	train-rmse:2366.336768+0.316350	test-rmse:2366.337427+2.930770 
## [558]	train-rmse:2366.102905+0.317168	test-rmse:2366.101294+2.930437 
## [559]	train-rmse:2365.865137+0.316697	test-rmse:2365.865088+2.930303 
## [560]	train-rmse:2365.630151+0.317689	test-rmse:2365.629199+2.930230 
## [561]	train-rmse:2365.393237+0.315622	test-rmse:2365.393189+2.930028 
## [562]	train-rmse:2365.158496+0.316188	test-rmse:2365.157080+2.930010 
## [563]	train-rmse:2364.922485+0.316234	test-rmse:2364.920898+2.930080 
## [564]	train-rmse:2364.685083+0.316301	test-rmse:2364.685474+2.930207 
## [565]	train-rmse:2364.451563+0.316158	test-rmse:2364.448950+2.929513 
## [566]	train-rmse:2364.213916+0.315535	test-rmse:2364.213403+2.929855 
## [567]	train-rmse:2363.981567+0.315573	test-rmse:2363.977564+2.929515 
## [568]	train-rmse:2363.741919+0.316420	test-rmse:2363.741675+2.929639 
## [569]	train-rmse:2363.508105+0.316015	test-rmse:2363.505664+2.929506 
## [570]	train-rmse:2363.269360+0.316066	test-rmse:2363.270215+2.929497 
## [571]	train-rmse:2363.036841+0.316580	test-rmse:2363.034497+2.929464 
## [572]	train-rmse:2362.797681+0.316156	test-rmse:2362.798608+2.929184 
## [573]	train-rmse:2362.565308+0.315239	test-rmse:2362.562818+2.928909 
## [574]	train-rmse:2362.328198+0.316463	test-rmse:2362.326953+2.929062 
## [575]	train-rmse:2362.092261+0.315284	test-rmse:2362.091357+2.928926 
## [576]	train-rmse:2361.856836+0.316025	test-rmse:2361.855835+2.929130 
## [577]	train-rmse:2361.621411+0.315834	test-rmse:2361.620240+2.928987 
## [578]	train-rmse:2361.385376+0.315814	test-rmse:2361.384619+2.928529 
## [579]	train-rmse:2361.149243+0.315326	test-rmse:2361.148731+2.928351 
## [580]	train-rmse:2360.915894+0.315651	test-rmse:2360.913184+2.928457 
## [581]	train-rmse:2360.679687+0.316378	test-rmse:2360.677808+2.928295 
## [582]	train-rmse:2360.442359+0.315730	test-rmse:2360.442114+2.928147 
## [583]	train-rmse:2360.209790+0.315968	test-rmse:2360.206787+2.928097 
## [584]	train-rmse:2359.971460+0.315733	test-rmse:2359.971265+2.928277 
## [585]	train-rmse:2359.738208+0.316105	test-rmse:2359.735840+2.928103 
## [586]	train-rmse:2359.500610+0.314385	test-rmse:2359.500464+2.927871 
## [587]	train-rmse:2359.266870+0.316261	test-rmse:2359.265063+2.927857 
## [588]	train-rmse:2359.031225+0.314808	test-rmse:2359.029639+2.927860 
## [589]	train-rmse:2358.795605+0.315692	test-rmse:2358.794409+2.927469 
## [590]	train-rmse:2358.561328+0.315086	test-rmse:2358.558863+2.927533 
## [591]	train-rmse:2358.324341+0.315175	test-rmse:2358.323535+2.927685 
## [592]	train-rmse:2358.091284+0.316334	test-rmse:2358.088403+2.927872 
## [593]	train-rmse:2357.853467+0.314879	test-rmse:2357.853198+2.927404 
## [594]	train-rmse:2357.620239+0.315619	test-rmse:2357.617627+2.927335 
## [595]	train-rmse:2357.382812+0.314876	test-rmse:2357.382788+2.927130 
## [596]	train-rmse:2357.150098+0.315148	test-rmse:2357.147754+2.927446 
## [597]	train-rmse:2356.912036+0.314745	test-rmse:2356.912329+2.926984 
## [598]	train-rmse:2356.679785+0.315527	test-rmse:2356.677661+2.926940 
## [599]	train-rmse:2356.443042+0.315293	test-rmse:2356.441943+2.926803 
## [600]	train-rmse:2356.209473+0.315245	test-rmse:2356.207178+2.926791 
## [601]	train-rmse:2355.973022+0.314532	test-rmse:2355.971802+2.926486 
## [602]	train-rmse:2355.739502+0.314645	test-rmse:2355.737183+2.926452 
## [603]	train-rmse:2355.502319+0.314656	test-rmse:2355.502197+2.926366 
## [604]	train-rmse:2355.269312+0.314708	test-rmse:2355.266626+2.926434 
## [605]	train-rmse:2355.033252+0.315561	test-rmse:2355.031641+2.926577 
## [606]	train-rmse:2354.799390+0.315159	test-rmse:2354.796997+2.926035 
## [607]	train-rmse:2354.564282+0.315814	test-rmse:2354.561963+2.926274 
## [608]	train-rmse:2354.329810+0.315208	test-rmse:2354.326977+2.926377 
## [609]	train-rmse:2354.093408+0.314724	test-rmse:2354.092066+2.926327 
## [610]	train-rmse:2353.859302+0.313534	test-rmse:2353.857300+2.925648 
## [611]	train-rmse:2353.624243+0.315101	test-rmse:2353.622729+2.926025 
## [612]	train-rmse:2353.389819+0.314626	test-rmse:2353.387720+2.926041 
## [613]	train-rmse:2353.154858+0.314779	test-rmse:2353.153003+2.925676 
## [614]	train-rmse:2352.919629+0.314557	test-rmse:2352.918164+2.925353 
## [615]	train-rmse:2352.685059+0.314866	test-rmse:2352.683423+2.925587 
## [616]	train-rmse:2352.450806+0.315005	test-rmse:2352.448853+2.925146 
## [617]	train-rmse:2352.216089+0.314362	test-rmse:2352.214282+2.925702 
## [618]	train-rmse:2351.980762+0.314768	test-rmse:2351.979321+2.924832 
## [619]	train-rmse:2351.747461+0.314147	test-rmse:2351.744580+2.925252 
## [620]	train-rmse:2351.512280+0.314869	test-rmse:2351.509839+2.924993 
## [621]	train-rmse:2351.275952+0.314539	test-rmse:2351.275366+2.924931 
## [622]	train-rmse:2351.042773+0.314175	test-rmse:2351.041064+2.924998 
## [623]	train-rmse:2350.807544+0.314973	test-rmse:2350.806299+2.925012 
## [624]	train-rmse:2350.573877+0.314889	test-rmse:2350.571558+2.924722 
## [625]	train-rmse:2350.339551+0.314170	test-rmse:2350.336963+2.924939 
## [626]	train-rmse:2350.104492+0.314493	test-rmse:2350.102515+2.924572 
## [627]	train-rmse:2349.870874+0.313633	test-rmse:2349.868140+2.924242 
## [628]	train-rmse:2349.636499+0.313327	test-rmse:2349.633740+2.924449 
## [629]	train-rmse:2349.401636+0.315082	test-rmse:2349.399268+2.924076 
## [630]	train-rmse:2349.166333+0.313834	test-rmse:2349.164868+2.923993 
## [631]	train-rmse:2348.933496+0.314695	test-rmse:2348.930493+2.924158 
## [632]	train-rmse:2348.698022+0.314940	test-rmse:2348.696192+2.923891 
## [633]	train-rmse:2348.464111+0.314463	test-rmse:2348.461987+2.923787 
## [634]	train-rmse:2348.230054+0.314735	test-rmse:2348.227710+2.924270 
## [635]	train-rmse:2347.995385+0.314246	test-rmse:2347.993432+2.923668 
## [636]	train-rmse:2347.760864+0.313203	test-rmse:2347.759302+2.923627 
## [637]	train-rmse:2347.527124+0.313770	test-rmse:2347.525073+2.923590 
## [638]	train-rmse:2347.292407+0.314111	test-rmse:2347.291040+2.923799 
## [639]	train-rmse:2347.059863+0.313416	test-rmse:2347.056763+2.923123 
## [640]	train-rmse:2346.824072+0.313697	test-rmse:2346.822510+2.923386 
## [641]	train-rmse:2346.591480+0.314254	test-rmse:2346.588525+2.923050 
## [642]	train-rmse:2346.356201+0.313864	test-rmse:2346.354248+2.923089 
## [643]	train-rmse:2346.123901+0.313805	test-rmse:2346.120142+2.922956 
## [644]	train-rmse:2345.887720+0.313854	test-rmse:2345.886279+2.922927 
## [645]	train-rmse:2345.655225+0.313879	test-rmse:2345.652197+2.922964 
## [646]	train-rmse:2345.419483+0.312104	test-rmse:2345.418213+2.922770 
## [647]	train-rmse:2345.187329+0.314498	test-rmse:2345.183960+2.922666 
## [648]	train-rmse:2344.951758+0.313128	test-rmse:2344.950415+2.922521 
## [649]	train-rmse:2344.719507+0.314773	test-rmse:2344.716357+2.922305 
## [650]	train-rmse:2344.482959+0.313047	test-rmse:2344.482251+2.922242 
## [651]	train-rmse:2344.250977+0.313658	test-rmse:2344.248657+2.922122 
## [652]	train-rmse:2344.015845+0.313002	test-rmse:2344.014331+2.922281 
## [653]	train-rmse:2343.783423+0.313464	test-rmse:2343.781177+2.922179 
## [654]	train-rmse:2343.548145+0.313601	test-rmse:2343.546704+2.921802 
## [655]	train-rmse:2343.314429+0.312875	test-rmse:2343.313111+2.921833 
## [656]	train-rmse:2343.082300+0.314186	test-rmse:2343.079419+2.921975 
## [657]	train-rmse:2342.847607+0.312705	test-rmse:2342.845752+2.922054 
## [658]	train-rmse:2342.614966+0.312999	test-rmse:2342.611816+2.921806 
## [659]	train-rmse:2342.379565+0.313096	test-rmse:2342.378296+2.921794 
## [660]	train-rmse:2342.147681+0.313352	test-rmse:2342.144653+2.921865 
## [661]	train-rmse:2341.913721+0.314046	test-rmse:2341.910815+2.921289 
## [662]	train-rmse:2341.680152+0.313591	test-rmse:2341.677246+2.921657 
## [663]	train-rmse:2341.445752+0.312740	test-rmse:2341.443433+2.921493 
## [664]	train-rmse:2341.212866+0.313736	test-rmse:2341.209570+2.920949 
## [665]	train-rmse:2340.978809+0.313001	test-rmse:2340.976587+2.921110 
## [666]	train-rmse:2340.745142+0.312397	test-rmse:2340.742896+2.921300 
## [667]	train-rmse:2340.511938+0.312883	test-rmse:2340.509522+2.921330 
## [668]	train-rmse:2340.278027+0.313122	test-rmse:2340.276050+2.920939 
## [669]	train-rmse:2340.045337+0.312438	test-rmse:2340.042651+2.920958 
## [670]	train-rmse:2339.810205+0.312993	test-rmse:2339.809180+2.920830 
## [671]	train-rmse:2339.577783+0.313112	test-rmse:2339.575659+2.921042 
## [672]	train-rmse:2339.345532+0.312100	test-rmse:2339.342041+2.920583 
## [673]	train-rmse:2339.112085+0.313629	test-rmse:2339.108765+2.920491 
## [674]	train-rmse:2338.877490+0.312270	test-rmse:2338.875537+2.920377 
## [675]	train-rmse:2338.644189+0.311903	test-rmse:2338.642188+2.920368 
## [676]	train-rmse:2338.411792+0.312539	test-rmse:2338.409033+2.920131 
## [677]	train-rmse:2338.177270+0.312712	test-rmse:2338.175537+2.920024 
## [678]	train-rmse:2337.944165+0.312847	test-rmse:2337.942505+2.920118 
## [679]	train-rmse:2337.710693+0.312896	test-rmse:2337.709302+2.920082 
## [680]	train-rmse:2337.478760+0.312536	test-rmse:2337.475952+2.919775 
## [681]	train-rmse:2337.245264+0.312304	test-rmse:2337.242700+2.919884 
## [682]	train-rmse:2337.011768+0.312826	test-rmse:2337.009570+2.919723 
## [683]	train-rmse:2336.778638+0.312204	test-rmse:2336.776050+2.919664 
## [684]	train-rmse:2336.546216+0.311699	test-rmse:2336.543335+2.919367 
## [685]	train-rmse:2336.311963+0.312136	test-rmse:2336.310156+2.919675 
## [686]	train-rmse:2336.079956+0.312561	test-rmse:2336.077100+2.919579 
## [687]	train-rmse:2335.846411+0.312140	test-rmse:2335.843897+2.919405 
## [688]	train-rmse:2335.614014+0.313134	test-rmse:2335.611035+2.919272 
## [689]	train-rmse:2335.380713+0.312220	test-rmse:2335.378052+2.919220 
## [690]	train-rmse:2335.148291+0.312396	test-rmse:2335.145166+2.919124 
## [691]	train-rmse:2334.914746+0.312358	test-rmse:2334.912085+2.919150 
## [692]	train-rmse:2334.682593+0.312177	test-rmse:2334.679248+2.919049 
## [693]	train-rmse:2334.448950+0.312022	test-rmse:2334.446485+2.918616 
## [694]	train-rmse:2334.215625+0.311348	test-rmse:2334.213477+2.918621 
## [695]	train-rmse:2333.984326+0.311507	test-rmse:2333.980396+2.918605 
## [696]	train-rmse:2333.749267+0.311073	test-rmse:2333.747681+2.918679 
## [697]	train-rmse:2333.518311+0.312598	test-rmse:2333.514673+2.918384 
## [698]	train-rmse:2333.283154+0.310695	test-rmse:2333.282007+2.918591 
## [699]	train-rmse:2333.053320+0.312344	test-rmse:2333.049194+2.918563 
## [700]	train-rmse:2332.818262+0.311568	test-rmse:2332.816309+2.918288 
## [701]	train-rmse:2332.587329+0.311385	test-rmse:2332.583569+2.918154 
## [702]	train-rmse:2332.352954+0.311600	test-rmse:2332.351172+2.917894 
## [703]	train-rmse:2332.121875+0.311998	test-rmse:2332.118335+2.917797 
## [704]	train-rmse:2331.887500+0.311751	test-rmse:2331.885913+2.917802 
## [705]	train-rmse:2331.655688+0.311945	test-rmse:2331.653174+2.917715 
## [706]	train-rmse:2331.423682+0.311698	test-rmse:2331.420703+2.917746 
## [707]	train-rmse:2331.190064+0.310980	test-rmse:2331.188013+2.917385 
## [708]	train-rmse:2330.958130+0.311917	test-rmse:2330.955396+2.917534 
## [709]	train-rmse:2330.724853+0.311590	test-rmse:2330.722998+2.917358 
## [710]	train-rmse:2330.494067+0.311485	test-rmse:2330.490308+2.917480 
## [711]	train-rmse:2330.260425+0.311842	test-rmse:2330.257886+2.917257 
## [712]	train-rmse:2330.028540+0.312164	test-rmse:2330.025293+2.917247 
## [713]	train-rmse:2329.795532+0.310776	test-rmse:2329.793018+2.917393 
## [714]	train-rmse:2329.563599+0.311201	test-rmse:2329.560449+2.917150 
## [715]	train-rmse:2329.330151+0.311285	test-rmse:2329.327857+2.917103 
## [716]	train-rmse:2329.097925+0.311844	test-rmse:2329.095581+2.916915 
## [717]	train-rmse:2328.865869+0.312022	test-rmse:2328.863696+2.916936 
## [718]	train-rmse:2328.633276+0.311389	test-rmse:2328.631030+2.916933 
## [719]	train-rmse:2328.401587+0.311995	test-rmse:2328.398730+2.916791 
## [720]	train-rmse:2328.169092+0.311312	test-rmse:2328.166382+2.916835 
## [721]	train-rmse:2327.937647+0.311709	test-rmse:2327.934204+2.916227 
## [722]	train-rmse:2327.705566+0.311394	test-rmse:2327.701733+2.916330 
## [723]	train-rmse:2327.472070+0.310986	test-rmse:2327.469751+2.916195 
## [724]	train-rmse:2327.240674+0.310417	test-rmse:2327.237524+2.916013 
## [725]	train-rmse:2327.008130+0.310410	test-rmse:2327.005444+2.916052 
## [726]	train-rmse:2326.776489+0.311442	test-rmse:2326.773023+2.916078 
## [727]	train-rmse:2326.544043+0.310204	test-rmse:2326.541235+2.915788 
## [728]	train-rmse:2326.312085+0.310735	test-rmse:2326.308936+2.915880 
## [729]	train-rmse:2326.079516+0.310081	test-rmse:2326.076929+2.916024 
## [730]	train-rmse:2325.847998+0.310690	test-rmse:2325.844873+2.915568 
## [731]	train-rmse:2325.615527+0.310507	test-rmse:2325.612793+2.915745 
## [732]	train-rmse:2325.384057+0.310516	test-rmse:2325.381055+2.915848 
## [733]	train-rmse:2325.151660+0.310830	test-rmse:2325.148975+2.915385 
## [734]	train-rmse:2324.920191+0.310298	test-rmse:2324.917212+2.915352 
## [735]	train-rmse:2324.688770+0.309848	test-rmse:2324.684961+2.915070 
## [736]	train-rmse:2324.456641+0.310484	test-rmse:2324.453150+2.915329 
## [737]	train-rmse:2324.223950+0.310298	test-rmse:2324.221167+2.915031 
## [738]	train-rmse:2323.992285+0.310752	test-rmse:2323.989575+2.915316 
## [739]	train-rmse:2323.760181+0.310184	test-rmse:2323.757398+2.914969 
## [740]	train-rmse:2323.528442+0.310196	test-rmse:2323.525806+2.914911 
## [741]	train-rmse:2323.296435+0.310572	test-rmse:2323.294018+2.914800 
## [742]	train-rmse:2323.064722+0.310439	test-rmse:2323.062476+2.914685 
## [743]	train-rmse:2322.833862+0.310517	test-rmse:2322.830420+2.914548 
## [744]	train-rmse:2322.601904+0.310510	test-rmse:2322.598779+2.914305 
## [745]	train-rmse:2322.370044+0.310232	test-rmse:2322.367212+2.914667 
## [746]	train-rmse:2322.139478+0.310581	test-rmse:2322.135303+2.914503 
## [747]	train-rmse:2321.906836+0.309586	test-rmse:2321.903662+2.914178 
## [748]	train-rmse:2321.675732+0.309993	test-rmse:2321.672095+2.914063 
## [749]	train-rmse:2321.443164+0.310596	test-rmse:2321.440845+2.914339 
## [750]	train-rmse:2321.212036+0.309740	test-rmse:2321.209204+2.914140 
## [751]	train-rmse:2320.980469+0.310104	test-rmse:2320.977636+2.913993 
## [752]	train-rmse:2320.748730+0.309430	test-rmse:2320.746069+2.913637 
## [753]	train-rmse:2320.517505+0.310759	test-rmse:2320.514356+2.913492 
## [754]	train-rmse:2320.285669+0.310572	test-rmse:2320.282983+2.913650 
## [755]	train-rmse:2320.054370+0.310659	test-rmse:2320.051489+2.913845 
## [756]	train-rmse:2319.823511+0.309682	test-rmse:2319.819946+2.913411 
## [757]	train-rmse:2319.591748+0.310224	test-rmse:2319.588721+2.913322 
## [758]	train-rmse:2319.359863+0.309640	test-rmse:2319.357105+2.913341 
## [759]	train-rmse:2319.129394+0.309984	test-rmse:2319.125659+2.913284 
## [760]	train-rmse:2318.897314+0.310085	test-rmse:2318.894360+2.913224 
## [761]	train-rmse:2318.666699+0.309497	test-rmse:2318.663208+2.913009 
## [762]	train-rmse:2318.434595+0.309244	test-rmse:2318.431836+2.912954 
## [763]	train-rmse:2318.203833+0.309931	test-rmse:2318.200732+2.912747 
## [764]	train-rmse:2317.972485+0.310339	test-rmse:2317.969458+2.913111 
## [765]	train-rmse:2317.740503+0.309781	test-rmse:2317.738452+2.912501 
## [766]	train-rmse:2317.510107+0.310074	test-rmse:2317.506909+2.912750 
## [767]	train-rmse:2317.278345+0.309629	test-rmse:2317.275757+2.912407 
## [768]	train-rmse:2317.048047+0.309531	test-rmse:2317.044800+2.912533 
## [769]	train-rmse:2316.815991+0.308892	test-rmse:2316.813281+2.912211 
## [770]	train-rmse:2316.586450+0.309821	test-rmse:2316.582202+2.912225 
## [771]	train-rmse:2316.353784+0.309720	test-rmse:2316.351440+2.912304 
## [772]	train-rmse:2316.123413+0.309444	test-rmse:2316.120093+2.912104 
## [773]	train-rmse:2315.892090+0.309592	test-rmse:2315.889258+2.911920 
## [774]	train-rmse:2315.661060+0.309789	test-rmse:2315.658179+2.912025 
## [775]	train-rmse:2315.431250+0.309270	test-rmse:2315.427197+2.911740 
## [776]	train-rmse:2315.198462+0.309329	test-rmse:2315.196436+2.911531 
## [777]	train-rmse:2314.969385+0.309956	test-rmse:2314.964893+2.911556 
## [778]	train-rmse:2314.736816+0.308596	test-rmse:2314.734546+2.911315 
## [779]	train-rmse:2314.506860+0.309179	test-rmse:2314.503589+2.911461 
## [780]	train-rmse:2314.275073+0.308954	test-rmse:2314.272705+2.911202 
## [781]	train-rmse:2314.044946+0.309397	test-rmse:2314.041699+2.911569 
## [782]	train-rmse:2313.812769+0.309365	test-rmse:2313.810889+2.911089 
## [783]	train-rmse:2313.583179+0.309316	test-rmse:2313.580176+2.911316 
## [784]	train-rmse:2313.351172+0.309357	test-rmse:2313.349487+2.911088 
## [785]	train-rmse:2313.122217+0.309613	test-rmse:2313.118555+2.911237 
## [786]	train-rmse:2312.890234+0.309347	test-rmse:2312.887769+2.910978 
## [787]	train-rmse:2312.660840+0.308413	test-rmse:2312.657348+2.910892 
## [788]	train-rmse:2312.429077+0.309604	test-rmse:2312.426343+2.910563 
## [789]	train-rmse:2312.199048+0.308897	test-rmse:2312.195581+2.910586 
## [790]	train-rmse:2311.968115+0.309878	test-rmse:2311.965015+2.910375 
## [791]	train-rmse:2311.737744+0.309417	test-rmse:2311.734790+2.910034 
## [792]	train-rmse:2311.507007+0.309010	test-rmse:2311.503980+2.910529 
## [793]	train-rmse:2311.276953+0.309112	test-rmse:2311.273242+2.910378 
## [794]	train-rmse:2311.045874+0.308779	test-rmse:2311.042700+2.910319 
## [795]	train-rmse:2310.815479+0.308437	test-rmse:2310.812329+2.909764 
## [796]	train-rmse:2310.584839+0.309494	test-rmse:2310.581812+2.910027 
## [797]	train-rmse:2310.354199+0.308548	test-rmse:2310.351538+2.909922 
## [798]	train-rmse:2310.123779+0.309479	test-rmse:2310.120874+2.909835 
## [799]	train-rmse:2309.893701+0.308306	test-rmse:2309.890186+2.909904 
## [800]	train-rmse:2309.662891+0.309109	test-rmse:2309.659888+2.909597 
## [801]	train-rmse:2309.432983+0.309005	test-rmse:2309.429565+2.909351 
## [802]	train-rmse:2309.201807+0.308658	test-rmse:2309.199268+2.909356 
## [803]	train-rmse:2308.971558+0.309232	test-rmse:2308.968921+2.909481 
## [804]	train-rmse:2308.741089+0.308861	test-rmse:2308.738599+2.909039 
## [805]	train-rmse:2308.511938+0.308013	test-rmse:2308.508447+2.909025 
## [806]	train-rmse:2308.280176+0.308704	test-rmse:2308.277881+2.908941 
## [807]	train-rmse:2308.050757+0.308248	test-rmse:2308.047900+2.908949 
## [808]	train-rmse:2307.819800+0.308847	test-rmse:2307.817505+2.908960 
## [809]	train-rmse:2307.590454+0.308197	test-rmse:2307.587671+2.908760 
## [810]	train-rmse:2307.358862+0.308799	test-rmse:2307.357129+2.908826 
## [811]	train-rmse:2307.130029+0.308212	test-rmse:2307.127246+2.908426 
## [812]	train-rmse:2306.899072+0.308651	test-rmse:2306.896728+2.908547 
## [813]	train-rmse:2306.670117+0.308414	test-rmse:2306.666382+2.908420 
## [814]	train-rmse:2306.439844+0.308558	test-rmse:2306.436182+2.908102 
## [815]	train-rmse:2306.209717+0.307739	test-rmse:2306.206494+2.908243 
## [816]	train-rmse:2305.979761+0.308550	test-rmse:2305.976440+2.908202 
## [817]	train-rmse:2305.749756+0.307857	test-rmse:2305.746582+2.908305 
## [818]	train-rmse:2305.519458+0.307666	test-rmse:2305.516308+2.907944 
## [819]	train-rmse:2305.289356+0.307652	test-rmse:2305.286426+2.908066 
## [820]	train-rmse:2305.058984+0.307901	test-rmse:2305.056665+2.907703 
## [821]	train-rmse:2304.829443+0.308324	test-rmse:2304.826782+2.907963 
## [822]	train-rmse:2304.598755+0.307549	test-rmse:2304.596948+2.907686 
## [823]	train-rmse:2304.369092+0.307368	test-rmse:2304.366919+2.907505 
## [824]	train-rmse:2304.139795+0.307907	test-rmse:2304.136841+2.907483 
## [825]	train-rmse:2303.909326+0.307554	test-rmse:2303.907080+2.907252 
## [826]	train-rmse:2303.680762+0.307686	test-rmse:2303.677344+2.907041 
## [827]	train-rmse:2303.450439+0.307912	test-rmse:2303.447583+2.907174 
## [828]	train-rmse:2303.220972+0.308111	test-rmse:2303.217749+2.907104 
## [829]	train-rmse:2302.990527+0.307994	test-rmse:2302.987891+2.907451 
## [830]	train-rmse:2302.761182+0.308069	test-rmse:2302.758252+2.906847 
## [831]	train-rmse:2302.531738+0.307495	test-rmse:2302.528735+2.907086 
## [832]	train-rmse:2302.302881+0.308105	test-rmse:2302.298877+2.906851 
## [833]	train-rmse:2302.071460+0.306927	test-rmse:2302.069336+2.906540 
## [834]	train-rmse:2301.843457+0.307344	test-rmse:2301.839575+2.906510 
## [835]	train-rmse:2301.612476+0.307395	test-rmse:2301.610034+2.906695 
## [836]	train-rmse:2301.383789+0.307582	test-rmse:2301.380493+2.906702 
## [837]	train-rmse:2301.152734+0.307716	test-rmse:2301.150928+2.906139 
## [838]	train-rmse:2300.924341+0.308051	test-rmse:2300.920923+2.906250 
## [839]	train-rmse:2300.693555+0.307342	test-rmse:2300.691724+2.906109 
## [840]	train-rmse:2300.465674+0.307921	test-rmse:2300.462036+2.905782 
## [841]	train-rmse:2300.235278+0.306953	test-rmse:2300.232690+2.906011 
## [842]	train-rmse:2300.006470+0.307094	test-rmse:2300.003247+2.906122 
## [843]	train-rmse:2299.776611+0.307336	test-rmse:2299.773950+2.905929 
## [844]	train-rmse:2299.547510+0.306953	test-rmse:2299.544678+2.905740 
## [845]	train-rmse:2299.317749+0.306705	test-rmse:2299.315186+2.905797 
## [846]	train-rmse:2299.088477+0.307079	test-rmse:2299.086304+2.905315 
## [847]	train-rmse:2298.859277+0.306572	test-rmse:2298.856616+2.905339 
## [848]	train-rmse:2298.630200+0.306870	test-rmse:2298.627344+2.905331 
## [849]	train-rmse:2298.399927+0.306264	test-rmse:2298.398023+2.904932 
## [850]	train-rmse:2298.171997+0.307212	test-rmse:2298.168823+2.905156 
## [851]	train-rmse:2297.941357+0.307294	test-rmse:2297.939697+2.905082 
## [852]	train-rmse:2297.712939+0.307063	test-rmse:2297.710254+2.904980 
## [853]	train-rmse:2297.483374+0.306817	test-rmse:2297.481323+2.904781 
## [854]	train-rmse:2297.254517+0.307175	test-rmse:2297.252002+2.905016 
## [855]	train-rmse:2297.026025+0.306817	test-rmse:2297.022754+2.904593 
## [856]	train-rmse:2296.795776+0.307155	test-rmse:2296.793872+2.904663 
## [857]	train-rmse:2296.568018+0.307851	test-rmse:2296.564331+2.904594 
## [858]	train-rmse:2296.337476+0.307156	test-rmse:2296.335278+2.904460 
## [859]	train-rmse:2296.109863+0.307326	test-rmse:2296.106030+2.904064 
## [860]	train-rmse:2295.879468+0.306938	test-rmse:2295.877490+2.904336 
## [861]	train-rmse:2295.651001+0.306828	test-rmse:2295.648169+2.904108 
## [862]	train-rmse:2295.421851+0.306434	test-rmse:2295.419214+2.904022 
## [863]	train-rmse:2295.193017+0.306517	test-rmse:2295.190064+2.903979 
## [864]	train-rmse:2294.964404+0.307063	test-rmse:2294.961109+2.903735 
## [865]	train-rmse:2294.735132+0.306418	test-rmse:2294.732373+2.903578 
## [866]	train-rmse:2294.506738+0.307248	test-rmse:2294.503662+2.903532 
## [867]	train-rmse:2294.277124+0.305865	test-rmse:2294.274585+2.903412 
## [868]	train-rmse:2294.049170+0.307595	test-rmse:2294.045605+2.903506 
## [869]	train-rmse:2293.819019+0.306407	test-rmse:2293.816821+2.903337 
## [870]	train-rmse:2293.591651+0.307071	test-rmse:2293.588037+2.903148 
## [871]	train-rmse:2293.361426+0.305911	test-rmse:2293.359644+2.903221 
## [872]	train-rmse:2293.133692+0.306893	test-rmse:2293.130566+2.903045 
## [873]	train-rmse:2292.904175+0.306391	test-rmse:2292.901831+2.902887 
## [874]	train-rmse:2292.675903+0.306388	test-rmse:2292.673218+2.902715 
## [875]	train-rmse:2292.446997+0.306605	test-rmse:2292.444653+2.902755 
## [876]	train-rmse:2292.218848+0.306574	test-rmse:2292.215967+2.902896 
## [877]	train-rmse:2291.989111+0.305454	test-rmse:2291.987232+2.902648 
## [878]	train-rmse:2291.761401+0.306679	test-rmse:2291.758667+2.902706 
## [879]	train-rmse:2291.532715+0.306393	test-rmse:2291.529907+2.902337 
## [880]	train-rmse:2291.304346+0.306906	test-rmse:2291.301270+2.902260 
## [881]	train-rmse:2291.075049+0.306336	test-rmse:2291.072900+2.902293 
## [882]	train-rmse:2290.846948+0.306378	test-rmse:2290.844458+2.902264 
## [883]	train-rmse:2290.618164+0.306501	test-rmse:2290.615649+2.902109 
## [884]	train-rmse:2290.389648+0.306567	test-rmse:2290.387207+2.902126 
## [885]	train-rmse:2290.161743+0.305788	test-rmse:2290.158740+2.902039 
## [886]	train-rmse:2289.933618+0.306552	test-rmse:2289.930469+2.901703 
## [887]	train-rmse:2289.705298+0.304792	test-rmse:2289.702026+2.901659 
## [888]	train-rmse:2289.476636+0.305872	test-rmse:2289.473804+2.901539 
## [889]	train-rmse:2289.247876+0.306030	test-rmse:2289.245630+2.901707 
## [890]	train-rmse:2289.019385+0.305759	test-rmse:2289.017163+2.901573 
## [891]	train-rmse:2288.791553+0.305750	test-rmse:2288.789087+2.901320 
## [892]	train-rmse:2288.562427+0.305404	test-rmse:2288.560303+2.901104 
## [893]	train-rmse:2288.335083+0.305939	test-rmse:2288.331836+2.901157 
## [894]	train-rmse:2288.105420+0.305419	test-rmse:2288.103906+2.900937 
## [895]	train-rmse:2287.878564+0.305457	test-rmse:2287.875220+2.900744 
## [896]	train-rmse:2287.649731+0.304937	test-rmse:2287.647119+2.901028 
## [897]	train-rmse:2287.422192+0.305629	test-rmse:2287.418970+2.900918 
## [898]	train-rmse:2287.193799+0.304992	test-rmse:2287.190918+2.900765 
## [899]	train-rmse:2286.965186+0.305566	test-rmse:2286.962647+2.900734 
## [900]	train-rmse:2286.736914+0.305210	test-rmse:2286.734521+2.900598 
## [901]	train-rmse:2286.509204+0.305848	test-rmse:2286.506567+2.900400 
## [902]	train-rmse:2286.280981+0.305468	test-rmse:2286.278027+2.900238 
## [903]	train-rmse:2286.053247+0.306064	test-rmse:2286.050171+2.900521 
## [904]	train-rmse:2285.824780+0.305244	test-rmse:2285.822339+2.900083 
## [905]	train-rmse:2285.597827+0.305843	test-rmse:2285.594360+2.900296 
## [906]	train-rmse:2285.368384+0.304525	test-rmse:2285.366675+2.900048 
## [907]	train-rmse:2285.141504+0.305548	test-rmse:2285.138452+2.900422 
## [908]	train-rmse:2284.912891+0.305269	test-rmse:2284.910620+2.899871 
## [909]	train-rmse:2284.685058+0.305171	test-rmse:2284.682739+2.899766 
## [910]	train-rmse:2284.457617+0.304925	test-rmse:2284.454663+2.899686 
## [911]	train-rmse:2284.229297+0.305729	test-rmse:2284.226758+2.899467 
## [912]	train-rmse:2284.001880+0.304534	test-rmse:2283.998975+2.899302 
## [913]	train-rmse:2283.774024+0.305375	test-rmse:2283.771191+2.899304 
## [914]	train-rmse:2283.546338+0.304514	test-rmse:2283.543311+2.899191 
## [915]	train-rmse:2283.317847+0.304991	test-rmse:2283.315845+2.899241 
## [916]	train-rmse:2283.091309+0.304834	test-rmse:2283.087940+2.899214 
## [917]	train-rmse:2282.861768+0.304468	test-rmse:2282.860108+2.899059 
## [918]	train-rmse:2282.635352+0.305263	test-rmse:2282.632373+2.898924 
## [919]	train-rmse:2282.406909+0.304817	test-rmse:2282.404639+2.899138 
## [920]	train-rmse:2282.180273+0.305152	test-rmse:2282.176685+2.898911 
## [921]	train-rmse:2281.951758+0.305046	test-rmse:2281.949512+2.898561 
## [922]	train-rmse:2281.725147+0.304858	test-rmse:2281.722046+2.898747 
## [923]	train-rmse:2281.496997+0.304745	test-rmse:2281.494019+2.898548 
## [924]	train-rmse:2281.269531+0.304406	test-rmse:2281.266699+2.898302 
## [925]	train-rmse:2281.042749+0.304639	test-rmse:2281.038892+2.898328 
## [926]	train-rmse:2280.814722+0.304416	test-rmse:2280.811548+2.898374 
## [927]	train-rmse:2280.587305+0.304123	test-rmse:2280.584033+2.897988 
## [928]	train-rmse:2280.359424+0.304140	test-rmse:2280.356787+2.897998 
## [929]	train-rmse:2280.132276+0.304565	test-rmse:2280.129394+2.898086 
## [930]	train-rmse:2279.904053+0.305148	test-rmse:2279.901904+2.897927 
## [931]	train-rmse:2279.676953+0.303721	test-rmse:2279.674439+2.897722 
## [932]	train-rmse:2279.449121+0.304619	test-rmse:2279.446606+2.897737 
## [933]	train-rmse:2279.222534+0.303685	test-rmse:2279.219385+2.897538 
## [934]	train-rmse:2278.994287+0.305129	test-rmse:2278.992261+2.897640 
## [935]	train-rmse:2278.767334+0.303676	test-rmse:2278.764868+2.897586 
## [936]	train-rmse:2278.540210+0.304436	test-rmse:2278.537671+2.897413 
## [937]	train-rmse:2278.313428+0.303736	test-rmse:2278.310278+2.897283 
## [938]	train-rmse:2278.085181+0.304998	test-rmse:2278.083032+2.897280 
## [939]	train-rmse:2277.859521+0.303838	test-rmse:2277.855761+2.897366 
## [940]	train-rmse:2277.631152+0.304678	test-rmse:2277.628613+2.897214 
## [941]	train-rmse:2277.403760+0.304250	test-rmse:2277.401660+2.896653 
## [942]	train-rmse:2277.176855+0.305253	test-rmse:2277.174170+2.896798 
## [943]	train-rmse:2276.950024+0.303659	test-rmse:2276.947144+2.896531 
## [944]	train-rmse:2276.722363+0.304486	test-rmse:2276.719751+2.896721 
## [945]	train-rmse:2276.495483+0.303756	test-rmse:2276.492651+2.896786 
## [946]	train-rmse:2276.268286+0.304503	test-rmse:2276.265893+2.896666 
## [947]	train-rmse:2276.041358+0.303849	test-rmse:2276.038916+2.896229 
## [948]	train-rmse:2275.814014+0.304333	test-rmse:2275.811865+2.896250 
## [949]	train-rmse:2275.587158+0.303119	test-rmse:2275.584424+2.895930 
## [950]	train-rmse:2275.359643+0.304249	test-rmse:2275.357422+2.896272 
## [951]	train-rmse:2275.133545+0.303139	test-rmse:2275.130640+2.895951 
## [952]	train-rmse:2274.906226+0.303644	test-rmse:2274.903711+2.895810 
## [953]	train-rmse:2274.680029+0.303308	test-rmse:2274.676855+2.895697 
## [954]	train-rmse:2274.452246+0.303691	test-rmse:2274.449731+2.895811 
## [955]	train-rmse:2274.226318+0.303581	test-rmse:2274.223218+2.895847 
## [956]	train-rmse:2273.998511+0.304105	test-rmse:2273.996265+2.895574 
## [957]	train-rmse:2273.772607+0.303806	test-rmse:2273.769629+2.895108 
## [958]	train-rmse:2273.545215+0.304200	test-rmse:2273.542676+2.895593 
## [959]	train-rmse:2273.318677+0.303360	test-rmse:2273.315796+2.895365 
## [960]	train-rmse:2273.091626+0.304369	test-rmse:2273.089209+2.895043 
## [961]	train-rmse:2272.865356+0.303487	test-rmse:2272.862476+2.895336 
## [962]	train-rmse:2272.638110+0.304014	test-rmse:2272.635815+2.894987 
## [963]	train-rmse:2272.411694+0.303541	test-rmse:2272.408691+2.894839 
## [964]	train-rmse:2272.184399+0.303671	test-rmse:2272.181958+2.894792 
## [965]	train-rmse:2271.958691+0.304104	test-rmse:2271.955615+2.894912 
## [966]	train-rmse:2271.731079+0.303288	test-rmse:2271.729053+2.894676 
## [967]	train-rmse:2271.505737+0.304094	test-rmse:2271.502490+2.894468 
## [968]	train-rmse:2271.277588+0.303426	test-rmse:2271.275952+2.894671 
## [969]	train-rmse:2271.052246+0.304425	test-rmse:2271.049439+2.894732 
## [970]	train-rmse:2270.825610+0.302969	test-rmse:2270.822656+2.894455 
## [971]	train-rmse:2270.599243+0.303415	test-rmse:2270.596436+2.894233 
## [972]	train-rmse:2270.373023+0.302805	test-rmse:2270.370142+2.894296 
## [973]	train-rmse:2270.146509+0.303482	test-rmse:2270.143604+2.894053 
## [974]	train-rmse:2269.920117+0.302341	test-rmse:2269.917139+2.894050 
## [975]	train-rmse:2269.693311+0.303214	test-rmse:2269.690576+2.893976 
## [976]	train-rmse:2269.466895+0.302216	test-rmse:2269.464380+2.893980 
## [977]	train-rmse:2269.239893+0.302635	test-rmse:2269.237939+2.893762 
## [978]	train-rmse:2269.014868+0.302904	test-rmse:2269.011499+2.893637 
## [979]	train-rmse:2268.787036+0.303167	test-rmse:2268.785132+2.893353 
## [980]	train-rmse:2268.562280+0.303741	test-rmse:2268.558862+2.893446 
## [981]	train-rmse:2268.334790+0.302748	test-rmse:2268.332837+2.893551 
## [982]	train-rmse:2268.109107+0.303724	test-rmse:2268.106470+2.893639 
## [983]	train-rmse:2267.881982+0.302688	test-rmse:2267.880273+2.893288 
## [984]	train-rmse:2267.657202+0.303925	test-rmse:2267.653638+2.893207 
## [985]	train-rmse:2267.430127+0.302205	test-rmse:2267.427759+2.892729 
## [986]	train-rmse:2267.204883+0.303527	test-rmse:2267.201929+2.893158 
## [987]	train-rmse:2266.977026+0.302047	test-rmse:2266.975195+2.893050 
## [988]	train-rmse:2266.752734+0.303771	test-rmse:2266.749292+2.892799 
## [989]	train-rmse:2266.525830+0.302436	test-rmse:2266.523291+2.892680 
## [990]	train-rmse:2266.300317+0.303229	test-rmse:2266.296924+2.892576 
## [991]	train-rmse:2266.073828+0.302451	test-rmse:2266.070898+2.892535 
## [992]	train-rmse:2265.847144+0.302864	test-rmse:2265.845141+2.892472 
## [993]	train-rmse:2265.621851+0.303369	test-rmse:2265.619067+2.892393 
## [994]	train-rmse:2265.395044+0.302934	test-rmse:2265.392847+2.891870 
## [995]	train-rmse:2265.170312+0.302557	test-rmse:2265.166968+2.892178 
## [996]	train-rmse:2264.942895+0.302729	test-rmse:2264.941284+2.892189 
## [997]	train-rmse:2264.718188+0.302717	test-rmse:2264.715161+2.891721 
## [998]	train-rmse:2264.490820+0.301774	test-rmse:2264.489526+2.891835 
## [999]	train-rmse:2264.266431+0.302774	test-rmse:2264.263281+2.891725 
## [1000]	train-rmse:2264.038379+0.301099	test-rmse:2264.037695+2.891694 
## [1001]	train-rmse:2263.814404+0.302103	test-rmse:2263.811963+2.891722 
## [1002]	train-rmse:2263.588159+0.301345	test-rmse:2263.586182+2.891512 
## [1003]	train-rmse:2263.362769+0.302436	test-rmse:2263.360156+2.891257 
## [1004]	train-rmse:2263.137231+0.302244	test-rmse:2263.134204+2.891328 
## [1005]	train-rmse:2262.911645+0.302604	test-rmse:2262.908691+2.891157 
## [1006]	train-rmse:2262.686328+0.302088	test-rmse:2262.683154+2.891190 
## [1007]	train-rmse:2262.459961+0.302836	test-rmse:2262.457617+2.890944 
## [1008]	train-rmse:2262.234839+0.302452	test-rmse:2262.231885+2.890992 
## [1009]	train-rmse:2262.008740+0.302106	test-rmse:2262.006006+2.890806 
## [1010]	train-rmse:2261.782519+0.302561	test-rmse:2261.780225+2.890797 
## [1011]	train-rmse:2261.557495+0.303022	test-rmse:2261.554810+2.890785 
## [1012]	train-rmse:2261.330859+0.302309	test-rmse:2261.329395+2.890630 
## [1013]	train-rmse:2261.106738+0.302583	test-rmse:2261.103711+2.890438 
## [1014]	train-rmse:2260.880005+0.301641	test-rmse:2260.877881+2.890578 
## [1015]	train-rmse:2260.655713+0.302390	test-rmse:2260.652539+2.890191 
## [1016]	train-rmse:2260.429004+0.301918	test-rmse:2260.427246+2.890398 
## [1017]	train-rmse:2260.204517+0.301749	test-rmse:2260.201612+2.889982 
## [1018]	train-rmse:2259.978345+0.301466	test-rmse:2259.976392+2.889985 
## [1019]	train-rmse:2259.752930+0.301291	test-rmse:2259.750952+2.890288 
## [1020]	train-rmse:2259.527930+0.301804	test-rmse:2259.525537+2.889998 
## [1021]	train-rmse:2259.302930+0.301527	test-rmse:2259.300440+2.889803 
## [1022]	train-rmse:2259.076929+0.301845	test-rmse:2259.074658+2.889673 
## [1023]	train-rmse:2258.852490+0.301738	test-rmse:2258.849365+2.889752 
## [1024]	train-rmse:2258.626880+0.302121	test-rmse:2258.624097+2.889643 
## [1025]	train-rmse:2258.401318+0.301721	test-rmse:2258.398535+2.889244 
## [1026]	train-rmse:2258.175806+0.301765	test-rmse:2258.173682+2.889259 
## [1027]	train-rmse:2257.951050+0.301778	test-rmse:2257.948071+2.889329 
## [1028]	train-rmse:2257.725659+0.301935	test-rmse:2257.722803+2.889292 
## [1029]	train-rmse:2257.500928+0.302515	test-rmse:2257.497852+2.888951 
## [1030]	train-rmse:2257.275537+0.301158	test-rmse:2257.272754+2.889187 
## [1031]	train-rmse:2257.049927+0.301751	test-rmse:2257.047510+2.889031 
## [1032]	train-rmse:2256.825708+0.301208	test-rmse:2256.822290+2.888660 
## [1033]	train-rmse:2256.599341+0.301556	test-rmse:2256.597461+2.888837 
## [1034]	train-rmse:2256.375147+0.300899	test-rmse:2256.372021+2.888679 
## [1035]	train-rmse:2256.149487+0.301393	test-rmse:2256.147095+2.888545 
## [1036]	train-rmse:2255.924829+0.300574	test-rmse:2255.922192+2.888707 
## [1037]	train-rmse:2255.699707+0.301654	test-rmse:2255.696704+2.888469 
## [1038]	train-rmse:2255.475146+0.301631	test-rmse:2255.471875+2.888328 
## [1039]	train-rmse:2255.249731+0.301463	test-rmse:2255.246924+2.888354 
## [1040]	train-rmse:2255.024976+0.301760	test-rmse:2255.022168+2.888155 
## [1041]	train-rmse:2254.800537+0.301549	test-rmse:2254.797632+2.888051 
## [1042]	train-rmse:2254.575098+0.301480	test-rmse:2254.572388+2.888003 
## [1043]	train-rmse:2254.350635+0.300920	test-rmse:2254.347266+2.888132 
## [1044]	train-rmse:2254.125586+0.301578	test-rmse:2254.122608+2.887741 
## [1045]	train-rmse:2253.901123+0.301926	test-rmse:2253.897778+2.887898 
## [1046]	train-rmse:2253.676025+0.300763	test-rmse:2253.673291+2.887541 
## [1047]	train-rmse:2253.451270+0.301543	test-rmse:2253.448291+2.887636 
## [1048]	train-rmse:2253.225683+0.300474	test-rmse:2253.223560+2.887422 
## [1049]	train-rmse:2253.001953+0.301566	test-rmse:2252.998535+2.887441 
## [1050]	train-rmse:2252.776733+0.300362	test-rmse:2252.773657+2.887169 
## [1051]	train-rmse:2252.552539+0.301021	test-rmse:2252.549072+2.887119 
## [1052]	train-rmse:2252.327515+0.300482	test-rmse:2252.324658+2.887164 
## [1053]	train-rmse:2252.103272+0.301061	test-rmse:2252.100390+2.887007 
## [1054]	train-rmse:2251.878223+0.300855	test-rmse:2251.875439+2.886749 
## [1055]	train-rmse:2251.653809+0.300389	test-rmse:2251.650757+2.886913 
## [1056]	train-rmse:2251.428662+0.300467	test-rmse:2251.426123+2.886782 
## [1057]	train-rmse:2251.204468+0.301365	test-rmse:2251.201685+2.886751 
## [1058]	train-rmse:2250.979858+0.300633	test-rmse:2250.977026+2.886523 
## [1059]	train-rmse:2250.755591+0.301374	test-rmse:2250.752466+2.886462 
## [1060]	train-rmse:2250.530127+0.300177	test-rmse:2250.528027+2.886383 
## [1061]	train-rmse:2250.306470+0.301007	test-rmse:2250.303735+2.886371 
## [1062]	train-rmse:2250.081494+0.299884	test-rmse:2250.079028+2.886279 
## [1063]	train-rmse:2249.857398+0.301130	test-rmse:2249.854736+2.886017 
## [1064]	train-rmse:2249.632642+0.300086	test-rmse:2249.630054+2.886320 
## [1065]	train-rmse:2249.409399+0.301485	test-rmse:2249.405933+2.886010 
## [1066]	train-rmse:2249.183984+0.299907	test-rmse:2249.181225+2.885944 
## [1067]	train-rmse:2248.960351+0.300548	test-rmse:2248.957080+2.885977 
## [1068]	train-rmse:2248.735132+0.299754	test-rmse:2248.733130+2.885552 
## [1069]	train-rmse:2248.511841+0.299989	test-rmse:2248.508838+2.885499 
## [1070]	train-rmse:2248.286841+0.299458	test-rmse:2248.284546+2.885396 
## [1071]	train-rmse:2248.063550+0.300123	test-rmse:2248.059985+2.885624 
## [1072]	train-rmse:2247.838281+0.299628	test-rmse:2247.835913+2.885249 
## [1073]	train-rmse:2247.614697+0.300111	test-rmse:2247.611914+2.885202 
## [1074]	train-rmse:2247.389551+0.299261	test-rmse:2247.387671+2.885037 
## [1075]	train-rmse:2247.166260+0.300673	test-rmse:2247.163525+2.885145 
## [1076]	train-rmse:2246.941382+0.299826	test-rmse:2246.939526+2.884983 
## [1077]	train-rmse:2246.717773+0.301195	test-rmse:2246.715161+2.884864 
## [1078]	train-rmse:2246.494311+0.299991	test-rmse:2246.491040+2.884581 
## [1079]	train-rmse:2246.269629+0.300109	test-rmse:2246.266968+2.884665 
## [1080]	train-rmse:2246.045752+0.300043	test-rmse:2246.042847+2.884712 
## [1081]	train-rmse:2245.821069+0.300034	test-rmse:2245.818750+2.884808 
## [1082]	train-rmse:2245.598022+0.300351	test-rmse:2245.594873+2.884582 
## [1083]	train-rmse:2245.372949+0.300022	test-rmse:2245.371021+2.884493 
## [1084]	train-rmse:2245.149976+0.300287	test-rmse:2245.146997+2.884505 
## [1085]	train-rmse:2244.924902+0.299793	test-rmse:2244.923120+2.884412 
## [1086]	train-rmse:2244.701855+0.300473	test-rmse:2244.699072+2.884146 
## [1087]	train-rmse:2244.477393+0.299716	test-rmse:2244.475195+2.883942 
## [1088]	train-rmse:2244.253980+0.299946	test-rmse:2244.251489+2.884161 
## [1089]	train-rmse:2244.029761+0.299553	test-rmse:2244.027295+2.883868 
## [1090]	train-rmse:2243.806323+0.299403	test-rmse:2243.803760+2.883730 
## [1091]	train-rmse:2243.582397+0.299766	test-rmse:2243.579932+2.883508 
## [1092]	train-rmse:2243.358764+0.299271	test-rmse:2243.356250+2.883429 
## [1093]	train-rmse:2243.135229+0.299576	test-rmse:2243.132422+2.883349 
## [1094]	train-rmse:2242.911304+0.298898	test-rmse:2242.908447+2.883528 
## [1095]	train-rmse:2242.687939+0.299250	test-rmse:2242.685059+2.883441 
## [1096]	train-rmse:2242.463745+0.299354	test-rmse:2242.461133+2.883423 
## [1097]	train-rmse:2242.239795+0.299755	test-rmse:2242.237866+2.882971 
## [1098]	train-rmse:2242.016480+0.300203	test-rmse:2242.014038+2.882943 
## [1099]	train-rmse:2241.792993+0.300018	test-rmse:2241.790357+2.883009 
## [1100]	train-rmse:2241.569458+0.299966	test-rmse:2241.566675+2.882898 
## [1101]	train-rmse:2241.346240+0.299514	test-rmse:2241.343432+2.882737 
## [1102]	train-rmse:2241.122388+0.299910	test-rmse:2241.119434+2.882572 
## [1103]	train-rmse:2240.898730+0.299158	test-rmse:2240.896069+2.882580 
## [1104]	train-rmse:2240.674536+0.299288	test-rmse:2240.672437+2.882304 
## [1105]	train-rmse:2240.451929+0.299080	test-rmse:2240.448950+2.882468 
## [1106]	train-rmse:2240.227124+0.299145	test-rmse:2240.225610+2.882271 
## [1107]	train-rmse:2240.004297+0.299338	test-rmse:2240.002026+2.881921 
## [1108]	train-rmse:2239.780835+0.298461	test-rmse:2239.778589+2.882194 
## [1109]	train-rmse:2239.557861+0.299726	test-rmse:2239.554981+2.882167 
## [1110]	train-rmse:2239.335034+0.298481	test-rmse:2239.331812+2.882339 
## [1111]	train-rmse:2239.111182+0.298845	test-rmse:2239.108325+2.882013 
## [1112]	train-rmse:2238.889087+0.298188	test-rmse:2238.885303+2.881853 
## [1113]	train-rmse:2238.664575+0.298935	test-rmse:2238.662158+2.881550 
## [1114]	train-rmse:2238.441602+0.298896	test-rmse:2238.438525+2.881719 
## [1115]	train-rmse:2238.217896+0.298664	test-rmse:2238.215259+2.881402 
## [1116]	train-rmse:2237.995313+0.299081	test-rmse:2237.992016+2.881405 
## [1117]	train-rmse:2237.771240+0.298155	test-rmse:2237.768945+2.881001 
## [1118]	train-rmse:2237.548413+0.299356	test-rmse:2237.545801+2.881124 
## [1119]	train-rmse:2237.325464+0.298444	test-rmse:2237.322363+2.881067 
## [1120]	train-rmse:2237.101685+0.299074	test-rmse:2237.099658+2.881080 
## [1121]	train-rmse:2236.878906+0.298598	test-rmse:2236.876269+2.880952 
## [1122]	train-rmse:2236.655517+0.298874	test-rmse:2236.653101+2.880999 
## [1123]	train-rmse:2236.433423+0.298981	test-rmse:2236.430078+2.881071 
## [1124]	train-rmse:2236.209961+0.298963	test-rmse:2236.207056+2.880694 
## [1125]	train-rmse:2235.986621+0.298699	test-rmse:2235.984155+2.880702 
## [1126]	train-rmse:2235.763721+0.298948	test-rmse:2235.761279+2.880376 
## [1127]	train-rmse:2235.540479+0.298469	test-rmse:2235.538062+2.880261 
## [1128]	train-rmse:2235.318310+0.298494	test-rmse:2235.315088+2.880149 
## [1129]	train-rmse:2235.094092+0.298174	test-rmse:2235.092115+2.880402 
## [1130]	train-rmse:2234.871851+0.299193	test-rmse:2234.869092+2.880072 
## [1131]	train-rmse:2234.648975+0.297552	test-rmse:2234.646216+2.880194 
## [1132]	train-rmse:2234.426147+0.298937	test-rmse:2234.423340+2.879836 
## [1133]	train-rmse:2234.203369+0.298479	test-rmse:2234.200342+2.879987 
## [1134]	train-rmse:2233.980225+0.298418	test-rmse:2233.977661+2.880085 
## [1135]	train-rmse:2233.758252+0.297466	test-rmse:2233.754956+2.880088 
## [1136]	train-rmse:2233.534961+0.298417	test-rmse:2233.532349+2.879543 
## [1137]	train-rmse:2233.312671+0.297578	test-rmse:2233.309399+2.879687 
## [1138]	train-rmse:2233.089063+0.298521	test-rmse:2233.086621+2.879444 
## [1139]	train-rmse:2232.866894+0.297513	test-rmse:2232.863867+2.879486 
## [1140]	train-rmse:2232.644043+0.298426	test-rmse:2232.641528+2.879140 
## [1141]	train-rmse:2232.420605+0.297593	test-rmse:2232.418481+2.879202 
## [1142]	train-rmse:2232.198853+0.298143	test-rmse:2232.195947+2.879116 
## [1143]	train-rmse:2231.975220+0.297467	test-rmse:2231.973218+2.879220 
## [1144]	train-rmse:2231.753833+0.297791	test-rmse:2231.750586+2.878842 
## [1145]	train-rmse:2231.529907+0.297486	test-rmse:2231.527857+2.878552 
## [1146]	train-rmse:2231.309204+0.298130	test-rmse:2231.305371+2.878422 
## [1147]	train-rmse:2231.085425+0.297399	test-rmse:2231.082861+2.878679 
## [1148]	train-rmse:2230.863672+0.297943	test-rmse:2230.860327+2.878804 
## [1149]	train-rmse:2230.640112+0.297249	test-rmse:2230.637720+2.878759 
## [1150]	train-rmse:2230.418774+0.298058	test-rmse:2230.415625+2.878396 
## [1151]	train-rmse:2230.195581+0.296931	test-rmse:2230.192871+2.878389 
## [1152]	train-rmse:2229.973535+0.297677	test-rmse:2229.970483+2.878480 
## [1153]	train-rmse:2229.750855+0.297864	test-rmse:2229.747876+2.878437 
## [1154]	train-rmse:2229.528687+0.298274	test-rmse:2229.525488+2.878040 
## [1155]	train-rmse:2229.305713+0.298256	test-rmse:2229.303052+2.877929 
## [1156]	train-rmse:2229.083520+0.298341	test-rmse:2229.080884+2.877727 
## [1157]	train-rmse:2228.860205+0.297745	test-rmse:2228.858594+2.877951 
## [1158]	train-rmse:2228.638818+0.297559	test-rmse:2228.636426+2.877931 
## [1159]	train-rmse:2228.415894+0.297388	test-rmse:2228.414136+2.877740 
## [1160]	train-rmse:2228.194702+0.297803	test-rmse:2228.191821+2.877741 
## [1161]	train-rmse:2227.971338+0.297162	test-rmse:2227.969605+2.877609 
## [1162]	train-rmse:2227.750293+0.298173	test-rmse:2227.747046+2.877603 
## [1163]	train-rmse:2227.527612+0.297382	test-rmse:2227.525220+2.877403 
## [1164]	train-rmse:2227.305957+0.298312	test-rmse:2227.303027+2.877078 
## [1165]	train-rmse:2227.083667+0.297268	test-rmse:2227.080762+2.877156 
## [1166]	train-rmse:2226.860889+0.297421	test-rmse:2226.858691+2.877299 
## [1167]	train-rmse:2226.639477+0.297040	test-rmse:2226.636719+2.877173 
## [1168]	train-rmse:2226.416528+0.297561	test-rmse:2226.414624+2.876949 
## [1169]	train-rmse:2226.195654+0.296942	test-rmse:2226.192383+2.877137 
## [1170]	train-rmse:2225.972168+0.297529	test-rmse:2225.970679+2.876595 
## [1171]	train-rmse:2225.751098+0.297152	test-rmse:2225.748315+2.876525 
## [1172]	train-rmse:2225.529566+0.297850	test-rmse:2225.526514+2.876676 
## [1173]	train-rmse:2225.306983+0.297318	test-rmse:2225.304492+2.876513 
## [1174]	train-rmse:2225.085352+0.297112	test-rmse:2225.082373+2.876197 
## [1175]	train-rmse:2224.862378+0.296655	test-rmse:2224.860547+2.876289 
## [1176]	train-rmse:2224.642163+0.297617	test-rmse:2224.638574+2.876408 
## [1177]	train-rmse:2224.418311+0.296409	test-rmse:2224.416846+2.876067 
## [1178]	train-rmse:2224.198877+0.297607	test-rmse:2224.194775+2.876245 
## [1179]	train-rmse:2223.974976+0.296327	test-rmse:2223.973047+2.875941 
## [1180]	train-rmse:2223.754150+0.297374	test-rmse:2223.751489+2.875914 
## [1181]	train-rmse:2223.531177+0.296941	test-rmse:2223.529590+2.875740 
## [1182]	train-rmse:2223.309692+0.297668	test-rmse:2223.307764+2.875678 
## [1183]	train-rmse:2223.088623+0.296726	test-rmse:2223.085645+2.875571 
## [1184]	train-rmse:2222.866357+0.296933	test-rmse:2222.864380+2.875662 
## [1185]	train-rmse:2222.645898+0.296256	test-rmse:2222.642871+2.875692 
## [1186]	train-rmse:2222.423267+0.296597	test-rmse:2222.420728+2.875350 
## [1187]	train-rmse:2222.202344+0.296956	test-rmse:2222.199243+2.875143 
## [1188]	train-rmse:2221.980347+0.296772	test-rmse:2221.977490+2.875163 
## [1189]	train-rmse:2221.758325+0.297102	test-rmse:2221.755884+2.874763 
## [1190]	train-rmse:2221.537500+0.297020	test-rmse:2221.534131+2.875155 
## [1191]	train-rmse:2221.315332+0.296766	test-rmse:2221.312573+2.874782 
## [1192]	train-rmse:2221.093726+0.296876	test-rmse:2221.091089+2.874946 
## [1193]	train-rmse:2220.872144+0.296407	test-rmse:2220.869726+2.874983 
## [1194]	train-rmse:2220.651562+0.296994	test-rmse:2220.648340+2.874833 
## [1195]	train-rmse:2220.429663+0.296789	test-rmse:2220.426855+2.874571 
## [1196]	train-rmse:2220.208301+0.295642	test-rmse:2220.205371+2.874589 
## [1197]	train-rmse:2219.985864+0.296532	test-rmse:2219.983813+2.874571 
## [1198]	train-rmse:2219.765210+0.295956	test-rmse:2219.762476+2.874565 
## [1199]	train-rmse:2219.543042+0.296283	test-rmse:2219.540918+2.874452 
## [1200]	train-rmse:2219.321924+0.296411	test-rmse:2219.319653+2.874173 
## [1201]	train-rmse:2219.100439+0.296494	test-rmse:2219.098413+2.874075 
## [1202]	train-rmse:2218.879492+0.296311	test-rmse:2218.876709+2.873900 
## [1203]	train-rmse:2218.658496+0.296095	test-rmse:2218.655762+2.874054 
## [1204]	train-rmse:2218.436621+0.296477	test-rmse:2218.434546+2.873819 
## [1205]	train-rmse:2218.215772+0.296257	test-rmse:2218.213257+2.873452 
## [1206]	train-rmse:2217.994067+0.295935	test-rmse:2217.991773+2.873351 
## [1207]	train-rmse:2217.773926+0.296075	test-rmse:2217.770850+2.873632 
## [1208]	train-rmse:2217.552051+0.296236	test-rmse:2217.549390+2.873143 
## [1209]	train-rmse:2217.331616+0.296173	test-rmse:2217.328271+2.873020 
## [1210]	train-rmse:2217.109692+0.296649	test-rmse:2217.106982+2.873144 
## [1211]	train-rmse:2216.890015+0.296221	test-rmse:2216.886157+2.873386 
## [1212]	train-rmse:2216.667383+0.296033	test-rmse:2216.665015+2.873287 
## [1213]	train-rmse:2216.446924+0.295668	test-rmse:2216.443726+2.872911 
## [1214]	train-rmse:2216.224463+0.296364	test-rmse:2216.222705+2.872684 
## [1215]	train-rmse:2216.004468+0.295173	test-rmse:2216.001831+2.872519 
## [1216]	train-rmse:2215.782983+0.296766	test-rmse:2215.780591+2.872789 
## [1217]	train-rmse:2215.561890+0.295711	test-rmse:2215.559912+2.872673 
## [1218]	train-rmse:2215.341821+0.296580	test-rmse:2215.339038+2.872293 
## [1219]	train-rmse:2215.119849+0.295537	test-rmse:2215.117700+2.872464 
## [1220]	train-rmse:2214.899829+0.296195	test-rmse:2214.896728+2.872543 
## [1221]	train-rmse:2214.678125+0.296166	test-rmse:2214.675903+2.872407 
## [1222]	train-rmse:2214.457813+0.296147	test-rmse:2214.455273+2.872274 
## [1223]	train-rmse:2214.236743+0.295571	test-rmse:2214.234595+2.872045 
## [1224]	train-rmse:2214.015674+0.295570	test-rmse:2214.013452+2.872471 
## [1225]	train-rmse:2213.795654+0.295737	test-rmse:2213.792798+2.872073 
## [1226]	train-rmse:2213.574097+0.295109	test-rmse:2213.571729+2.871676 
## [1227]	train-rmse:2213.354419+0.295829	test-rmse:2213.351245+2.871693 
## [1228]	train-rmse:2213.132520+0.295490	test-rmse:2213.130005+2.871643 
## [1229]	train-rmse:2212.912085+0.295630	test-rmse:2212.909717+2.871464 
## [1230]	train-rmse:2212.691016+0.295428	test-rmse:2212.688916+2.871246 
## [1231]	train-rmse:2212.470654+0.295382	test-rmse:2212.467895+2.871251 
## [1232]	train-rmse:2212.249878+0.295975	test-rmse:2212.247388+2.871401 
## [1233]	train-rmse:2212.028540+0.295153	test-rmse:2212.026953+2.871377 
## [1234]	train-rmse:2211.809155+0.295631	test-rmse:2211.806494+2.870998 
## [1235]	train-rmse:2211.587598+0.295029	test-rmse:2211.585547+2.871147 
## [1236]	train-rmse:2211.368091+0.295715	test-rmse:2211.365039+2.871152 
## [1237]	train-rmse:2211.147144+0.295162	test-rmse:2211.144458+2.870898 
## [1238]	train-rmse:2210.927197+0.295133	test-rmse:2210.924023+2.870753 
## [1239]	train-rmse:2210.706543+0.295638	test-rmse:2210.703540+2.870623 
## [1240]	train-rmse:2210.485498+0.294943	test-rmse:2210.482666+2.870651 
## [1241]	train-rmse:2210.265405+0.294887	test-rmse:2210.262427+2.870596 
## [1242]	train-rmse:2210.044238+0.294838	test-rmse:2210.041895+2.870438 
## [1243]	train-rmse:2209.824341+0.295033	test-rmse:2209.821680+2.870211 
## [1244]	train-rmse:2209.603809+0.295218	test-rmse:2209.601074+2.869886 
## [1245]	train-rmse:2209.384595+0.294503	test-rmse:2209.380957+2.870121 
## [1246]	train-rmse:2209.163208+0.295691	test-rmse:2209.160327+2.870071 
## [1247]	train-rmse:2208.943213+0.294125	test-rmse:2208.940039+2.869866 
## [1248]	train-rmse:2208.723511+0.295481	test-rmse:2208.720068+2.869996 
## [1249]	train-rmse:2208.502442+0.294080	test-rmse:2208.499561+2.870115 
## [1250]	train-rmse:2208.283032+0.295321	test-rmse:2208.279443+2.869498 
## [1251]	train-rmse:2208.061255+0.294105	test-rmse:2208.059131+2.869450 
## [1252]	train-rmse:2207.841895+0.294940	test-rmse:2207.838916+2.869306 
## [1253]	train-rmse:2207.620996+0.294839	test-rmse:2207.618604+2.869546 
## [1254]	train-rmse:2207.401563+0.294977	test-rmse:2207.398413+2.869203 
## [1255]	train-rmse:2207.180859+0.294978	test-rmse:2207.178271+2.869221 
## [1256]	train-rmse:2206.961694+0.294495	test-rmse:2206.958301+2.869447 
## [1257]	train-rmse:2206.741358+0.294946	test-rmse:2206.737940+2.869079 
## [1258]	train-rmse:2206.521094+0.294242	test-rmse:2206.518091+2.869204 
## [1259]	train-rmse:2206.300562+0.294852	test-rmse:2206.298096+2.868987 
## [1260]	train-rmse:2206.081470+0.294077	test-rmse:2206.078027+2.868790 
## [1261]	train-rmse:2205.860522+0.294390	test-rmse:2205.857910+2.868872 
## [1262]	train-rmse:2205.640259+0.294311	test-rmse:2205.638013+2.868602 
## [1263]	train-rmse:2205.420435+0.294328	test-rmse:2205.418140+2.868586 
## [1264]	train-rmse:2205.200659+0.294734	test-rmse:2205.198071+2.868382 
## [1265]	train-rmse:2204.980786+0.293816	test-rmse:2204.977954+2.868499 
## [1266]	train-rmse:2204.760718+0.294223	test-rmse:2204.758081+2.868344 
## [1267]	train-rmse:2204.541650+0.294160	test-rmse:2204.538281+2.868399 
## [1268]	train-rmse:2204.320703+0.294102	test-rmse:2204.318384+2.868061 
## [1269]	train-rmse:2204.101611+0.294115	test-rmse:2204.098511+2.867899 
## [1270]	train-rmse:2203.881421+0.293729	test-rmse:2203.878784+2.868123 
## [1271]	train-rmse:2203.661865+0.293672	test-rmse:2203.658911+2.867742 
## [1272]	train-rmse:2203.442139+0.293818	test-rmse:2203.439038+2.867466 
## [1273]	train-rmse:2203.222534+0.294260	test-rmse:2203.219531+2.867675 
## [1274]	train-rmse:2203.002393+0.294084	test-rmse:2202.999780+2.867475 
## [1275]	train-rmse:2202.782959+0.293892	test-rmse:2202.780078+2.867809 
## [1276]	train-rmse:2202.562720+0.293309	test-rmse:2202.560327+2.867261 
## [1277]	train-rmse:2202.343115+0.294585	test-rmse:2202.340772+2.867434 
## [1278]	train-rmse:2202.124024+0.293597	test-rmse:2202.120898+2.867203 
## [1279]	train-rmse:2201.903833+0.294153	test-rmse:2201.901514+2.867215 
## [1280]	train-rmse:2201.684936+0.293894	test-rmse:2201.681543+2.867085 
## [1281]	train-rmse:2201.464600+0.294382	test-rmse:2201.462110+2.867182 
## [1282]	train-rmse:2201.245923+0.294094	test-rmse:2201.242505+2.866739 
## [1283]	train-rmse:2201.025000+0.293956	test-rmse:2201.023340+2.867023 
## [1284]	train-rmse:2200.806738+0.294718	test-rmse:2200.803638+2.867067 
## [1285]	train-rmse:2200.586938+0.293444	test-rmse:2200.583911+2.866767 
## [1286]	train-rmse:2200.367114+0.294321	test-rmse:2200.364429+2.866519 
## [1287]	train-rmse:2200.148169+0.293407	test-rmse:2200.145190+2.866578 
## [1288]	train-rmse:2199.928735+0.294994	test-rmse:2199.925708+2.866501 
## [1289]	train-rmse:2199.708935+0.293670	test-rmse:2199.706225+2.866449 
## [1290]	train-rmse:2199.489893+0.293986	test-rmse:2199.486816+2.866065 
## [1291]	train-rmse:2199.270386+0.293445	test-rmse:2199.267627+2.866064 
## [1292]	train-rmse:2199.050879+0.293430	test-rmse:2199.048291+2.866343 
## [1293]	train-rmse:2198.830420+0.293289	test-rmse:2198.828955+2.866187 
## [1294]	train-rmse:2198.612695+0.293209	test-rmse:2198.609863+2.866037 
## [1295]	train-rmse:2198.391650+0.293702	test-rmse:2198.389990+2.865512 
## [1296]	train-rmse:2198.174390+0.293453	test-rmse:2198.171094+2.865907 
## [1297]	train-rmse:2197.953394+0.293763	test-rmse:2197.952051+2.865550 
## [1298]	train-rmse:2197.735693+0.294076	test-rmse:2197.732593+2.865578 
## [1299]	train-rmse:2197.515918+0.292465	test-rmse:2197.513501+2.865756 
## [1300]	train-rmse:2197.297168+0.293727	test-rmse:2197.294238+2.865413 
## [1301]	train-rmse:2197.078369+0.292234	test-rmse:2197.074829+2.865149 
## [1302]	train-rmse:2196.857910+0.293941	test-rmse:2196.856421+2.865433 
## [1303]	train-rmse:2196.640088+0.292454	test-rmse:2196.637109+2.865104 
## [1304]	train-rmse:2196.419678+0.293197	test-rmse:2196.417774+2.865201 
## [1305]	train-rmse:2196.201367+0.293202	test-rmse:2196.198706+2.864791 
## [1306]	train-rmse:2195.981885+0.292625	test-rmse:2195.979639+2.864946 
## [1307]	train-rmse:2195.763086+0.293986	test-rmse:2195.760840+2.864922 
## [1308]	train-rmse:2195.544116+0.292785	test-rmse:2195.541724+2.864713 
## [1309]	train-rmse:2195.324927+0.294058	test-rmse:2195.322754+2.864804 
## [1310]	train-rmse:2195.107129+0.292939	test-rmse:2195.103809+2.864837 
## [1311]	train-rmse:2194.886426+0.292873	test-rmse:2194.884790+2.864720 
## [1312]	train-rmse:2194.669922+0.292757	test-rmse:2194.666016+2.864316 
## [1313]	train-rmse:2194.449194+0.292940	test-rmse:2194.446973+2.864556 
## [1314]	train-rmse:2194.230981+0.293809	test-rmse:2194.228223+2.863952 
## [1315]	train-rmse:2194.012109+0.292314	test-rmse:2194.009473+2.864085 
## [1316]	train-rmse:2193.792700+0.293243	test-rmse:2193.790820+2.863994 
## [1317]	train-rmse:2193.575415+0.292265	test-rmse:2193.571826+2.863820 
## [1318]	train-rmse:2193.354492+0.293070	test-rmse:2193.353149+2.864047 
## [1319]	train-rmse:2193.138086+0.292422	test-rmse:2193.134131+2.863717 
## [1320]	train-rmse:2192.916602+0.291581	test-rmse:2192.915649+2.863726 
## [1321]	train-rmse:2192.699951+0.293404	test-rmse:2192.697314+2.863695 
## [1322]	train-rmse:2192.480762+0.291803	test-rmse:2192.478516+2.863540 
## [1323]	train-rmse:2192.262012+0.293571	test-rmse:2192.259522+2.863401 
## [1324]	train-rmse:2192.043603+0.292066	test-rmse:2192.040894+2.863324 
## [1325]	train-rmse:2191.823950+0.293110	test-rmse:2191.822266+2.863216 
## [1326]	train-rmse:2191.606836+0.292210	test-rmse:2191.603833+2.862996 
## [1327]	train-rmse:2191.386402+0.293083	test-rmse:2191.385034+2.863054 
## [1328]	train-rmse:2191.169580+0.293027	test-rmse:2191.166772+2.862882 
## [1329]	train-rmse:2190.950586+0.292425	test-rmse:2190.948145+2.862963 
## [1330]	train-rmse:2190.732422+0.292667	test-rmse:2190.729761+2.862885 
## [1331]	train-rmse:2190.513745+0.292584	test-rmse:2190.511133+2.862652 
## [1332]	train-rmse:2190.294727+0.293019	test-rmse:2190.292407+2.862844 
## [1333]	train-rmse:2190.077441+0.291615	test-rmse:2190.074121+2.862711 
## [1334]	train-rmse:2189.857153+0.291701	test-rmse:2189.855811+2.862528 
## [1335]	train-rmse:2189.640918+0.292577	test-rmse:2189.637524+2.862573 
## [1336]	train-rmse:2189.420728+0.291895	test-rmse:2189.419165+2.862145 
## [1337]	train-rmse:2189.204272+0.292904	test-rmse:2189.200904+2.862072 
## [1338]	train-rmse:2188.984741+0.291992	test-rmse:2188.982397+2.862157 
## [1339]	train-rmse:2188.767114+0.292875	test-rmse:2188.763745+2.862164 
## [1340]	train-rmse:2188.548145+0.291140	test-rmse:2188.546069+2.862297 
## [1341]	train-rmse:2188.330249+0.292212	test-rmse:2188.327393+2.861733 
## [1342]	train-rmse:2188.111914+0.292710	test-rmse:2188.109204+2.862182 
## [1343]	train-rmse:2187.893701+0.291365	test-rmse:2187.891016+2.861891 
## [1344]	train-rmse:2187.675806+0.292735	test-rmse:2187.672827+2.861922 
## [1345]	train-rmse:2187.457129+0.292150	test-rmse:2187.454590+2.861449 
## [1346]	train-rmse:2187.238599+0.292311	test-rmse:2187.236768+2.861246 
## [1347]	train-rmse:2187.021143+0.291343	test-rmse:2187.018360+2.861467 
## [1348]	train-rmse:2186.802295+0.291714	test-rmse:2186.800391+2.861283 
## [1349]	train-rmse:2186.585181+0.291703	test-rmse:2186.582324+2.861036 
## [1350]	train-rmse:2186.366284+0.292032	test-rmse:2186.364136+2.860863 
## [1351]	train-rmse:2186.149097+0.292109	test-rmse:2186.145752+2.861101 
## [1352]	train-rmse:2185.929858+0.291766	test-rmse:2185.928052+2.860904 
## [1353]	train-rmse:2185.713086+0.292347	test-rmse:2185.709741+2.860867 
## [1354]	train-rmse:2185.494507+0.291247	test-rmse:2185.491919+2.860572 
## [1355]	train-rmse:2185.276831+0.292105	test-rmse:2185.273950+2.861070 
## [1356]	train-rmse:2185.058154+0.291297	test-rmse:2185.056299+2.860596 
## [1357]	train-rmse:2184.841016+0.291931	test-rmse:2184.838135+2.860630 
## [1358]	train-rmse:2184.623144+0.291787	test-rmse:2184.620215+2.860416 
## [1359]	train-rmse:2184.404761+0.292231	test-rmse:2184.402344+2.860381 
## [1360]	train-rmse:2184.186645+0.291510	test-rmse:2184.184766+2.860291 
## [1361]	train-rmse:2183.969726+0.291305	test-rmse:2183.966675+2.860251 
## [1362]	train-rmse:2183.751514+0.291430	test-rmse:2183.749072+2.860022 
## [1363]	train-rmse:2183.533350+0.291154	test-rmse:2183.531519+2.859900 
## [1364]	train-rmse:2183.315918+0.290993	test-rmse:2183.313623+2.859849 
## [1365]	train-rmse:2183.097949+0.291053	test-rmse:2183.095459+2.859954 
## [1366]	train-rmse:2182.880737+0.292111	test-rmse:2182.878125+2.859654 
## [1367]	train-rmse:2182.662256+0.291039	test-rmse:2182.660083+2.859684 
## [1368]	train-rmse:2182.445288+0.291579	test-rmse:2182.442554+2.859320 
## [1369]	train-rmse:2182.226489+0.291032	test-rmse:2182.224976+2.859555 
## [1370]	train-rmse:2182.010352+0.291730	test-rmse:2182.007276+2.859294 
## [1371]	train-rmse:2181.792969+0.290218	test-rmse:2181.789697+2.859357 
## [1372]	train-rmse:2181.575293+0.291534	test-rmse:2181.572119+2.859199 
## [1373]	train-rmse:2181.357642+0.291493	test-rmse:2181.354370+2.859222 
## [1374]	train-rmse:2181.139282+0.290785	test-rmse:2181.136890+2.859058 
## [1375]	train-rmse:2180.922217+0.290992	test-rmse:2180.919360+2.859140 
## [1376]	train-rmse:2180.703784+0.290788	test-rmse:2180.701953+2.858914 
## [1377]	train-rmse:2180.486328+0.290944	test-rmse:2180.484229+2.858865 
## [1378]	train-rmse:2180.270019+0.290851	test-rmse:2180.266846+2.859023 
## [1379]	train-rmse:2180.051123+0.290896	test-rmse:2180.049536+2.858439 
## [1380]	train-rmse:2179.835693+0.290584	test-rmse:2179.832129+2.858300 
## [1381]	train-rmse:2179.616577+0.291366	test-rmse:2179.614893+2.858408 
## [1382]	train-rmse:2179.401489+0.290568	test-rmse:2179.397290+2.858318 
## [1383]	train-rmse:2179.181665+0.290714	test-rmse:2179.180005+2.858248 
## [1384]	train-rmse:2178.966138+0.290690	test-rmse:2178.962231+2.858216 
## [1385]	train-rmse:2178.748071+0.290949	test-rmse:2178.745483+2.857958 
## [1386]	train-rmse:2178.530566+0.290550	test-rmse:2178.528271+2.858105 
## [1387]	train-rmse:2178.314526+0.291012	test-rmse:2178.310767+2.858011 
## [1388]	train-rmse:2178.095508+0.290645	test-rmse:2178.093603+2.858047 
## [1389]	train-rmse:2177.880127+0.290810	test-rmse:2177.876367+2.857980 
## [1390]	train-rmse:2177.660767+0.290449	test-rmse:2177.659229+2.857558 
## [1391]	train-rmse:2177.444897+0.291373	test-rmse:2177.442114+2.857555 
## [1392]	train-rmse:2177.228003+0.290476	test-rmse:2177.224805+2.857577 
## [1393]	train-rmse:2177.010352+0.290404	test-rmse:2177.007495+2.857319 
## [1394]	train-rmse:2176.794287+0.291056	test-rmse:2176.790796+2.857296 
## [1395]	train-rmse:2176.575415+0.290161	test-rmse:2176.573364+2.857070 
## [1396]	train-rmse:2176.359668+0.290230	test-rmse:2176.356226+2.857200 
## [1397]	train-rmse:2176.141748+0.290248	test-rmse:2176.139282+2.857155 
## [1398]	train-rmse:2175.924780+0.290584	test-rmse:2175.922241+2.857051 
## [1399]	train-rmse:2175.708105+0.290124	test-rmse:2175.705347+2.856802 
## [1400]	train-rmse:2175.490650+0.290539	test-rmse:2175.488208+2.857070 
## [1401]	train-rmse:2175.274487+0.290434	test-rmse:2175.271582+2.856540 
## [1402]	train-rmse:2175.056225+0.290229	test-rmse:2175.054419+2.856512 
## [1403]	train-rmse:2174.841162+0.289665	test-rmse:2174.837207+2.856471 
## [1404]	train-rmse:2174.622510+0.290856	test-rmse:2174.620728+2.856251 
## [1405]	train-rmse:2174.406934+0.290347	test-rmse:2174.403808+2.856577 
## [1406]	train-rmse:2174.190332+0.290191	test-rmse:2174.186816+2.856107 
## [1407]	train-rmse:2173.972656+0.289906	test-rmse:2173.970142+2.856154 
## [1408]	train-rmse:2173.756274+0.291355	test-rmse:2173.753418+2.856078 
## [1409]	train-rmse:2173.538232+0.289743	test-rmse:2173.536426+2.855948 
## [1410]	train-rmse:2173.322632+0.290464	test-rmse:2173.319580+2.855996 
## [1411]	train-rmse:2173.104370+0.289674	test-rmse:2173.102686+2.855807 
## [1412]	train-rmse:2172.888745+0.291002	test-rmse:2172.886035+2.856008 
## [1413]	train-rmse:2172.672730+0.289698	test-rmse:2172.669482+2.855570 
## [1414]	train-rmse:2172.454883+0.290078	test-rmse:2172.452954+2.855819 
## [1415]	train-rmse:2172.239868+0.290521	test-rmse:2172.236255+2.855336 
## [1416]	train-rmse:2172.021509+0.288911	test-rmse:2172.019702+2.855534 
## [1417]	train-rmse:2171.805688+0.290397	test-rmse:2171.803101+2.855520 
## [1418]	train-rmse:2171.587524+0.289125	test-rmse:2171.586352+2.855250 
## [1419]	train-rmse:2171.372461+0.290426	test-rmse:2171.369922+2.855103 
## [1420]	train-rmse:2171.155859+0.289031	test-rmse:2171.153345+2.855234 
## [1421]	train-rmse:2170.938892+0.290398	test-rmse:2170.936548+2.855161 
## [1422]	train-rmse:2170.723804+0.289851	test-rmse:2170.720361+2.855076 
## [1423]	train-rmse:2170.506299+0.290170	test-rmse:2170.503931+2.854810 
## [1424]	train-rmse:2170.290747+0.289867	test-rmse:2170.287427+2.854739 
## [1425]	train-rmse:2170.073242+0.288770	test-rmse:2170.071045+2.854402 
## [1426]	train-rmse:2169.856348+0.289375	test-rmse:2169.854541+2.854308 
## [1427]	train-rmse:2169.640527+0.289497	test-rmse:2169.638013+2.854509 
## [1428]	train-rmse:2169.423755+0.289890	test-rmse:2169.421850+2.854354 
## [1429]	train-rmse:2169.207300+0.289442	test-rmse:2169.205469+2.854180 
## [1430]	train-rmse:2168.991724+0.289902	test-rmse:2168.989209+2.854246 
## [1431]	train-rmse:2168.775610+0.289720	test-rmse:2168.772705+2.854000 
## [1432]	train-rmse:2168.559668+0.289178	test-rmse:2168.556250+2.854247 
## [1433]	train-rmse:2168.341504+0.289441	test-rmse:2168.340332+2.853813 
## [1434]	train-rmse:2168.127734+0.289240	test-rmse:2168.123877+2.854004 
## [1435]	train-rmse:2167.909375+0.290164	test-rmse:2167.907861+2.853660 
## [1436]	train-rmse:2167.694580+0.288305	test-rmse:2167.691455+2.853514 
## [1437]	train-rmse:2167.477368+0.289907	test-rmse:2167.475464+2.853617 
## [1438]	train-rmse:2167.262085+0.289284	test-rmse:2167.258960+2.853644 
## [1439]	train-rmse:2167.046020+0.289201	test-rmse:2167.043066+2.853424 
## [1440]	train-rmse:2166.829273+0.289611	test-rmse:2166.826904+2.853403 
## [1441]	train-rmse:2166.614429+0.289234	test-rmse:2166.611011+2.853400 
## [1442]	train-rmse:2166.396167+0.289528	test-rmse:2166.394849+2.853272 
## [1443]	train-rmse:2166.182788+0.288510	test-rmse:2166.178613+2.853082 
## [1444]	train-rmse:2165.964697+0.288943	test-rmse:2165.962622+2.852963 
## [1445]	train-rmse:2165.749194+0.289045	test-rmse:2165.746509+2.852966 
## [1446]	train-rmse:2165.534058+0.288514	test-rmse:2165.530859+2.852926 
## [1447]	train-rmse:2165.317065+0.289247	test-rmse:2165.314697+2.852567 
## [1448]	train-rmse:2165.102344+0.288698	test-rmse:2165.098682+2.852667 
## [1449]	train-rmse:2164.884644+0.289539	test-rmse:2164.883008+2.852610 
## [1450]	train-rmse:2164.670337+0.288298	test-rmse:2164.667017+2.852582 
## [1451]	train-rmse:2164.453271+0.288789	test-rmse:2164.451196+2.852592 
## [1452]	train-rmse:2164.237720+0.289214	test-rmse:2164.235108+2.852399 
## [1453]	train-rmse:2164.022681+0.288287	test-rmse:2164.019556+2.852210 
## [1454]	train-rmse:2163.805982+0.289304	test-rmse:2163.803320+2.852199 
## [1455]	train-rmse:2163.590552+0.288181	test-rmse:2163.587866+2.851993 
## [1456]	train-rmse:2163.374072+0.289031	test-rmse:2163.372119+2.852233 
## [1457]	train-rmse:2163.159107+0.287980	test-rmse:2163.156714+2.852040 
## [1458]	train-rmse:2162.943091+0.288737	test-rmse:2162.940723+2.851916 
## [1459]	train-rmse:2162.726929+0.288933	test-rmse:2162.724829+2.851743 
## [1460]	train-rmse:2162.511743+0.287929	test-rmse:2162.509033+2.851506 
## [1461]	train-rmse:2162.295361+0.289091	test-rmse:2162.293457+2.851568 
## [1462]	train-rmse:2162.080225+0.287950	test-rmse:2162.077808+2.851410 
## [1463]	train-rmse:2161.864355+0.289163	test-rmse:2161.862475+2.851326 
## [1464]	train-rmse:2161.649536+0.288087	test-rmse:2161.646411+2.851305 
## [1465]	train-rmse:2161.433471+0.288865	test-rmse:2161.431177+2.851216 
## [1466]	train-rmse:2161.218164+0.288776	test-rmse:2161.215405+2.851228 
## [1467]	train-rmse:2161.003271+0.287520	test-rmse:2161.000049+2.851082 
## [1468]	train-rmse:2160.785815+0.289525	test-rmse:2160.784717+2.850628 
## [1469]	train-rmse:2160.573047+0.286754	test-rmse:2160.569043+2.850784 
## [1470]	train-rmse:2160.355225+0.288800	test-rmse:2160.353735+2.850842 
## [1471]	train-rmse:2160.141748+0.287567	test-rmse:2160.138159+2.850698 
## [1472]	train-rmse:2159.924951+0.288063	test-rmse:2159.922681+2.850818 
## [1473]	train-rmse:2159.710327+0.288352	test-rmse:2159.707397+2.850416 
## [1474]	train-rmse:2159.494263+0.287370	test-rmse:2159.491894+2.850663 
## [1475]	train-rmse:2159.279297+0.288874	test-rmse:2159.276587+2.850334 
## [1476]	train-rmse:2159.064893+0.286868	test-rmse:2159.061377+2.850188 
## [1477]	train-rmse:2158.847900+0.288468	test-rmse:2158.845752+2.850523 
## [1478]	train-rmse:2158.633862+0.287935	test-rmse:2158.630713+2.850060 
## [1479]	train-rmse:2158.417651+0.288386	test-rmse:2158.415405+2.850115 
## [1480]	train-rmse:2158.202783+0.288020	test-rmse:2158.200439+2.850104 
## [1481]	train-rmse:2157.987402+0.288183	test-rmse:2157.985230+2.849854 
## [1482]	train-rmse:2157.771728+0.287541	test-rmse:2157.769751+2.849523 
## [1483]	train-rmse:2157.557935+0.287325	test-rmse:2157.554492+2.849824 
## [1484]	train-rmse:2157.341455+0.287523	test-rmse:2157.339648+2.849607 
## [1485]	train-rmse:2157.127563+0.288305	test-rmse:2157.124145+2.849280 
## [1486]	train-rmse:2156.911841+0.288147	test-rmse:2156.909155+2.849534 
## [1487]	train-rmse:2156.697070+0.288339	test-rmse:2156.694141+2.849575 
## [1488]	train-rmse:2156.481665+0.287263	test-rmse:2156.478955+2.849375 
## [1489]	train-rmse:2156.265674+0.288278	test-rmse:2156.264160+2.849184 
## [1490]	train-rmse:2156.051489+0.287561	test-rmse:2156.048975+2.849077 
## [1491]	train-rmse:2155.835498+0.287586	test-rmse:2155.833740+2.848914 
## [1492]	train-rmse:2155.621216+0.286963	test-rmse:2155.618726+2.848940 
## [1493]	train-rmse:2155.406348+0.287403	test-rmse:2155.403711+2.848966 
## [1494]	train-rmse:2155.191260+0.287524	test-rmse:2155.189234+2.848787 
## [1495]	train-rmse:2154.977002+0.286909	test-rmse:2154.973804+2.848791 
## [1496]	train-rmse:2154.760889+0.287710	test-rmse:2154.759351+2.848700 
## [1497]	train-rmse:2154.547925+0.287497	test-rmse:2154.543970+2.848681 
## [1498]	train-rmse:2154.331543+0.286926	test-rmse:2154.329566+2.848624 
## [1499]	train-rmse:2154.116699+0.287550	test-rmse:2154.114307+2.848077 
## [1500]	train-rmse:2153.902344+0.287159	test-rmse:2153.899878+2.848259 
## [1501]	train-rmse:2153.686548+0.288028	test-rmse:2153.684912+2.848225 
## [1502]	train-rmse:2153.473340+0.286335	test-rmse:2153.470288+2.848018 
## [1503]	train-rmse:2153.256226+0.287675	test-rmse:2153.255420+2.847810 
## [1504]	train-rmse:2153.044311+0.287622	test-rmse:2153.040674+2.848074 
## [1505]	train-rmse:2152.828369+0.286941	test-rmse:2152.825952+2.848108 
## [1506]	train-rmse:2152.614233+0.287253	test-rmse:2152.611255+2.847798 
## [1507]	train-rmse:2152.399389+0.287924	test-rmse:2152.396704+2.847617 
## [1508]	train-rmse:2152.184033+0.287088	test-rmse:2152.181763+2.847539 
## [1509]	train-rmse:2151.970801+0.286422	test-rmse:2151.967456+2.847624 
## [1510]	train-rmse:2151.754175+0.286983	test-rmse:2151.752905+2.847416 
## [1511]	train-rmse:2151.541333+0.287348	test-rmse:2151.538037+2.847296 
## [1512]	train-rmse:2151.325732+0.287182	test-rmse:2151.323730+2.847101 
## [1513]	train-rmse:2151.112232+0.287667	test-rmse:2151.108936+2.847064 
## [1514]	train-rmse:2150.896704+0.286359	test-rmse:2150.894409+2.847359 
## [1515]	train-rmse:2150.682568+0.287668	test-rmse:2150.680102+2.847123 
## [1516]	train-rmse:2150.468042+0.287011	test-rmse:2150.465528+2.846966 
## [1517]	train-rmse:2150.253711+0.287066	test-rmse:2150.250977+2.847008 
## [1518]	train-rmse:2150.039868+0.287187	test-rmse:2150.036670+2.846759 
## [1519]	train-rmse:2149.825269+0.286715	test-rmse:2149.822314+2.846786 
## [1520]	train-rmse:2149.609302+0.286173	test-rmse:2149.607813+2.846514 
## [1521]	train-rmse:2149.396655+0.286458	test-rmse:2149.393433+2.846598 
## [1522]	train-rmse:2149.181225+0.286810	test-rmse:2149.178980+2.846509 
## [1523]	train-rmse:2148.967188+0.286523	test-rmse:2148.964795+2.846334 
## [1524]	train-rmse:2148.753369+0.286210	test-rmse:2148.750537+2.846129 
## [1525]	train-rmse:2148.538696+0.286342	test-rmse:2148.536157+2.846147 
## [1526]	train-rmse:2148.324658+0.286990	test-rmse:2148.321875+2.845943 
## [1527]	train-rmse:2148.109546+0.286576	test-rmse:2148.107788+2.846078 
## [1528]	train-rmse:2147.897290+0.286528	test-rmse:2147.893799+2.845908 
## [1529]	train-rmse:2147.680396+0.286263	test-rmse:2147.679468+2.846042 
## [1530]	train-rmse:2147.468506+0.287351	test-rmse:2147.465430+2.845553 
## [1531]	train-rmse:2147.252881+0.285609	test-rmse:2147.251074+2.845672 
## [1532]	train-rmse:2147.039600+0.287070	test-rmse:2147.037183+2.845348 
## [1533]	train-rmse:2146.825220+0.286882	test-rmse:2146.822827+2.845939 
## [1534]	train-rmse:2146.610644+0.286382	test-rmse:2146.608789+2.845312 
## [1535]	train-rmse:2146.398023+0.287041	test-rmse:2146.394824+2.845276 
## [1536]	train-rmse:2146.182080+0.285941	test-rmse:2146.180591+2.845072 
## [1537]	train-rmse:2145.969629+0.286377	test-rmse:2145.966650+2.845176 
## [1538]	train-rmse:2145.755542+0.285951	test-rmse:2145.752441+2.845127 
## [1539]	train-rmse:2145.541211+0.286780	test-rmse:2145.538574+2.844944 
## [1540]	train-rmse:2145.328442+0.286567	test-rmse:2145.324902+2.845040 
## [1541]	train-rmse:2145.112524+0.286149	test-rmse:2145.110571+2.844926 
## [1542]	train-rmse:2144.900195+0.287015	test-rmse:2144.896924+2.844797 
## [1543]	train-rmse:2144.685693+0.285571	test-rmse:2144.682910+2.844584 
## [1544]	train-rmse:2144.471582+0.285929	test-rmse:2144.468921+2.844255 
## [1545]	train-rmse:2144.257935+0.286711	test-rmse:2144.255054+2.844345 
## [1546]	train-rmse:2144.043091+0.285865	test-rmse:2144.041431+2.844540 
## [1547]	train-rmse:2143.830249+0.286757	test-rmse:2143.827637+2.844111 
## [1548]	train-rmse:2143.615308+0.285185	test-rmse:2143.613745+2.844402 
## [1549]	train-rmse:2143.403198+0.286900	test-rmse:2143.400390+2.844170 
## [1550]	train-rmse:2143.189160+0.285094	test-rmse:2143.186304+2.844279 
## [1551]	train-rmse:2142.974634+0.286581	test-rmse:2142.972266+2.843892 
## [1552]	train-rmse:2142.761182+0.285945	test-rmse:2142.758740+2.844024 
## [1553]	train-rmse:2142.547217+0.285752	test-rmse:2142.544995+2.843792 
## [1554]	train-rmse:2142.334595+0.287192	test-rmse:2142.331616+2.843800 
## [1555]	train-rmse:2142.119873+0.284521	test-rmse:2142.117822+2.843326 
## [1556]	train-rmse:2141.906616+0.286515	test-rmse:2141.904126+2.843502 
## [1557]	train-rmse:2141.693433+0.285915	test-rmse:2141.690674+2.843462 
## [1558]	train-rmse:2141.480664+0.285848	test-rmse:2141.476807+2.843388 
## [1559]	train-rmse:2141.265942+0.285079	test-rmse:2141.263525+2.843559 
## [1560]	train-rmse:2141.052661+0.285571	test-rmse:2141.050122+2.843130 
## [1561]	train-rmse:2140.838452+0.286503	test-rmse:2140.836621+2.843044 
## [1562]	train-rmse:2140.625733+0.284562	test-rmse:2140.622900+2.843028 
## [1563]	train-rmse:2140.411548+0.286292	test-rmse:2140.409668+2.843097 
## [1564]	train-rmse:2140.198169+0.285776	test-rmse:2140.196191+2.843116 
## [1565]	train-rmse:2139.984424+0.285650	test-rmse:2139.982788+2.842784 
## [1566]	train-rmse:2139.771997+0.285490	test-rmse:2139.769140+2.842756 
## [1567]	train-rmse:2139.557593+0.285205	test-rmse:2139.555933+2.842492 
## [1568]	train-rmse:2139.344897+0.286278	test-rmse:2139.342505+2.842468 
## [1569]	train-rmse:2139.131250+0.284348	test-rmse:2139.129248+2.842288 
## [1570]	train-rmse:2138.918481+0.285447	test-rmse:2138.916065+2.842333 
## [1571]	train-rmse:2138.705762+0.284582	test-rmse:2138.702344+2.842483 
## [1572]	train-rmse:2138.491577+0.285438	test-rmse:2138.489233+2.842128 
## [1573]	train-rmse:2138.278613+0.285970	test-rmse:2138.275708+2.842186 
## [1574]	train-rmse:2138.065259+0.284676	test-rmse:2138.062915+2.842200 
## [1575]	train-rmse:2137.851074+0.286467	test-rmse:2137.849707+2.841946 
## [1576]	train-rmse:2137.639453+0.284212	test-rmse:2137.636377+2.842083 
## [1577]	train-rmse:2137.425073+0.285371	test-rmse:2137.423413+2.841645 
## [1578]	train-rmse:2137.213135+0.283934	test-rmse:2137.210107+2.841571 
## [1579]	train-rmse:2136.998779+0.285310	test-rmse:2136.996826+2.841583 
## [1580]	train-rmse:2136.786206+0.285467	test-rmse:2136.783569+2.841426 
## [1581]	train-rmse:2136.573511+0.284757	test-rmse:2136.570899+2.841537 
## [1582]	train-rmse:2136.359082+0.285387	test-rmse:2136.357715+2.841239 
## [1583]	train-rmse:2136.147656+0.284410	test-rmse:2136.144702+2.841097 
## [1584]	train-rmse:2135.934009+0.284793	test-rmse:2135.931299+2.841125 
## [1585]	train-rmse:2135.721753+0.284818	test-rmse:2135.718872+2.841300 
## [1586]	train-rmse:2135.508301+0.284894	test-rmse:2135.505640+2.840913 
## [1587]	train-rmse:2135.294751+0.284694	test-rmse:2135.292993+2.841178 
## [1588]	train-rmse:2135.083520+0.284479	test-rmse:2135.079663+2.840885 
## [1589]	train-rmse:2134.869067+0.285066	test-rmse:2134.866699+2.840900 
## [1590]	train-rmse:2134.657178+0.283448	test-rmse:2134.653736+2.840597 
## [1591]	train-rmse:2134.442773+0.284788	test-rmse:2134.441016+2.840719 
## [1592]	train-rmse:2134.230762+0.285234	test-rmse:2134.228467+2.840493 
## [1593]	train-rmse:2134.017529+0.283856	test-rmse:2134.015503+2.840667 
## [1594]	train-rmse:2133.804175+0.284768	test-rmse:2133.802637+2.840171 
## [1595]	train-rmse:2133.592993+0.284209	test-rmse:2133.589917+2.840040 
## [1596]	train-rmse:2133.378540+0.284895	test-rmse:2133.377197+2.839992 
## [1597]	train-rmse:2133.167969+0.284092	test-rmse:2133.164380+2.840278 
## [1598]	train-rmse:2132.953223+0.284408	test-rmse:2132.951831+2.839714 
## [1599]	train-rmse:2132.742285+0.285008	test-rmse:2132.738745+2.839811 
## [1600]	train-rmse:2132.529541+0.283328	test-rmse:2132.525977+2.839780 
## [1601]	train-rmse:2132.314819+0.284931	test-rmse:2132.313892+2.839544 
## [1602]	train-rmse:2132.104883+0.283456	test-rmse:2132.101099+2.839323 
## [1603]	train-rmse:2131.888965+0.284989	test-rmse:2131.888428+2.839522 
## [1604]	train-rmse:2131.678296+0.284634	test-rmse:2131.675610+2.839564 
## [1605]	train-rmse:2131.466089+0.283347	test-rmse:2131.463037+2.839232 
## [1606]	train-rmse:2131.252417+0.284355	test-rmse:2131.250513+2.839414 
## [1607]	train-rmse:2131.041260+0.283949	test-rmse:2131.038135+2.839225 
## [1608]	train-rmse:2130.826807+0.284820	test-rmse:2130.825732+2.838986 
## [1609]	train-rmse:2130.616480+0.283301	test-rmse:2130.613135+2.839149 
## [1610]	train-rmse:2130.401636+0.284615	test-rmse:2130.400513+2.838886 
## [1611]	train-rmse:2130.190723+0.284281	test-rmse:2130.188257+2.838894 
## [1612]	train-rmse:2129.979004+0.283939	test-rmse:2129.975708+2.838830 
## [1613]	train-rmse:2129.765063+0.284450	test-rmse:2129.763330+2.838650 
## [1614]	train-rmse:2129.554761+0.283391	test-rmse:2129.551050+2.838663 
## [1615]	train-rmse:2129.340405+0.284422	test-rmse:2129.338843+2.838478 
## [1616]	train-rmse:2129.130224+0.283489	test-rmse:2129.126538+2.838383 
## [1617]	train-rmse:2128.915454+0.284139	test-rmse:2128.913843+2.838562 
## [1618]	train-rmse:2128.703809+0.283938	test-rmse:2128.701978+2.838016 
## [1619]	train-rmse:2128.491626+0.283872	test-rmse:2128.489429+2.838175 
## [1620]	train-rmse:2128.278125+0.284481	test-rmse:2128.277222+2.838130 
## [1621]	train-rmse:2128.068213+0.283191	test-rmse:2128.064819+2.837865 
## [1622]	train-rmse:2127.854346+0.284081	test-rmse:2127.853052+2.837877 
## [1623]	train-rmse:2127.643994+0.283935	test-rmse:2127.640796+2.837686 
## [1624]	train-rmse:2127.431055+0.283126	test-rmse:2127.428296+2.837945 
## [1625]	train-rmse:2127.217895+0.284354	test-rmse:2127.216357+2.837489 
## [1626]	train-rmse:2127.006983+0.282784	test-rmse:2127.004029+2.837580 
## [1627]	train-rmse:2126.793823+0.284518	test-rmse:2126.792285+2.837271 
## [1628]	train-rmse:2126.583277+0.283730	test-rmse:2126.580054+2.837307 
## [1629]	train-rmse:2126.369629+0.284447	test-rmse:2126.368042+2.837132 
## [1630]	train-rmse:2126.158203+0.283520	test-rmse:2126.155835+2.837079 
## [1631]	train-rmse:2125.946509+0.283331	test-rmse:2125.943774+2.837189 
## [1632]	train-rmse:2125.733789+0.283815	test-rmse:2125.732056+2.836724 
## [1633]	train-rmse:2125.522681+0.282982	test-rmse:2125.519702+2.837034 
## [1634]	train-rmse:2125.309961+0.284292	test-rmse:2125.307983+2.836938 
## [1635]	train-rmse:2125.099170+0.283644	test-rmse:2125.095849+2.836646 
## [1636]	train-rmse:2124.886597+0.283916	test-rmse:2124.884082+2.836717 
## [1637]	train-rmse:2124.675000+0.283242	test-rmse:2124.672021+2.836619 
## [1638]	train-rmse:2124.462720+0.282923	test-rmse:2124.460205+2.836664 
## [1639]	train-rmse:2124.250855+0.283162	test-rmse:2124.248144+2.836267 
## [1640]	train-rmse:2124.039551+0.282861	test-rmse:2124.036792+2.836479 
## [1641]	train-rmse:2123.826684+0.283531	test-rmse:2123.824609+2.836364 
## [1642]	train-rmse:2123.615552+0.283273	test-rmse:2123.612939+2.835978 
## [1643]	train-rmse:2123.404297+0.283783	test-rmse:2123.401294+2.836037 
## [1644]	train-rmse:2123.190552+0.283832	test-rmse:2123.189258+2.835892 
## [1645]	train-rmse:2122.980982+0.282312	test-rmse:2122.977563+2.836207 
## [1646]	train-rmse:2122.767871+0.283616	test-rmse:2122.766308+2.835686 
## [1647]	train-rmse:2122.557251+0.282481	test-rmse:2122.554346+2.835627 
## [1648]	train-rmse:2122.344922+0.282586	test-rmse:2122.342847+2.835615 
## [1649]	train-rmse:2122.133423+0.282660	test-rmse:2122.130957+2.835681 
## [1650]	train-rmse:2121.922046+0.282888	test-rmse:2121.919531+2.835116 
## [1651]	train-rmse:2121.709497+0.283184	test-rmse:2121.707886+2.835717 
## [1652]	train-rmse:2121.499390+0.283082	test-rmse:2121.496240+2.834995 
## [1653]	train-rmse:2121.287500+0.282230	test-rmse:2121.284595+2.835249 
## [1654]	train-rmse:2121.075781+0.282651	test-rmse:2121.073218+2.835239 
## [1655]	train-rmse:2120.863525+0.282478	test-rmse:2120.861890+2.835144 
## [1656]	train-rmse:2120.652686+0.282085	test-rmse:2120.650317+2.834692 
## [1657]	train-rmse:2120.440796+0.282447	test-rmse:2120.438672+2.834821 
## [1658]	train-rmse:2120.229517+0.283269	test-rmse:2120.227344+2.834862 
## [1659]	train-rmse:2120.017407+0.282571	test-rmse:2120.015820+2.834868 
## [1660]	train-rmse:2119.807617+0.282675	test-rmse:2119.804395+2.834801 
## [1661]	train-rmse:2119.594629+0.283310	test-rmse:2119.593237+2.834738 
## [1662]	train-rmse:2119.384107+0.283058	test-rmse:2119.381616+2.834461 
## [1663]	train-rmse:2119.172949+0.282699	test-rmse:2119.170850+2.834557 
## [1664]	train-rmse:2118.961914+0.282726	test-rmse:2118.959473+2.834523 
## [1665]	train-rmse:2118.750439+0.282524	test-rmse:2118.747534+2.834230 
## [1666]	train-rmse:2118.538843+0.281945	test-rmse:2118.536743+2.834390 
## [1667]	train-rmse:2118.328613+0.282600	test-rmse:2118.325147+2.833911 
## [1668]	train-rmse:2118.115991+0.282602	test-rmse:2118.114087+2.834202 
## [1669]	train-rmse:2117.906104+0.282373	test-rmse:2117.902930+2.834046 
## [1670]	train-rmse:2117.693335+0.282199	test-rmse:2117.691675+2.833786 
## [1671]	train-rmse:2117.483765+0.282076	test-rmse:2117.480591+2.833858 
## [1672]	train-rmse:2117.271606+0.282122	test-rmse:2117.269629+2.833550 
## [1673]	train-rmse:2117.060474+0.282355	test-rmse:2117.058496+2.833908 
## [1674]	train-rmse:2116.849805+0.281928	test-rmse:2116.847046+2.833652 
## [1675]	train-rmse:2116.637769+0.282893	test-rmse:2116.636353+2.833563 
## [1676]	train-rmse:2116.427954+0.282882	test-rmse:2116.425122+2.833253 
## [1677]	train-rmse:2116.215381+0.282034	test-rmse:2116.213965+2.833355 
## [1678]	train-rmse:2116.005713+0.282512	test-rmse:2116.002783+2.833080 
## [1679]	train-rmse:2115.793579+0.281799	test-rmse:2115.791895+2.833376 
## [1680]	train-rmse:2115.583350+0.282199	test-rmse:2115.581128+2.832795 
## [1681]	train-rmse:2115.372436+0.281805	test-rmse:2115.370190+2.832986 
## [1682]	train-rmse:2115.160962+0.281306	test-rmse:2115.158862+2.833027 
## [1683]	train-rmse:2114.950342+0.282773	test-rmse:2114.948169+2.832583 
## [1684]	train-rmse:2114.739941+0.282034	test-rmse:2114.737256+2.832655 
## [1685]	train-rmse:2114.528809+0.282876	test-rmse:2114.526563+2.832696 
## [1686]	train-rmse:2114.317798+0.281771	test-rmse:2114.315405+2.832608 
## [1687]	train-rmse:2114.107373+0.282470	test-rmse:2114.104858+2.832825 
## [1688]	train-rmse:2113.896216+0.282542	test-rmse:2113.893823+2.832741 
## [1689]	train-rmse:2113.685913+0.281300	test-rmse:2113.683203+2.832527 
## [1690]	train-rmse:2113.475000+0.282042	test-rmse:2113.472412+2.832101 
## [1691]	train-rmse:2113.263501+0.281432	test-rmse:2113.262109+2.832458 
## [1692]	train-rmse:2113.053125+0.281899	test-rmse:2113.050928+2.832071 
## [1693]	train-rmse:2112.842041+0.282048	test-rmse:2112.840381+2.832148 
## [1694]	train-rmse:2112.632251+0.281595	test-rmse:2112.629761+2.832252 
## [1695]	train-rmse:2112.421118+0.282729	test-rmse:2112.419092+2.831865 
## [1696]	train-rmse:2112.210596+0.280856	test-rmse:2112.208203+2.831555 
## [1697]	train-rmse:2111.999658+0.282832	test-rmse:2111.997510+2.831771 
## [1698]	train-rmse:2111.789673+0.280981	test-rmse:2111.786963+2.831504 
## [1699]	train-rmse:2111.578345+0.281435	test-rmse:2111.576147+2.831902 
## [1700]	train-rmse:2111.367920+0.281784	test-rmse:2111.366040+2.831487 
## [1701]	train-rmse:2111.157886+0.281496	test-rmse:2111.155420+2.831330 
## [1702]	train-rmse:2110.947241+0.282658	test-rmse:2110.945020+2.831349 
## [1703]	train-rmse:2110.737256+0.279983	test-rmse:2110.734668+2.831348 
## [1704]	train-rmse:2110.525537+0.281648	test-rmse:2110.523877+2.831114 
## [1705]	train-rmse:2110.315967+0.280865	test-rmse:2110.313330+2.831396 
## [1706]	train-rmse:2110.105517+0.281278	test-rmse:2110.103271+2.830905 
## [1707]	train-rmse:2109.894800+0.281746	test-rmse:2109.892651+2.831036 
## [1708]	train-rmse:2109.684326+0.280438	test-rmse:2109.682471+2.830584 
## [1709]	train-rmse:2109.473535+0.282320	test-rmse:2109.471631+2.830757 
## [1710]	train-rmse:2109.263428+0.280000	test-rmse:2109.261426+2.830968 
## [1711]	train-rmse:2109.053100+0.281819	test-rmse:2109.051269+2.830899 
## [1712]	train-rmse:2108.842993+0.281558	test-rmse:2108.841089+2.830516 
## [1713]	train-rmse:2108.633447+0.281221	test-rmse:2108.630981+2.830502 
## [1714]	train-rmse:2108.421948+0.281577	test-rmse:2108.420361+2.830202 
## [1715]	train-rmse:2108.212451+0.279414	test-rmse:2108.210156+2.830486 
## [1716]	train-rmse:2108.002100+0.281552	test-rmse:2107.999805+2.830400 
## [1717]	train-rmse:2107.791431+0.280697	test-rmse:2107.789868+2.830267 
## [1718]	train-rmse:2107.582227+0.281373	test-rmse:2107.579590+2.830170 
## [1719]	train-rmse:2107.370557+0.281252	test-rmse:2107.369409+2.830139 
## [1720]	train-rmse:2107.162183+0.280762	test-rmse:2107.159424+2.829847 
## [1721]	train-rmse:2106.950610+0.281261	test-rmse:2106.949023+2.830007 
## [1722]	train-rmse:2106.741040+0.280813	test-rmse:2106.739209+2.829926 
## [1723]	train-rmse:2106.531982+0.280719	test-rmse:2106.528955+2.829804 
## [1724]	train-rmse:2106.320020+0.280835	test-rmse:2106.319141+2.829737 
## [1725]	train-rmse:2106.112012+0.281037	test-rmse:2106.108789+2.829518 
## [1726]	train-rmse:2105.899243+0.280803	test-rmse:2105.898975+2.829423 
## [1727]	train-rmse:2105.691601+0.279694	test-rmse:2105.689087+2.829389 
## [1728]	train-rmse:2105.480640+0.281563	test-rmse:2105.478979+2.829570 
## [1729]	train-rmse:2105.270386+0.279835	test-rmse:2105.269116+2.829178 
## [1730]	train-rmse:2105.062012+0.280714	test-rmse:2105.059155+2.829183 
## [1731]	train-rmse:2104.849927+0.280427	test-rmse:2104.848999+2.828991 
## [1732]	train-rmse:2104.643433+0.280554	test-rmse:2104.639380+2.829029 
## [1733]	train-rmse:2104.429736+0.281297	test-rmse:2104.429468+2.829041 
## [1734]	train-rmse:2104.222241+0.280126	test-rmse:2104.219629+2.828892 
## [1735]	train-rmse:2104.011963+0.280259	test-rmse:2104.009839+2.828497 
## [1736]	train-rmse:2103.800562+0.280565	test-rmse:2103.800293+2.828728 
## [1737]	train-rmse:2103.594556+0.280167	test-rmse:2103.590259+2.828656 
## [1738]	train-rmse:2103.380884+0.280922	test-rmse:2103.380420+2.828702 
## [1739]	train-rmse:2103.174292+0.280180	test-rmse:2103.170727+2.828294 
## [1740]	train-rmse:2102.962500+0.280284	test-rmse:2102.961059+2.828594 
## [1741]	train-rmse:2102.752979+0.281127	test-rmse:2102.751270+2.828134 
## [1742]	train-rmse:2102.544287+0.280516	test-rmse:2102.541675+2.828500 
## [1743]	train-rmse:2102.333130+0.280621	test-rmse:2102.332080+2.828310 
## [1744]	train-rmse:2102.126123+0.280082	test-rmse:2102.122534+2.827854 
## [1745]	train-rmse:2101.913330+0.280070	test-rmse:2101.913013+2.827945 
## [1746]	train-rmse:2101.705786+0.280211	test-rmse:2101.703272+2.827946 
## [1747]	train-rmse:2101.495801+0.280060	test-rmse:2101.493628+2.827819 
## [1748]	train-rmse:2101.285376+0.280524	test-rmse:2101.284082+2.827859 
## [1749]	train-rmse:2101.078394+0.279501	test-rmse:2101.074707+2.827389 
## [1750]	train-rmse:2100.865259+0.280278	test-rmse:2100.865235+2.827572 
## [1751]	train-rmse:2100.658887+0.280063	test-rmse:2100.655762+2.827603 
## [1752]	train-rmse:2100.447608+0.280329	test-rmse:2100.446021+2.827304 
## [1753]	train-rmse:2100.238355+0.279480	test-rmse:2100.236768+2.827461 
## [1754]	train-rmse:2100.030102+0.280433	test-rmse:2100.027319+2.827161 
## [1755]	train-rmse:2099.817920+0.280102	test-rmse:2099.818091+2.827378 
## [1756]	train-rmse:2099.612329+0.279697	test-rmse:2099.608594+2.827196 
## [1757]	train-rmse:2099.399097+0.279747	test-rmse:2099.399292+2.826884 
## [1758]	train-rmse:2099.192310+0.280294	test-rmse:2099.189868+2.826987 
## [1759]	train-rmse:2098.982373+0.280117	test-rmse:2098.980615+2.826788 
## [1760]	train-rmse:2098.772510+0.280208	test-rmse:2098.771021+2.826863 
## [1761]	train-rmse:2098.565088+0.279904	test-rmse:2098.562158+2.826629 
## [1762]	train-rmse:2098.353027+0.279834	test-rmse:2098.352222+2.826629 
## [1763]	train-rmse:2098.147070+0.280189	test-rmse:2098.143433+2.826258 
## [1764]	train-rmse:2097.934912+0.279341	test-rmse:2097.934351+2.826549 
## [1765]	train-rmse:2097.727026+0.279110	test-rmse:2097.725098+2.826281 
## [1766]	train-rmse:2097.518530+0.279417	test-rmse:2097.515674+2.826495 
## [1767]	train-rmse:2097.307227+0.279779	test-rmse:2097.306763+2.826307 
## [1768]	train-rmse:2097.101343+0.279706	test-rmse:2097.097607+2.826421 
## [1769]	train-rmse:2096.889331+0.278916	test-rmse:2096.888477+2.826331 
## [1770]	train-rmse:2096.682397+0.279609	test-rmse:2096.679858+2.825876 
## [1771]	train-rmse:2096.472290+0.279715	test-rmse:2096.470337+2.826325 
## [1772]	train-rmse:2096.262183+0.279781	test-rmse:2096.261426+2.825534 
## [1773]	train-rmse:2096.055151+0.279595	test-rmse:2096.052100+2.825841 
## [1774]	train-rmse:2095.843360+0.279530	test-rmse:2095.843506+2.825871 
## [1775]	train-rmse:2095.637964+0.279774	test-rmse:2095.634302+2.825510 
## [1776]	train-rmse:2095.426904+0.279477	test-rmse:2095.425195+2.825664 
## [1777]	train-rmse:2095.218579+0.279032	test-rmse:2095.216406+2.825522 
## [1778]	train-rmse:2095.009815+0.278870	test-rmse:2095.007544+2.825531 
## [1779]	train-rmse:2094.798267+0.279851	test-rmse:2094.798609+2.825311 
## [1780]	train-rmse:2094.593335+0.279391	test-rmse:2094.589673+2.825273 
## [1781]	train-rmse:2094.381445+0.279578	test-rmse:2094.380933+2.825306 
## [1782]	train-rmse:2094.175586+0.279530	test-rmse:2094.172290+2.825001 
## [1783]	train-rmse:2093.965356+0.277994	test-rmse:2093.963159+2.824915 
## [1784]	train-rmse:2093.756763+0.279148	test-rmse:2093.754419+2.825039 
## [1785]	train-rmse:2093.547949+0.279701	test-rmse:2093.545483+2.824577 
## [1786]	train-rmse:2093.338135+0.278441	test-rmse:2093.336890+2.824726 
## [1787]	train-rmse:2093.130982+0.279485	test-rmse:2093.128125+2.824766 
## [1788]	train-rmse:2092.920508+0.278237	test-rmse:2092.919336+2.824597 
## [1789]	train-rmse:2092.712817+0.279428	test-rmse:2092.710938+2.824727 
## [1790]	train-rmse:2092.503711+0.278854	test-rmse:2092.501953+2.824423 
## [1791]	train-rmse:2092.294336+0.278465	test-rmse:2092.293311+2.824196 
## [1792]	train-rmse:2092.086987+0.279180	test-rmse:2092.085107+2.824168 
## [1793]	train-rmse:2091.878125+0.278806	test-rmse:2091.876172+2.824184 
## [1794]	train-rmse:2091.670044+0.280067	test-rmse:2091.667773+2.824142 
## [1795]	train-rmse:2091.461011+0.277883	test-rmse:2091.459399+2.824347 
## [1796]	train-rmse:2091.251611+0.278670	test-rmse:2091.250488+2.824220 
## [1797]	train-rmse:2091.044434+0.279301	test-rmse:2091.042090+2.823919 
## [1798]	train-rmse:2090.835034+0.277773	test-rmse:2090.833570+2.823760 
## [1799]	train-rmse:2090.627271+0.279650	test-rmse:2090.625147+2.823958 
## [1800]	train-rmse:2090.418262+0.278207	test-rmse:2090.416577+2.823583 
## [1801]	train-rmse:2090.209107+0.279448	test-rmse:2090.208277+2.823788 
## [1802]	train-rmse:2090.002759+0.278818	test-rmse:2089.999683+2.823401 
## [1803]	train-rmse:2089.792773+0.277943	test-rmse:2089.791309+2.823527 
## [1804]	train-rmse:2089.585181+0.279039	test-rmse:2089.582983+2.823374 
## [1805]	train-rmse:2089.376123+0.277537	test-rmse:2089.374683+2.823447 
## [1806]	train-rmse:2089.168335+0.279584	test-rmse:2089.166480+2.823395 
## [1807]	train-rmse:2088.959985+0.278162	test-rmse:2088.958130+2.823310 
## [1808]	train-rmse:2088.751489+0.277696	test-rmse:2088.749732+2.823411 
## [1809]	train-rmse:2088.543750+0.279883	test-rmse:2088.541382+2.822936 
## [1810]	train-rmse:2088.335108+0.276934	test-rmse:2088.333301+2.823033 
## [1811]	train-rmse:2088.126611+0.279728	test-rmse:2088.125195+2.822850 
## [1812]	train-rmse:2087.918433+0.277613	test-rmse:2087.917041+2.822804 
## [1813]	train-rmse:2087.710644+0.278036	test-rmse:2087.708496+2.822522 
## [1814]	train-rmse:2087.502905+0.279223	test-rmse:2087.500586+2.822802 
## [1815]	train-rmse:2087.293604+0.276780	test-rmse:2087.292285+2.822314 
## [1816]	train-rmse:2087.085254+0.278913	test-rmse:2087.084155+2.822603 
## [1817]	train-rmse:2086.878711+0.277057	test-rmse:2086.876001+2.822409 
## [1818]	train-rmse:2086.669141+0.279751	test-rmse:2086.668066+2.822279 
## [1819]	train-rmse:2086.462085+0.277432	test-rmse:2086.459936+2.822363 
## [1820]	train-rmse:2086.254126+0.277678	test-rmse:2086.252026+2.822350 
## [1821]	train-rmse:2086.046094+0.279543	test-rmse:2086.044043+2.822081 
## [1822]	train-rmse:2085.837891+0.276171	test-rmse:2085.835913+2.822000 
## [1823]	train-rmse:2085.628589+0.279265	test-rmse:2085.627612+2.821802 
## [1824]	train-rmse:2085.422510+0.277655	test-rmse:2085.420019+2.821834 
## [1825]	train-rmse:2085.213940+0.278213	test-rmse:2085.211987+2.821565 
## [1826]	train-rmse:2085.006177+0.278916	test-rmse:2085.004102+2.821550 
## [1827]	train-rmse:2084.797144+0.276667	test-rmse:2084.796118+2.821807 
## [1828]	train-rmse:2084.589722+0.278893	test-rmse:2084.588696+2.821233 
## [1829]	train-rmse:2084.382178+0.277414	test-rmse:2084.380713+2.821625 
## [1830]	train-rmse:2084.174732+0.278022	test-rmse:2084.172778+2.821385 
## [1831]	train-rmse:2083.966748+0.277728	test-rmse:2083.965137+2.821323 
## [1832]	train-rmse:2083.758643+0.276808	test-rmse:2083.756885+2.821390 
## [1833]	train-rmse:2083.551172+0.278431	test-rmse:2083.549268+2.821020 
## [1834]	train-rmse:2083.342676+0.277214	test-rmse:2083.341870+2.821030 
## [1835]	train-rmse:2083.135742+0.278004	test-rmse:2083.133765+2.821080 
## [1836]	train-rmse:2082.928320+0.277586	test-rmse:2082.926172+2.821119 
## [1837]	train-rmse:2082.719385+0.278227	test-rmse:2082.718555+2.820835 
## [1838]	train-rmse:2082.513843+0.278265	test-rmse:2082.510596+2.820663 
## [1839]	train-rmse:2082.304346+0.275859	test-rmse:2082.303198+2.820749 
## [1840]	train-rmse:2082.097388+0.277687	test-rmse:2082.095459+2.820920 
## [1841]	train-rmse:2081.890039+0.277257	test-rmse:2081.887842+2.820726 
## [1842]	train-rmse:2081.681787+0.278616	test-rmse:2081.680298+2.820491 
## [1843]	train-rmse:2081.475073+0.277536	test-rmse:2081.472803+2.820238 
## [1844]	train-rmse:2081.266089+0.276274	test-rmse:2081.265112+2.820315 
## [1845]	train-rmse:2081.060107+0.278338	test-rmse:2081.057861+2.820106 
## [1846]	train-rmse:2080.851343+0.276391	test-rmse:2080.850293+2.819972 
## [1847]	train-rmse:2080.644336+0.278108	test-rmse:2080.643066+2.820039 
## [1848]	train-rmse:2080.437427+0.277126	test-rmse:2080.435181+2.819792 
## [1849]	train-rmse:2080.228418+0.276027	test-rmse:2080.228003+2.819691 
## [1850]	train-rmse:2080.023511+0.278103	test-rmse:2080.020264+2.820054 
## [1851]	train-rmse:2079.814087+0.276560	test-rmse:2079.812939+2.819803 
## [1852]	train-rmse:2079.607935+0.277912	test-rmse:2079.605737+2.819675 
## [1853]	train-rmse:2079.400391+0.277032	test-rmse:2079.398535+2.819686 
## [1854]	train-rmse:2079.192603+0.277002	test-rmse:2079.190918+2.819483 
## [1855]	train-rmse:2078.986133+0.278248	test-rmse:2078.983838+2.819377 
## [1856]	train-rmse:2078.777246+0.275612	test-rmse:2078.776343+2.819223 
## [1857]	train-rmse:2078.571484+0.277594	test-rmse:2078.569238+2.819081 
## [1858]	train-rmse:2078.362940+0.276722	test-rmse:2078.361719+2.819254 
## [1859]	train-rmse:2078.156665+0.277262	test-rmse:2078.154858+2.819099 
## [1860]	train-rmse:2077.948462+0.276966	test-rmse:2077.947290+2.819084 
## [1861]	train-rmse:2077.741308+0.276119	test-rmse:2077.740308+2.818960 
## [1862]	train-rmse:2077.535034+0.277619	test-rmse:2077.533057+2.818999 
## [1863]	train-rmse:2077.326099+0.276377	test-rmse:2077.325830+2.818898 
## [1864]	train-rmse:2077.121680+0.277341	test-rmse:2077.118970+2.818672 
## [1865]	train-rmse:2076.912305+0.276636	test-rmse:2076.911523+2.818772 
## [1866]	train-rmse:2076.706983+0.276821	test-rmse:2076.704468+2.818527 
## [1867]	train-rmse:2076.499390+0.277076	test-rmse:2076.497436+2.818318 
## [1868]	train-rmse:2076.291406+0.276372	test-rmse:2076.290357+2.818303 
## [1869]	train-rmse:2076.086719+0.277360	test-rmse:2076.083520+2.818272 
## [1870]	train-rmse:2075.877173+0.276252	test-rmse:2075.876489+2.818257 
## [1871]	train-rmse:2075.672241+0.276137	test-rmse:2075.669311+2.818153 
## [1872]	train-rmse:2075.463379+0.276167	test-rmse:2075.462817+2.818093 
## [1873]	train-rmse:2075.257422+0.276717	test-rmse:2075.255908+2.817944 
## [1874]	train-rmse:2075.051465+0.277167	test-rmse:2075.048462+2.817909 
## [1875]	train-rmse:2074.842309+0.276368	test-rmse:2074.842114+2.817792 
## [1876]	train-rmse:2074.637378+0.276736	test-rmse:2074.634863+2.817804 
## [1877]	train-rmse:2074.429321+0.276122	test-rmse:2074.428345+2.817572 
## [1878]	train-rmse:2074.222754+0.277399	test-rmse:2074.221314+2.817480 
## [1879]	train-rmse:2074.016016+0.276050	test-rmse:2074.014649+2.817445 
## [1880]	train-rmse:2073.808105+0.276405	test-rmse:2073.807642+2.817499 
## [1881]	train-rmse:2073.603003+0.276557	test-rmse:2073.600806+2.817484 
## [1882]	train-rmse:2073.394482+0.275618	test-rmse:2073.394092+2.817369 
## [1883]	train-rmse:2073.188818+0.277050	test-rmse:2073.187646+2.817235 
## [1884]	train-rmse:2072.982202+0.276285	test-rmse:2072.980591+2.817448 
## [1885]	train-rmse:2072.775415+0.276706	test-rmse:2072.773926+2.817073 
## [1886]	train-rmse:2072.569946+0.276550	test-rmse:2072.567432+2.817076 
## [1887]	train-rmse:2072.360938+0.275515	test-rmse:2072.360791+2.817181 
## [1888]	train-rmse:2072.156470+0.277111	test-rmse:2072.154297+2.817038 
## [1889]	train-rmse:2071.948218+0.275248	test-rmse:2071.947144+2.816826 
## [1890]	train-rmse:2071.742285+0.276682	test-rmse:2071.740918+2.816594 
## [1891]	train-rmse:2071.536646+0.276076	test-rmse:2071.534448+2.816562 
## [1892]	train-rmse:2071.328076+0.275727	test-rmse:2071.327637+2.816530 
## [1893]	train-rmse:2071.123999+0.276525	test-rmse:2071.121313+2.816489 
## [1894]	train-rmse:2070.915332+0.275555	test-rmse:2070.914673+2.816442 
## [1895]	train-rmse:2070.710254+0.276568	test-rmse:2070.708350+2.816345 
## [1896]	train-rmse:2070.503394+0.275166	test-rmse:2070.501855+2.816562 
## [1897]	train-rmse:2070.295190+0.275522	test-rmse:2070.295239+2.816204 
## [1898]	train-rmse:2070.090625+0.276405	test-rmse:2070.089014+2.816068 
## [1899]	train-rmse:2069.883154+0.275420	test-rmse:2069.882812+2.815758 
## [1900]	train-rmse:2069.678760+0.276697	test-rmse:2069.676587+2.816121 
## [1901]	train-rmse:2069.471704+0.275545	test-rmse:2069.469775+2.815819 
## [1902]	train-rmse:2069.264770+0.275825	test-rmse:2069.263476+2.815915 
## [1903]	train-rmse:2069.058936+0.275767	test-rmse:2069.057202+2.815798 
## [1904]	train-rmse:2068.851806+0.275346	test-rmse:2068.850757+2.815642 
## [1905]	train-rmse:2068.646924+0.276466	test-rmse:2068.644556+2.815738 
## [1906]	train-rmse:2068.439111+0.274861	test-rmse:2068.438428+2.815333 
## [1907]	train-rmse:2068.233838+0.276238	test-rmse:2068.232202+2.815676 
## [1908]	train-rmse:2068.028052+0.274784	test-rmse:2068.025830+2.815347 
## [1909]	train-rmse:2067.819995+0.275553	test-rmse:2067.819824+2.815331 
## [1910]	train-rmse:2067.615235+0.276668	test-rmse:2067.613428+2.815239 
## [1911]	train-rmse:2067.408081+0.274706	test-rmse:2067.407226+2.815004 
## [1912]	train-rmse:2067.203345+0.276305	test-rmse:2067.201416+2.815092 
## [1913]	train-rmse:2066.995239+0.275198	test-rmse:2066.994971+2.814941 
## [1914]	train-rmse:2066.790088+0.275908	test-rmse:2066.789136+2.814777 
## [1915]	train-rmse:2066.585351+0.275332	test-rmse:2066.583227+2.814757 
## [1916]	train-rmse:2066.378052+0.274148	test-rmse:2066.376831+2.814525 
## [1917]	train-rmse:2066.173706+0.276286	test-rmse:2066.170947+2.814757 
## [1918]	train-rmse:2065.965601+0.273819	test-rmse:2065.965137+2.814247 
## [1919]	train-rmse:2065.760547+0.275678	test-rmse:2065.758887+2.814642 
## [1920]	train-rmse:2065.553833+0.275191	test-rmse:2065.552856+2.814461 
## [1921]	train-rmse:2065.348193+0.274902	test-rmse:2065.346826+2.814283 
## [1922]	train-rmse:2065.143164+0.276482	test-rmse:2065.140967+2.814334 
## [1923]	train-rmse:2064.935913+0.273750	test-rmse:2064.935352+2.814347 
## [1924]	train-rmse:2064.731836+0.275596	test-rmse:2064.729321+2.814218 
## [1925]	train-rmse:2064.524097+0.274923	test-rmse:2064.523438+2.813917 
## [1926]	train-rmse:2064.318311+0.274466	test-rmse:2064.317725+2.813878 
## [1927]	train-rmse:2064.113355+0.276060	test-rmse:2064.111890+2.813849 
## [1928]	train-rmse:2063.907202+0.273264	test-rmse:2063.906103+2.813682 
## [1929]	train-rmse:2063.701978+0.275813	test-rmse:2063.700269+2.813622 
## [1930]	train-rmse:2063.494849+0.275048	test-rmse:2063.494727+2.813716 
## [1931]	train-rmse:2063.290112+0.274629	test-rmse:2063.288843+2.813670 
## [1932]	train-rmse:2063.084082+0.276411	test-rmse:2063.082984+2.813751 
## [1933]	train-rmse:2062.879004+0.273428	test-rmse:2062.877686+2.813643 
## [1934]	train-rmse:2062.672705+0.275848	test-rmse:2062.671631+2.813516 
## [1935]	train-rmse:2062.467212+0.274297	test-rmse:2062.466113+2.813391 
## [1936]	train-rmse:2062.261670+0.274757	test-rmse:2062.260376+2.812996 
## [1937]	train-rmse:2062.056103+0.275332	test-rmse:2062.054834+2.813483 
## [1938]	train-rmse:2061.851172+0.273515	test-rmse:2061.849219+2.813311 
## [1939]	train-rmse:2061.643848+0.275837	test-rmse:2061.643359+2.813043 
## [1940]	train-rmse:2061.439917+0.273700	test-rmse:2061.437964+2.813022 
## [1941]	train-rmse:2061.233057+0.275410	test-rmse:2061.232617+2.813002 
## [1942]	train-rmse:2061.028589+0.274525	test-rmse:2061.026904+2.813115 
## [1943]	train-rmse:2060.823169+0.274287	test-rmse:2060.821777+2.812906 
## [1944]	train-rmse:2060.616553+0.276172	test-rmse:2060.615991+2.812817 
## [1945]	train-rmse:2060.412573+0.273488	test-rmse:2060.410498+2.812992 
## [1946]	train-rmse:2060.205518+0.274734	test-rmse:2060.205298+2.812555 
## [1947]	train-rmse:2060.001489+0.274324	test-rmse:2059.999756+2.812310 
## [1948]	train-rmse:2059.795190+0.274306	test-rmse:2059.794336+2.812415 
## [1949]	train-rmse:2059.589453+0.276072	test-rmse:2059.588965+2.812140 
## [1950]	train-rmse:2059.386035+0.272759	test-rmse:2059.383545+2.812130 
## [1951]	train-rmse:2059.178271+0.275382	test-rmse:2059.178271+2.812235 
## [1952]	train-rmse:2058.975073+0.273870	test-rmse:2058.972900+2.812111 
## [1953]	train-rmse:2058.768726+0.274669	test-rmse:2058.767798+2.811883 
## [1954]	train-rmse:2058.563330+0.273882	test-rmse:2058.562500+2.812107 
## [1955]	train-rmse:2058.359326+0.273113	test-rmse:2058.357471+2.811804 
## [1956]	train-rmse:2058.151514+0.275694	test-rmse:2058.152075+2.811773 
## [1957]	train-rmse:2057.949219+0.273504	test-rmse:2057.946972+2.811877 
## [1958]	train-rmse:2057.742310+0.274725	test-rmse:2057.741651+2.811777 
## [1959]	train-rmse:2057.538037+0.273743	test-rmse:2057.536646+2.811806 
## [1960]	train-rmse:2057.331787+0.273520	test-rmse:2057.331347+2.811379 
## [1961]	train-rmse:2057.126392+0.275719	test-rmse:2057.126074+2.811422 
## [1962]	train-rmse:2056.923657+0.272541	test-rmse:2056.921191+2.811449 
## [1963]	train-rmse:2056.715625+0.274339	test-rmse:2056.715918+2.811511 
## [1964]	train-rmse:2056.512744+0.273617	test-rmse:2056.510913+2.811260 
## [1965]	train-rmse:2056.306836+0.273217	test-rmse:2056.305762+2.811086 
## [1966]	train-rmse:2056.102344+0.275160	test-rmse:2056.101026+2.811328 
## [1967]	train-rmse:2055.898389+0.272301	test-rmse:2055.895752+2.811130 
## [1968]	train-rmse:2055.690942+0.275027	test-rmse:2055.690771+2.810895 
## [1969]	train-rmse:2055.487891+0.273580	test-rmse:2055.485937+2.811074 
## [1970]	train-rmse:2055.281518+0.273845	test-rmse:2055.281006+2.810973 
## [1971]	train-rmse:2055.077197+0.274118	test-rmse:2055.076050+2.810846 
## [1972]	train-rmse:2054.873169+0.272618	test-rmse:2054.871216+2.810559 
## [1973]	train-rmse:2054.666260+0.275230	test-rmse:2054.666113+2.810646 
## [1974]	train-rmse:2054.464038+0.273385	test-rmse:2054.461401+2.810864 
## [1975]	train-rmse:2054.256592+0.273811	test-rmse:2054.256567+2.810474 
## [1976]	train-rmse:2054.053467+0.273749	test-rmse:2054.051880+2.810322 
## [1977]	train-rmse:2053.847485+0.273249	test-rmse:2053.847144+2.810380 
## [1978]	train-rmse:2053.642578+0.274700	test-rmse:2053.642163+2.810337 
## [1979]	train-rmse:2053.440161+0.272949	test-rmse:2053.437451+2.810019 
## [1980]	train-rmse:2053.232471+0.273486	test-rmse:2053.232788+2.809962 
## [1981]	train-rmse:2053.030737+0.273889	test-rmse:2053.027930+2.810368 
## [1982]	train-rmse:2052.823193+0.272590	test-rmse:2052.823218+2.809981 
## [1983]	train-rmse:2052.620386+0.274376	test-rmse:2052.618726+2.810091 
## [1984]	train-rmse:2052.415356+0.272437	test-rmse:2052.413867+2.810088 
## [1985]	train-rmse:2052.208716+0.273369	test-rmse:2052.209155+2.809824 
## [1986]	train-rmse:2052.007617+0.273523	test-rmse:2052.004834+2.809806 
## [1987]	train-rmse:2051.800342+0.273072	test-rmse:2051.800293+2.809709 
## [1988]	train-rmse:2051.597339+0.273230	test-rmse:2051.595569+2.809558 
## [1989]	train-rmse:2051.391821+0.272806	test-rmse:2051.390857+2.809652 
## [1990]	train-rmse:2051.186011+0.273646	test-rmse:2051.186548+2.809341 
## [1991]	train-rmse:2050.984546+0.272707	test-rmse:2050.981909+2.809471 
## [1992]	train-rmse:2050.777368+0.273236	test-rmse:2050.777771+2.809351 
## [1993]	train-rmse:2050.574683+0.273677	test-rmse:2050.573181+2.809369 
## [1994]	train-rmse:2050.369629+0.272101	test-rmse:2050.368848+2.809106 
## [1995]	train-rmse:2050.165430+0.274259	test-rmse:2050.164490+2.808922 
## [1996]	train-rmse:2049.961768+0.273070	test-rmse:2049.959643+2.809296 
## [1997]	train-rmse:2049.754736+0.273769	test-rmse:2049.755420+2.809106 
## [1998]	train-rmse:2049.552246+0.272760	test-rmse:2049.551331+2.809080 
## [1999]	train-rmse:2049.346826+0.272977	test-rmse:2049.346753+2.808843 
## [2000]	train-rmse:2049.143579+0.274064	test-rmse:2049.142285+2.808869 
## [2001]	train-rmse:2048.938965+0.272694	test-rmse:2048.937964+2.808891 
## [2002]	train-rmse:2048.734497+0.273338	test-rmse:2048.733899+2.808565 
## [2003]	train-rmse:2048.531543+0.272889	test-rmse:2048.529565+2.808842 
## [2004]	train-rmse:2048.325501+0.272344	test-rmse:2048.325403+2.808484 
## [2005]	train-rmse:2048.122485+0.273436	test-rmse:2048.121167+2.808494 
## [2006]	train-rmse:2047.917725+0.271550	test-rmse:2047.917004+2.808578 
## [2007]	train-rmse:2047.712842+0.273141	test-rmse:2047.712890+2.808397 
## [2008]	train-rmse:2047.510962+0.272709	test-rmse:2047.508655+2.808052 
## [2009]	train-rmse:2047.304248+0.272441	test-rmse:2047.304382+2.807928 
## [2010]	train-rmse:2047.102344+0.273803	test-rmse:2047.100122+2.808047 
## [2011]	train-rmse:2046.896582+0.272020	test-rmse:2046.896020+2.808144 
## [2012]	train-rmse:2046.692493+0.273377	test-rmse:2046.692285+2.808004 
## [2013]	train-rmse:2046.489820+0.272536	test-rmse:2046.488025+2.807697 
## [2014]	train-rmse:2046.283887+0.271895	test-rmse:2046.283960+2.807927 
## [2015]	train-rmse:2046.081579+0.273612	test-rmse:2046.079761+2.807639 
## [2016]	train-rmse:2045.875818+0.271847	test-rmse:2045.875867+2.807837 
## [2017]	train-rmse:2045.672876+0.272985	test-rmse:2045.671814+2.807685 
## [2018]	train-rmse:2045.469849+0.272492	test-rmse:2045.468298+2.807555 
## [2019]	train-rmse:2045.265100+0.271638	test-rmse:2045.264160+2.807613 
## [2020]	train-rmse:2045.060815+0.272192	test-rmse:2045.059912+2.807437 
## [2021]	train-rmse:2044.856702+0.272228	test-rmse:2044.856201+2.807395 
## [2022]	train-rmse:2044.654333+0.273943	test-rmse:2044.652527+2.807309 
## [2023]	train-rmse:2044.449316+0.271435	test-rmse:2044.448682+2.807205 
## [2024]	train-rmse:2044.245606+0.271876	test-rmse:2044.244788+2.807198 
## [2025]	train-rmse:2044.041443+0.272208	test-rmse:2044.041064+2.807187 
## [2026]	train-rmse:2043.836865+0.272013	test-rmse:2043.836975+2.807172 
## [2027]	train-rmse:2043.635669+0.273002	test-rmse:2043.633130+2.807109 
## [2028]	train-rmse:2043.430066+0.271145	test-rmse:2043.429675+2.806745 
## [2029]	train-rmse:2043.226245+0.272811	test-rmse:2043.225659+2.806881 
## [2030]	train-rmse:2043.022974+0.272155	test-rmse:2043.022254+2.806448 
## [2031]	train-rmse:2042.819080+0.271737	test-rmse:2042.818494+2.806366 
## [2032]	train-rmse:2042.617615+0.271788	test-rmse:2042.614722+2.806641 
## [2033]	train-rmse:2042.411072+0.271159	test-rmse:2042.411096+2.806405 
## [2034]	train-rmse:2042.207849+0.272394	test-rmse:2042.207568+2.806308 
## [2035]	train-rmse:2042.005396+0.272185	test-rmse:2042.003918+2.806162 
## [2036]	train-rmse:2041.801172+0.271573	test-rmse:2041.800122+2.806542 
## [2037]	train-rmse:2041.598462+0.272310	test-rmse:2041.596777+2.806104 
## [2038]	train-rmse:2041.393726+0.270559	test-rmse:2041.393372+2.805938 
## [2039]	train-rmse:2041.191040+0.272824	test-rmse:2041.189660+2.805948 
## [2040]	train-rmse:2040.988025+0.271768	test-rmse:2040.986450+2.805791 
## [2041]	train-rmse:2040.783545+0.271049	test-rmse:2040.782788+2.805735 
## [2042]	train-rmse:2040.580554+0.272095	test-rmse:2040.579309+2.806037 
## [2043]	train-rmse:2040.376379+0.271526	test-rmse:2040.376111+2.805760 
## [2044]	train-rmse:2040.174255+0.271638	test-rmse:2040.172376+2.805822 
## [2045]	train-rmse:2039.969922+0.271658	test-rmse:2039.968811+2.805799 
## [2046]	train-rmse:2039.766077+0.271574	test-rmse:2039.765515+2.805625 
## [2047]	train-rmse:2039.563586+0.272233	test-rmse:2039.562060+2.805627 
## [2048]	train-rmse:2039.359729+0.271660	test-rmse:2039.358801+2.805476 
## [2049]	train-rmse:2039.156494+0.271219	test-rmse:2039.155566+2.805359 
## [2050]	train-rmse:2038.952759+0.271278	test-rmse:2038.952503+2.805353 
## [2051]	train-rmse:2038.750293+0.271687	test-rmse:2038.749146+2.805416 
## [2052]	train-rmse:2038.546667+0.272077	test-rmse:2038.545947+2.804998 
## [2053]	train-rmse:2038.343225+0.270992	test-rmse:2038.342407+2.805117 
## [2054]	train-rmse:2038.139539+0.271872	test-rmse:2038.139270+2.805239 
## [2055]	train-rmse:2037.936328+0.271699	test-rmse:2037.936340+2.805053 
## [2056]	train-rmse:2037.734729+0.271386	test-rmse:2037.732910+2.804793 
## [2057]	train-rmse:2037.529675+0.272026	test-rmse:2037.529687+2.804841 
## [2058]	train-rmse:2037.327856+0.270883	test-rmse:2037.326611+2.804668 
## [2059]	train-rmse:2037.123877+0.271797	test-rmse:2037.123389+2.804528 
## [2060]	train-rmse:2036.922083+0.270835	test-rmse:2036.920227+2.804685 
## [2061]	train-rmse:2036.718701+0.271415	test-rmse:2036.717322+2.804360 
## [2062]	train-rmse:2036.513880+0.270820	test-rmse:2036.514173+2.804493 
## [2063]	train-rmse:2036.313281+0.271581	test-rmse:2036.311243+2.804541 
## [2064]	train-rmse:2036.107666+0.271252	test-rmse:2036.108179+2.804317 
## [2065]	train-rmse:2035.907239+0.270317	test-rmse:2035.905017+2.804237 
## [2066]	train-rmse:2035.702478+0.272253	test-rmse:2035.702149+2.804338 
## [2067]	train-rmse:2035.499585+0.270774	test-rmse:2035.499268+2.804222 
## [2068]	train-rmse:2035.298730+0.271166	test-rmse:2035.296252+2.803937 
## [2069]	train-rmse:2035.092773+0.271274	test-rmse:2035.093494+2.803669 
## [2070]	train-rmse:2034.892639+0.270826	test-rmse:2034.890601+2.804075 
## [2071]	train-rmse:2034.687988+0.272085	test-rmse:2034.687585+2.804041 
## [2072]	train-rmse:2034.485461+0.270071	test-rmse:2034.484705+2.803767 
## [2073]	train-rmse:2034.283740+0.271136	test-rmse:2034.282178+2.803707 
## [2074]	train-rmse:2034.078259+0.270654	test-rmse:2034.079431+2.803510 
## [2075]	train-rmse:2033.878735+0.270200	test-rmse:2033.876343+2.803647 
## [2076]	train-rmse:2033.673303+0.272004	test-rmse:2033.673547+2.803401 
## [2077]	train-rmse:2033.472192+0.269580	test-rmse:2033.471069+2.803452 
## [2078]	train-rmse:2033.268469+0.270796	test-rmse:2033.268176+2.803258 
## [2079]	train-rmse:2033.065576+0.270825	test-rmse:2033.065173+2.803160 
## [2080]	train-rmse:2032.865002+0.270902	test-rmse:2032.862769+2.803087 
## [2081]	train-rmse:2032.659119+0.271409	test-rmse:2032.659924+2.802954 
## [2082]	train-rmse:2032.459363+0.269448	test-rmse:2032.457288+2.803272 
## [2083]	train-rmse:2032.255103+0.271327	test-rmse:2032.254627+2.802868 
## [2084]	train-rmse:2032.052319+0.270172	test-rmse:2032.052014+2.803069 
## [2085]	train-rmse:2031.851856+0.270373	test-rmse:2031.849585+2.803160 
## [2086]	train-rmse:2031.646472+0.272208	test-rmse:2031.646753+2.802911 
## [2087]	train-rmse:2031.446594+0.269014	test-rmse:2031.444189+2.802916 
## [2088]	train-rmse:2031.241809+0.271172	test-rmse:2031.241980+2.802616 
## [2089]	train-rmse:2031.039624+0.269931	test-rmse:2031.039404+2.802675 
## [2090]	train-rmse:2030.839246+0.270165	test-rmse:2030.836658+2.802564 
## [2091]	train-rmse:2030.633594+0.271067	test-rmse:2030.634668+2.802500 
## [2092]	train-rmse:2030.433166+0.269722	test-rmse:2030.431763+2.802279 
## [2093]	train-rmse:2030.230212+0.271644	test-rmse:2030.229700+2.802300 
## [2094]	train-rmse:2030.028613+0.269888	test-rmse:2030.027039+2.802273 
## [2095]	train-rmse:2029.826489+0.269534	test-rmse:2029.824695+2.801920 
## [2096]	train-rmse:2029.621680+0.270651	test-rmse:2029.622351+2.802236 
## [2097]	train-rmse:2029.422144+0.269976	test-rmse:2029.419861+2.802331 
## [2098]	train-rmse:2029.217615+0.271195	test-rmse:2029.217676+2.802214 
## [2099]	train-rmse:2029.016699+0.269586	test-rmse:2029.015479+2.801768 
## [2100]	train-rmse:2028.814185+0.270117	test-rmse:2028.813074+2.801952 
## [2101]	train-rmse:2028.610132+0.270866	test-rmse:2028.611011+2.801749 
## [2102]	train-rmse:2028.411035+0.269488	test-rmse:2028.408643+2.801772 
## [2103]	train-rmse:2028.205774+0.270542	test-rmse:2028.206396+2.801574 
## [2104]	train-rmse:2028.006006+0.269715	test-rmse:2028.004004+2.801681 
## [2105]	train-rmse:2027.802368+0.270000	test-rmse:2027.801612+2.801709 
## [2106]	train-rmse:2027.599731+0.270729	test-rmse:2027.599914+2.801232 
## [2107]	train-rmse:2027.399670+0.269402	test-rmse:2027.397669+2.801321 
## [2108]	train-rmse:2027.195618+0.270212	test-rmse:2027.195325+2.801438 
## [2109]	train-rmse:2026.995044+0.269405	test-rmse:2026.993518+2.801320 
## [2110]	train-rmse:2026.791260+0.270470	test-rmse:2026.791101+2.801305 
## [2111]	train-rmse:2026.589648+0.270361	test-rmse:2026.589221+2.801266 
## [2112]	train-rmse:2026.388538+0.268563	test-rmse:2026.387207+2.801055 
## [2113]	train-rmse:2026.184680+0.269971	test-rmse:2026.185193+2.800874 
## [2114]	train-rmse:2025.985303+0.269614	test-rmse:2025.983484+2.800814 
## [2115]	train-rmse:2025.780383+0.269907	test-rmse:2025.781372+2.800727 
## [2116]	train-rmse:2025.580383+0.270036	test-rmse:2025.579285+2.800746 
## [2117]	train-rmse:2025.378320+0.269780	test-rmse:2025.377441+2.800754 
## [2118]	train-rmse:2025.174976+0.269889	test-rmse:2025.175672+2.800666 
## [2119]	train-rmse:2024.975635+0.268917	test-rmse:2024.973437+2.800576 
## [2120]	train-rmse:2024.770789+0.269373	test-rmse:2024.771643+2.800591 
## [2121]	train-rmse:2024.571179+0.269790	test-rmse:2024.569824+2.800476 
## [2122]	train-rmse:2024.368396+0.269727	test-rmse:2024.367944+2.800352 
## [2123]	train-rmse:2024.166138+0.269650	test-rmse:2024.166113+2.800385 
## [2124]	train-rmse:2023.966345+0.268801	test-rmse:2023.964526+2.800173 
## [2125]	train-rmse:2023.761877+0.269417	test-rmse:2023.762585+2.800329 
## [2126]	train-rmse:2023.562793+0.269689	test-rmse:2023.560815+2.800200 
## [2127]	train-rmse:2023.358557+0.269883	test-rmse:2023.358960+2.799990 
## [2128]	train-rmse:2023.157641+0.269779	test-rmse:2023.157459+2.800163 
## [2129]	train-rmse:2022.957788+0.268021	test-rmse:2022.955811+2.800159 
## [2130]	train-rmse:2022.752698+0.269784	test-rmse:2022.753992+2.799821 
## [2131]	train-rmse:2022.554712+0.269149	test-rmse:2022.552441+2.800043 
## [2132]	train-rmse:2022.350452+0.269389	test-rmse:2022.350708+2.799444 
## [2133]	train-rmse:2022.150061+0.268976	test-rmse:2022.149182+2.799568 
## [2134]	train-rmse:2021.948706+0.268388	test-rmse:2021.947705+2.799748 
## [2135]	train-rmse:2021.745166+0.269945	test-rmse:2021.745874+2.799465 
## [2136]	train-rmse:2021.546387+0.269114	test-rmse:2021.544141+2.799267 
## [2137]	train-rmse:2021.341907+0.269746	test-rmse:2021.342834+2.799544 
## [2138]	train-rmse:2021.142017+0.268979	test-rmse:2021.141138+2.799460 
## [2139]	train-rmse:2020.940942+0.269212	test-rmse:2020.939575+2.799408 
## [2140]	train-rmse:2020.737732+0.269932	test-rmse:2020.738184+2.799255 
## [2141]	train-rmse:2020.538562+0.268681	test-rmse:2020.536609+2.799173 
## [2142]	train-rmse:2020.335181+0.269068	test-rmse:2020.335449+2.798848 
## [2143]	train-rmse:2020.134741+0.268571	test-rmse:2020.134167+2.798893 
## [2144]	train-rmse:2019.933606+0.269514	test-rmse:2019.932458+2.798794 
## [2145]	train-rmse:2019.730945+0.269584	test-rmse:2019.731201+2.798912 
## [2146]	train-rmse:2019.531897+0.268098	test-rmse:2019.529993+2.798812 
## [2147]	train-rmse:2019.327942+0.269047	test-rmse:2019.328577+2.798754 
## [2148]	train-rmse:2019.127319+0.268052	test-rmse:2019.127185+2.798594 
## [2149]	train-rmse:2018.927038+0.269600	test-rmse:2018.925903+2.798571 
## [2150]	train-rmse:2018.724304+0.269911	test-rmse:2018.724744+2.798813 
## [2151]	train-rmse:2018.525281+0.267749	test-rmse:2018.523315+2.798432 
## [2152]	train-rmse:2018.321021+0.268952	test-rmse:2018.322168+2.798257 
## [2153]	train-rmse:2018.121716+0.268087	test-rmse:2018.120935+2.798518 
## [2154]	train-rmse:2017.920410+0.269154	test-rmse:2017.919787+2.798245 
## [2155]	train-rmse:2017.719080+0.269149	test-rmse:2017.718860+2.798034 
## [2156]	train-rmse:2017.519360+0.268059	test-rmse:2017.517273+2.797887 
## [2157]	train-rmse:2017.314563+0.269003	test-rmse:2017.316077+2.798323 
## [2158]	train-rmse:2017.117102+0.268015	test-rmse:2017.115295+2.797743 
## [2159]	train-rmse:2016.914160+0.269164	test-rmse:2016.913977+2.797839 
## [2160]	train-rmse:2016.712195+0.268436	test-rmse:2016.712891+2.797845 
## [2161]	train-rmse:2016.514001+0.267456	test-rmse:2016.512122+2.797691 
## [2162]	train-rmse:2016.309729+0.269763	test-rmse:2016.310974+2.797552 
## [2163]	train-rmse:2016.112097+0.267699	test-rmse:2016.109961+2.797738 
## [2164]	train-rmse:2015.908728+0.269338	test-rmse:2015.908814+2.797589 
## [2165]	train-rmse:2015.708057+0.267850	test-rmse:2015.707971+2.797302 
## [2166]	train-rmse:2015.508801+0.267109	test-rmse:2015.506812+2.797222 
## [2167]	train-rmse:2015.304602+0.269229	test-rmse:2015.305920+2.797207 
## [2168]	train-rmse:2015.106030+0.267186	test-rmse:2015.105115+2.797418 
## [2169]	train-rmse:2014.904675+0.269641	test-rmse:2014.904333+2.797164 
## [2170]	train-rmse:2014.703711+0.267713	test-rmse:2014.703345+2.797276 
## [2171]	train-rmse:2014.503821+0.266954	test-rmse:2014.502686+2.797501 
## [2172]	train-rmse:2014.301001+0.268823	test-rmse:2014.301892+2.797222 
## [2173]	train-rmse:2014.101489+0.267279	test-rmse:2014.100659+2.796861 
## [2174]	train-rmse:2013.899854+0.269360	test-rmse:2013.899731+2.796865 
## [2175]	train-rmse:2013.699744+0.268235	test-rmse:2013.699207+2.796931 
## [2176]	train-rmse:2013.498999+0.266989	test-rmse:2013.498340+2.796979 
## [2177]	train-rmse:2013.298059+0.269001	test-rmse:2013.297791+2.796706 
## [2178]	train-rmse:2013.097693+0.267579	test-rmse:2013.097192+2.796472 
## [2179]	train-rmse:2012.896558+0.268914	test-rmse:2012.896497+2.796436 
## [2180]	train-rmse:2012.696509+0.267402	test-rmse:2012.695679+2.796433 
## [2181]	train-rmse:2012.495093+0.267543	test-rmse:2012.494946+2.796228 
## [2182]	train-rmse:2012.295593+0.268294	test-rmse:2012.294507+2.796401 
## [2183]	train-rmse:2012.094006+0.267280	test-rmse:2012.093713+2.796231 
## [2184]	train-rmse:2011.893420+0.268549	test-rmse:2011.893103+2.796172 
## [2185]	train-rmse:2011.693945+0.267621	test-rmse:2011.692712+2.796128 
## [2186]	train-rmse:2011.492493+0.266983	test-rmse:2011.492163+2.795866 
## [2187]	train-rmse:2011.292578+0.268620	test-rmse:2011.291712+2.795932 
## [2188]	train-rmse:2011.090894+0.267192	test-rmse:2011.091174+2.795957 
## [2189]	train-rmse:2010.891223+0.267761	test-rmse:2010.890369+2.796133 
## [2190]	train-rmse:2010.690833+0.267040	test-rmse:2010.689819+2.796123 
## [2191]	train-rmse:2010.489648+0.267652	test-rmse:2010.489685+2.795880 
## [2192]	train-rmse:2010.289929+0.268394	test-rmse:2010.289294+2.795864 
## [2193]	train-rmse:2010.089477+0.267339	test-rmse:2010.088855+2.795823 
## [2194]	train-rmse:2009.889234+0.268420	test-rmse:2009.888257+2.795495 
## [2195]	train-rmse:2009.687854+0.266538	test-rmse:2009.687793+2.795544 
## [2196]	train-rmse:2009.488232+0.267725	test-rmse:2009.487586+2.795329 
## [2197]	train-rmse:2009.287878+0.268611	test-rmse:2009.287439+2.795309 
## [2198]	train-rmse:2009.087378+0.266417	test-rmse:2009.087146+2.795366 
## [2199]	train-rmse:2008.887402+0.267929	test-rmse:2008.886792+2.795254 
## [2200]	train-rmse:2008.686450+0.265879	test-rmse:2008.686450+2.795094 
## [2201]	train-rmse:2008.487073+0.267408	test-rmse:2008.486377+2.794938 
## [2202]	train-rmse:2008.286377+0.268552	test-rmse:2008.285937+2.795091 
## [2203]	train-rmse:2008.086218+0.265980	test-rmse:2008.085718+2.795033 
## [2204]	train-rmse:2007.886475+0.267462	test-rmse:2007.885449+2.794980 
## [2205]	train-rmse:2007.684936+0.266395	test-rmse:2007.685461+2.794645 
## [2206]	train-rmse:2007.486023+0.267431	test-rmse:2007.485119+2.794524 
## [2207]	train-rmse:2007.285974+0.268133	test-rmse:2007.285144+2.794458 
## [2208]	train-rmse:2007.085462+0.266095	test-rmse:2007.084900+2.794462 
## [2209]	train-rmse:2006.885913+0.267583	test-rmse:2006.884973+2.794472 
## [2210]	train-rmse:2006.684814+0.266783	test-rmse:2006.684924+2.794270 
## [2211]	train-rmse:2006.484631+0.267302	test-rmse:2006.484827+2.794417 
## [2212]	train-rmse:2006.285230+0.268446	test-rmse:2006.284778+2.794354 
## [2213]	train-rmse:2006.084265+0.266066	test-rmse:2006.085095+2.794376 
## [2214]	train-rmse:2005.886023+0.267178	test-rmse:2005.884863+2.794076 
## [2215]	train-rmse:2005.685071+0.266735	test-rmse:2005.684705+2.793947 
## [2216]	train-rmse:2005.484937+0.266806	test-rmse:2005.484815+2.794118 
## [2217]	train-rmse:2005.285925+0.267785	test-rmse:2005.284900+2.794121 
## [2218]	train-rmse:2005.084631+0.266294	test-rmse:2005.084998+2.793938 
## [2219]	train-rmse:2004.886475+0.266739	test-rmse:2004.885205+2.793814 
## [2220]	train-rmse:2004.684851+0.267316	test-rmse:2004.685364+2.793683 
## [2221]	train-rmse:2004.485889+0.266816	test-rmse:2004.485413+2.793898 
## [2222]	train-rmse:2004.286206+0.266948	test-rmse:2004.285571+2.793615 
## [2223]	train-rmse:2004.085303+0.265918	test-rmse:2004.085669+2.793572 
## [2224]	train-rmse:2003.886780+0.266918	test-rmse:2003.886145+2.793386 
## [2225]	train-rmse:2003.685535+0.266519	test-rmse:2003.686218+2.793468 
## [2226]	train-rmse:2003.487207+0.266518	test-rmse:2003.486487+2.793517 
## [2227]	train-rmse:2003.287390+0.267170	test-rmse:2003.286719+2.793441 
## [2228]	train-rmse:2003.086377+0.266626	test-rmse:2003.087085+2.793332 
## [2229]	train-rmse:2002.888611+0.266701	test-rmse:2002.887341+2.793127 
## [2230]	train-rmse:2002.687634+0.266551	test-rmse:2002.687757+2.793230 
## [2231]	train-rmse:2002.488525+0.265908	test-rmse:2002.488245+2.792997 
## [2232]	train-rmse:2002.288818+0.266492	test-rmse:2002.288391+2.792761 
## [2233]	train-rmse:2002.088928+0.266055	test-rmse:2002.088733+2.793083 
## [2234]	train-rmse:2001.890466+0.266717	test-rmse:2001.889343+2.792836 
## [2235]	train-rmse:2001.689221+0.266793	test-rmse:2001.689685+2.792878 
## [2236]	train-rmse:2001.490735+0.266096	test-rmse:2001.490112+2.793027 
## [2237]	train-rmse:2001.291003+0.266818	test-rmse:2001.290576+2.792761 
## [2238]	train-rmse:2001.091492+0.266169	test-rmse:2001.090869+2.792807 
## [2239]	train-rmse:2000.892493+0.266737	test-rmse:2000.891443+2.792805 
## [2240]	train-rmse:2000.691797+0.265770	test-rmse:2000.691980+2.792478 
## [2241]	train-rmse:2000.492956+0.265639	test-rmse:2000.492578+2.792456 
## [2242]	train-rmse:2000.292993+0.266441	test-rmse:2000.293189+2.792112 
## [2243]	train-rmse:2000.093481+0.266347	test-rmse:2000.093762+2.792045 
## [2244]	train-rmse:1999.895068+0.266998	test-rmse:1999.894702+2.792115 
## [2245]	train-rmse:1999.694751+0.266026	test-rmse:1999.695068+2.792121 
## [2246]	train-rmse:1999.496667+0.265026	test-rmse:1999.495654+2.791977 
## [2247]	train-rmse:1999.296386+0.266759	test-rmse:1999.296130+2.791921 
## [2248]	train-rmse:1999.097449+0.265878	test-rmse:1999.097156+2.791971 
## [2249]	train-rmse:1998.898291+0.266206	test-rmse:1998.897900+2.791943 
## [2250]	train-rmse:1998.698474+0.266754	test-rmse:1998.698157+2.791876 
## [2251]	train-rmse:1998.500330+0.265439	test-rmse:1998.499280+2.791847 
## [2252]	train-rmse:1998.299780+0.266607	test-rmse:1998.300122+2.791493 
## [2253]	train-rmse:1998.102210+0.264951	test-rmse:1998.100684+2.791445 
## [2254]	train-rmse:1997.901587+0.265867	test-rmse:1997.901782+2.791260 
## [2255]	train-rmse:1997.702270+0.266043	test-rmse:1997.702563+2.791432 
## [2256]	train-rmse:1997.504956+0.265118	test-rmse:1997.503210+2.791342 
## [2257]	train-rmse:1997.303259+0.266919	test-rmse:1997.303992+2.791183 
## [2258]	train-rmse:1997.106433+0.264848	test-rmse:1997.104919+2.791082 
## [2259]	train-rmse:1996.905786+0.265571	test-rmse:1996.905945+2.791190 
## [2260]	train-rmse:1996.706384+0.265669	test-rmse:1996.706909+2.791142 
## [2261]	train-rmse:1996.509741+0.265133	test-rmse:1996.507715+2.791206 
## [2262]	train-rmse:1996.308203+0.266782	test-rmse:1996.308691+2.790852 
## [2263]	train-rmse:1996.110913+0.264712	test-rmse:1996.109619+2.790742 
## [2264]	train-rmse:1995.910950+0.265295	test-rmse:1995.910535+2.790820 
## [2265]	train-rmse:1995.711340+0.265802	test-rmse:1995.712024+2.790787 
## [2266]	train-rmse:1995.514416+0.265620	test-rmse:1995.512683+2.790685 
## [2267]	train-rmse:1995.312915+0.266670	test-rmse:1995.313867+2.790708 
## [2268]	train-rmse:1995.116626+0.264434	test-rmse:1995.114844+2.790510 
## [2269]	train-rmse:1994.916272+0.266181	test-rmse:1994.916064+2.790272 
## [2270]	train-rmse:1994.717285+0.265059	test-rmse:1994.717285+2.790505 
## [2271]	train-rmse:1994.519910+0.265004	test-rmse:1994.518469+2.790300 
## [2272]	train-rmse:1994.318237+0.266333	test-rmse:1994.319617+2.790350 
## [2273]	train-rmse:1994.122302+0.264998	test-rmse:1994.120764+2.790309 
## [2274]	train-rmse:1993.921289+0.265510	test-rmse:1993.922022+2.790222 
## [2275]	train-rmse:1993.723120+0.265358	test-rmse:1993.723450+2.789918 
## [2276]	train-rmse:1993.525977+0.264735	test-rmse:1993.524536+2.789816 
## [2277]	train-rmse:1993.324817+0.266584	test-rmse:1993.325818+2.789983 
## [2278]	train-rmse:1993.128747+0.264717	test-rmse:1993.127161+2.789842 
## [2279]	train-rmse:1992.927710+0.264904	test-rmse:1992.928357+2.789593 
## [2280]	train-rmse:1992.729578+0.265023	test-rmse:1992.729541+2.789846 
## [2281]	train-rmse:1992.532544+0.265524	test-rmse:1992.531043+2.789663 
## [2282]	train-rmse:1992.331067+0.266397	test-rmse:1992.332556+2.789823 
## [2283]	train-rmse:1992.135937+0.264134	test-rmse:1992.133899+2.789726 
## [2284]	train-rmse:1991.935083+0.264290	test-rmse:1991.935278+2.789411 
## [2285]	train-rmse:1991.735840+0.265861	test-rmse:1991.736841+2.789379 
## [2286]	train-rmse:1991.539380+0.264682	test-rmse:1991.538013+2.789354 
## [2287]	train-rmse:1991.337793+0.266194	test-rmse:1991.339343+2.789384 
## [2288]	train-rmse:1991.142822+0.264348	test-rmse:1991.141065+2.789160 
## [2289]	train-rmse:1990.942102+0.264998	test-rmse:1990.942505+2.789015 
## [2290]	train-rmse:1990.743384+0.264957	test-rmse:1990.743933+2.789252 
## [2291]	train-rmse:1990.546912+0.264163	test-rmse:1990.545569+2.789380 
## [2292]	train-rmse:1990.346081+0.265458	test-rmse:1990.347131+2.789040 
## [2293]	train-rmse:1990.150366+0.264865	test-rmse:1990.148779+2.788702 
## [2294]	train-rmse:1989.950366+0.264424	test-rmse:1989.950464+2.789105 
## [2295]	train-rmse:1989.750989+0.264952	test-rmse:1989.752051+2.788819 
## [2296]	train-rmse:1989.554394+0.264514	test-rmse:1989.553491+2.788844 
## [2297]	train-rmse:1989.354053+0.265658	test-rmse:1989.355139+2.788642 
## [2298]	train-rmse:1989.157947+0.263639	test-rmse:1989.156750+2.788667 
## [2299]	train-rmse:1988.959460+0.265106	test-rmse:1988.958777+2.788431 
## [2300]	train-rmse:1988.759778+0.265269	test-rmse:1988.760437+2.788226 
## [2301]	train-rmse:1988.563537+0.263398	test-rmse:1988.562000+2.788220 
## [2302]	train-rmse:1988.362463+0.265926	test-rmse:1988.363794+2.788394 
## [2303]	train-rmse:1988.166760+0.263590	test-rmse:1988.165894+2.788240 
## [2304]	train-rmse:1987.968164+0.264533	test-rmse:1987.967517+2.787850 
## [2305]	train-rmse:1987.768604+0.265518	test-rmse:1987.769324+2.788090 
## [2306]	train-rmse:1987.572107+0.263612	test-rmse:1987.571106+2.787622 
## [2307]	train-rmse:1987.372278+0.264989	test-rmse:1987.373157+2.787739 
## [2308]	train-rmse:1987.176025+0.263660	test-rmse:1987.175134+2.787797 
## [2309]	train-rmse:1986.976892+0.264520	test-rmse:1986.976978+2.787728 
## [2310]	train-rmse:1986.778564+0.264523	test-rmse:1986.778870+2.787504 
## [2311]	train-rmse:1986.582410+0.262753	test-rmse:1986.580554+2.787678 
## [2312]	train-rmse:1986.381873+0.264859	test-rmse:1986.382617+2.787714 
## [2313]	train-rmse:1986.186109+0.264081	test-rmse:1986.184753+2.787444 
## [2314]	train-rmse:1985.986475+0.264362	test-rmse:1985.986658+2.787544 
## [2315]	train-rmse:1985.788305+0.264062	test-rmse:1985.788538+2.787411 
## [2316]	train-rmse:1985.592505+0.262990	test-rmse:1985.590564+2.787259 
## [2317]	train-rmse:1985.391699+0.265554	test-rmse:1985.392822+2.787098 
## [2318]	train-rmse:1985.195239+0.264481	test-rmse:1985.194971+2.787134 
## [2319]	train-rmse:1984.996790+0.263609	test-rmse:1984.997083+2.786970 
## [2320]	train-rmse:1984.799072+0.264120	test-rmse:1984.799096+2.787136 
## [2321]	train-rmse:1984.602356+0.262639	test-rmse:1984.601208+2.786885 
## [2322]	train-rmse:1984.402087+0.264541	test-rmse:1984.403357+2.786981 
## [2323]	train-rmse:1984.206396+0.263789	test-rmse:1984.205615+2.786826 
## [2324]	train-rmse:1984.007751+0.264132	test-rmse:1984.007471+2.786504 
## [2325]	train-rmse:1983.809680+0.264970	test-rmse:1983.809705+2.786581 
## [2326]	train-rmse:1983.613184+0.262536	test-rmse:1983.612146+2.786445 
## [2327]	train-rmse:1983.414087+0.264567	test-rmse:1983.414526+2.786599 
## [2328]	train-rmse:1983.217444+0.263411	test-rmse:1983.216809+2.786221 
## [2329]	train-rmse:1983.018982+0.263637	test-rmse:1983.018945+2.786285 
## [2330]	train-rmse:1982.820886+0.264484	test-rmse:1982.821362+2.786276 
## [2331]	train-rmse:1982.624048+0.262712	test-rmse:1982.623718+2.786279 
## [2332]	train-rmse:1982.425964+0.264307	test-rmse:1982.426184+2.786231 
## [2333]	train-rmse:1982.228931+0.263613	test-rmse:1982.228394+2.785952 
## [2334]	train-rmse:1982.030896+0.263837	test-rmse:1982.030859+2.785981 
## [2335]	train-rmse:1981.833277+0.264184	test-rmse:1981.833301+2.785767 
## [2336]	train-rmse:1981.636157+0.262688	test-rmse:1981.635925+2.785882 
## [2337]	train-rmse:1981.437439+0.264146	test-rmse:1981.438342+2.785958 
## [2338]	train-rmse:1981.241260+0.263655	test-rmse:1981.240662+2.785817 
## [2339]	train-rmse:1981.042676+0.263401	test-rmse:1981.043054+2.786076 
## [2340]	train-rmse:1980.845630+0.264761	test-rmse:1980.845606+2.785848 
## [2341]	train-rmse:1980.648486+0.262908	test-rmse:1980.648267+2.785529 
## [2342]	train-rmse:1980.450708+0.263909	test-rmse:1980.450708+2.785777 
## [2343]	train-rmse:1980.253796+0.264207	test-rmse:1980.253418+2.785467 
## [2344]	train-rmse:1980.055798+0.262276	test-rmse:1980.055945+2.785376 
## [2345]	train-rmse:1979.858789+0.264147	test-rmse:1979.858496+2.785263 
## [2346]	train-rmse:1979.661206+0.263058	test-rmse:1979.661353+2.785447 
## [2347]	train-rmse:1979.463135+0.263551	test-rmse:1979.463794+2.785207 
## [2348]	train-rmse:1979.266980+0.264382	test-rmse:1979.266406+2.785273 
## [2349]	train-rmse:1979.069019+0.263051	test-rmse:1979.069250+2.785132 
## [2350]	train-rmse:1978.872302+0.263821	test-rmse:1978.871765+2.785154 
## [2351]	train-rmse:1978.675037+0.262614	test-rmse:1978.674512+2.785027 
## [2352]	train-rmse:1978.476623+0.263433	test-rmse:1978.477637+2.785163 
## [2353]	train-rmse:1978.280725+0.263139	test-rmse:1978.280347+2.784919 
## [2354]	train-rmse:1978.081970+0.262919	test-rmse:1978.083045+2.784803 
## [2355]	train-rmse:1977.885864+0.263208	test-rmse:1977.886011+2.784626 
## [2356]	train-rmse:1977.689233+0.263210	test-rmse:1977.688709+2.784789 
## [2357]	train-rmse:1977.490650+0.263165	test-rmse:1977.491528+2.784628 
## [2358]	train-rmse:1977.294885+0.262869	test-rmse:1977.294446+2.784574 
## [2359]	train-rmse:1977.096839+0.262074	test-rmse:1977.097119+2.784502 
## [2360]	train-rmse:1976.900061+0.263262	test-rmse:1976.900134+2.784769 
## [2361]	train-rmse:1976.703345+0.263355	test-rmse:1976.703247+2.784329 
## [2362]	train-rmse:1976.505688+0.263128	test-rmse:1976.505749+2.784159 
## [2363]	train-rmse:1976.309949+0.262524	test-rmse:1976.308801+2.784352 
## [2364]	train-rmse:1976.112049+0.262109	test-rmse:1976.112134+2.783966 
## [2365]	train-rmse:1975.915234+0.262970	test-rmse:1975.914917+2.784176 
## [2366]	train-rmse:1975.718335+0.262719	test-rmse:1975.718115+2.784133 
## [2367]	train-rmse:1975.520789+0.262817	test-rmse:1975.521167+2.784085 
## [2368]	train-rmse:1975.324023+0.262889	test-rmse:1975.323999+2.783927 
## [2369]	train-rmse:1975.127563+0.262128	test-rmse:1975.127283+2.783848 
## [2370]	train-rmse:1974.930115+0.263109	test-rmse:1974.930151+2.783715 
## [2371]	train-rmse:1974.733203+0.263008	test-rmse:1974.733569+2.783686 
## [2372]	train-rmse:1974.536353+0.262618	test-rmse:1974.536548+2.783460 
## [2373]	train-rmse:1974.339722+0.262317	test-rmse:1974.339905+2.783622 
## [2374]	train-rmse:1974.143201+0.262791	test-rmse:1974.143066+2.783436 
## [2375]	train-rmse:1973.946045+0.263052	test-rmse:1973.946301+2.783368 
## [2376]	train-rmse:1973.749426+0.262096	test-rmse:1973.749512+2.783246 
## [2377]	train-rmse:1973.553052+0.262724	test-rmse:1973.552881+2.783363 
## [2378]	train-rmse:1973.355505+0.263088	test-rmse:1973.356104+2.782876 
## [2379]	train-rmse:1973.159216+0.262597	test-rmse:1973.159473+2.783368 
## [2380]	train-rmse:1972.962939+0.262283	test-rmse:1972.962647+2.782977 
## [2381]	train-rmse:1972.765198+0.262190	test-rmse:1972.765967+2.782888 
## [2382]	train-rmse:1972.569311+0.262399	test-rmse:1972.569397+2.782859 
## [2383]	train-rmse:1972.372400+0.262947	test-rmse:1972.372595+2.782790 
## [2384]	train-rmse:1972.176501+0.261987	test-rmse:1972.175989+2.782861 
## [2385]	train-rmse:1971.979675+0.261789	test-rmse:1971.979614+2.782872 
## [2386]	train-rmse:1971.781970+0.262412	test-rmse:1971.782813+2.782772 
## [2387]	train-rmse:1971.586352+0.261956	test-rmse:1971.586414+2.782713 
## [2388]	train-rmse:1971.389539+0.262731	test-rmse:1971.389697+2.782448 
## [2389]	train-rmse:1971.192810+0.262306	test-rmse:1971.193506+2.782752 
## [2390]	train-rmse:1970.996667+0.261991	test-rmse:1970.996741+2.782606 
## [2391]	train-rmse:1970.799732+0.262140	test-rmse:1970.800440+2.782249 
## [2392]	train-rmse:1970.604028+0.261838	test-rmse:1970.603833+2.782011 
## [2393]	train-rmse:1970.407287+0.262497	test-rmse:1970.407507+2.782109 
## [2394]	train-rmse:1970.211572+0.261877	test-rmse:1970.210950+2.782018 
## [2395]	train-rmse:1970.015075+0.261556	test-rmse:1970.014807+2.781643 
## [2396]	train-rmse:1969.817603+0.262740	test-rmse:1969.818213+2.782093 
## [2397]	train-rmse:1969.622144+0.261923	test-rmse:1969.621851+2.781726 
## [2398]	train-rmse:1969.425159+0.261904	test-rmse:1969.425745+2.781720 
## [2399]	train-rmse:1969.229285+0.262102	test-rmse:1969.229175+2.781724 
## [2400]	train-rmse:1969.033228+0.261002	test-rmse:1969.033118+2.781548 
## [2401]	train-rmse:1968.836011+0.262640	test-rmse:1968.836462+2.781615 
## [2402]	train-rmse:1968.640662+0.261168	test-rmse:1968.640198+2.781576 
## [2403]	train-rmse:1968.443311+0.262404	test-rmse:1968.444080+2.781524 
## [2404]	train-rmse:1968.247949+0.261672	test-rmse:1968.248084+2.781264 
## [2405]	train-rmse:1968.051550+0.261070	test-rmse:1968.051709+2.781357 
## [2406]	train-rmse:1967.855005+0.262655	test-rmse:1967.855579+2.781390 
## [2407]	train-rmse:1967.660327+0.261590	test-rmse:1967.659265+2.781189 
## [2408]	train-rmse:1967.462830+0.261360	test-rmse:1967.463184+2.781092 
## [2409]	train-rmse:1967.266821+0.262074	test-rmse:1967.267334+2.780974 
## [2410]	train-rmse:1967.071472+0.261255	test-rmse:1967.071167+2.781049 
## [2411]	train-rmse:1966.873706+0.261729	test-rmse:1966.874939+2.781108 
## [2412]	train-rmse:1966.679480+0.261361	test-rmse:1966.678797+2.780983 
## [2413]	train-rmse:1966.482678+0.261255	test-rmse:1966.483008+2.780766 
## [2414]	train-rmse:1966.286279+0.262027	test-rmse:1966.286951+2.780523 
## [2415]	train-rmse:1966.091418+0.260802	test-rmse:1966.090845+2.780583 
## [2416]	train-rmse:1965.894043+0.261529	test-rmse:1965.894873+2.780481 
## [2417]	train-rmse:1965.698535+0.261992	test-rmse:1965.698889+2.780393 
## [2418]	train-rmse:1965.503186+0.260653	test-rmse:1965.502966+2.780634 
## [2419]	train-rmse:1965.306653+0.261681	test-rmse:1965.307214+2.780723 
## [2420]	train-rmse:1965.110986+0.261098	test-rmse:1965.111230+2.780554 
## [2421]	train-rmse:1964.914819+0.261535	test-rmse:1964.915271+2.780377 
## [2422]	train-rmse:1964.718933+0.262164	test-rmse:1964.719543+2.780206 
## [2423]	train-rmse:1964.523608+0.260495	test-rmse:1964.523511+2.779899 
## [2424]	train-rmse:1964.327490+0.261301	test-rmse:1964.327661+2.780076 
## [2425]	train-rmse:1964.131396+0.261363	test-rmse:1964.131958+2.779974 
## [2426]	train-rmse:1963.935681+0.260720	test-rmse:1963.936291+2.779954 
## [2427]	train-rmse:1963.740186+0.260973	test-rmse:1963.740332+2.779926 
## [2428]	train-rmse:1963.545386+0.261423	test-rmse:1963.544714+2.779744 
## [2429]	train-rmse:1963.348450+0.260878	test-rmse:1963.348975+2.779811 
## [2430]	train-rmse:1963.152576+0.260751	test-rmse:1963.153052+2.779521 
## [2431]	train-rmse:1962.957019+0.260462	test-rmse:1962.957568+2.779446 
## [2432]	train-rmse:1962.761450+0.260989	test-rmse:1962.761829+2.779243 
## [2433]	train-rmse:1962.566223+0.262061	test-rmse:1962.566211+2.779444 
## [2434]	train-rmse:1962.369409+0.260613	test-rmse:1962.370496+2.779263 
## [2435]	train-rmse:1962.175281+0.260779	test-rmse:1962.175073+2.779381 
## [2436]	train-rmse:1961.978650+0.261355	test-rmse:1961.979443+2.779259 
## [2437]	train-rmse:1961.782947+0.260608	test-rmse:1961.783691+2.779077 
## [2438]	train-rmse:1961.588940+0.260767	test-rmse:1961.588232+2.779252 
## [2439]	train-rmse:1961.392005+0.261015	test-rmse:1961.392786+2.779162 
## [2440]	train-rmse:1961.196838+0.260050	test-rmse:1961.197107+2.779134 
## [2441]	train-rmse:1961.001868+0.260221	test-rmse:1961.001660+2.779132 
## [2442]	train-rmse:1960.805420+0.261327	test-rmse:1960.806323+2.778689 
## [2443]	train-rmse:1960.611120+0.260753	test-rmse:1960.610766+2.778740 
## [2444]	train-rmse:1960.414478+0.260385	test-rmse:1960.415381+2.778814 
## [2445]	train-rmse:1960.220251+0.260636	test-rmse:1960.219959+2.778680 
## [2446]	train-rmse:1960.023938+0.260014	test-rmse:1960.024487+2.778652 
## [2447]	train-rmse:1959.828406+0.260764	test-rmse:1959.829260+2.778457 
## [2448]	train-rmse:1959.633923+0.260577	test-rmse:1959.633972+2.778188 
## [2449]	train-rmse:1959.437451+0.260638	test-rmse:1959.438330+2.778450 
## [2450]	train-rmse:1959.242871+0.260401	test-rmse:1959.243384+2.778367 
## [2451]	train-rmse:1959.047485+0.260090	test-rmse:1959.047852+2.778089 
## [2452]	train-rmse:1958.851807+0.260803	test-rmse:1958.852564+2.778267 
## [2453]	train-rmse:1958.657727+0.259899	test-rmse:1958.657288+2.777993 
## [2454]	train-rmse:1958.460840+0.260430	test-rmse:1958.462293+2.778006 
## [2455]	train-rmse:1958.267236+0.260483	test-rmse:1958.266992+2.778073 
## [2456]	train-rmse:1958.070776+0.260475	test-rmse:1958.071936+2.777901 
## [2457]	train-rmse:1957.875500+0.260285	test-rmse:1957.876501+2.777831 
## [2458]	train-rmse:1957.682300+0.260368	test-rmse:1957.681226+2.777921 
## [2459]	train-rmse:1957.485193+0.260607	test-rmse:1957.486279+2.777647 
## [2460]	train-rmse:1957.291394+0.260002	test-rmse:1957.291064+2.777452 
## [2461]	train-rmse:1957.096082+0.260207	test-rmse:1957.095874+2.777763 
## [2462]	train-rmse:1956.899170+0.260543	test-rmse:1956.900842+2.777571 
## [2463]	train-rmse:1956.706775+0.260444	test-rmse:1956.705676+2.777446 
## [2464]	train-rmse:1956.510095+0.260123	test-rmse:1956.510876+2.777647 
## [2465]	train-rmse:1956.314990+0.260056	test-rmse:1956.315759+2.777486 
## [2466]	train-rmse:1956.120947+0.260311	test-rmse:1956.120740+2.777331 
## [2467]	train-rmse:1955.924512+0.260343	test-rmse:1955.925708+2.777176 
## [2468]	train-rmse:1955.730591+0.259535	test-rmse:1955.730578+2.777111 
## [2469]	train-rmse:1955.535058+0.259678	test-rmse:1955.535718+2.777053 
## [2470]	train-rmse:1955.340698+0.260276	test-rmse:1955.340930+2.776949 
## [2471]	train-rmse:1955.146142+0.259782	test-rmse:1955.146155+2.776786 
## [2472]	train-rmse:1954.950757+0.260717	test-rmse:1954.950903+2.776668 
## [2473]	train-rmse:1954.756726+0.260118	test-rmse:1954.756299+2.776624 
## [2474]	train-rmse:1954.560083+0.259508	test-rmse:1954.561426+2.776741 
## [2475]	train-rmse:1954.366138+0.259337	test-rmse:1954.366455+2.776339 
## [2476]	train-rmse:1954.171570+0.259859	test-rmse:1954.171777+2.776493 
## [2477]	train-rmse:1953.976111+0.260442	test-rmse:1953.977173+2.776559 
## [2478]	train-rmse:1953.782764+0.259146	test-rmse:1953.782202+2.776514 
## [2479]	train-rmse:1953.586499+0.260123	test-rmse:1953.587439+2.776593 
## [2480]	train-rmse:1953.392285+0.259589	test-rmse:1953.392725+2.776225 
## [2481]	train-rmse:1953.198157+0.258776	test-rmse:1953.198132+2.776101 
## [2482]	train-rmse:1953.002661+0.260986	test-rmse:1953.003271+2.775986 
## [2483]	train-rmse:1952.808972+0.259020	test-rmse:1952.808716+2.775895 
## [2484]	train-rmse:1952.613049+0.259798	test-rmse:1952.614002+2.775838 
## [2485]	train-rmse:1952.418469+0.259473	test-rmse:1952.419287+2.775627 
## [2486]	train-rmse:1952.224780+0.258728	test-rmse:1952.224731+2.775745 
## [2487]	train-rmse:1952.028931+0.260556	test-rmse:1952.030237+2.775715 
## [2488]	train-rmse:1951.836169+0.258302	test-rmse:1951.835583+2.775731 
## [2489]	train-rmse:1951.640210+0.259641	test-rmse:1951.641065+2.775771 
## [2490]	train-rmse:1951.445813+0.259453	test-rmse:1951.446289+2.775597 
## [2491]	train-rmse:1951.252246+0.258993	test-rmse:1951.251929+2.775571 
## [2492]	train-rmse:1951.056372+0.259797	test-rmse:1951.057446+2.775303 
## [2493]	train-rmse:1950.863074+0.258737	test-rmse:1950.863147+2.775087 
## [2494]	train-rmse:1950.668433+0.259954	test-rmse:1950.668530+2.775203 
## [2495]	train-rmse:1950.473438+0.259739	test-rmse:1950.474109+2.774951 
## [2496]	train-rmse:1950.280286+0.258647	test-rmse:1950.279516+2.775064 
## [2497]	train-rmse:1950.083984+0.259717	test-rmse:1950.085596+2.774968 
## [2498]	train-rmse:1949.891089+0.258800	test-rmse:1949.891138+2.775173 
## [2499]	train-rmse:1949.696423+0.258982	test-rmse:1949.696350+2.774857 
## [2500]	train-rmse:1949.500830+0.259736	test-rmse:1949.502014+2.775058 
## [2501]	train-rmse:1949.308460+0.258744	test-rmse:1949.307886+2.774902 
## [2502]	train-rmse:1949.112317+0.259789	test-rmse:1949.113636+2.774686 
## [2503]	train-rmse:1948.919336+0.258875	test-rmse:1948.919177+2.774773 
## [2504]	train-rmse:1948.724683+0.258424	test-rmse:1948.724915+2.774248 
## [2505]	train-rmse:1948.529675+0.259867	test-rmse:1948.530688+2.774517 
## [2506]	train-rmse:1948.337036+0.258087	test-rmse:1948.336560+2.774272 
## [2507]	train-rmse:1948.141699+0.258768	test-rmse:1948.142224+2.774533 
## [2508]	train-rmse:1947.947180+0.259399	test-rmse:1947.948193+2.774501 
## [2509]	train-rmse:1947.754102+0.257994	test-rmse:1947.754199+2.774553 
## [2510]	train-rmse:1947.559082+0.259750	test-rmse:1947.560046+2.774381 
## [2511]	train-rmse:1947.365393+0.258669	test-rmse:1947.365515+2.774173 
## [2512]	train-rmse:1947.170837+0.259570	test-rmse:1947.171777+2.773913 
## [2513]	train-rmse:1946.977197+0.259039	test-rmse:1946.977734+2.773980 
## [2514]	train-rmse:1946.783118+0.257981	test-rmse:1946.783728+2.773855 
## [2515]	train-rmse:1946.588696+0.259218	test-rmse:1946.589758+2.773868 
## [2516]	train-rmse:1946.394959+0.258668	test-rmse:1946.395679+2.773769 
## [2517]	train-rmse:1946.200293+0.258651	test-rmse:1946.201636+2.773848 
## [2518]	train-rmse:1946.007617+0.258469	test-rmse:1946.007837+2.773749 
## [2519]	train-rmse:1945.812781+0.258383	test-rmse:1945.813648+2.773681 
## [2520]	train-rmse:1945.618482+0.258905	test-rmse:1945.619568+2.773822 
## [2521]	train-rmse:1945.426245+0.258699	test-rmse:1945.425562+2.773724 
## [2522]	train-rmse:1945.230835+0.257718	test-rmse:1945.231750+2.773362 
## [2523]	train-rmse:1945.036755+0.258798	test-rmse:1945.037976+2.773201 
## [2524]	train-rmse:1944.844092+0.258190	test-rmse:1944.843897+2.773180 
## [2525]	train-rmse:1944.648816+0.258669	test-rmse:1944.650207+2.773016 
## [2526]	train-rmse:1944.455811+0.258312	test-rmse:1944.456360+2.773046 
## [2527]	train-rmse:1944.262219+0.258226	test-rmse:1944.262622+2.773190 
## [2528]	train-rmse:1944.066589+0.258422	test-rmse:1944.068433+2.773144 
## [2529]	train-rmse:1943.875012+0.257530	test-rmse:1943.874707+2.772993 
## [2530]	train-rmse:1943.680542+0.258573	test-rmse:1943.680969+2.772629 
## [2531]	train-rmse:1943.486438+0.258681	test-rmse:1943.487366+2.772550 
## [2532]	train-rmse:1943.293494+0.258432	test-rmse:1943.293738+2.772668 
## [2533]	train-rmse:1943.098474+0.258088	test-rmse:1943.099988+2.772818 
## [2534]	train-rmse:1942.905237+0.258111	test-rmse:1942.906250+2.772617 
## [2535]	train-rmse:1942.712292+0.258273	test-rmse:1942.712769+2.772491 
## [2536]	train-rmse:1942.518372+0.257879	test-rmse:1942.518896+2.772348 
## [2537]	train-rmse:1942.325134+0.257039	test-rmse:1942.325427+2.772717 
## [2538]	train-rmse:1942.131079+0.259198	test-rmse:1942.131763+2.772240 
## [2539]	train-rmse:1941.937244+0.258008	test-rmse:1941.938257+2.772164 
## [2540]	train-rmse:1941.744043+0.257761	test-rmse:1941.744556+2.772192 
## [2541]	train-rmse:1941.550207+0.258957	test-rmse:1941.551013+2.771907 
## [2542]	train-rmse:1941.356909+0.257233	test-rmse:1941.357422+2.771931 
## [2543]	train-rmse:1941.163232+0.258148	test-rmse:1941.164002+2.771837 
## [2544]	train-rmse:1940.969580+0.258057	test-rmse:1940.970813+2.771884 
## [2545]	train-rmse:1940.776331+0.258270	test-rmse:1940.777356+2.771972 
## [2546]	train-rmse:1940.582752+0.257840	test-rmse:1940.583691+2.772163 
## [2547]	train-rmse:1940.389307+0.257146	test-rmse:1940.390149+2.771986 
## [2548]	train-rmse:1940.196814+0.258521	test-rmse:1940.196826+2.771550 
## [2549]	train-rmse:1940.002222+0.257750	test-rmse:1940.003784+2.771430 
## [2550]	train-rmse:1939.809387+0.257687	test-rmse:1939.810242+2.771593 
## [2551]	train-rmse:1939.615894+0.258313	test-rmse:1939.616638+2.771279 
## [2552]	train-rmse:1939.421667+0.256892	test-rmse:1939.423425+2.771134 
## [2553]	train-rmse:1939.230579+0.257884	test-rmse:1939.230017+2.771420 
## [2554]	train-rmse:1939.036023+0.257603	test-rmse:1939.036633+2.771494 
## [2555]	train-rmse:1938.842285+0.257608	test-rmse:1938.843726+2.771055 
## [2556]	train-rmse:1938.649719+0.258125	test-rmse:1938.650256+2.771038 
## [2557]	train-rmse:1938.455286+0.256966	test-rmse:1938.457056+2.770929 
## [2558]	train-rmse:1938.263586+0.257980	test-rmse:1938.263855+2.771012 
## [2559]	train-rmse:1938.070190+0.258095	test-rmse:1938.070630+2.771061 
## [2560]	train-rmse:1937.876062+0.257184	test-rmse:1937.877551+2.770822 
## [2561]	train-rmse:1937.684277+0.258893	test-rmse:1937.684277+2.770608 
## [2562]	train-rmse:1937.490613+0.257455	test-rmse:1937.491211+2.770847 
## [2563]	train-rmse:1937.297302+0.256917	test-rmse:1937.298133+2.770711 
## [2564]	train-rmse:1937.104163+0.257382	test-rmse:1937.105054+2.770439 
## [2565]	train-rmse:1936.910986+0.256909	test-rmse:1936.911926+2.770457 
## [2566]	train-rmse:1936.718067+0.257717	test-rmse:1936.718945+2.770478 
## [2567]	train-rmse:1936.524353+0.257066	test-rmse:1936.525879+2.770318 
## [2568]	train-rmse:1936.332385+0.256837	test-rmse:1936.332776+2.770360 
## [2569]	train-rmse:1936.138709+0.257238	test-rmse:1936.139844+2.770174 
## [2570]	train-rmse:1935.945019+0.257346	test-rmse:1935.946765+2.770326 
## [2571]	train-rmse:1935.753638+0.257027	test-rmse:1935.754077+2.769900 
## [2572]	train-rmse:1935.559595+0.257489	test-rmse:1935.560779+2.769832 
## [2573]	train-rmse:1935.367468+0.257173	test-rmse:1935.368054+2.769962 
## [2574]	train-rmse:1935.174963+0.256905	test-rmse:1935.175037+2.769806 
## [2575]	train-rmse:1934.980273+0.256975	test-rmse:1934.982092+2.769777 
## [2576]	train-rmse:1934.788415+0.257622	test-rmse:1934.789184+2.769685 
## [2577]	train-rmse:1934.595996+0.257441	test-rmse:1934.596265+2.769497 
## [2578]	train-rmse:1934.402905+0.257001	test-rmse:1934.403821+2.769619 
## [2579]	train-rmse:1934.210230+0.257601	test-rmse:1934.211096+2.769570 
## [2580]	train-rmse:1934.015918+0.257333	test-rmse:1934.018091+2.769484 
## [2581]	train-rmse:1933.824939+0.257105	test-rmse:1933.825256+2.769432 
## [2582]	train-rmse:1933.631408+0.256625	test-rmse:1933.632556+2.769368 
## [2583]	train-rmse:1933.438367+0.256858	test-rmse:1933.439990+2.769135 
## [2584]	train-rmse:1933.246863+0.256802	test-rmse:1933.246887+2.769224 
## [2585]	train-rmse:1933.052856+0.256478	test-rmse:1933.054565+2.769207 
## [2586]	train-rmse:1932.861230+0.256571	test-rmse:1932.861682+2.768949 
## [2587]	train-rmse:1932.668640+0.256436	test-rmse:1932.668738+2.769202 
## [2588]	train-rmse:1932.474255+0.256882	test-rmse:1932.476355+2.769115 
## [2589]	train-rmse:1932.282922+0.257354	test-rmse:1932.284058+2.768853 
## [2590]	train-rmse:1932.090552+0.256963	test-rmse:1932.091333+2.768974 
## [2591]	train-rmse:1931.897058+0.257165	test-rmse:1931.898791+2.768842 
## [2592]	train-rmse:1931.705749+0.256781	test-rmse:1931.706274+2.768890 
## [2593]	train-rmse:1931.512085+0.257097	test-rmse:1931.513428+2.768505 
## [2594]	train-rmse:1931.319837+0.256818	test-rmse:1931.320947+2.768673 
## [2595]	train-rmse:1931.127686+0.256892	test-rmse:1931.128638+2.768380 
## [2596]	train-rmse:1930.934875+0.256735	test-rmse:1930.936218+2.768370 
## [2597]	train-rmse:1930.742932+0.256678	test-rmse:1930.743579+2.768163 
## [2598]	train-rmse:1930.549988+0.255743	test-rmse:1930.551209+2.768210 
## [2599]	train-rmse:1930.357947+0.257108	test-rmse:1930.358838+2.768327 
## [2600]	train-rmse:1930.165600+0.256402	test-rmse:1930.166333+2.768240 
## [2601]	train-rmse:1929.972363+0.256950	test-rmse:1929.973950+2.768323 
## [2602]	train-rmse:1929.781433+0.255818	test-rmse:1929.781555+2.768261 
## [2603]	train-rmse:1929.587500+0.256082	test-rmse:1929.589526+2.768199 
## [2604]	train-rmse:1929.396204+0.256686	test-rmse:1929.397302+2.768226 
## [2605]	train-rmse:1929.204260+0.256084	test-rmse:1929.204675+2.767928 
## [2606]	train-rmse:1929.010571+0.256364	test-rmse:1929.012561+2.767791 
## [2607]	train-rmse:1928.819556+0.256482	test-rmse:1928.820300+2.767932 
## [2608]	train-rmse:1928.626746+0.256923	test-rmse:1928.627893+2.767691 
## [2609]	train-rmse:1928.434070+0.256752	test-rmse:1928.435657+2.767676 
## [2610]	train-rmse:1928.242639+0.255816	test-rmse:1928.243591+2.767644 
## [2611]	train-rmse:1928.049841+0.256208	test-rmse:1928.051343+2.767495 
## [2612]	train-rmse:1927.858191+0.256170	test-rmse:1927.859277+2.767403 
## [2613]	train-rmse:1927.665332+0.255903	test-rmse:1927.667151+2.767336 
## [2614]	train-rmse:1927.472937+0.256794	test-rmse:1927.474915+2.767047 
## [2615]	train-rmse:1927.282166+0.255630	test-rmse:1927.282739+2.767091 
## [2616]	train-rmse:1927.088953+0.256427	test-rmse:1927.090625+2.767235 
## [2617]	train-rmse:1926.897266+0.256285	test-rmse:1926.898621+2.767132 
## [2618]	train-rmse:1926.705542+0.255653	test-rmse:1926.706629+2.767008 
## [2619]	train-rmse:1926.512549+0.256890	test-rmse:1926.514392+2.766990 
## [2620]	train-rmse:1926.321582+0.255243	test-rmse:1926.322217+2.766912 
## [2621]	train-rmse:1926.129053+0.256400	test-rmse:1926.130200+2.766742 
## [2622]	train-rmse:1925.936951+0.255962	test-rmse:1925.938574+2.766804 
## [2623]	train-rmse:1925.745532+0.255513	test-rmse:1925.746338+2.766928 
## [2624]	train-rmse:1925.552893+0.257339	test-rmse:1925.554406+2.766693 
## [2625]	train-rmse:1925.361450+0.256272	test-rmse:1925.362671+2.766599 
## [2626]	train-rmse:1925.169238+0.255072	test-rmse:1925.170764+2.766515 
## [2627]	train-rmse:1924.978003+0.256219	test-rmse:1924.978992+2.766774 
## [2628]	train-rmse:1924.785657+0.255029	test-rmse:1924.787036+2.766508 
## [2629]	train-rmse:1924.593005+0.256527	test-rmse:1924.595422+2.766446 
## [2630]	train-rmse:1924.403223+0.255692	test-rmse:1924.403259+2.766246 
## [2631]	train-rmse:1924.209424+0.255025	test-rmse:1924.211243+2.766293 
## [2632]	train-rmse:1924.018359+0.256829	test-rmse:1924.019580+2.766028 
## [2633]	train-rmse:1923.827527+0.255481	test-rmse:1923.827966+2.766238 
## [2634]	train-rmse:1923.633936+0.255673	test-rmse:1923.636340+2.765987 
## [2635]	train-rmse:1923.443945+0.256007	test-rmse:1923.444177+2.765891 
## [2636]	train-rmse:1923.252136+0.255644	test-rmse:1923.252661+2.765981 
## [2637]	train-rmse:1923.058020+0.255583	test-rmse:1923.061218+2.765906 
## [2638]	train-rmse:1922.869763+0.255489	test-rmse:1922.869544+2.765663 
## [2639]	train-rmse:1922.676221+0.255179	test-rmse:1922.677820+2.765780 
## [2640]	train-rmse:1922.484326+0.255299	test-rmse:1922.485950+2.765696 
## [2641]	train-rmse:1922.295020+0.255464	test-rmse:1922.294421+2.765553 
## [2642]	train-rmse:1922.100659+0.255999	test-rmse:1922.103003+2.765401 
## [2643]	train-rmse:1921.910327+0.254334	test-rmse:1921.911633+2.765397 
## [2644]	train-rmse:1921.718823+0.255388	test-rmse:1921.720142+2.765165 
## [2645]	train-rmse:1921.525745+0.255374	test-rmse:1921.528467+2.765153 
## [2646]	train-rmse:1921.336487+0.255055	test-rmse:1921.336865+2.765354 
## [2647]	train-rmse:1921.142993+0.255669	test-rmse:1921.145349+2.765135 
## [2648]	train-rmse:1920.952551+0.255231	test-rmse:1920.953845+2.765093 
## [2649]	train-rmse:1920.761682+0.255271	test-rmse:1920.762109+2.765339 
## [2650]	train-rmse:1920.569531+0.255808	test-rmse:1920.570862+2.764795 
## [2651]	train-rmse:1920.378528+0.254509	test-rmse:1920.379455+2.764851 
## [2652]	train-rmse:1920.186060+0.256203	test-rmse:1920.187891+2.764836 
## [2653]	train-rmse:1919.995142+0.255824	test-rmse:1919.996631+2.764574 
## [2654]	train-rmse:1919.804273+0.254196	test-rmse:1919.805188+2.764572 
## [2655]	train-rmse:1919.612292+0.255562	test-rmse:1919.613940+2.764554 
## [2656]	train-rmse:1919.421546+0.254498	test-rmse:1919.422571+2.764526 
## [2657]	train-rmse:1919.230225+0.253899	test-rmse:1919.231567+2.764665 
## [2658]	train-rmse:1919.038391+0.255683	test-rmse:1919.040271+2.764467 
## [2659]	train-rmse:1918.847900+0.254404	test-rmse:1918.848962+2.764308 
## [2660]	train-rmse:1918.655347+0.254869	test-rmse:1918.657434+2.764622 
## [2661]	train-rmse:1918.465698+0.255181	test-rmse:1918.466187+2.764185 
## [2662]	train-rmse:1918.273779+0.254073	test-rmse:1918.275098+2.764056 
## [2663]	train-rmse:1918.082019+0.254775	test-rmse:1918.084021+2.764047 
## [2664]	train-rmse:1917.892652+0.254774	test-rmse:1917.892847+2.763897 
## [2665]	train-rmse:1917.699524+0.255177	test-rmse:1917.701721+2.763881 
## [2666]	train-rmse:1917.509131+0.255040	test-rmse:1917.510583+2.763981 
## [2667]	train-rmse:1917.318762+0.253652	test-rmse:1917.319543+2.763774 
## [2668]	train-rmse:1917.126025+0.255503	test-rmse:1917.128442+2.763841 
## [2669]	train-rmse:1916.936682+0.254716	test-rmse:1916.937195+2.763750 
## [2670]	train-rmse:1916.744495+0.254376	test-rmse:1916.746033+2.763822 
## [2671]	train-rmse:1916.553357+0.255203	test-rmse:1916.555127+2.763647 
## [2672]	train-rmse:1916.363086+0.254269	test-rmse:1916.363977+2.763391 
## [2673]	train-rmse:1916.171387+0.254847	test-rmse:1916.172791+2.763614 
## [2674]	train-rmse:1915.980725+0.254262	test-rmse:1915.982129+2.763363 
## [2675]	train-rmse:1915.790271+0.254372	test-rmse:1915.791089+2.763220 
## [2676]	train-rmse:1915.598218+0.255460	test-rmse:1915.600415+2.763333 
## [2677]	train-rmse:1915.408459+0.254348	test-rmse:1915.409070+2.763233 
## [2678]	train-rmse:1915.216528+0.254129	test-rmse:1915.218445+2.763000 
## [2679]	train-rmse:1915.025940+0.254374	test-rmse:1915.027539+2.762968 
## [2680]	train-rmse:1914.834949+0.253618	test-rmse:1914.836780+2.762764 
## [2681]	train-rmse:1914.643493+0.253915	test-rmse:1914.645801+2.763004 
## [2682]	train-rmse:1914.454627+0.254255	test-rmse:1914.455029+2.762827 
## [2683]	train-rmse:1914.262134+0.253984	test-rmse:1914.263965+2.762692 
## [2684]	train-rmse:1914.071289+0.254216	test-rmse:1914.073389+2.762846 
## [2685]	train-rmse:1913.881860+0.254291	test-rmse:1913.882642+2.762605 
## [2686]	train-rmse:1913.690173+0.254392	test-rmse:1913.691821+2.762669 
## [2687]	train-rmse:1913.499378+0.253590	test-rmse:1913.501160+2.762752 
## [2688]	train-rmse:1913.309473+0.254979	test-rmse:1913.310449+2.762571 
## [2689]	train-rmse:1913.117834+0.253791	test-rmse:1913.119592+2.762254 
## [2690]	train-rmse:1912.926904+0.254050	test-rmse:1912.929004+2.762121 
## [2691]	train-rmse:1912.736804+0.254519	test-rmse:1912.738184+2.762195 
## [2692]	train-rmse:1912.545606+0.253624	test-rmse:1912.547778+2.762138 
## [2693]	train-rmse:1912.355322+0.253934	test-rmse:1912.357031+2.762055 
## [2694]	train-rmse:1912.165149+0.254680	test-rmse:1912.166712+2.761853 
## [2695]	train-rmse:1911.974683+0.253102	test-rmse:1911.975989+2.762067 
## [2696]	train-rmse:1911.782910+0.254781	test-rmse:1911.785535+2.761888 
## [2697]	train-rmse:1911.593811+0.253883	test-rmse:1911.594971+2.762077 
## [2698]	train-rmse:1911.402588+0.253227	test-rmse:1911.404248+2.761934 
## [2699]	train-rmse:1911.211670+0.254885	test-rmse:1911.213867+2.761665 
## [2700]	train-rmse:1911.023010+0.252924	test-rmse:1911.023352+2.761838 
## [2701]	train-rmse:1910.831323+0.253698	test-rmse:1910.832715+2.761600 
## [2702]	train-rmse:1910.640771+0.254580	test-rmse:1910.642419+2.761635 
## [2703]	train-rmse:1910.450952+0.253368	test-rmse:1910.452026+2.761519 
## [2704]	train-rmse:1910.259265+0.253458	test-rmse:1910.261621+2.761488 
## [2705]	train-rmse:1910.069727+0.254041	test-rmse:1910.070959+2.761370 
## [2706]	train-rmse:1909.879102+0.253655	test-rmse:1909.880737+2.761478 
## [2707]	train-rmse:1909.688013+0.253479	test-rmse:1909.690564+2.761230 
## [2708]	train-rmse:1909.498816+0.253022	test-rmse:1909.500256+2.761075 
## [2709]	train-rmse:1909.308105+0.254213	test-rmse:1909.309643+2.761194 
## [2710]	train-rmse:1909.118225+0.252899	test-rmse:1909.119568+2.760902 
## [2711]	train-rmse:1908.927576+0.253115	test-rmse:1908.929419+2.761063 
## [2712]	train-rmse:1908.737402+0.253993	test-rmse:1908.738892+2.760821 
## [2713]	train-rmse:1908.547546+0.253374	test-rmse:1908.548633+2.760931 
## [2714]	train-rmse:1908.356421+0.253255	test-rmse:1908.358630+2.760838 
## [2715]	train-rmse:1908.167139+0.253667	test-rmse:1908.168359+2.760601 
## [2716]	train-rmse:1907.976453+0.253572	test-rmse:1907.978235+2.760537 
## [2717]	train-rmse:1907.786108+0.253661	test-rmse:1907.787952+2.760509 
## [2718]	train-rmse:1907.596948+0.252823	test-rmse:1907.598035+2.760486 
## [2719]	train-rmse:1907.405249+0.253489	test-rmse:1907.407923+2.760373 
## [2720]	train-rmse:1907.216516+0.253144	test-rmse:1907.217664+2.760026 
## [2721]	train-rmse:1907.026306+0.253069	test-rmse:1907.027808+2.760439 
## [2722]	train-rmse:1906.835400+0.253609	test-rmse:1906.837537+2.760081 
## [2723]	train-rmse:1906.646033+0.253578	test-rmse:1906.647449+2.760068 
## [2724]	train-rmse:1906.456470+0.252169	test-rmse:1906.457544+2.759845 
## [2725]	train-rmse:1906.265625+0.253595	test-rmse:1906.267688+2.759949 
## [2726]	train-rmse:1906.075684+0.253363	test-rmse:1906.077515+2.759955 
## [2727]	train-rmse:1905.886353+0.252441	test-rmse:1905.887720+2.759748 
## [2728]	train-rmse:1905.695593+0.253195	test-rmse:1905.697766+2.759723 
## [2729]	train-rmse:1905.505432+0.252887	test-rmse:1905.507715+2.759650 
## [2730]	train-rmse:1905.316882+0.253256	test-rmse:1905.317786+2.759596 
## [2731]	train-rmse:1905.126099+0.253077	test-rmse:1905.127710+2.759620 
## [2732]	train-rmse:1904.936145+0.253549	test-rmse:1904.938049+2.759300 
## [2733]	train-rmse:1904.747058+0.252397	test-rmse:1904.748205+2.759624 
## [2734]	train-rmse:1904.556189+0.252931	test-rmse:1904.558252+2.759199 
## [2735]	train-rmse:1904.366638+0.253469	test-rmse:1904.368506+2.759484 
## [2736]	train-rmse:1904.176953+0.252922	test-rmse:1904.178760+2.759182 
## [2737]	train-rmse:1903.987231+0.252748	test-rmse:1903.988867+2.759242 
## [2738]	train-rmse:1903.796924+0.253075	test-rmse:1903.798999+2.759339 
## [2739]	train-rmse:1903.607996+0.252141	test-rmse:1903.609265+2.759051 
## [2740]	train-rmse:1903.418140+0.253033	test-rmse:1903.419507+2.758874 
## [2741]	train-rmse:1903.227722+0.253586	test-rmse:1903.229761+2.759053 
## [2742]	train-rmse:1903.038550+0.251621	test-rmse:1903.040320+2.758755 
## [2743]	train-rmse:1902.848608+0.252699	test-rmse:1902.850659+2.758745 
## [2744]	train-rmse:1902.658838+0.252623	test-rmse:1902.660889+2.758682 
## [2745]	train-rmse:1902.470361+0.252448	test-rmse:1902.471252+2.758621 
## [2746]	train-rmse:1902.279004+0.253119	test-rmse:1902.281604+2.758817 
## [2747]	train-rmse:1902.089978+0.252852	test-rmse:1902.091846+2.758611 
## [2748]	train-rmse:1901.901294+0.252676	test-rmse:1901.902600+2.758671 
## [2749]	train-rmse:1901.710474+0.252816	test-rmse:1901.713074+2.758696 
## [2750]	train-rmse:1901.521350+0.252856	test-rmse:1901.523438+2.758612 
## [2751]	train-rmse:1901.333057+0.253168	test-rmse:1901.334057+2.758312 
## [2752]	train-rmse:1901.142310+0.252440	test-rmse:1901.144250+2.758148 
## [2753]	train-rmse:1900.953211+0.252834	test-rmse:1900.954932+2.758047 
## [2754]	train-rmse:1900.764416+0.252546	test-rmse:1900.765698+2.758137 
## [2755]	train-rmse:1900.573987+0.252313	test-rmse:1900.576038+2.757823 
## [2756]	train-rmse:1900.384448+0.253134	test-rmse:1900.386682+2.758015 
## [2757]	train-rmse:1900.196033+0.252008	test-rmse:1900.197266+2.758026 
## [2758]	train-rmse:1900.005884+0.252583	test-rmse:1900.007825+2.757941 
## [2759]	train-rmse:1899.815735+0.252707	test-rmse:1899.818677+2.757920 
## [2760]	train-rmse:1899.627502+0.252114	test-rmse:1899.629077+2.757742 
## [2761]	train-rmse:1899.438513+0.252372	test-rmse:1899.440186+2.757781 
## [2762]	train-rmse:1899.248035+0.252168	test-rmse:1899.250769+2.757622 
## [2763]	train-rmse:1899.059375+0.251764	test-rmse:1899.061365+2.757594 
## [2764]	train-rmse:1898.870569+0.251930	test-rmse:1898.871961+2.757504 
## [2765]	train-rmse:1898.679394+0.252442	test-rmse:1898.682849+2.757096 
## [2766]	train-rmse:1898.492761+0.252356	test-rmse:1898.493689+2.757227 
## [2767]	train-rmse:1898.302844+0.251295	test-rmse:1898.304346+2.756973 
## [2768]	train-rmse:1898.112305+0.252265	test-rmse:1898.114954+2.757163 
## [2769]	train-rmse:1897.924927+0.252471	test-rmse:1897.925867+2.757101 
## [2770]	train-rmse:1897.734289+0.251161	test-rmse:1897.736866+2.757085 
## [2771]	train-rmse:1897.545740+0.252316	test-rmse:1897.547949+2.757015 
## [2772]	train-rmse:1897.357849+0.252014	test-rmse:1897.358520+2.756651 
## [2773]	train-rmse:1897.166455+0.251538	test-rmse:1897.169385+2.756765 
## [2774]	train-rmse:1896.978979+0.252405	test-rmse:1896.980432+2.756738 
## [2775]	train-rmse:1896.790430+0.251663	test-rmse:1896.791284+2.756703 
## [2776]	train-rmse:1896.599146+0.251929	test-rmse:1896.602234+2.756835 
## [2777]	train-rmse:1896.411951+0.252386	test-rmse:1896.413342+2.756726 
## [2778]	train-rmse:1896.223010+0.251752	test-rmse:1896.224390+2.756550 
## [2779]	train-rmse:1896.032593+0.251723	test-rmse:1896.035388+2.756211 
## [2780]	train-rmse:1895.844800+0.251689	test-rmse:1895.846338+2.756479 
## [2781]	train-rmse:1895.655005+0.251625	test-rmse:1895.657641+2.756504 
## [2782]	train-rmse:1895.465820+0.251892	test-rmse:1895.468445+2.756463 
## [2783]	train-rmse:1895.277478+0.252012	test-rmse:1895.279517+2.756282 
## [2784]	train-rmse:1895.088916+0.251730	test-rmse:1895.090454+2.756288 
## [2785]	train-rmse:1894.900012+0.252315	test-rmse:1894.901807+2.756045 
## [2786]	train-rmse:1894.709912+0.251193	test-rmse:1894.712939+2.755886 
## [2787]	train-rmse:1894.523071+0.251677	test-rmse:1894.523987+2.756145 
## [2788]	train-rmse:1894.332751+0.251877	test-rmse:1894.335620+2.755946 
## [2789]	train-rmse:1894.143579+0.251461	test-rmse:1894.146558+2.756051 
## [2790]	train-rmse:1893.956824+0.251589	test-rmse:1893.957874+2.755673 
## [2791]	train-rmse:1893.766602+0.251068	test-rmse:1893.768836+2.755770 
## [2792]	train-rmse:1893.577600+0.251510	test-rmse:1893.580493+2.755590 
## [2793]	train-rmse:1893.390466+0.251538	test-rmse:1893.391455+2.755567 
## [2794]	train-rmse:1893.200623+0.251222	test-rmse:1893.202869+2.755607 
## [2795]	train-rmse:1893.012085+0.251469	test-rmse:1893.014209+2.755560 
## [2796]	train-rmse:1892.823401+0.252099	test-rmse:1892.825696+2.755181 
## [2797]	train-rmse:1892.635144+0.250466	test-rmse:1892.636829+2.755387 
## [2798]	train-rmse:1892.446509+0.251450	test-rmse:1892.448291+2.755256 
## [2799]	train-rmse:1892.256946+0.251836	test-rmse:1892.259534+2.755255 
## [2800]	train-rmse:1892.069507+0.250856	test-rmse:1892.071033+2.755273 
## [2801]	train-rmse:1891.880225+0.251233	test-rmse:1891.882703+2.754787 
## [2802]	train-rmse:1891.691467+0.251844	test-rmse:1891.693982+2.755092 
## [2803]	train-rmse:1891.504224+0.250837	test-rmse:1891.505359+2.754871 
## [2804]	train-rmse:1891.313843+0.251229	test-rmse:1891.316931+2.754846 
## [2805]	train-rmse:1891.126685+0.251764	test-rmse:1891.128418+2.754971 
## [2806]	train-rmse:1890.938733+0.250835	test-rmse:1890.939929+2.754771 
## [2807]	train-rmse:1890.748523+0.251321	test-rmse:1890.751502+2.754820 
## [2808]	train-rmse:1890.561292+0.250672	test-rmse:1890.563269+2.754434 
## [2809]	train-rmse:1890.372827+0.250528	test-rmse:1890.374829+2.754675 
## [2810]	train-rmse:1890.183240+0.251277	test-rmse:1890.186279+2.754621 
## [2811]	train-rmse:1889.996973+0.250486	test-rmse:1889.997925+2.754962 
## [2812]	train-rmse:1889.806811+0.250962	test-rmse:1889.809521+2.754619 
## [2813]	train-rmse:1889.618591+0.250919	test-rmse:1889.621216+2.754379 
## [2814]	train-rmse:1889.431934+0.250791	test-rmse:1889.432849+2.754291 
## [2815]	train-rmse:1889.241626+0.250817	test-rmse:1889.244543+2.754205 
## [2816]	train-rmse:1889.054028+0.250875	test-rmse:1889.056421+2.754127 
## [2817]	train-rmse:1888.865918+0.250759	test-rmse:1888.868176+2.754003 
## [2818]	train-rmse:1888.677136+0.250605	test-rmse:1888.679492+2.754063 
## [2819]	train-rmse:1888.489758+0.251488	test-rmse:1888.491540+2.754110 
## [2820]	train-rmse:1888.301062+0.250414	test-rmse:1888.303308+2.753925 
## [2821]	train-rmse:1888.113464+0.251018	test-rmse:1888.115296+2.753872 
## [2822]	train-rmse:1887.925232+0.250710	test-rmse:1887.926868+2.753915 
## [2823]	train-rmse:1887.736169+0.250853	test-rmse:1887.738574+2.753584 
## [2824]	train-rmse:1887.549292+0.250553	test-rmse:1887.550696+2.753712 
## [2825]	train-rmse:1887.359949+0.250626	test-rmse:1887.362695+2.753520 
## [2826]	train-rmse:1887.172302+0.250878	test-rmse:1887.174365+2.753336 
## [2827]	train-rmse:1886.984680+0.250675	test-rmse:1886.986340+2.753358 
## [2828]	train-rmse:1886.795923+0.250517	test-rmse:1886.798437+2.753289 
## [2829]	train-rmse:1886.608008+0.250730	test-rmse:1886.610034+2.753347 
## [2830]	train-rmse:1886.420593+0.250090	test-rmse:1886.422278+2.753263 
## [2831]	train-rmse:1886.232642+0.250161	test-rmse:1886.234082+2.752899 
## [2832]	train-rmse:1886.044433+0.250433	test-rmse:1886.046265+2.753016 
## [2833]	train-rmse:1885.855981+0.250308	test-rmse:1885.858264+2.753137 
## [2834]	train-rmse:1885.667688+0.250929	test-rmse:1885.670483+2.753272 
## [2835]	train-rmse:1885.481006+0.250019	test-rmse:1885.482373+2.752931 
## [2836]	train-rmse:1885.292517+0.250452	test-rmse:1885.294665+2.752961 
## [2837]	train-rmse:1885.104223+0.250478	test-rmse:1885.106653+2.752886 
## [2838]	train-rmse:1884.916614+0.249752	test-rmse:1884.918726+2.752752 
## [2839]	train-rmse:1884.728284+0.250625	test-rmse:1884.730969+2.752805 
## [2840]	train-rmse:1884.540955+0.249497	test-rmse:1884.543311+2.752674 
## [2841]	train-rmse:1884.353467+0.250062	test-rmse:1884.355274+2.752643 
## [2842]	train-rmse:1884.165405+0.250611	test-rmse:1884.167554+2.752570 
## [2843]	train-rmse:1883.977759+0.249531	test-rmse:1883.979797+2.752313 
## [2844]	train-rmse:1883.790381+0.250811	test-rmse:1883.792066+2.752092 
## [2845]	train-rmse:1883.602356+0.250363	test-rmse:1883.604285+2.752245 
## [2846]	train-rmse:1883.414612+0.249857	test-rmse:1883.416504+2.752146 
## [2847]	train-rmse:1883.226514+0.250635	test-rmse:1883.229028+2.752080 
## [2848]	train-rmse:1883.039795+0.249824	test-rmse:1883.041321+2.752199 
## [2849]	train-rmse:1882.850903+0.249816	test-rmse:1882.853357+2.752210 
## [2850]	train-rmse:1882.663037+0.249827	test-rmse:1882.665857+2.752162 
## [2851]	train-rmse:1882.476795+0.249728	test-rmse:1882.478186+2.751781 
## [2852]	train-rmse:1882.288110+0.249720	test-rmse:1882.290747+2.751834 
## [2853]	train-rmse:1882.101050+0.248992	test-rmse:1882.102905+2.751825 
## [2854]	train-rmse:1881.913830+0.250611	test-rmse:1881.915479+2.751793 
## [2855]	train-rmse:1881.724866+0.249702	test-rmse:1881.727832+2.751800 
## [2856]	train-rmse:1881.538489+0.249033	test-rmse:1881.540308+2.751741 
## [2857]	train-rmse:1881.350354+0.251270	test-rmse:1881.352954+2.751492 
## [2858]	train-rmse:1881.163318+0.249182	test-rmse:1881.165417+2.751394 
## [2859]	train-rmse:1880.975415+0.249149	test-rmse:1880.977954+2.751566 
## [2860]	train-rmse:1880.787903+0.250906	test-rmse:1880.790539+2.751340 
## [2861]	train-rmse:1880.601440+0.249328	test-rmse:1880.603027+2.751314 
## [2862]	train-rmse:1880.413172+0.249556	test-rmse:1880.415710+2.751279 
## [2863]	train-rmse:1880.225915+0.250152	test-rmse:1880.228247+2.751176 
## [2864]	train-rmse:1880.038733+0.249585	test-rmse:1880.040833+2.751353 
## [2865]	train-rmse:1879.851001+0.249991	test-rmse:1879.853516+2.750913 
## [2866]	train-rmse:1879.664209+0.249645	test-rmse:1879.666247+2.751130 
## [2867]	train-rmse:1879.476611+0.249570	test-rmse:1879.478918+2.751051 
## [2868]	train-rmse:1879.288916+0.250129	test-rmse:1879.291602+2.751037 
## [2869]	train-rmse:1879.102759+0.249154	test-rmse:1879.104333+2.751065 
## [2870]	train-rmse:1878.915015+0.249725	test-rmse:1878.917004+2.750847 
## [2871]	train-rmse:1878.726782+0.249684	test-rmse:1878.729626+2.750594 
## [2872]	train-rmse:1878.541077+0.249595	test-rmse:1878.542261+2.750515 
## [2873]	train-rmse:1878.353467+0.249556	test-rmse:1878.355347+2.750499 
## [2874]	train-rmse:1878.165161+0.249734	test-rmse:1878.167883+2.750347 
## [2875]	train-rmse:1877.978845+0.249436	test-rmse:1877.981079+2.750306 
## [2876]	train-rmse:1877.791455+0.249595	test-rmse:1877.793543+2.750398 
## [2877]	train-rmse:1877.604419+0.249133	test-rmse:1877.606506+2.750316 
## [2878]	train-rmse:1877.416992+0.249314	test-rmse:1877.419360+2.750188 
## [2879]	train-rmse:1877.229675+0.249003	test-rmse:1877.232336+2.750233 
## [2880]	train-rmse:1877.043384+0.249457	test-rmse:1877.045325+2.750170 
## [2881]	train-rmse:1876.855481+0.249484	test-rmse:1876.858045+2.750190 
## [2882]	train-rmse:1876.668713+0.249306	test-rmse:1876.671240+2.750238 
## [2883]	train-rmse:1876.482812+0.249937	test-rmse:1876.484046+2.749787 
## [2884]	train-rmse:1876.294507+0.249002	test-rmse:1876.297253+2.749615 
## [2885]	train-rmse:1876.107385+0.248581	test-rmse:1876.110071+2.750004 
## [2886]	train-rmse:1875.921668+0.249460	test-rmse:1875.923071+2.749907 
## [2887]	train-rmse:1875.733935+0.249164	test-rmse:1875.736182+2.749632 
## [2888]	train-rmse:1875.546948+0.248470	test-rmse:1875.549231+2.749560 
## [2889]	train-rmse:1875.360339+0.249359	test-rmse:1875.362378+2.749729 
## [2890]	train-rmse:1875.173071+0.249082	test-rmse:1875.175354+2.749488 
## [2891]	train-rmse:1874.986340+0.248359	test-rmse:1874.988696+2.749506 
## [2892]	train-rmse:1874.799670+0.249419	test-rmse:1874.801624+2.749325 
## [2893]	train-rmse:1874.612219+0.249000	test-rmse:1874.614990+2.749440 
## [2894]	train-rmse:1874.426086+0.248548	test-rmse:1874.428186+2.749226 
## [2895]	train-rmse:1874.238696+0.249243	test-rmse:1874.241467+2.749350 
## [2896]	train-rmse:1874.052222+0.248651	test-rmse:1874.054639+2.749211 
## [2897]	train-rmse:1873.865125+0.248955	test-rmse:1873.867822+2.748880 
## [2898]	train-rmse:1873.678723+0.249198	test-rmse:1873.681274+2.749018 
## [2899]	train-rmse:1873.491943+0.247957	test-rmse:1873.494372+2.748965 
## [2900]	train-rmse:1873.305603+0.248471	test-rmse:1873.307642+2.748799 
## [2901]	train-rmse:1873.119226+0.248649	test-rmse:1873.120959+2.748852 
## [2902]	train-rmse:1872.931592+0.248951	test-rmse:1872.934229+2.748854 
## [2903]	train-rmse:1872.745801+0.248496	test-rmse:1872.747668+2.748639 
## [2904]	train-rmse:1872.559009+0.248227	test-rmse:1872.561084+2.748729 
## [2905]	train-rmse:1872.371496+0.248872	test-rmse:1872.374414+2.748750 
## [2906]	train-rmse:1872.185315+0.247972	test-rmse:1872.187915+2.748628 
## [2907]	train-rmse:1871.999255+0.248051	test-rmse:1872.001172+2.748527 
## [2908]	train-rmse:1871.812244+0.249127	test-rmse:1871.814453+2.748450 
## [2909]	train-rmse:1871.626172+0.248687	test-rmse:1871.628027+2.748542 
## [2910]	train-rmse:1871.438965+0.249031	test-rmse:1871.441663+2.748290 
## [2911]	train-rmse:1871.252307+0.248177	test-rmse:1871.255005+2.748245 
## [2912]	train-rmse:1871.066309+0.248081	test-rmse:1871.068762+2.748250 
## [2913]	train-rmse:1870.879492+0.248473	test-rmse:1870.882385+2.748034 
## [2914]	train-rmse:1870.692908+0.248014	test-rmse:1870.695666+2.748017 
## [2915]	train-rmse:1870.508423+0.248079	test-rmse:1870.509168+2.748067 
## [2916]	train-rmse:1870.320093+0.248471	test-rmse:1870.322803+2.747912 
## [2917]	train-rmse:1870.133496+0.247355	test-rmse:1870.136462+2.748011 
## [2918]	train-rmse:1869.948035+0.248600	test-rmse:1869.950208+2.748142 
## [2919]	train-rmse:1869.761267+0.248434	test-rmse:1869.763843+2.747834 
## [2920]	train-rmse:1869.574536+0.247817	test-rmse:1869.577515+2.747933 
## [2921]	train-rmse:1869.389624+0.248126	test-rmse:1869.390881+2.747680 
## [2922]	train-rmse:1869.202734+0.248769	test-rmse:1869.204883+2.747632 
## [2923]	train-rmse:1869.015979+0.247977	test-rmse:1869.018567+2.747635 
## [2924]	train-rmse:1868.829956+0.247588	test-rmse:1868.832446+2.747534 
## [2925]	train-rmse:1868.643628+0.248319	test-rmse:1868.646069+2.747591 
## [2926]	train-rmse:1868.458057+0.248040	test-rmse:1868.459839+2.747461 
## [2927]	train-rmse:1868.271008+0.246769	test-rmse:1868.273694+2.747316 
## [2928]	train-rmse:1868.085095+0.248958	test-rmse:1868.087500+2.747563 
## [2929]	train-rmse:1867.899548+0.248763	test-rmse:1867.901123+2.747232 
## [2930]	train-rmse:1867.712048+0.247529	test-rmse:1867.715002+2.747052 
## [2931]	train-rmse:1867.526563+0.248899	test-rmse:1867.528870+2.747313 
## [2932]	train-rmse:1867.341077+0.248017	test-rmse:1867.342993+2.747161 
## [2933]	train-rmse:1867.154358+0.248030	test-rmse:1867.156628+2.747095 
## [2934]	train-rmse:1866.968115+0.248364	test-rmse:1866.970764+2.746838 
## [2935]	train-rmse:1866.782324+0.247627	test-rmse:1866.784863+2.746732 
## [2936]	train-rmse:1866.596692+0.247699	test-rmse:1866.598438+2.746794 
## [2937]	train-rmse:1866.410120+0.247875	test-rmse:1866.412769+2.746805 
## [2938]	train-rmse:1866.224231+0.247650	test-rmse:1866.226599+2.746618 
## [2939]	train-rmse:1866.038257+0.247570	test-rmse:1866.040625+2.746567 
## [2940]	train-rmse:1865.852173+0.247944	test-rmse:1865.854639+2.746426 
## [2941]	train-rmse:1865.666772+0.248066	test-rmse:1865.668689+2.746324 
## [2942]	train-rmse:1865.480664+0.247768	test-rmse:1865.482886+2.746414 
## [2943]	train-rmse:1865.294580+0.248015	test-rmse:1865.296973+2.746332 
## [2944]	train-rmse:1865.108813+0.248106	test-rmse:1865.110669+2.746315 
## [2945]	train-rmse:1864.922559+0.247376	test-rmse:1864.924927+2.746302 
## [2946]	train-rmse:1864.736975+0.248073	test-rmse:1864.739368+2.746270 
## [2947]	train-rmse:1864.552173+0.247094	test-rmse:1864.553454+2.746172 
## [2948]	train-rmse:1864.365173+0.247293	test-rmse:1864.367468+2.746355 
## [2949]	train-rmse:1864.179675+0.247123	test-rmse:1864.181836+2.746016 
## [2950]	train-rmse:1863.994641+0.247611	test-rmse:1863.996069+2.745773 
## [2951]	train-rmse:1863.807788+0.247399	test-rmse:1863.810388+2.745809 
## [2952]	train-rmse:1863.622156+0.246759	test-rmse:1863.624609+2.745804 
## [2953]	train-rmse:1863.437183+0.247383	test-rmse:1863.439050+2.745759 
## [2954]	train-rmse:1863.249963+0.247764	test-rmse:1863.253101+2.746062 
## [2955]	train-rmse:1863.065161+0.246412	test-rmse:1863.067358+2.745636 
## [2956]	train-rmse:1862.879211+0.247348	test-rmse:1862.882056+2.745292 
## [2957]	train-rmse:1862.693836+0.247052	test-rmse:1862.696106+2.745598 
## [2958]	train-rmse:1862.508472+0.246232	test-rmse:1862.510571+2.745546 
## [2959]	train-rmse:1862.322583+0.247514	test-rmse:1862.324841+2.745374 
## [2960]	train-rmse:1862.136975+0.246561	test-rmse:1862.139587+2.745485 
## [2961]	train-rmse:1861.951221+0.247107	test-rmse:1861.953784+2.745566 
## [2962]	train-rmse:1861.765760+0.247251	test-rmse:1861.768286+2.745048 
## [2963]	train-rmse:1861.580603+0.247025	test-rmse:1861.582556+2.745201 
## [2964]	train-rmse:1861.394141+0.246641	test-rmse:1861.397400+2.744958 
## [2965]	train-rmse:1861.209644+0.246907	test-rmse:1861.211743+2.745049 
## [2966]	train-rmse:1861.024133+0.246897	test-rmse:1861.026453+2.745045 
## [2967]	train-rmse:1860.837830+0.246757	test-rmse:1860.840796+2.744800 
## [2968]	train-rmse:1860.654175+0.246984	test-rmse:1860.655432+2.744879 
## [2969]	train-rmse:1860.467371+0.247045	test-rmse:1860.470215+2.744839 
## [2970]	train-rmse:1860.281177+0.246810	test-rmse:1860.284607+2.744714 
## [2971]	train-rmse:1860.097583+0.246185	test-rmse:1860.098962+2.744746 
## [2972]	train-rmse:1859.911047+0.246512	test-rmse:1859.913806+2.744643 
## [2973]	train-rmse:1859.726099+0.247084	test-rmse:1859.728259+2.744635 
## [2974]	train-rmse:1859.541260+0.246199	test-rmse:1859.542981+2.744569 
## [2975]	train-rmse:1859.355005+0.246980	test-rmse:1859.357800+2.744458 
## [2976]	train-rmse:1859.170679+0.246965	test-rmse:1859.172375+2.744524 
## [2977]	train-rmse:1858.985095+0.246163	test-rmse:1858.987244+2.744517 
## [2978]	train-rmse:1858.799536+0.246973	test-rmse:1858.802014+2.744409 
## [2979]	train-rmse:1858.614795+0.246427	test-rmse:1858.616626+2.744267 
## [2980]	train-rmse:1858.429175+0.246740	test-rmse:1858.431396+2.744061 
## [2981]	train-rmse:1858.243152+0.246638	test-rmse:1858.246277+2.744162 
## [2982]	train-rmse:1858.060034+0.246213	test-rmse:1858.061279+2.743726 
## [2983]	train-rmse:1857.873828+0.246704	test-rmse:1857.875976+2.744203 
## [2984]	train-rmse:1857.688403+0.246255	test-rmse:1857.690808+2.743904 
## [2985]	train-rmse:1857.503601+0.246272	test-rmse:1857.505921+2.743928 
## [2986]	train-rmse:1857.318176+0.247033	test-rmse:1857.320422+2.743725 
## [2987]	train-rmse:1857.133313+0.246566	test-rmse:1857.135535+2.743627 
## [2988]	train-rmse:1856.947717+0.245895	test-rmse:1856.950488+2.743562 
## [2989]	train-rmse:1856.763122+0.246144	test-rmse:1856.765369+2.743767 
## [2990]	train-rmse:1856.577502+0.246945	test-rmse:1856.580310+2.743523 
## [2991]	train-rmse:1856.392688+0.245717	test-rmse:1856.395349+2.743567 
## [2992]	train-rmse:1856.207788+0.245878	test-rmse:1856.210462+2.743519 
## [2993]	train-rmse:1856.022864+0.246444	test-rmse:1856.025390+2.743446 
## [2994]	train-rmse:1855.837170+0.246249	test-rmse:1855.840357+2.743478 
## [2995]	train-rmse:1855.653943+0.245931	test-rmse:1855.655554+2.743387 
## [2996]	train-rmse:1855.468018+0.246307	test-rmse:1855.470520+2.743486 
## [2997]	train-rmse:1855.283020+0.246023	test-rmse:1855.285913+2.743154 
## [2998]	train-rmse:1855.098816+0.245947	test-rmse:1855.100757+2.743034 
## [2999]	train-rmse:1854.913074+0.246569	test-rmse:1854.915820+2.743019 
## [3000]	train-rmse:1854.728784+0.245233	test-rmse:1854.731030+2.743073 
## [3001]	train-rmse:1854.544092+0.246357	test-rmse:1854.546228+2.743109 
## [3002]	train-rmse:1854.358984+0.246686	test-rmse:1854.361450+2.743099 
## [3003]	train-rmse:1854.174988+0.245252	test-rmse:1854.176489+2.742997 
## [3004]	train-rmse:1853.988867+0.246624	test-rmse:1853.992029+2.742782 
## [3005]	train-rmse:1853.804846+0.245767	test-rmse:1853.807055+2.742506 
## [3006]	train-rmse:1853.621167+0.245070	test-rmse:1853.622351+2.742718 
## [3007]	train-rmse:1853.434473+0.246624	test-rmse:1853.437622+2.742615 
## [3008]	train-rmse:1853.250818+0.245797	test-rmse:1853.252905+2.742422 
## [3009]	train-rmse:1853.067041+0.244979	test-rmse:1853.068017+2.742380 
## [3010]	train-rmse:1852.879773+0.246396	test-rmse:1852.883508+2.742453 
## [3011]	train-rmse:1852.697095+0.245492	test-rmse:1852.698962+2.742501 
## [3012]	train-rmse:1852.512280+0.245948	test-rmse:1852.514197+2.742256 
## [3013]	train-rmse:1852.327295+0.245835	test-rmse:1852.329895+2.742301 
## [3014]	train-rmse:1852.143481+0.245287	test-rmse:1852.145190+2.742231 
## [3015]	train-rmse:1851.958667+0.245422	test-rmse:1851.960401+2.742020 
## [3016]	train-rmse:1851.773865+0.244727	test-rmse:1851.775903+2.741701 
## [3017]	train-rmse:1851.588843+0.245537	test-rmse:1851.591443+2.742138 
## [3018]	train-rmse:1851.404273+0.246331	test-rmse:1851.407031+2.741753 
## [3019]	train-rmse:1851.220825+0.244560	test-rmse:1851.222522+2.741995 
## [3020]	train-rmse:1851.035181+0.246134	test-rmse:1851.038000+2.742099 
## [3021]	train-rmse:1850.850867+0.245760	test-rmse:1850.853443+2.741808 
## [3022]	train-rmse:1850.666528+0.245430	test-rmse:1850.669153+2.741883 
## [3023]	train-rmse:1850.482166+0.245881	test-rmse:1850.484631+2.741714 
## [3024]	train-rmse:1850.297949+0.245244	test-rmse:1850.300391+2.741502 
## [3025]	train-rmse:1850.113623+0.245215	test-rmse:1850.115918+2.741567 
## [3026]	train-rmse:1849.929126+0.246010	test-rmse:1849.931250+2.741660 
## [3027]	train-rmse:1849.744995+0.245047	test-rmse:1849.747339+2.741217 
## [3028]	train-rmse:1849.560681+0.245473	test-rmse:1849.562842+2.741500 
## [3029]	train-rmse:1849.376282+0.245152	test-rmse:1849.378662+2.741176 
## [3030]	train-rmse:1849.191333+0.245470	test-rmse:1849.194299+2.741154 
## [3031]	train-rmse:1849.007666+0.245608	test-rmse:1849.010156+2.741200 
## [3032]	train-rmse:1848.823547+0.244810	test-rmse:1848.825745+2.741032 
## [3033]	train-rmse:1848.639392+0.245206	test-rmse:1848.641455+2.741183 
## [3034]	train-rmse:1848.455188+0.245224	test-rmse:1848.457202+2.740930 
## [3035]	train-rmse:1848.271094+0.244512	test-rmse:1848.273096+2.741132 
## [3036]	train-rmse:1848.087195+0.245183	test-rmse:1848.088806+2.740930 
## [3037]	train-rmse:1847.902808+0.245489	test-rmse:1847.904810+2.740954 
## [3038]	train-rmse:1847.718176+0.244052	test-rmse:1847.720630+2.740951 
## [3039]	train-rmse:1847.534314+0.244576	test-rmse:1847.536536+2.740816 
## [3040]	train-rmse:1847.350171+0.245738	test-rmse:1847.352356+2.740786 
## [3041]	train-rmse:1847.165637+0.244760	test-rmse:1847.168274+2.740424 
## [3042]	train-rmse:1846.981750+0.245059	test-rmse:1846.984021+2.740650 
## [3043]	train-rmse:1846.797900+0.245424	test-rmse:1846.799890+2.740365 
## [3044]	train-rmse:1846.613672+0.244788	test-rmse:1846.616089+2.740530 
## [3045]	train-rmse:1846.429321+0.245142	test-rmse:1846.431921+2.740548 
## [3046]	train-rmse:1846.246252+0.244647	test-rmse:1846.248010+2.740357 
## [3047]	train-rmse:1846.061707+0.244737	test-rmse:1846.064160+2.740258 
## [3048]	train-rmse:1845.877661+0.245268	test-rmse:1845.880200+2.740177 
## [3049]	train-rmse:1845.694470+0.244918	test-rmse:1845.695984+2.740086 
## [3050]	train-rmse:1845.510278+0.244788	test-rmse:1845.512219+2.739907 
## [3051]	train-rmse:1845.325696+0.244939	test-rmse:1845.328259+2.740060 
## [3052]	train-rmse:1845.142456+0.244933	test-rmse:1845.144336+2.740093 
## [3053]	train-rmse:1844.958301+0.244873	test-rmse:1844.960742+2.739983 
## [3054]	train-rmse:1844.774829+0.244695	test-rmse:1844.776929+2.739745 
## [3055]	train-rmse:1844.590759+0.244869	test-rmse:1844.592700+2.739662 
## [3056]	train-rmse:1844.406799+0.244875	test-rmse:1844.409058+2.739716 
## [3057]	train-rmse:1844.223462+0.245343	test-rmse:1844.225305+2.739785 
## [3058]	train-rmse:1844.039087+0.244789	test-rmse:1844.041199+2.739580 
## [3059]	train-rmse:1843.855444+0.243847	test-rmse:1843.857581+2.739415 
## [3060]	train-rmse:1843.671826+0.245113	test-rmse:1843.674097+2.739577 
## [3061]	train-rmse:1843.487463+0.245034	test-rmse:1843.490222+2.739412 
## [3062]	train-rmse:1843.305029+0.243710	test-rmse:1843.306555+2.739584 
## [3063]	train-rmse:1843.120508+0.244749	test-rmse:1843.122937+2.739091 
## [3064]	train-rmse:1842.936572+0.244834	test-rmse:1842.939246+2.739093 
## [3065]	train-rmse:1842.754285+0.243894	test-rmse:1842.755359+2.739084 
## [3066]	train-rmse:1842.570007+0.244248	test-rmse:1842.572144+2.739232 
## [3067]	train-rmse:1842.385889+0.244520	test-rmse:1842.388257+2.738931 
## [3068]	train-rmse:1842.202881+0.244549	test-rmse:1842.204700+2.739052 
## [3069]	train-rmse:1842.018591+0.244194	test-rmse:1842.021252+2.738918 
## [3070]	train-rmse:1841.834851+0.244367	test-rmse:1841.837610+2.738901 
## [3071]	train-rmse:1841.652026+0.244512	test-rmse:1841.654285+2.738737 
## [3072]	train-rmse:1841.468176+0.244056	test-rmse:1841.470520+2.738992 
## [3073]	train-rmse:1841.285168+0.244981	test-rmse:1841.287146+2.738718 
## [3074]	train-rmse:1841.101428+0.244560	test-rmse:1841.103467+2.738564 
## [3075]	train-rmse:1840.918213+0.244233	test-rmse:1840.920093+2.738640 
## [3076]	train-rmse:1840.734107+0.244253	test-rmse:1840.736450+2.738367 
## [3077]	train-rmse:1840.551489+0.244100	test-rmse:1840.553162+2.738299 
## [3078]	train-rmse:1840.367834+0.244030	test-rmse:1840.369751+2.738490 
## [3079]	train-rmse:1840.184277+0.243878	test-rmse:1840.186426+2.738355 
## [3080]	train-rmse:1840.001062+0.243675	test-rmse:1840.002979+2.738319 
## [3081]	train-rmse:1839.818445+0.243711	test-rmse:1839.819568+2.738266 
## [3082]	train-rmse:1839.633411+0.243814	test-rmse:1839.636365+2.738106 
## [3083]	train-rmse:1839.450720+0.244113	test-rmse:1839.453088+2.738162 
## [3084]	train-rmse:1839.267676+0.243460	test-rmse:1839.269763+2.738262 
## [3085]	train-rmse:1839.084302+0.244046	test-rmse:1839.086218+2.738029 
## [3086]	train-rmse:1838.901550+0.243927	test-rmse:1838.903137+2.737941 
## [3087]	train-rmse:1838.717297+0.244335	test-rmse:1838.719946+2.737890 
## [3088]	train-rmse:1838.534741+0.243701	test-rmse:1838.536853+2.737812 
## [3089]	train-rmse:1838.351636+0.243882	test-rmse:1838.353430+2.737791 
## [3090]	train-rmse:1838.167920+0.243783	test-rmse:1838.170313+2.737650 
## [3091]	train-rmse:1837.984607+0.243374	test-rmse:1837.987353+2.737759 
## [3092]	train-rmse:1837.802051+0.244217	test-rmse:1837.803955+2.737703 
## [3093]	train-rmse:1837.619006+0.243486	test-rmse:1837.620874+2.737703 
## [3094]	train-rmse:1837.435144+0.243606	test-rmse:1837.437769+2.737449 
## [3095]	train-rmse:1837.252673+0.243902	test-rmse:1837.254517+2.737075 
## [3096]	train-rmse:1837.069373+0.243234	test-rmse:1837.071741+2.737510 
## [3097]	train-rmse:1836.886206+0.243086	test-rmse:1836.888416+2.737329 
## [3098]	train-rmse:1836.703430+0.243890	test-rmse:1836.705286+2.737061 
## [3099]	train-rmse:1836.520007+0.243836	test-rmse:1836.522461+2.737394 
## [3100]	train-rmse:1836.337085+0.243076	test-rmse:1836.339453+2.737061 
## [3101]	train-rmse:1836.154236+0.243663	test-rmse:1836.156323+2.736999 
## [3102]	train-rmse:1835.971448+0.244327	test-rmse:1835.973218+2.736955 
## [3103]	train-rmse:1835.787769+0.243043	test-rmse:1835.790515+2.736788 
## [3104]	train-rmse:1835.606286+0.243789	test-rmse:1835.607593+2.736750 
## [3105]	train-rmse:1835.422864+0.243848	test-rmse:1835.424499+2.736675 
## [3106]	train-rmse:1835.239490+0.242965	test-rmse:1835.241443+2.736532 
## [3107]	train-rmse:1835.057202+0.243942	test-rmse:1835.058753+2.736453 
## [3108]	train-rmse:1834.873987+0.243358	test-rmse:1834.875867+2.736668 
## [3109]	train-rmse:1834.690967+0.243045	test-rmse:1834.693225+2.736418 
## [3110]	train-rmse:1834.508948+0.243363	test-rmse:1834.510193+2.736685 
## [3111]	train-rmse:1834.325720+0.243248	test-rmse:1834.327600+2.736400 
## [3112]	train-rmse:1834.142383+0.243106	test-rmse:1834.144556+2.736216 
## [3113]	train-rmse:1833.959875+0.243400	test-rmse:1833.961816+2.736151 
## [3114]	train-rmse:1833.777197+0.243023	test-rmse:1833.779114+2.735976 
## [3115]	train-rmse:1833.594214+0.243149	test-rmse:1833.596387+2.735911 
## [3116]	train-rmse:1833.411780+0.242843	test-rmse:1833.413635+2.735821 
## [3117]	train-rmse:1833.229358+0.243258	test-rmse:1833.230871+2.736074 
## [3118]	train-rmse:1833.046094+0.242933	test-rmse:1833.048120+2.735874 
## [3119]	train-rmse:1832.864014+0.243097	test-rmse:1832.865649+2.735859 
## [3120]	train-rmse:1832.681006+0.243859	test-rmse:1832.682898+2.736015 
## [3121]	train-rmse:1832.498401+0.242577	test-rmse:1832.500220+2.735606 
## [3122]	train-rmse:1832.315564+0.243335	test-rmse:1832.317712+2.735642 
## [3123]	train-rmse:1832.133045+0.243693	test-rmse:1832.135205+2.735676 
## [3124]	train-rmse:1831.950598+0.242199	test-rmse:1831.952478+2.735840 
## [3125]	train-rmse:1831.767993+0.243539	test-rmse:1831.769837+2.735475 
## [3126]	train-rmse:1831.585339+0.243186	test-rmse:1831.587390+2.735732 
## [3127]	train-rmse:1831.403003+0.242501	test-rmse:1831.404956+2.735368 
## [3128]	train-rmse:1831.220032+0.243766	test-rmse:1831.222522+2.735336 
## [3129]	train-rmse:1831.038721+0.242698	test-rmse:1831.040173+2.735346 
## [3130]	train-rmse:1830.855811+0.242248	test-rmse:1830.857398+2.735156 
## [3131]	train-rmse:1830.672937+0.243063	test-rmse:1830.674939+2.735095 
## [3132]	train-rmse:1830.491150+0.242666	test-rmse:1830.492310+2.735028 
## [3133]	train-rmse:1830.308106+0.242340	test-rmse:1830.310364+2.735185 
## [3134]	train-rmse:1830.125940+0.241939	test-rmse:1830.127710+2.735209 
## [3135]	train-rmse:1829.944409+0.243069	test-rmse:1829.945520+2.734807 
## [3136]	train-rmse:1829.761255+0.242397	test-rmse:1829.763184+2.735122 
## [3137]	train-rmse:1829.579614+0.242140	test-rmse:1829.580945+2.734909 
## [3138]	train-rmse:1829.397388+0.242737	test-rmse:1829.398303+2.734735 
## [3139]	train-rmse:1829.214477+0.241916	test-rmse:1829.215893+2.734569 
## [3140]	train-rmse:1829.032263+0.242898	test-rmse:1829.033960+2.734753 
## [3141]	train-rmse:1828.849744+0.242177	test-rmse:1828.851428+2.734504 
## [3142]	train-rmse:1828.667932+0.242124	test-rmse:1828.669189+2.734647 
## [3143]	train-rmse:1828.485107+0.242459	test-rmse:1828.487170+2.734452 
## [3144]	train-rmse:1828.303479+0.242764	test-rmse:1828.304993+2.734413 
## [3145]	train-rmse:1828.121631+0.242487	test-rmse:1828.122742+2.734192 
## [3146]	train-rmse:1827.938684+0.242409	test-rmse:1827.940552+2.734397 
## [3147]	train-rmse:1827.757337+0.242060	test-rmse:1827.758423+2.734335 
## [3148]	train-rmse:1827.575147+0.243006	test-rmse:1827.576331+2.734055 
## [3149]	train-rmse:1827.392615+0.242283	test-rmse:1827.393982+2.733875 
## [3150]	train-rmse:1827.210828+0.242218	test-rmse:1827.211865+2.734265 
## [3151]	train-rmse:1827.028064+0.242604	test-rmse:1827.029846+2.733881 
## [3152]	train-rmse:1826.846619+0.241610	test-rmse:1826.847888+2.734045 
## [3153]	train-rmse:1826.664417+0.242388	test-rmse:1826.665857+2.733699 
## [3154]	train-rmse:1826.482190+0.242920	test-rmse:1826.483789+2.733497 
## [3155]	train-rmse:1826.300061+0.241672	test-rmse:1826.301990+2.733525 
## [3156]	train-rmse:1826.118823+0.242347	test-rmse:1826.119727+2.733639 
## [3157]	train-rmse:1825.936646+0.242405	test-rmse:1825.937781+2.733607 
## [3158]	train-rmse:1825.754309+0.241718	test-rmse:1825.755981+2.733261 
## [3159]	train-rmse:1825.572375+0.242172	test-rmse:1825.573938+2.733615 
## [3160]	train-rmse:1825.390613+0.242480	test-rmse:1825.392188+2.733505 
## [3161]	train-rmse:1825.208777+0.241101	test-rmse:1825.210413+2.733259 
## [3162]	train-rmse:1825.026294+0.241769	test-rmse:1825.028247+2.733183 
## [3163]	train-rmse:1824.845227+0.242140	test-rmse:1824.846704+2.733179 
## [3164]	train-rmse:1824.663391+0.241606	test-rmse:1824.664514+2.733069 
## [3165]	train-rmse:1824.481323+0.241902	test-rmse:1824.482837+2.732937 
## [3166]	train-rmse:1824.300232+0.242215	test-rmse:1824.300794+2.732931 
## [3167]	train-rmse:1824.118115+0.241318	test-rmse:1824.119055+2.732911 
## [3168]	train-rmse:1823.935791+0.242142	test-rmse:1823.937353+2.732899 
## [3169]	train-rmse:1823.754346+0.242259	test-rmse:1823.755603+2.732807 
## [3170]	train-rmse:1823.572681+0.241281	test-rmse:1823.573926+2.732722 
## [3171]	train-rmse:1823.390881+0.241261	test-rmse:1823.392029+2.732732 
## [3172]	train-rmse:1823.208899+0.242591	test-rmse:1823.210547+2.732424 
## [3173]	train-rmse:1823.027527+0.241749	test-rmse:1823.028723+2.732289 
## [3174]	train-rmse:1822.845593+0.241189	test-rmse:1822.847339+2.732568 
## [3175]	train-rmse:1822.664538+0.242614	test-rmse:1822.665698+2.732285 
## [3176]	train-rmse:1822.482141+0.241379	test-rmse:1822.483960+2.732330 
## [3177]	train-rmse:1822.301379+0.241055	test-rmse:1822.302295+2.732237 
## [3178]	train-rmse:1822.119617+0.241812	test-rmse:1822.120837+2.732526 
## [3179]	train-rmse:1821.937707+0.241798	test-rmse:1821.939014+2.732111 
## [3180]	train-rmse:1821.756677+0.240500	test-rmse:1821.757654+2.732135 
## [3181]	train-rmse:1821.574365+0.241560	test-rmse:1821.575989+2.732032 
## [3182]	train-rmse:1821.393579+0.241952	test-rmse:1821.394458+2.731905 
## [3183]	train-rmse:1821.212256+0.240983	test-rmse:1821.213086+2.732086 
## [3184]	train-rmse:1821.029932+0.241188	test-rmse:1821.031336+2.731795 
## [3185]	train-rmse:1820.849158+0.241459	test-rmse:1820.850146+2.731851 
## [3186]	train-rmse:1820.667114+0.241820	test-rmse:1820.668677+2.731707 
## [3187]	train-rmse:1820.485889+0.240644	test-rmse:1820.487231+2.731621 
## [3188]	train-rmse:1820.304492+0.241453	test-rmse:1820.305957+2.731648 
## [3189]	train-rmse:1820.123535+0.241689	test-rmse:1820.124524+2.731400 
## [3190]	train-rmse:1819.942395+0.240467	test-rmse:1819.943225+2.731369 
## [3191]	train-rmse:1819.760547+0.241906	test-rmse:1819.761853+2.731521 
## [3192]	train-rmse:1819.579456+0.241510	test-rmse:1819.580518+2.731286 
## [3193]	train-rmse:1819.398303+0.240610	test-rmse:1819.399036+2.731353 
## [3194]	train-rmse:1819.216516+0.241339	test-rmse:1819.217944+2.731093 
## [3195]	train-rmse:1819.036084+0.241121	test-rmse:1819.036487+2.731111 
## [3196]	train-rmse:1818.853882+0.241139	test-rmse:1818.855151+2.731148 
## [3197]	train-rmse:1818.672656+0.240677	test-rmse:1818.673901+2.731072 
## [3198]	train-rmse:1818.492541+0.241316	test-rmse:1818.492810+2.730947 
## [3199]	train-rmse:1818.310608+0.240932	test-rmse:1818.311609+2.730815 
## [3200]	train-rmse:1818.129101+0.240704	test-rmse:1818.130310+2.730703 
## [3201]	train-rmse:1817.948230+0.241883	test-rmse:1817.949268+2.730815 
## [3202]	train-rmse:1817.767212+0.240570	test-rmse:1817.767993+2.730730 
## [3203]	train-rmse:1817.585339+0.240616	test-rmse:1817.586951+2.730771 
## [3204]	train-rmse:1817.404284+0.241680	test-rmse:1817.405798+2.730751 
## [3205]	train-rmse:1817.223499+0.240415	test-rmse:1817.224841+2.730578 
## [3206]	train-rmse:1817.043176+0.240610	test-rmse:1817.043591+2.730629 
## [3207]	train-rmse:1816.861499+0.241846	test-rmse:1816.862561+2.730393 
## [3208]	train-rmse:1816.679761+0.240897	test-rmse:1816.681567+2.730219 
## [3209]	train-rmse:1816.499341+0.240605	test-rmse:1816.500390+2.730232 
## [3210]	train-rmse:1816.318274+0.241185	test-rmse:1816.319556+2.730468 
## [3211]	train-rmse:1816.137659+0.241373	test-rmse:1816.138538+2.730470 
## [3212]	train-rmse:1815.956226+0.240525	test-rmse:1815.957459+2.730290 
## [3213]	train-rmse:1815.775305+0.240536	test-rmse:1815.776733+2.730172 
## [3214]	train-rmse:1815.594653+0.241134	test-rmse:1815.595764+2.730042 
## [3215]	train-rmse:1815.414221+0.240405	test-rmse:1815.414709+2.729875 
## [3216]	train-rmse:1815.232617+0.240154	test-rmse:1815.233887+2.729887 
## [3217]	train-rmse:1815.051587+0.241249	test-rmse:1815.053052+2.729884 
## [3218]	train-rmse:1814.870703+0.240899	test-rmse:1814.872070+2.729915 
## [3219]	train-rmse:1814.690991+0.240063	test-rmse:1814.691321+2.729786 
## [3220]	train-rmse:1814.508960+0.241059	test-rmse:1814.510425+2.729745 
## [3221]	train-rmse:1814.328369+0.241044	test-rmse:1814.329419+2.729716 
## [3222]	train-rmse:1814.148413+0.239673	test-rmse:1814.149085+2.729516 
## [3223]	train-rmse:1813.967090+0.241020	test-rmse:1813.968042+2.729418 
## [3224]	train-rmse:1813.786182+0.240986	test-rmse:1813.787305+2.729336 
## [3225]	train-rmse:1813.605103+0.240124	test-rmse:1813.606933+2.729442 
## [3226]	train-rmse:1813.425317+0.240447	test-rmse:1813.425891+2.729282 
## [3227]	train-rmse:1813.244202+0.240627	test-rmse:1813.245325+2.729276 
## [3228]	train-rmse:1813.063672+0.239972	test-rmse:1813.064575+2.729179 
## [3229]	train-rmse:1812.882922+0.240789	test-rmse:1812.884045+2.729133 
## [3230]	train-rmse:1812.702417+0.240334	test-rmse:1812.703332+2.728880 
## [3231]	train-rmse:1812.521716+0.240272	test-rmse:1812.522840+2.729082 
## [3232]	train-rmse:1812.341077+0.240240	test-rmse:1812.342053+2.729021 
## [3233]	train-rmse:1812.160547+0.240551	test-rmse:1812.161499+2.728756 
## [3234]	train-rmse:1811.979736+0.239848	test-rmse:1811.980810+2.728813 
## [3235]	train-rmse:1811.799573+0.240515	test-rmse:1811.800281+2.728828 
## [3236]	train-rmse:1811.619788+0.240144	test-rmse:1811.619604+2.728784 
## [3237]	train-rmse:1811.438940+0.240438	test-rmse:1811.439099+2.728705 
## [3238]	train-rmse:1811.257678+0.240239	test-rmse:1811.258801+2.728729 
## [3239]	train-rmse:1811.077588+0.240453	test-rmse:1811.078332+2.728729 
## [3240]	train-rmse:1810.897253+0.240560	test-rmse:1810.897998+2.728421 
## [3241]	train-rmse:1810.715918+0.239674	test-rmse:1810.717273+2.728369 
## [3242]	train-rmse:1810.536829+0.239945	test-rmse:1810.536841+2.728397 
## [3243]	train-rmse:1810.355859+0.240565	test-rmse:1810.356726+2.728253 
## [3244]	train-rmse:1810.174695+0.239246	test-rmse:1810.176221+2.728406 
## [3245]	train-rmse:1809.995532+0.239195	test-rmse:1809.995703+2.728253 
## [3246]	train-rmse:1809.814392+0.240404	test-rmse:1809.815247+2.728168 
## [3247]	train-rmse:1809.634595+0.239492	test-rmse:1809.635120+2.728016 
## [3248]	train-rmse:1809.454797+0.239750	test-rmse:1809.454797+2.728019 
## [3249]	train-rmse:1809.273828+0.239966	test-rmse:1809.274512+2.727895 
## [3250]	train-rmse:1809.093530+0.239402	test-rmse:1809.093908+2.727672 
## [3251]	train-rmse:1808.913928+0.240005	test-rmse:1808.913916+2.727767 
## [3252]	train-rmse:1808.732361+0.239777	test-rmse:1808.733704+2.727782 
## [3253]	train-rmse:1808.553125+0.239702	test-rmse:1808.553418+2.727906 
## [3254]	train-rmse:1808.372937+0.240258	test-rmse:1808.373132+2.727703 
## [3255]	train-rmse:1808.192127+0.238995	test-rmse:1808.193005+2.727380 
## [3256]	train-rmse:1808.012451+0.239449	test-rmse:1808.012927+2.727654 
## [3257]	train-rmse:1807.832458+0.240511	test-rmse:1807.832507+2.727262 
## [3258]	train-rmse:1807.652112+0.239286	test-rmse:1807.652759+2.727215 
## [3259]	train-rmse:1807.472205+0.239461	test-rmse:1807.472522+2.727389 
## [3260]	train-rmse:1807.292065+0.239774	test-rmse:1807.292175+2.727556 
## [3261]	train-rmse:1807.111792+0.239690	test-rmse:1807.112390+2.727245 
## [3262]	train-rmse:1806.931189+0.238822	test-rmse:1806.932300+2.727084 
## [3263]	train-rmse:1806.752380+0.239782	test-rmse:1806.752234+2.727153 
## [3264]	train-rmse:1806.571826+0.239890	test-rmse:1806.572314+2.727162 
## [3265]	train-rmse:1806.390759+0.238965	test-rmse:1806.392212+2.727104 
## [3266]	train-rmse:1806.211792+0.239663	test-rmse:1806.212146+2.727210 
## [3267]	train-rmse:1806.031897+0.239701	test-rmse:1806.032312+2.726952 
## [3268]	train-rmse:1805.850989+0.239179	test-rmse:1805.852283+2.726852 
## [3269]	train-rmse:1805.671850+0.239342	test-rmse:1805.672351+2.726871 
## [3270]	train-rmse:1805.492297+0.239552	test-rmse:1805.492310+2.726878 
## [3271]	train-rmse:1805.311462+0.239388	test-rmse:1805.312610+2.726714 
## [3272]	train-rmse:1805.132165+0.239180	test-rmse:1805.132666+2.726455 
## [3273]	train-rmse:1804.952869+0.239487	test-rmse:1804.952869+2.726626 
## [3274]	train-rmse:1804.771936+0.239132	test-rmse:1804.772839+2.726532 
## [3275]	train-rmse:1804.592212+0.238984	test-rmse:1804.593127+2.726545 
## [3276]	train-rmse:1804.413123+0.239127	test-rmse:1804.413196+2.726507 
## [3277]	train-rmse:1804.232947+0.238969	test-rmse:1804.233362+2.726397 
## [3278]	train-rmse:1804.053259+0.238777	test-rmse:1804.053613+2.726314 
## [3279]	train-rmse:1803.873804+0.239815	test-rmse:1803.874048+2.726376 
## [3280]	train-rmse:1803.693591+0.238804	test-rmse:1803.694055+2.726071 
## [3281]	train-rmse:1803.513696+0.238918	test-rmse:1803.514233+2.726050 
## [3282]	train-rmse:1803.334094+0.239246	test-rmse:1803.334692+2.726141 
## [3283]	train-rmse:1803.154968+0.238668	test-rmse:1803.155176+2.725841 
## [3284]	train-rmse:1802.975403+0.239400	test-rmse:1802.975574+2.725863 
## [3285]	train-rmse:1802.795069+0.238812	test-rmse:1802.795715+2.725654 
## [3286]	train-rmse:1802.616223+0.238556	test-rmse:1802.616052+2.725804 
## [3287]	train-rmse:1802.436072+0.238892	test-rmse:1802.436584+2.725645 
## [3288]	train-rmse:1802.256384+0.239309	test-rmse:1802.256836+2.725607 
## [3289]	train-rmse:1802.076660+0.238783	test-rmse:1802.077576+2.725581 
## [3290]	train-rmse:1801.897693+0.238582	test-rmse:1801.897717+2.725565 
## [3291]	train-rmse:1801.717383+0.239059	test-rmse:1801.718298+2.725710 
## [3292]	train-rmse:1801.538184+0.238531	test-rmse:1801.538940+2.725222 
## [3293]	train-rmse:1801.359119+0.239274	test-rmse:1801.359277+2.725463 
## [3294]	train-rmse:1801.179419+0.238311	test-rmse:1801.179614+2.725191 
## [3295]	train-rmse:1800.999475+0.239410	test-rmse:1801.000415+2.725327 
## [3296]	train-rmse:1800.820715+0.238524	test-rmse:1800.821167+2.725245 
## [3297]	train-rmse:1800.640979+0.238191	test-rmse:1800.641333+2.725054 
## [3298]	train-rmse:1800.461438+0.238781	test-rmse:1800.462207+2.725176 
## [3299]	train-rmse:1800.282617+0.238590	test-rmse:1800.282776+2.725081 
## [3300]	train-rmse:1800.103076+0.238349	test-rmse:1800.103210+2.724869 
## [3301]	train-rmse:1799.923584+0.238312	test-rmse:1799.923743+2.724857 
## [3302]	train-rmse:1799.744568+0.239406	test-rmse:1799.744458+2.724806 
## [3303]	train-rmse:1799.564185+0.238137	test-rmse:1799.565112+2.724717 
## [3304]	train-rmse:1799.386157+0.238473	test-rmse:1799.386011+2.724767 
## [3305]	train-rmse:1799.206299+0.238692	test-rmse:1799.206555+2.724502 
## [3306]	train-rmse:1799.027087+0.238336	test-rmse:1799.027503+2.724682 
## [3307]	train-rmse:1798.848022+0.238131	test-rmse:1798.848083+2.724792 
## [3308]	train-rmse:1798.667981+0.238460	test-rmse:1798.668994+2.724614 
## [3309]	train-rmse:1798.489880+0.238728	test-rmse:1798.489795+2.724359 
## [3310]	train-rmse:1798.309180+0.238263	test-rmse:1798.310242+2.724526 
## [3311]	train-rmse:1798.131226+0.238052	test-rmse:1798.131445+2.724300 
## [3312]	train-rmse:1797.951672+0.238432	test-rmse:1797.952136+2.724254 
## [3313]	train-rmse:1797.772144+0.237972	test-rmse:1797.773071+2.724285 
## [3314]	train-rmse:1797.593616+0.237597	test-rmse:1797.593787+2.724328 
## [3315]	train-rmse:1797.414612+0.238902	test-rmse:1797.414599+2.724090 
## [3316]	train-rmse:1797.235230+0.238308	test-rmse:1797.235681+2.724191 
## [3317]	train-rmse:1797.056995+0.238106	test-rmse:1797.056702+2.724082 
## [3318]	train-rmse:1796.877026+0.238004	test-rmse:1796.877429+2.724201 
## [3319]	train-rmse:1796.697974+0.238164	test-rmse:1796.698413+2.723929 
## [3320]	train-rmse:1796.519226+0.238509	test-rmse:1796.519360+2.724043 
## [3321]	train-rmse:1796.340332+0.237724	test-rmse:1796.340515+2.723645 
## [3322]	train-rmse:1796.161133+0.237767	test-rmse:1796.161499+2.723699 
## [3323]	train-rmse:1795.982190+0.238161	test-rmse:1795.982507+2.723446 
## [3324]	train-rmse:1795.803357+0.237443	test-rmse:1795.803552+2.723520 
## [3325]	train-rmse:1795.624475+0.238186	test-rmse:1795.624719+2.723527 
## [3326]	train-rmse:1795.445605+0.237531	test-rmse:1795.445715+2.723468 
## [3327]	train-rmse:1795.266394+0.238040	test-rmse:1795.266797+2.723492 
## [3328]	train-rmse:1795.087561+0.237498	test-rmse:1795.088086+2.723528 
## [3329]	train-rmse:1794.909045+0.238005	test-rmse:1794.908936+2.723260 
## [3330]	train-rmse:1794.729468+0.237715	test-rmse:1794.730213+2.723021 
## [3331]	train-rmse:1794.551379+0.237897	test-rmse:1794.551367+2.723223 
## [3332]	train-rmse:1794.372791+0.237816	test-rmse:1794.372632+2.722972 
## [3333]	train-rmse:1794.193457+0.238182	test-rmse:1794.193958+2.723145 
## [3334]	train-rmse:1794.014465+0.237670	test-rmse:1794.015039+2.723138 
## [3335]	train-rmse:1793.836206+0.237948	test-rmse:1793.835986+2.722937 
## [3336]	train-rmse:1793.657703+0.238003	test-rmse:1793.657507+2.723047 
## [3337]	train-rmse:1793.477942+0.237821	test-rmse:1793.478772+2.722685 
## [3338]	train-rmse:1793.299609+0.238010	test-rmse:1793.300000+2.722698 
## [3339]	train-rmse:1793.121655+0.237052	test-rmse:1793.121338+2.722688 
## [3340]	train-rmse:1792.942700+0.237637	test-rmse:1792.942761+2.722510 
## [3341]	train-rmse:1792.763635+0.237627	test-rmse:1792.764197+2.722327 
## [3342]	train-rmse:1792.585657+0.237204	test-rmse:1792.585742+2.722340 
## [3343]	train-rmse:1792.406518+0.236871	test-rmse:1792.406934+2.722163 
## [3344]	train-rmse:1792.228394+0.238241	test-rmse:1792.228247+2.722450 
## [3345]	train-rmse:1792.049475+0.238041	test-rmse:1792.049829+2.722408 
## [3346]	train-rmse:1791.870996+0.236265	test-rmse:1791.871228+2.722331 
## [3347]	train-rmse:1791.693249+0.237654	test-rmse:1791.692603+2.722234 
## [3348]	train-rmse:1791.513928+0.237420	test-rmse:1791.514111+2.721978 
## [3349]	train-rmse:1791.334875+0.237208	test-rmse:1791.335718+2.722091 
## [3350]	train-rmse:1791.157556+0.237234	test-rmse:1791.156933+2.721900 
## [3351]	train-rmse:1790.978906+0.237877	test-rmse:1790.978564+2.721799 
## [3352]	train-rmse:1790.800366+0.237059	test-rmse:1790.800147+2.721988 
## [3353]	train-rmse:1790.621582+0.236868	test-rmse:1790.621716+2.721880 
## [3354]	train-rmse:1790.443408+0.237804	test-rmse:1790.443347+2.721697 
## [3355]	train-rmse:1790.264868+0.237094	test-rmse:1790.264795+2.721706 
## [3356]	train-rmse:1790.086682+0.237116	test-rmse:1790.086658+2.721652 
## [3357]	train-rmse:1789.907873+0.237123	test-rmse:1789.908069+2.721723 
## [3358]	train-rmse:1789.729797+0.237251	test-rmse:1789.729907+2.721447 
## [3359]	train-rmse:1789.551477+0.237122	test-rmse:1789.551306+2.721438 
## [3360]	train-rmse:1789.373291+0.237344	test-rmse:1789.373303+2.721461 
## [3361]	train-rmse:1789.195154+0.237038	test-rmse:1789.194788+2.721119 
## [3362]	train-rmse:1789.016406+0.236959	test-rmse:1789.016565+2.721352 
## [3363]	train-rmse:1788.838892+0.236263	test-rmse:1788.838403+2.721229 
## [3364]	train-rmse:1788.660510+0.237302	test-rmse:1788.660071+2.721278 
## [3365]	train-rmse:1788.481567+0.237086	test-rmse:1788.481873+2.721002 
## [3366]	train-rmse:1788.303577+0.236667	test-rmse:1788.303760+2.720772 
## [3367]	train-rmse:1788.126587+0.237238	test-rmse:1788.125440+2.721018 
## [3368]	train-rmse:1787.947522+0.237124	test-rmse:1787.947265+2.720822 
## [3369]	train-rmse:1787.768506+0.236813	test-rmse:1787.769080+2.720889 
## [3370]	train-rmse:1787.591199+0.236792	test-rmse:1787.591016+2.720795 
## [3371]	train-rmse:1787.413672+0.236775	test-rmse:1787.413172+2.720666 
## [3372]	train-rmse:1787.235181+0.237002	test-rmse:1787.234631+2.720571 
## [3373]	train-rmse:1787.057275+0.236567	test-rmse:1787.056653+2.720474 
## [3374]	train-rmse:1786.879309+0.236661	test-rmse:1786.878931+2.720377 
## [3375]	train-rmse:1786.701050+0.237233	test-rmse:1786.700806+2.720468 
## [3376]	train-rmse:1786.523108+0.236870	test-rmse:1786.522510+2.720294 
## [3377]	train-rmse:1786.345374+0.236664	test-rmse:1786.344897+2.720252 
## [3378]	train-rmse:1786.167138+0.236313	test-rmse:1786.166772+2.720021 
## [3379]	train-rmse:1785.989405+0.236457	test-rmse:1785.988696+2.719918 
## [3380]	train-rmse:1785.810754+0.236816	test-rmse:1785.810840+2.719887 
## [3381]	train-rmse:1785.633215+0.236442	test-rmse:1785.632959+2.720116 
## [3382]	train-rmse:1785.454675+0.236974	test-rmse:1785.454944+2.719869 
## [3383]	train-rmse:1785.277954+0.236273	test-rmse:1785.277307+2.719449 
## [3384]	train-rmse:1785.099365+0.237184	test-rmse:1785.099170+2.719763 
## [3385]	train-rmse:1784.921326+0.236717	test-rmse:1784.921362+2.719555 
## [3386]	train-rmse:1784.743591+0.236210	test-rmse:1784.743457+2.719529 
## [3387]	train-rmse:1784.567029+0.236303	test-rmse:1784.565942+2.719346 
## [3388]	train-rmse:1784.388281+0.236792	test-rmse:1784.387708+2.719401 
## [3389]	train-rmse:1784.209705+0.236040	test-rmse:1784.210083+2.719395 
## [3390]	train-rmse:1784.033032+0.236396	test-rmse:1784.032410+2.719033 
## [3391]	train-rmse:1783.855200+0.236031	test-rmse:1783.854626+2.719063 
## [3392]	train-rmse:1783.676941+0.237065	test-rmse:1783.676855+2.719033 
## [3393]	train-rmse:1783.499536+0.236366	test-rmse:1783.499072+2.718929 
## [3394]	train-rmse:1783.321521+0.236204	test-rmse:1783.321496+2.718976 
## [3395]	train-rmse:1783.144482+0.236215	test-rmse:1783.143811+2.718923 
## [3396]	train-rmse:1782.966590+0.236414	test-rmse:1782.966077+2.718625 
## [3397]	train-rmse:1782.788428+0.236610	test-rmse:1782.788513+2.718741 
## [3398]	train-rmse:1782.611474+0.235460	test-rmse:1782.610913+2.718790 
## [3399]	train-rmse:1782.433557+0.236450	test-rmse:1782.433264+2.718487 
## [3400]	train-rmse:1782.255615+0.236040	test-rmse:1782.255823+2.718506 
## [3401]	train-rmse:1782.078650+0.235858	test-rmse:1782.078088+2.718286 
## [3402]	train-rmse:1781.901697+0.236136	test-rmse:1781.900598+2.718382 
## [3403]	train-rmse:1781.723792+0.236230	test-rmse:1781.722949+2.718405 
## [3404]	train-rmse:1781.546155+0.236194	test-rmse:1781.545288+2.718224 
## [3405]	train-rmse:1781.367786+0.235694	test-rmse:1781.368176+2.717987 
## [3406]	train-rmse:1781.190637+0.235757	test-rmse:1781.190576+2.717922 
## [3407]	train-rmse:1781.013232+0.236511	test-rmse:1781.013025+2.717886 
## [3408]	train-rmse:1780.836377+0.235923	test-rmse:1780.835523+2.717923 
## [3409]	train-rmse:1780.658288+0.235548	test-rmse:1780.658325+2.717738 
## [3410]	train-rmse:1780.481372+0.236051	test-rmse:1780.480774+2.717518 
## [3411]	train-rmse:1780.303625+0.236182	test-rmse:1780.303308+2.717519 
## [3412]	train-rmse:1780.126147+0.234949	test-rmse:1780.125952+2.717393 
## [3413]	train-rmse:1779.949194+0.236118	test-rmse:1779.948559+2.717445 
## [3414]	train-rmse:1779.771826+0.236315	test-rmse:1779.770898+2.717333 
## [3415]	train-rmse:1779.594556+0.235173	test-rmse:1779.593994+2.717099 
## [3416]	train-rmse:1779.417273+0.236168	test-rmse:1779.416480+2.717345 
## [3417]	train-rmse:1779.239880+0.235923	test-rmse:1779.239245+2.717121 
## [3418]	train-rmse:1779.062744+0.235576	test-rmse:1779.061938+2.717297 
## [3419]	train-rmse:1778.885327+0.235911	test-rmse:1778.884875+2.717077 
## [3420]	train-rmse:1778.708081+0.235989	test-rmse:1778.707495+2.716876 
## [3421]	train-rmse:1778.531360+0.235656	test-rmse:1778.530115+2.716759 
## [3422]	train-rmse:1778.353516+0.235469	test-rmse:1778.353028+2.716773 
## [3423]	train-rmse:1778.177112+0.235956	test-rmse:1778.175977+2.716816 
## [3424]	train-rmse:1777.999451+0.235493	test-rmse:1777.998669+2.716668 
## [3425]	train-rmse:1777.821545+0.234815	test-rmse:1777.821753+2.716662 
## [3426]	train-rmse:1777.645520+0.235356	test-rmse:1777.644397+2.716481 
## [3427]	train-rmse:1777.467810+0.236087	test-rmse:1777.467395+2.716374 
## [3428]	train-rmse:1777.290735+0.234504	test-rmse:1777.290222+2.716256 
## [3429]	train-rmse:1777.114063+0.235853	test-rmse:1777.113257+2.716247 
## [3430]	train-rmse:1776.936560+0.235380	test-rmse:1776.936121+2.716206 
## [3431]	train-rmse:1776.759900+0.235730	test-rmse:1776.759106+2.716160 
## [3432]	train-rmse:1776.582531+0.235593	test-rmse:1776.582080+2.715992 
## [3433]	train-rmse:1776.406103+0.235702	test-rmse:1776.405066+2.715838 
## [3434]	train-rmse:1776.228552+0.234753	test-rmse:1776.228100+2.715770 
## [3435]	train-rmse:1776.052014+0.235211	test-rmse:1776.051196+2.715719 
## [3436]	train-rmse:1775.874207+0.235559	test-rmse:1775.873950+2.715710 
## [3437]	train-rmse:1775.698315+0.234870	test-rmse:1775.697058+2.715666 
## [3438]	train-rmse:1775.520947+0.235535	test-rmse:1775.520374+2.715455 
## [3439]	train-rmse:1775.343823+0.235920	test-rmse:1775.343335+2.715695 
## [3440]	train-rmse:1775.167883+0.234960	test-rmse:1775.166565+2.715516 
## [3441]	train-rmse:1774.989917+0.235125	test-rmse:1774.989721+2.715370 
## [3442]	train-rmse:1774.813977+0.234951	test-rmse:1774.813098+2.715115 
## [3443]	train-rmse:1774.637183+0.235440	test-rmse:1774.635901+2.715200 
## [3444]	train-rmse:1774.459387+0.234895	test-rmse:1774.459045+2.715205 
## [3445]	train-rmse:1774.282971+0.234267	test-rmse:1774.282324+2.715111 
## [3446]	train-rmse:1774.106397+0.234945	test-rmse:1774.105579+2.714991 
## [3447]	train-rmse:1773.929919+0.234845	test-rmse:1773.928760+2.714908 
## [3448]	train-rmse:1773.752832+0.235040	test-rmse:1773.752136+2.714774 
## [3449]	train-rmse:1773.576465+0.234740	test-rmse:1773.575171+2.714865 
## [3450]	train-rmse:1773.399768+0.234864	test-rmse:1773.398572+2.714742 
## [3451]	train-rmse:1773.222449+0.234495	test-rmse:1773.221887+2.714477 
## [3452]	train-rmse:1773.046729+0.234884	test-rmse:1773.045349+2.714492 
## [3453]	train-rmse:1772.869373+0.234807	test-rmse:1772.868957+2.714452 
## [3454]	train-rmse:1772.692920+0.234956	test-rmse:1772.692114+2.714102 
## [3455]	train-rmse:1772.516992+0.234934	test-rmse:1772.515442+2.714243 
## [3456]	train-rmse:1772.340332+0.235145	test-rmse:1772.338867+2.714166 
## [3457]	train-rmse:1772.162976+0.235014	test-rmse:1772.162170+2.714254 
## [3458]	train-rmse:1771.986609+0.234401	test-rmse:1771.985852+2.714083 
## [3459]	train-rmse:1771.810669+0.234273	test-rmse:1771.809350+2.713766 
## [3460]	train-rmse:1771.633008+0.234636	test-rmse:1771.632544+2.713826 
## [3461]	train-rmse:1771.457080+0.235093	test-rmse:1771.456287+2.713796 
## [3462]	train-rmse:1771.280554+0.234330	test-rmse:1771.279517+2.713586 
## [3463]	train-rmse:1771.104321+0.233850	test-rmse:1771.103076+2.713614 
## [3464]	train-rmse:1770.927490+0.235138	test-rmse:1770.926660+2.713282 
## [3465]	train-rmse:1770.750745+0.234521	test-rmse:1770.750232+2.713626 
## [3466]	train-rmse:1770.574768+0.233653	test-rmse:1770.573938+2.713270 
## [3467]	train-rmse:1770.398621+0.234281	test-rmse:1770.397546+2.713185 
## [3468]	train-rmse:1770.221667+0.234791	test-rmse:1770.220935+2.713193 
## [3469]	train-rmse:1770.045459+0.234307	test-rmse:1770.044873+2.713056 
## [3470]	train-rmse:1769.869434+0.234342	test-rmse:1769.868237+2.713104 
## [3471]	train-rmse:1769.692871+0.234264	test-rmse:1769.692102+2.713032 
## [3472]	train-rmse:1769.516955+0.234826	test-rmse:1769.515649+2.713025 
## [3473]	train-rmse:1769.340186+0.234084	test-rmse:1769.339416+2.712842 
## [3474]	train-rmse:1769.164673+0.233629	test-rmse:1769.163281+2.712572 
## [3475]	train-rmse:1768.987549+0.234290	test-rmse:1768.986890+2.712704 
## [3476]	train-rmse:1768.812109+0.234153	test-rmse:1768.810718+2.712805 
## [3477]	train-rmse:1768.635315+0.234985	test-rmse:1768.634485+2.712529 
## [3478]	train-rmse:1768.458545+0.233549	test-rmse:1768.458179+2.712374 
## [3479]	train-rmse:1768.283301+0.234183	test-rmse:1768.281970+2.712334 
## [3480]	train-rmse:1768.106628+0.234836	test-rmse:1768.105884+2.712384 
## [3481]	train-rmse:1767.930542+0.233502	test-rmse:1767.929663+2.712219 
## [3482]	train-rmse:1767.754529+0.233954	test-rmse:1767.753406+2.712170 
## [3483]	train-rmse:1767.578174+0.235156	test-rmse:1767.577222+2.712111 
## [3484]	train-rmse:1767.402698+0.234201	test-rmse:1767.401294+2.711792 
## [3485]	train-rmse:1767.226392+0.234346	test-rmse:1767.224976+2.712026 
## [3486]	train-rmse:1767.050061+0.233853	test-rmse:1767.049182+2.711950 
## [3487]	train-rmse:1766.874316+0.233949	test-rmse:1766.873120+2.711798 
## [3488]	train-rmse:1766.697901+0.233502	test-rmse:1766.697241+2.711613 
## [3489]	train-rmse:1766.522534+0.234864	test-rmse:1766.521228+2.711746 
## [3490]	train-rmse:1766.346094+0.234052	test-rmse:1766.345215+2.711357 
## [3491]	train-rmse:1766.169751+0.233729	test-rmse:1766.169031+2.711502 
## [3492]	train-rmse:1765.994848+0.233928	test-rmse:1765.993091+2.711550 
## [3493]	train-rmse:1765.818787+0.233666	test-rmse:1765.817224+2.711444 
## [3494]	train-rmse:1765.641455+0.233430	test-rmse:1765.641162+2.711397 
## [3495]	train-rmse:1765.466650+0.234885	test-rmse:1765.465442+2.711256 
## [3496]	train-rmse:1765.291052+0.233587	test-rmse:1765.289307+2.711330 
## [3497]	train-rmse:1765.114807+0.233395	test-rmse:1765.113587+2.711235 
## [3498]	train-rmse:1764.939148+0.234083	test-rmse:1764.937756+2.711131 
## [3499]	train-rmse:1764.763391+0.233751	test-rmse:1764.761719+2.710907 
## [3500]	train-rmse:1764.587463+0.233586	test-rmse:1764.585803+2.710722 
## [3501]	train-rmse:1764.410925+0.233372	test-rmse:1764.410388+2.710798 
## [3502]	train-rmse:1764.236389+0.234465	test-rmse:1764.234399+2.710820 
## [3503]	train-rmse:1764.059436+0.233411	test-rmse:1764.058643+2.710631 
## [3504]	train-rmse:1763.883716+0.233427	test-rmse:1763.882739+2.710481 
## [3505]	train-rmse:1763.709021+0.234223	test-rmse:1763.707214+2.710606 
## [3506]	train-rmse:1763.533130+0.233116	test-rmse:1763.531396+2.710521 
## [3507]	train-rmse:1763.357129+0.233523	test-rmse:1763.355774+2.710296 
## [3508]	train-rmse:1763.181140+0.233461	test-rmse:1763.180115+2.710420 
## [3509]	train-rmse:1763.006067+0.233610	test-rmse:1763.004602+2.710266 
## [3510]	train-rmse:1762.829883+0.233393	test-rmse:1762.828918+2.710204 
## [3511]	train-rmse:1762.653516+0.233110	test-rmse:1762.653235+2.710051 
## [3512]	train-rmse:1762.478723+0.232679	test-rmse:1762.477808+2.709865 
## [3513]	train-rmse:1762.304224+0.233489	test-rmse:1762.302112+2.710102 
## [3514]	train-rmse:1762.127283+0.233293	test-rmse:1762.126367+2.709995 
## [3515]	train-rmse:1761.952234+0.233654	test-rmse:1761.950757+2.709940 
## [3516]	train-rmse:1761.776453+0.233206	test-rmse:1761.775500+2.709731 
## [3517]	train-rmse:1761.600830+0.233293	test-rmse:1761.599878+2.709717 
## [3518]	train-rmse:1761.426013+0.233717	test-rmse:1761.424487+2.709695 
## [3519]	train-rmse:1761.249793+0.232469	test-rmse:1761.248791+2.709807 
## [3520]	train-rmse:1761.074780+0.233129	test-rmse:1761.073279+2.709433 
## [3521]	train-rmse:1760.898987+0.233517	test-rmse:1760.897949+2.709419 
## [3522]	train-rmse:1760.723938+0.232825	test-rmse:1760.722558+2.709299 
## [3523]	train-rmse:1760.548999+0.232784	test-rmse:1760.546973+2.709378 
## [3524]	train-rmse:1760.372473+0.233156	test-rmse:1760.371655+2.709166 
## [3525]	train-rmse:1760.197986+0.232624	test-rmse:1760.196130+2.709139 
## [3526]	train-rmse:1760.022705+0.233357	test-rmse:1760.021057+2.709223 
## [3527]	train-rmse:1759.847229+0.232653	test-rmse:1759.845862+2.709133 
## [3528]	train-rmse:1759.671216+0.233256	test-rmse:1759.670166+2.708976 
## [3529]	train-rmse:1759.496155+0.232912	test-rmse:1759.494849+2.708774 
## [3530]	train-rmse:1759.321338+0.232569	test-rmse:1759.319666+2.708640 
## [3531]	train-rmse:1759.145911+0.232859	test-rmse:1759.144434+2.708629 
## [3532]	train-rmse:1758.970337+0.232668	test-rmse:1758.969165+2.708676 
## [3533]	train-rmse:1758.795459+0.233264	test-rmse:1758.793909+2.708610 
## [3534]	train-rmse:1758.620483+0.231967	test-rmse:1758.618652+2.708526 
## [3535]	train-rmse:1758.445178+0.232951	test-rmse:1758.443420+2.708273 
## [3536]	train-rmse:1758.269226+0.232915	test-rmse:1758.268372+2.708475 
## [3537]	train-rmse:1758.094629+0.232358	test-rmse:1758.093128+2.708330 
## [3538]	train-rmse:1757.919421+0.232477	test-rmse:1757.917773+2.708272 
## [3539]	train-rmse:1757.743982+0.232651	test-rmse:1757.742712+2.708102 
## [3540]	train-rmse:1757.569922+0.232211	test-rmse:1757.567688+2.708075 
## [3541]	train-rmse:1757.393457+0.232331	test-rmse:1757.392542+2.707955 
## [3542]	train-rmse:1757.219312+0.232419	test-rmse:1757.217529+2.707729 
## [3543]	train-rmse:1757.043616+0.232464	test-rmse:1757.042395+2.707845 
## [3544]	train-rmse:1756.869116+0.232378	test-rmse:1756.867602+2.707840 
## [3545]	train-rmse:1756.693567+0.232791	test-rmse:1756.692236+2.707738 
## [3546]	train-rmse:1756.519092+0.232272	test-rmse:1756.517261+2.707729 
## [3547]	train-rmse:1756.343848+0.231933	test-rmse:1756.342480+2.707494 
## [3548]	train-rmse:1756.168787+0.232938	test-rmse:1756.167602+2.707355 
## [3549]	train-rmse:1755.994385+0.232342	test-rmse:1755.992261+2.707358 
## [3550]	train-rmse:1755.819043+0.232320	test-rmse:1755.817407+2.707532 
## [3551]	train-rmse:1755.644287+0.232571	test-rmse:1755.642529+2.707191 
## [3552]	train-rmse:1755.469177+0.231914	test-rmse:1755.467529+2.707469 
## [3553]	train-rmse:1755.294556+0.232809	test-rmse:1755.292786+2.707168 
## [3554]	train-rmse:1755.118958+0.232418	test-rmse:1755.117896+2.707041 
## [3555]	train-rmse:1754.945178+0.232062	test-rmse:1754.943079+2.706861 
## [3556]	train-rmse:1754.769666+0.232364	test-rmse:1754.768250+2.706920 
## [3557]	train-rmse:1754.595068+0.232443	test-rmse:1754.593274+2.706736 
## [3558]	train-rmse:1754.420740+0.232623	test-rmse:1754.418445+2.706839 
## [3559]	train-rmse:1754.245019+0.232440	test-rmse:1754.243689+2.706941 
## [3560]	train-rmse:1754.070520+0.232076	test-rmse:1754.068811+2.706487 
## [3561]	train-rmse:1753.896216+0.231887	test-rmse:1753.894165+2.706344 
## [3562]	train-rmse:1753.720947+0.232078	test-rmse:1753.719495+2.706484 
## [3563]	train-rmse:1753.546863+0.232018	test-rmse:1753.544787+2.706247 
## [3564]	train-rmse:1753.372217+0.231911	test-rmse:1753.370129+2.706322 
## [3565]	train-rmse:1753.197559+0.231454	test-rmse:1753.195422+2.706241 
## [3566]	train-rmse:1753.022668+0.232218	test-rmse:1753.020593+2.706219 
## [3567]	train-rmse:1752.847620+0.232132	test-rmse:1752.845984+2.705988 
## [3568]	train-rmse:1752.673950+0.232124	test-rmse:1752.671436+2.706242 
## [3569]	train-rmse:1752.498255+0.231669	test-rmse:1752.496814+2.706095 
## [3570]	train-rmse:1752.323389+0.231680	test-rmse:1752.322351+2.705945 
## [3571]	train-rmse:1752.149927+0.232066	test-rmse:1752.147485+2.706031 
## [3572]	train-rmse:1751.974658+0.231465	test-rmse:1751.973096+2.705822 
## [3573]	train-rmse:1751.800342+0.231902	test-rmse:1751.798572+2.705903 
## [3574]	train-rmse:1751.625696+0.232088	test-rmse:1751.624011+2.705704 
## [3575]	train-rmse:1751.450683+0.231800	test-rmse:1751.449536+2.705513 
## [3576]	train-rmse:1751.277503+0.231179	test-rmse:1751.275061+2.705469 
## [3577]	train-rmse:1751.102624+0.232019	test-rmse:1751.100769+2.705502 
## [3578]	train-rmse:1750.928039+0.231987	test-rmse:1750.926050+2.705481 
## [3579]	train-rmse:1750.753186+0.231333	test-rmse:1750.751880+2.705458 
## [3580]	train-rmse:1750.579199+0.231119	test-rmse:1750.577429+2.705399 
## [3581]	train-rmse:1750.404895+0.231462	test-rmse:1750.402978+2.705191 
## [3582]	train-rmse:1750.229748+0.231838	test-rmse:1750.228394+2.705157 
## [3583]	train-rmse:1750.057043+0.231964	test-rmse:1750.054272+2.704934 
## [3584]	train-rmse:1749.881311+0.230785	test-rmse:1749.879858+2.705050 
## [3585]	train-rmse:1749.707727+0.231481	test-rmse:1749.705163+2.704678 
## [3586]	train-rmse:1749.533228+0.231500	test-rmse:1749.531189+2.704841 
## [3587]	train-rmse:1749.358667+0.230919	test-rmse:1749.356751+2.704794 
## [3588]	train-rmse:1749.184546+0.232069	test-rmse:1749.182458+2.704710 
## [3589]	train-rmse:1749.010449+0.231382	test-rmse:1749.008350+2.704803 
## [3590]	train-rmse:1748.836413+0.231697	test-rmse:1748.834192+2.704590 
## [3591]	train-rmse:1748.661279+0.230443	test-rmse:1748.659656+2.704290 
## [3592]	train-rmse:1748.487915+0.231101	test-rmse:1748.485583+2.704267 
## [3593]	train-rmse:1748.313806+0.231123	test-rmse:1748.311377+2.704379 
## [3594]	train-rmse:1748.138831+0.231014	test-rmse:1748.137219+2.704435 
## [3595]	train-rmse:1747.965210+0.231340	test-rmse:1747.963196+2.704284 
## [3596]	train-rmse:1747.791467+0.231773	test-rmse:1747.788855+2.704158 
## [3597]	train-rmse:1747.617224+0.231349	test-rmse:1747.614990+2.704081 
## [3598]	train-rmse:1747.442700+0.230494	test-rmse:1747.440942+2.703853 
## [3599]	train-rmse:1747.269226+0.231331	test-rmse:1747.266687+2.703723 
## [3600]	train-rmse:1747.094458+0.231176	test-rmse:1747.092664+2.703857 
## [3601]	train-rmse:1746.920422+0.230653	test-rmse:1746.918640+2.703691 
## [3602]	train-rmse:1746.747180+0.231086	test-rmse:1746.744592+2.703650 
## [3603]	train-rmse:1746.572192+0.231310	test-rmse:1746.570593+2.703489 
## [3604]	train-rmse:1746.398437+0.230843	test-rmse:1746.396545+2.703515 
## [3605]	train-rmse:1746.224805+0.231125	test-rmse:1746.222729+2.703547 
## [3606]	train-rmse:1746.050586+0.231325	test-rmse:1746.048438+2.703480 
## [3607]	train-rmse:1745.876929+0.230277	test-rmse:1745.874450+2.703404 
## [3608]	train-rmse:1745.703186+0.231161	test-rmse:1745.700610+2.703379 
## [3609]	train-rmse:1745.528735+0.230903	test-rmse:1745.526673+2.703257 
## [3610]	train-rmse:1745.355518+0.230772	test-rmse:1745.352893+2.703249 
## [3611]	train-rmse:1745.180652+0.231238	test-rmse:1745.179016+2.702906 
## [3612]	train-rmse:1745.007959+0.230846	test-rmse:1745.005188+2.703090 
## [3613]	train-rmse:1744.833056+0.231028	test-rmse:1744.831226+2.702803 
## [3614]	train-rmse:1744.659949+0.231199	test-rmse:1744.657422+2.702757 
## [3615]	train-rmse:1744.485742+0.230443	test-rmse:1744.483459+2.702701 
## [3616]	train-rmse:1744.311438+0.230844	test-rmse:1744.309827+2.702648 
## [3617]	train-rmse:1744.138721+0.230424	test-rmse:1744.136145+2.702554 
## [3618]	train-rmse:1743.964783+0.231063	test-rmse:1743.962378+2.702587 
## [3619]	train-rmse:1743.790454+0.230447	test-rmse:1743.788721+2.702509 
## [3620]	train-rmse:1743.617554+0.231066	test-rmse:1743.614905+2.702446 
## [3621]	train-rmse:1743.443603+0.230360	test-rmse:1743.441199+2.702302 
## [3622]	train-rmse:1743.269556+0.230564	test-rmse:1743.267493+2.702113 
## [3623]	train-rmse:1743.096399+0.230506	test-rmse:1743.093835+2.702108 
## [3624]	train-rmse:1742.922290+0.231043	test-rmse:1742.920227+2.702167 
## [3625]	train-rmse:1742.749243+0.229874	test-rmse:1742.746521+2.701980 
## [3626]	train-rmse:1742.575671+0.230422	test-rmse:1742.572961+2.701921 
## [3627]	train-rmse:1742.401868+0.231182	test-rmse:1742.399158+2.701933 
## [3628]	train-rmse:1742.227515+0.230037	test-rmse:1742.225574+2.701838 
## [3629]	train-rmse:1742.054626+0.230470	test-rmse:1742.052295+2.701811 
## [3630]	train-rmse:1741.881384+0.230397	test-rmse:1741.878479+2.701895 
## [3631]	train-rmse:1741.707605+0.230135	test-rmse:1741.705322+2.701607 
## [3632]	train-rmse:1741.533984+0.230327	test-rmse:1741.531787+2.701310 
## [3633]	train-rmse:1741.360559+0.230806	test-rmse:1741.358179+2.701455 
## [3634]	train-rmse:1741.187402+0.230417	test-rmse:1741.184619+2.701280 
## [3635]	train-rmse:1741.013122+0.229963	test-rmse:1741.011194+2.701383 
## [3636]	train-rmse:1740.840149+0.230316	test-rmse:1740.837854+2.701143 
## [3637]	train-rmse:1740.666821+0.230453	test-rmse:1740.664526+2.701148 
## [3638]	train-rmse:1740.493176+0.229649	test-rmse:1740.491089+2.700977 
## [3639]	train-rmse:1740.319604+0.230080	test-rmse:1740.317773+2.701123 
## [3640]	train-rmse:1740.146826+0.229822	test-rmse:1740.144092+2.700999 
## [3641]	train-rmse:1739.973608+0.229943	test-rmse:1739.970837+2.700864 
## [3642]	train-rmse:1739.799792+0.230297	test-rmse:1739.797424+2.700731 
## [3643]	train-rmse:1739.627124+0.230231	test-rmse:1739.624084+2.700774 
## [3644]	train-rmse:1739.452722+0.229994	test-rmse:1739.451038+2.700779 
## [3645]	train-rmse:1739.280481+0.230086	test-rmse:1739.277783+2.700689 
## [3646]	train-rmse:1739.106543+0.229946	test-rmse:1739.104492+2.700588 
## [3647]	train-rmse:1738.933887+0.229601	test-rmse:1738.931189+2.700279 
## [3648]	train-rmse:1738.760547+0.230187	test-rmse:1738.758020+2.700572 
## [3649]	train-rmse:1738.587195+0.229942	test-rmse:1738.584607+2.700274 
## [3650]	train-rmse:1738.413977+0.229363	test-rmse:1738.411316+2.700214 
## [3651]	train-rmse:1738.240662+0.229919	test-rmse:1738.238281+2.700152 
## [3652]	train-rmse:1738.067749+0.229975	test-rmse:1738.065088+2.700080 
## [3653]	train-rmse:1737.894311+0.229802	test-rmse:1737.892163+2.699934 
## [3654]	train-rmse:1737.721485+0.230275	test-rmse:1737.718762+2.700003 
## [3655]	train-rmse:1737.548621+0.229390	test-rmse:1737.545886+2.699673 
## [3656]	train-rmse:1737.375024+0.229469	test-rmse:1737.373010+2.699763 
## [3657]	train-rmse:1737.201587+0.230068	test-rmse:1737.199793+2.699634 
## [3658]	train-rmse:1737.029492+0.229614	test-rmse:1737.026648+2.699808 
## [3659]	train-rmse:1736.855603+0.229902	test-rmse:1736.853516+2.699731 
## [3660]	train-rmse:1736.683337+0.229007	test-rmse:1736.680322+2.699623 
## [3661]	train-rmse:1736.509729+0.229846	test-rmse:1736.507288+2.699446 
## [3662]	train-rmse:1736.337305+0.229556	test-rmse:1736.334644+2.699581 
## [3663]	train-rmse:1736.164282+0.229375	test-rmse:1736.161560+2.699418 
## [3664]	train-rmse:1735.990930+0.229107	test-rmse:1735.988550+2.699419 
## [3665]	train-rmse:1735.818786+0.229244	test-rmse:1735.815650+2.699240 
## [3666]	train-rmse:1735.644726+0.229460	test-rmse:1735.642590+2.699299 
## [3667]	train-rmse:1735.472424+0.229657	test-rmse:1735.469788+2.699429 
## [3668]	train-rmse:1735.299463+0.229193	test-rmse:1735.296826+2.699190 
## [3669]	train-rmse:1735.125696+0.229832	test-rmse:1735.124133+2.698943 
## [3670]	train-rmse:1734.954199+0.228972	test-rmse:1734.951282+2.698920 
## [3671]	train-rmse:1734.780371+0.229060	test-rmse:1734.778320+2.698956 
## [3672]	train-rmse:1734.608276+0.228988	test-rmse:1734.605335+2.698853 
## [3673]	train-rmse:1734.435266+0.229865	test-rmse:1734.432824+2.698598 
## [3674]	train-rmse:1734.262158+0.228967	test-rmse:1734.260095+2.698666 
## [3675]	train-rmse:1734.090100+0.229282	test-rmse:1734.087183+2.698193 
## [3676]	train-rmse:1733.917102+0.229943	test-rmse:1733.914331+2.698558 
## [3677]	train-rmse:1733.744202+0.228667	test-rmse:1733.741651+2.698301 
## [3678]	train-rmse:1733.571582+0.229276	test-rmse:1733.569177+2.698108 
## [3679]	train-rmse:1733.399194+0.228997	test-rmse:1733.396350+2.698342 
## [3680]	train-rmse:1733.226343+0.228992	test-rmse:1733.223779+2.697930 
## [3681]	train-rmse:1733.054077+0.229242	test-rmse:1733.051062+2.697967 
## [3682]	train-rmse:1732.881384+0.228739	test-rmse:1732.878320+2.697813 
## [3683]	train-rmse:1732.708740+0.229314	test-rmse:1732.705859+2.697813 
## [3684]	train-rmse:1732.535657+0.228612	test-rmse:1732.533203+2.697703 
## [3685]	train-rmse:1732.363354+0.228888	test-rmse:1732.360852+2.697746 
## [3686]	train-rmse:1732.190625+0.228980	test-rmse:1732.188049+2.697809 
## [3687]	train-rmse:1732.017529+0.228400	test-rmse:1732.015527+2.697435 
## [3688]	train-rmse:1731.845801+0.228593	test-rmse:1731.843115+2.697439 
## [3689]	train-rmse:1731.673084+0.228832	test-rmse:1731.670435+2.697438 
## [3690]	train-rmse:1731.499988+0.229020	test-rmse:1731.498132+2.697417 
## [3691]	train-rmse:1731.328015+0.228787	test-rmse:1731.325513+2.697312 
## [3692]	train-rmse:1731.155664+0.228517	test-rmse:1731.153039+2.697192 
## [3693]	train-rmse:1730.982800+0.228347	test-rmse:1730.980664+2.697295 
## [3694]	train-rmse:1730.810877+0.228533	test-rmse:1730.808179+2.697100 
## [3695]	train-rmse:1730.638013+0.228600	test-rmse:1730.635669+2.696922 
## [3696]	train-rmse:1730.466052+0.229044	test-rmse:1730.463464+2.696781 
## [3697]	train-rmse:1730.293127+0.228537	test-rmse:1730.291064+2.696867 
## [3698]	train-rmse:1730.121704+0.228366	test-rmse:1730.118640+2.696879 
## [3699]	train-rmse:1729.948389+0.229217	test-rmse:1729.946436+2.696772 
## [3700]	train-rmse:1729.777051+0.228555	test-rmse:1729.773938+2.696572 
## [3701]	train-rmse:1729.604224+0.228959	test-rmse:1729.601562+2.696507 
## [3702]	train-rmse:1729.432825+0.228338	test-rmse:1729.429456+2.696490 
## [3703]	train-rmse:1729.259912+0.228243	test-rmse:1729.257178+2.696364 
## [3704]	train-rmse:1729.087207+0.228373	test-rmse:1729.085071+2.696352 
## [3705]	train-rmse:1728.915222+0.228749	test-rmse:1728.912549+2.696255 
## [3706]	train-rmse:1728.742603+0.228821	test-rmse:1728.740527+2.696331 
## [3707]	train-rmse:1728.570337+0.228274	test-rmse:1728.568250+2.696088 
## [3708]	train-rmse:1728.399109+0.227967	test-rmse:1728.396008+2.695864 
## [3709]	train-rmse:1728.226514+0.228547	test-rmse:1728.223816+2.695906 
## [3710]	train-rmse:1728.054517+0.227838	test-rmse:1728.051709+2.696105 
## [3711]	train-rmse:1727.881445+0.228639	test-rmse:1727.879675+2.695840 
## [3712]	train-rmse:1727.710584+0.228052	test-rmse:1727.707495+2.695329 
## [3713]	train-rmse:1727.537585+0.228634	test-rmse:1727.535510+2.695801 
## [3714]	train-rmse:1727.365650+0.228727	test-rmse:1727.363306+2.695630 
## [3715]	train-rmse:1727.193616+0.227941	test-rmse:1727.191467+2.695536 
## [3716]	train-rmse:1727.021387+0.228603	test-rmse:1727.019373+2.695311 
## [3717]	train-rmse:1726.850037+0.227718	test-rmse:1726.847217+2.695459 
## [3718]	train-rmse:1726.677320+0.227863	test-rmse:1726.675207+2.695250 
## [3719]	train-rmse:1726.505762+0.228641	test-rmse:1726.503223+2.695265 
## [3720]	train-rmse:1726.332983+0.228062	test-rmse:1726.331409+2.695111 
## [3721]	train-rmse:1726.162049+0.227867	test-rmse:1726.159228+2.694961 
## [3722]	train-rmse:1725.989612+0.227195	test-rmse:1725.987207+2.695129 
## [3723]	train-rmse:1725.818005+0.227599	test-rmse:1725.815430+2.694883 
## [3724]	train-rmse:1725.646130+0.228360	test-rmse:1725.643384+2.695000 
## [3725]	train-rmse:1725.473950+0.227832	test-rmse:1725.471582+2.694615 
## [3726]	train-rmse:1725.301685+0.227724	test-rmse:1725.299756+2.694678 
## [3727]	train-rmse:1725.130347+0.227870	test-rmse:1725.128003+2.694425 
## [3728]	train-rmse:1724.958606+0.227567	test-rmse:1724.956104+2.694354 
## [3729]	train-rmse:1724.786804+0.227951	test-rmse:1724.784179+2.694349 
## [3730]	train-rmse:1724.614685+0.227995	test-rmse:1724.612463+2.694291 
## [3731]	train-rmse:1724.443115+0.227503	test-rmse:1724.440698+2.694323 
## [3732]	train-rmse:1724.271521+0.227934	test-rmse:1724.268823+2.694103 
## [3733]	train-rmse:1724.099524+0.227539	test-rmse:1724.097131+2.694074 
## [3734]	train-rmse:1723.928333+0.228192	test-rmse:1723.925378+2.694139 
## [3735]	train-rmse:1723.756055+0.227612	test-rmse:1723.753662+2.693988 
## [3736]	train-rmse:1723.584448+0.227561	test-rmse:1723.581629+2.693868 
## [3737]	train-rmse:1723.412171+0.227657	test-rmse:1723.410169+2.693751 
## [3738]	train-rmse:1723.241333+0.227523	test-rmse:1723.238513+2.693835 
## [3739]	train-rmse:1723.069311+0.227327	test-rmse:1723.066748+2.693541 
## [3740]	train-rmse:1722.898230+0.227768	test-rmse:1722.895227+2.693509 
## [3741]	train-rmse:1722.726074+0.227743	test-rmse:1722.723682+2.693586 
## [3742]	train-rmse:1722.554077+0.227499	test-rmse:1722.552124+2.693365 
## [3743]	train-rmse:1722.382727+0.227481	test-rmse:1722.380566+2.693428 
## [3744]	train-rmse:1722.211963+0.228119	test-rmse:1722.208850+2.693133 
## [3745]	train-rmse:1722.039917+0.227363	test-rmse:1722.037415+2.692990 
## [3746]	train-rmse:1721.867920+0.227088	test-rmse:1721.865918+2.693151 
## [3747]	train-rmse:1721.697046+0.227379	test-rmse:1721.694263+2.692963 
## [3748]	train-rmse:1721.526196+0.227311	test-rmse:1721.522998+2.692936 
## [3749]	train-rmse:1721.353442+0.227621	test-rmse:1721.351562+2.692851 
## [3750]	train-rmse:1721.182422+0.227259	test-rmse:1721.179993+2.692690 
## [3751]	train-rmse:1721.011401+0.227353	test-rmse:1721.008472+2.692978 
## [3752]	train-rmse:1720.839478+0.227644	test-rmse:1720.837219+2.692451 
## [3753]	train-rmse:1720.668030+0.227002	test-rmse:1720.665747+2.692689 
## [3754]	train-rmse:1720.497168+0.227189	test-rmse:1720.494336+2.692496 
## [3755]	train-rmse:1720.325256+0.227259	test-rmse:1720.322803+2.692388 
## [3756]	train-rmse:1720.154187+0.226682	test-rmse:1720.151636+2.692335 
## [3757]	train-rmse:1719.982129+0.227196	test-rmse:1719.980213+2.692342 
## [3758]	train-rmse:1719.811865+0.227714	test-rmse:1719.808850+2.692119 
## [3759]	train-rmse:1719.639355+0.226750	test-rmse:1719.637659+2.692012 
## [3760]	train-rmse:1719.468445+0.227523	test-rmse:1719.466138+2.692102 
## [3761]	train-rmse:1719.297485+0.227292	test-rmse:1719.294849+2.691989 
## [3762]	train-rmse:1719.126135+0.226893	test-rmse:1719.123730+2.691827 
## [3763]	train-rmse:1718.955066+0.226730	test-rmse:1718.952673+2.691903 
## [3764]	train-rmse:1718.783643+0.227235	test-rmse:1718.781311+2.691773 
## [3765]	train-rmse:1718.613257+0.226734	test-rmse:1718.610059+2.691969 
## [3766]	train-rmse:1718.440527+0.227055	test-rmse:1718.439111+2.691504 
## [3767]	train-rmse:1718.270435+0.227063	test-rmse:1718.267798+2.691499 
## [3768]	train-rmse:1718.099072+0.227298	test-rmse:1718.096423+2.691651 
## [3769]	train-rmse:1717.927429+0.226781	test-rmse:1717.925415+2.691481 
## [3770]	train-rmse:1717.756763+0.226959	test-rmse:1717.754260+2.691555 
## [3771]	train-rmse:1717.585535+0.227278	test-rmse:1717.583203+2.691403 
## [3772]	train-rmse:1717.414050+0.226688	test-rmse:1717.412317+2.691219 
## [3773]	train-rmse:1717.243750+0.227121	test-rmse:1717.241321+2.691020 
## [3774]	train-rmse:1717.071863+0.226410	test-rmse:1717.070276+2.691209 
## [3775]	train-rmse:1716.901282+0.226373	test-rmse:1716.898987+2.690866 
## [3776]	train-rmse:1716.729895+0.226723	test-rmse:1716.728027+2.691023 
## [3777]	train-rmse:1716.559399+0.226249	test-rmse:1716.557068+2.690708 
## [3778]	train-rmse:1716.388635+0.226647	test-rmse:1716.386060+2.690933 
## [3779]	train-rmse:1716.217554+0.226702	test-rmse:1716.215259+2.690648 
## [3780]	train-rmse:1716.046118+0.227137	test-rmse:1716.044299+2.690730 
## [3781]	train-rmse:1715.875549+0.226462	test-rmse:1715.873340+2.690435 
## [3782]	train-rmse:1715.704333+0.226447	test-rmse:1715.702710+2.690562 
## [3783]	train-rmse:1715.533899+0.226828	test-rmse:1715.531519+2.690543 
## [3784]	train-rmse:1715.362634+0.226356	test-rmse:1715.360596+2.690451 
## [3785]	train-rmse:1715.192200+0.226592	test-rmse:1715.189856+2.690227 
## [3786]	train-rmse:1715.021106+0.226662	test-rmse:1715.019006+2.690026 
## [3787]	train-rmse:1714.850085+0.226346	test-rmse:1714.848401+2.690298 
## [3788]	train-rmse:1714.679541+0.226523	test-rmse:1714.677307+2.690154 
## [3789]	train-rmse:1714.508838+0.226993	test-rmse:1714.506494+2.690103 
## [3790]	train-rmse:1714.337109+0.226282	test-rmse:1714.335632+2.690025 
## [3791]	train-rmse:1714.167602+0.226075	test-rmse:1714.165173+2.689833 
## [3792]	train-rmse:1713.996240+0.226654	test-rmse:1713.994336+2.689822 
## [3793]	train-rmse:1713.825476+0.226446	test-rmse:1713.823523+2.689823 
## [3794]	train-rmse:1713.654858+0.225588	test-rmse:1713.653015+2.689741 
## [3795]	train-rmse:1713.484424+0.226149	test-rmse:1713.482178+2.689800 
## [3796]	train-rmse:1713.313733+0.226249	test-rmse:1713.311768+2.689511 
## [3797]	train-rmse:1713.142566+0.225874	test-rmse:1713.141101+2.689546 
## [3798]	train-rmse:1712.971790+0.225806	test-rmse:1712.970300+2.689472 
## [3799]	train-rmse:1712.801795+0.225895	test-rmse:1712.799853+2.689142 
## [3800]	train-rmse:1712.631470+0.226324	test-rmse:1712.629248+2.689616 
## [3801]	train-rmse:1712.460767+0.226277	test-rmse:1712.458630+2.689025 
## [3802]	train-rmse:1712.289844+0.226365	test-rmse:1712.287964+2.689127 
## [3803]	train-rmse:1712.119544+0.225882	test-rmse:1712.117688+2.689050 
## [3804]	train-rmse:1711.948999+0.226046	test-rmse:1711.946973+2.689150 
## [3805]	train-rmse:1711.777429+0.226117	test-rmse:1711.776697+2.688840 
## [3806]	train-rmse:1711.608142+0.226026	test-rmse:1711.605798+2.688935 
## [3807]	train-rmse:1711.436584+0.226034	test-rmse:1711.435535+2.688803 
## [3808]	train-rmse:1711.266748+0.225762	test-rmse:1711.265185+2.688971 
## [3809]	train-rmse:1711.095972+0.226498	test-rmse:1711.094690+2.688627 
## [3810]	train-rmse:1710.926489+0.225145	test-rmse:1710.924353+2.688645 
## [3811]	train-rmse:1710.755713+0.225518	test-rmse:1710.754016+2.688454 
## [3812]	train-rmse:1710.585144+0.226209	test-rmse:1710.583545+2.688392 
## [3813]	train-rmse:1710.414783+0.225759	test-rmse:1710.412842+2.688659 
## [3814]	train-rmse:1710.244763+0.225421	test-rmse:1710.242566+2.688240 
## [3815]	train-rmse:1710.074292+0.225693	test-rmse:1710.072400+2.688324 
## [3816]	train-rmse:1709.903760+0.225854	test-rmse:1709.901977+2.688257 
## [3817]	train-rmse:1709.733069+0.225790	test-rmse:1709.731836+2.688069 
## [3818]	train-rmse:1709.563318+0.225189	test-rmse:1709.561365+2.687925 
## [3819]	train-rmse:1709.392969+0.225762	test-rmse:1709.391089+2.687943 
## [3820]	train-rmse:1709.222900+0.225498	test-rmse:1709.220972+2.687915 
## [3821]	train-rmse:1709.051599+0.225723	test-rmse:1709.050574+2.687927 
## [3822]	train-rmse:1708.882190+0.225320	test-rmse:1708.880432+2.687608 
## [3823]	train-rmse:1708.711572+0.225995	test-rmse:1708.710339+2.687776 
## [3824]	train-rmse:1708.541809+0.225339	test-rmse:1708.540149+2.687648 
## [3825]	train-rmse:1708.371838+0.225615	test-rmse:1708.369983+2.687423 
## [3826]	train-rmse:1708.201245+0.225582	test-rmse:1708.199707+2.687322 
## [3827]	train-rmse:1708.031079+0.226166	test-rmse:1708.029687+2.687350 
## [3828]	train-rmse:1707.861035+0.224836	test-rmse:1707.859399+2.687421 
## [3829]	train-rmse:1707.690845+0.225443	test-rmse:1707.689575+2.687295 
## [3830]	train-rmse:1707.521033+0.225161	test-rmse:1707.519434+2.687080 
## [3831]	train-rmse:1707.350232+0.225692	test-rmse:1707.349414+2.687059 
## [3832]	train-rmse:1707.181152+0.224895	test-rmse:1707.179468+2.687018 
## [3833]	train-rmse:1707.009961+0.225668	test-rmse:1707.009387+2.687174 
## [3834]	train-rmse:1706.840991+0.224532	test-rmse:1706.839184+2.686856 
## [3835]	train-rmse:1706.670325+0.225468	test-rmse:1706.669189+2.686876 
## [3836]	train-rmse:1706.500146+0.225332	test-rmse:1706.499353+2.686890 
## [3837]	train-rmse:1706.330579+0.225833	test-rmse:1706.329443+2.686591 
## [3838]	train-rmse:1706.160693+0.224927	test-rmse:1706.159302+2.686605 
## [3839]	train-rmse:1705.990991+0.225539	test-rmse:1705.989490+2.686547 
## [3840]	train-rmse:1705.820972+0.225641	test-rmse:1705.819360+2.686597 
## [3841]	train-rmse:1705.650244+0.225873	test-rmse:1705.649853+2.686596 
## [3842]	train-rmse:1705.481189+0.224453	test-rmse:1705.479724+2.686472 
## [3843]	train-rmse:1705.310937+0.225507	test-rmse:1705.309888+2.686370 
## [3844]	train-rmse:1705.141565+0.224765	test-rmse:1705.140234+2.686368 
## [3845]	train-rmse:1704.970837+0.224457	test-rmse:1704.970313+2.686233 
## [3846]	train-rmse:1704.802149+0.224292	test-rmse:1704.800525+2.686109 
## [3847]	train-rmse:1704.631824+0.225684	test-rmse:1704.630518+2.685935 
## [3848]	train-rmse:1704.461890+0.224438	test-rmse:1704.460864+2.686044 
## [3849]	train-rmse:1704.292200+0.224907	test-rmse:1704.291040+2.686083 
## [3850]	train-rmse:1704.122852+0.224896	test-rmse:1704.121375+2.686010 
## [3851]	train-rmse:1703.952869+0.224391	test-rmse:1703.951770+2.685827 
## [3852]	train-rmse:1703.783118+0.224137	test-rmse:1703.781787+2.685751 
## [3853]	train-rmse:1703.613476+0.225313	test-rmse:1703.612317+2.685815 
## [3854]	train-rmse:1703.443823+0.224798	test-rmse:1703.442444+2.685663 
## [3855]	train-rmse:1703.274377+0.224459	test-rmse:1703.272949+2.685686 
## [3856]	train-rmse:1703.104114+0.224909	test-rmse:1703.103137+2.685672 
## [3857]	train-rmse:1702.934839+0.224564	test-rmse:1702.933630+2.685430 
## [3858]	train-rmse:1702.765491+0.224730	test-rmse:1702.763989+2.685412 
## [3859]	train-rmse:1702.595203+0.224514	test-rmse:1702.594397+2.685395 
## [3860]	train-rmse:1702.426526+0.224695	test-rmse:1702.425110+2.685209 
## [3861]	train-rmse:1702.255920+0.224646	test-rmse:1702.255383+2.685070 
## [3862]	train-rmse:1702.086902+0.224291	test-rmse:1702.086023+2.685094 
## [3863]	train-rmse:1701.917322+0.224979	test-rmse:1701.916284+2.685089 
## [3864]	train-rmse:1701.747461+0.224518	test-rmse:1701.746814+2.684925 
## [3865]	train-rmse:1701.578162+0.224245	test-rmse:1701.577454+2.684762 
## [3866]	train-rmse:1701.409363+0.224687	test-rmse:1701.407873+2.684787 
## [3867]	train-rmse:1701.239294+0.225216	test-rmse:1701.238184+2.684826 
## [3868]	train-rmse:1701.069909+0.224822	test-rmse:1701.068835+2.684947 
## [3869]	train-rmse:1700.901074+0.224169	test-rmse:1700.899499+2.684509 
## [3870]	train-rmse:1700.730884+0.224511	test-rmse:1700.730164+2.684646 
## [3871]	train-rmse:1700.561829+0.224624	test-rmse:1700.560877+2.684497 
## [3872]	train-rmse:1700.392273+0.224565	test-rmse:1700.391443+2.684505 
## [3873]	train-rmse:1700.223560+0.224391	test-rmse:1700.222168+2.684474 
## [3874]	train-rmse:1700.053516+0.224301	test-rmse:1700.052783+2.684442 
## [3875]	train-rmse:1699.884302+0.223651	test-rmse:1699.883655+2.684247 
## [3876]	train-rmse:1699.714783+0.223997	test-rmse:1699.714136+2.684280 
## [3877]	train-rmse:1699.545935+0.224776	test-rmse:1699.544971+2.684147 
## [3878]	train-rmse:1699.376196+0.224276	test-rmse:1699.375391+2.684184 
## [3879]	train-rmse:1699.206690+0.223725	test-rmse:1699.206457+2.683891 
## [3880]	train-rmse:1699.038025+0.223895	test-rmse:1699.037000+2.684037 
## [3881]	train-rmse:1698.868384+0.224846	test-rmse:1698.867871+2.683885 
## [3882]	train-rmse:1698.699573+0.223810	test-rmse:1698.698682+2.683672 
## [3883]	train-rmse:1698.530041+0.223404	test-rmse:1698.529492+2.683813 
## [3884]	train-rmse:1698.361047+0.224483	test-rmse:1698.360303+2.683832 
## [3885]	train-rmse:1698.191491+0.224337	test-rmse:1698.191321+2.683575 
## [3886]	train-rmse:1698.022681+0.223652	test-rmse:1698.021924+2.683609 
## [3887]	train-rmse:1697.853735+0.223536	test-rmse:1697.853015+2.683638 
## [3888]	train-rmse:1697.684521+0.224452	test-rmse:1697.683826+2.683450 
## [3889]	train-rmse:1697.515088+0.223678	test-rmse:1697.514795+2.683397 
## [3890]	train-rmse:1697.346851+0.223608	test-rmse:1697.345752+2.683466 
## [3891]	train-rmse:1697.177600+0.224313	test-rmse:1697.176538+2.683379 
## [3892]	train-rmse:1697.008044+0.224188	test-rmse:1697.007678+2.683069 
## [3893]	train-rmse:1696.839050+0.223188	test-rmse:1696.838611+2.683195 
## [3894]	train-rmse:1696.670508+0.223431	test-rmse:1696.669556+2.682928 
## [3895]	train-rmse:1696.501563+0.223885	test-rmse:1696.500879+2.683183 
## [3896]	train-rmse:1696.331641+0.223805	test-rmse:1696.331458+2.682813 
## [3897]	train-rmse:1696.163611+0.223331	test-rmse:1696.162598+2.682737 
## [3898]	train-rmse:1695.994568+0.224192	test-rmse:1695.993762+2.682743 
## [3899]	train-rmse:1695.825451+0.223957	test-rmse:1695.824902+2.682719 
## [3900]	train-rmse:1695.656543+0.224163	test-rmse:1695.655920+2.682555 
## [3901]	train-rmse:1695.487915+0.223803	test-rmse:1695.487158+2.682655 
## [3902]	train-rmse:1695.318677+0.223174	test-rmse:1695.318286+2.682521 
## [3903]	train-rmse:1695.150061+0.223698	test-rmse:1695.149621+2.682363 
## [3904]	train-rmse:1694.980871+0.223696	test-rmse:1694.980603+2.682485 
## [3905]	train-rmse:1694.812292+0.223318	test-rmse:1694.811572+2.682275 
## [3906]	train-rmse:1694.643494+0.223801	test-rmse:1694.643201+2.682225 
## [3907]	train-rmse:1694.474963+0.223422	test-rmse:1694.474341+2.682129 
## [3908]	train-rmse:1694.306214+0.223055	test-rmse:1694.305554+2.682055 
## [3909]	train-rmse:1694.137183+0.223598	test-rmse:1694.136816+2.681908 
## [3910]	train-rmse:1693.969031+0.223047	test-rmse:1693.967956+2.682055 
## [3911]	train-rmse:1693.799768+0.223339	test-rmse:1693.799292+2.681998 
## [3912]	train-rmse:1693.630762+0.223199	test-rmse:1693.630652+2.681823 
## [3913]	train-rmse:1693.462549+0.223723	test-rmse:1693.461841+2.681842 
## [3914]	train-rmse:1693.293518+0.223086	test-rmse:1693.293579+2.681645 
## [3915]	train-rmse:1693.124841+0.223304	test-rmse:1693.124707+2.681802 
## [3916]	train-rmse:1692.956702+0.223419	test-rmse:1692.955945+2.681609 
## [3917]	train-rmse:1692.787366+0.223134	test-rmse:1692.787390+2.681638 
## [3918]	train-rmse:1692.618970+0.223098	test-rmse:1692.618750+2.681588 
## [3919]	train-rmse:1692.449719+0.223377	test-rmse:1692.450268+2.681405 
## [3920]	train-rmse:1692.282385+0.222291	test-rmse:1692.281909+2.681377 
## [3921]	train-rmse:1692.113770+0.223318	test-rmse:1692.113208+2.681331 
## [3922]	train-rmse:1691.945105+0.222467	test-rmse:1691.944653+2.681141 
## [3923]	train-rmse:1691.776123+0.222736	test-rmse:1691.776160+2.681018 
## [3924]	train-rmse:1691.608179+0.223295	test-rmse:1691.607568+2.680849 
## [3925]	train-rmse:1691.439966+0.223260	test-rmse:1691.439038+2.681054 
## [3926]	train-rmse:1691.271094+0.223359	test-rmse:1691.270581+2.680929 
## [3927]	train-rmse:1691.102502+0.222762	test-rmse:1691.102234+2.680891 
## [3928]	train-rmse:1690.934033+0.222859	test-rmse:1690.933984+2.680832 
## [3929]	train-rmse:1690.765906+0.222874	test-rmse:1690.765417+2.680724 
## [3930]	train-rmse:1690.597400+0.223090	test-rmse:1690.597131+2.680453 
## [3931]	train-rmse:1690.428870+0.222484	test-rmse:1690.428589+2.680559 
## [3932]	train-rmse:1690.261243+0.223419	test-rmse:1690.260339+2.680654 
## [3933]	train-rmse:1690.092126+0.222230	test-rmse:1690.092065+2.680557 
## [3934]	train-rmse:1689.923840+0.222697	test-rmse:1689.923767+2.680399 
## [3935]	train-rmse:1689.755310+0.222250	test-rmse:1689.755322+2.680373 
## [3936]	train-rmse:1689.587475+0.223568	test-rmse:1689.587268+2.680207 
## [3937]	train-rmse:1689.418738+0.222145	test-rmse:1689.418616+2.680135 
## [3938]	train-rmse:1689.251489+0.223095	test-rmse:1689.250598+2.680215 
## [3939]	train-rmse:1689.082702+0.222044	test-rmse:1689.082165+2.679984 
## [3940]	train-rmse:1688.913599+0.223469	test-rmse:1688.914123+2.679889 
## [3941]	train-rmse:1688.746240+0.221852	test-rmse:1688.745837+2.679847 
## [3942]	train-rmse:1688.577637+0.222777	test-rmse:1688.577454+2.679640 
## [3943]	train-rmse:1688.409888+0.222288	test-rmse:1688.409729+2.679919 
## [3944]	train-rmse:1688.242175+0.222819	test-rmse:1688.241370+2.679664 
## [3945]	train-rmse:1688.073071+0.222500	test-rmse:1688.073242+2.679677 
## [3946]	train-rmse:1687.905713+0.223097	test-rmse:1687.905041+2.679643 
## [3947]	train-rmse:1687.736597+0.222383	test-rmse:1687.736853+2.679401 
## [3948]	train-rmse:1687.568908+0.222504	test-rmse:1687.569068+2.679534 
## [3949]	train-rmse:1687.401123+0.222348	test-rmse:1687.400842+2.679128 
## [3950]	train-rmse:1687.232837+0.222679	test-rmse:1687.232886+2.679260 
## [3951]	train-rmse:1687.065271+0.222377	test-rmse:1687.064929+2.679137 
## [3952]	train-rmse:1686.896423+0.221840	test-rmse:1686.896680+2.679040 
## [3953]	train-rmse:1686.729480+0.222880	test-rmse:1686.728589+2.679101 
## [3954]	train-rmse:1686.561255+0.222112	test-rmse:1686.560767+2.679031 
## [3955]	train-rmse:1686.392505+0.222899	test-rmse:1686.392859+2.678865 
## [3956]	train-rmse:1686.224927+0.221163	test-rmse:1686.224878+2.678779 
## [3957]	train-rmse:1686.056983+0.222663	test-rmse:1686.057092+2.678648 
## [3958]	train-rmse:1685.889563+0.222644	test-rmse:1685.889075+2.678712 
## [3959]	train-rmse:1685.720959+0.221770	test-rmse:1685.721252+2.678336 
## [3960]	train-rmse:1685.553650+0.222010	test-rmse:1685.553394+2.678516 
## [3961]	train-rmse:1685.385632+0.222505	test-rmse:1685.385400+2.678277 
## [3962]	train-rmse:1685.217590+0.222198	test-rmse:1685.217627+2.678410 
## [3963]	train-rmse:1685.049707+0.222093	test-rmse:1685.049756+2.678381 
## [3964]	train-rmse:1684.881824+0.221305	test-rmse:1684.881970+2.678268 
## [3965]	train-rmse:1684.714331+0.221955	test-rmse:1684.714075+2.678156 
## [3966]	train-rmse:1684.546692+0.222042	test-rmse:1684.546326+2.678163 
## [3967]	train-rmse:1684.378430+0.222411	test-rmse:1684.378418+2.677946 
## [3968]	train-rmse:1684.210730+0.221547	test-rmse:1684.210669+2.677968 
## [3969]	train-rmse:1684.042883+0.222703	test-rmse:1684.043237+2.677798 
## [3970]	train-rmse:1683.876050+0.221808	test-rmse:1683.875293+2.677767 
## [3971]	train-rmse:1683.707202+0.221780	test-rmse:1683.707837+2.677598 
## [3972]	train-rmse:1683.540088+0.221445	test-rmse:1683.539917+2.677777 
## [3973]	train-rmse:1683.372339+0.221881	test-rmse:1683.372290+2.677525 
## [3974]	train-rmse:1683.205066+0.221343	test-rmse:1683.204675+2.677486 
## [3975]	train-rmse:1683.036889+0.221816	test-rmse:1683.037000+2.677537 
## [3976]	train-rmse:1682.868823+0.221156	test-rmse:1682.869446+2.677342 
## [3977]	train-rmse:1682.701880+0.222345	test-rmse:1682.701978+2.677374 
## [3978]	train-rmse:1682.533948+0.221597	test-rmse:1682.534253+2.677319 
## [3979]	train-rmse:1682.366773+0.221445	test-rmse:1682.366785+2.677056 
## [3980]	train-rmse:1682.198877+0.221885	test-rmse:1682.199255+2.677028 
## [3981]	train-rmse:1682.031897+0.221646	test-rmse:1682.031848+2.677114 
## [3982]	train-rmse:1681.863904+0.221630	test-rmse:1681.864050+2.676739 
## [3983]	train-rmse:1681.696985+0.221793	test-rmse:1681.696753+2.676876 
## [3984]	train-rmse:1681.528503+0.221549	test-rmse:1681.529297+2.676736 
## [3985]	train-rmse:1681.362158+0.221295	test-rmse:1681.361682+2.676773 
## [3986]	train-rmse:1681.193701+0.221450	test-rmse:1681.194287+2.676773 
## [3987]	train-rmse:1681.026440+0.221169	test-rmse:1681.026746+2.676645 
## [3988]	train-rmse:1680.859070+0.220979	test-rmse:1680.859253+2.676560 
## [3989]	train-rmse:1680.691858+0.221803	test-rmse:1680.692188+2.676326 
## [3990]	train-rmse:1680.524133+0.220912	test-rmse:1680.524988+2.676230 
## [3991]	train-rmse:1680.356848+0.221386	test-rmse:1680.357373+2.676391 
## [3992]	train-rmse:1680.189722+0.221401	test-rmse:1680.190112+2.676147 
## [3993]	train-rmse:1680.022192+0.221684	test-rmse:1680.022717+2.676110 
## [3994]	train-rmse:1679.854981+0.221423	test-rmse:1679.855517+2.675893 
## [3995]	train-rmse:1679.687268+0.221480	test-rmse:1679.688159+2.675958 
## [3996]	train-rmse:1679.520654+0.221507	test-rmse:1679.520911+2.675738 
## [3997]	train-rmse:1679.352710+0.221306	test-rmse:1679.353589+2.675836 
## [3998]	train-rmse:1679.186316+0.220861	test-rmse:1679.186206+2.675812 
## [3999]	train-rmse:1679.018469+0.220977	test-rmse:1679.019214+2.675676 
## [4000]	train-rmse:1678.851611+0.221533	test-rmse:1678.851929+2.675568 
## [4001]	train-rmse:1678.684033+0.220954	test-rmse:1678.684827+2.675397 
## [4002]	train-rmse:1678.516638+0.220958	test-rmse:1678.517749+2.675497 
## [4003]	train-rmse:1678.349878+0.221513	test-rmse:1678.350171+2.675231 
## [4004]	train-rmse:1678.182666+0.221357	test-rmse:1678.183350+2.675375 
## [4005]	train-rmse:1678.015466+0.220684	test-rmse:1678.015930+2.675039 
## [4006]	train-rmse:1677.848340+0.221076	test-rmse:1677.848987+2.675110 
## [4007]	train-rmse:1677.681335+0.220856	test-rmse:1677.682068+2.675009 
## [4008]	train-rmse:1677.514685+0.221152	test-rmse:1677.514844+2.675087 
## [4009]	train-rmse:1677.347119+0.220675	test-rmse:1677.347900+2.674935 
## [4010]	train-rmse:1677.179956+0.220575	test-rmse:1677.180798+2.674749 
## [4011]	train-rmse:1677.013025+0.221482	test-rmse:1677.013733+2.674785 
## [4012]	train-rmse:1676.846228+0.221291	test-rmse:1676.846924+2.674725 
## [4013]	train-rmse:1676.678662+0.220154	test-rmse:1676.679712+2.674581 
## [4014]	train-rmse:1676.512109+0.220650	test-rmse:1676.512756+2.674552 
## [4015]	train-rmse:1676.344971+0.220269	test-rmse:1676.345837+2.674512 
## [4016]	train-rmse:1676.178003+0.220412	test-rmse:1676.178784+2.674551 
## [4017]	train-rmse:1676.010864+0.220785	test-rmse:1676.012073+2.674437 
## [4018]	train-rmse:1675.844531+0.220320	test-rmse:1675.845129+2.674131 
## [4019]	train-rmse:1675.677466+0.221013	test-rmse:1675.678284+2.674292 
## [4020]	train-rmse:1675.510522+0.220338	test-rmse:1675.511255+2.673908 
## [4021]	train-rmse:1675.343787+0.220762	test-rmse:1675.344482+2.673969 
## [4022]	train-rmse:1675.176868+0.220313	test-rmse:1675.177514+2.673976 
## [4023]	train-rmse:1675.009729+0.220807	test-rmse:1675.010693+2.673869 
## [4024]	train-rmse:1674.842798+0.220773	test-rmse:1674.843725+2.673854 
## [4025]	train-rmse:1674.676514+0.221109	test-rmse:1674.677283+2.673671 
## [4026]	train-rmse:1674.509546+0.220013	test-rmse:1674.510583+2.673736 
## [4027]	train-rmse:1674.343408+0.220960	test-rmse:1674.343701+2.673411 
## [4028]	train-rmse:1674.175928+0.220190	test-rmse:1674.176917+2.673441 
## [4029]	train-rmse:1674.009704+0.220025	test-rmse:1674.010095+2.673513 
## [4030]	train-rmse:1673.843164+0.220541	test-rmse:1673.843543+2.673425 
## [4031]	train-rmse:1673.675574+0.220367	test-rmse:1673.676917+2.673308 
## [4032]	train-rmse:1673.509106+0.220369	test-rmse:1673.510022+2.673069 
## [4033]	train-rmse:1673.342639+0.220196	test-rmse:1673.343310+2.673179 
## [4034]	train-rmse:1673.176062+0.220270	test-rmse:1673.176807+2.673111 
## [4035]	train-rmse:1673.009216+0.220035	test-rmse:1673.010168+2.673067 
## [4036]	train-rmse:1672.842053+0.220274	test-rmse:1672.843775+2.673038 
## [4037]	train-rmse:1672.676599+0.220337	test-rmse:1672.677112+2.672888 
## [4038]	train-rmse:1672.509302+0.220478	test-rmse:1672.510413+2.672957 
## [4039]	train-rmse:1672.343298+0.219633	test-rmse:1672.343872+2.672672 
## [4040]	train-rmse:1672.176038+0.220578	test-rmse:1672.177368+2.672858 
## [4041]	train-rmse:1672.010376+0.219349	test-rmse:1672.010657+2.672624 
## [4042]	train-rmse:1671.843066+0.220181	test-rmse:1671.844299+2.672503 
## [4043]	train-rmse:1671.676611+0.219764	test-rmse:1671.677673+2.672663 
## [4044]	train-rmse:1671.510632+0.220507	test-rmse:1671.511255+2.672481 
## [4045]	train-rmse:1671.343677+0.220199	test-rmse:1671.344934+2.672362 
## [4046]	train-rmse:1671.177637+0.220664	test-rmse:1671.178540+2.672300 
## [4047]	train-rmse:1671.010693+0.219996	test-rmse:1671.011975+2.672103 
## [4048]	train-rmse:1670.844556+0.219599	test-rmse:1670.845630+2.672227 
## [4049]	train-rmse:1670.678040+0.220318	test-rmse:1670.679456+2.672178 
## [4050]	train-rmse:1670.512463+0.220074	test-rmse:1670.513013+2.671973 
## [4051]	train-rmse:1670.345239+0.219887	test-rmse:1670.346570+2.671934 
## [4052]	train-rmse:1670.179541+0.219662	test-rmse:1670.180188+2.671969 
## [4053]	train-rmse:1670.012524+0.219867	test-rmse:1670.013819+2.671700 
## [4054]	train-rmse:1669.846228+0.220250	test-rmse:1669.847559+2.671779 
## [4055]	train-rmse:1669.679761+0.219437	test-rmse:1669.681116+2.671640 
## [4056]	train-rmse:1669.514319+0.220182	test-rmse:1669.515198+2.671591 
## [4057]	train-rmse:1669.347363+0.219264	test-rmse:1669.348743+2.671479 
## [4058]	train-rmse:1669.181665+0.219999	test-rmse:1669.182715+2.671346 
## [4059]	train-rmse:1669.014587+0.219447	test-rmse:1669.016296+2.671426 
## [4060]	train-rmse:1668.848572+0.220634	test-rmse:1668.850037+2.671332 
## [4061]	train-rmse:1668.682410+0.219077	test-rmse:1668.683875+2.671267 
## [4062]	train-rmse:1668.516443+0.220324	test-rmse:1668.517603+2.671342 
## [4063]	train-rmse:1668.350049+0.219105	test-rmse:1668.351318+2.670951 
## [4064]	train-rmse:1668.184314+0.219392	test-rmse:1668.185412+2.670900 
## [4065]	train-rmse:1668.017676+0.219707	test-rmse:1668.019385+2.670962 
## [4066]	train-rmse:1667.851844+0.219809	test-rmse:1667.853149+2.670785 
## [4067]	train-rmse:1667.685596+0.219607	test-rmse:1667.687061+2.670755 
## [4068]	train-rmse:1667.519678+0.219924	test-rmse:1667.520972+2.670813 
## [4069]	train-rmse:1667.353528+0.218925	test-rmse:1667.354724+2.670666 
## [4070]	train-rmse:1667.187720+0.220130	test-rmse:1667.189026+2.670571 
## [4071]	train-rmse:1667.021753+0.218674	test-rmse:1667.022790+2.670398 
## [4072]	train-rmse:1666.855408+0.219580	test-rmse:1666.856860+2.670604 
## [4073]	train-rmse:1666.689441+0.218651	test-rmse:1666.690686+2.670297 
## [4074]	train-rmse:1666.523316+0.219993	test-rmse:1666.524890+2.670463 
## [4075]	train-rmse:1666.356799+0.218379	test-rmse:1666.359106+2.670232 
## [4076]	train-rmse:1666.191540+0.219751	test-rmse:1666.192993+2.670149 
## [4077]	train-rmse:1666.025427+0.218697	test-rmse:1666.027210+2.670059 
## [4078]	train-rmse:1665.860193+0.219907	test-rmse:1665.861133+2.670232 
## [4079]	train-rmse:1665.693799+0.218788	test-rmse:1665.695447+2.669869 
## [4080]	train-rmse:1665.528699+0.219777	test-rmse:1665.529334+2.669891 
## [4081]	train-rmse:1665.362244+0.219050	test-rmse:1665.363684+2.669909 
## [4082]	train-rmse:1665.196057+0.219739	test-rmse:1665.197815+2.669814 
## [4083]	train-rmse:1665.030554+0.218471	test-rmse:1665.031921+2.669784 
## [4084]	train-rmse:1664.864563+0.219485	test-rmse:1664.866284+2.669706 
## [4085]	train-rmse:1664.699524+0.218773	test-rmse:1664.700354+2.669457 
## [4086]	train-rmse:1664.533069+0.219234	test-rmse:1664.534460+2.669531 
## [4087]	train-rmse:1664.366809+0.218661	test-rmse:1664.368738+2.669452 
## [4088]	train-rmse:1664.201611+0.219790	test-rmse:1664.203296+2.669271 
## [4089]	train-rmse:1664.035925+0.218703	test-rmse:1664.037317+2.669108 
## [4090]	train-rmse:1663.869556+0.219176	test-rmse:1663.871655+2.669117 
## [4091]	train-rmse:1663.704614+0.218813	test-rmse:1663.705957+2.669163 
## [4092]	train-rmse:1663.538647+0.219443	test-rmse:1663.540393+2.669031 
## [4093]	train-rmse:1663.372901+0.218566	test-rmse:1663.374609+2.669191 
## [4094]	train-rmse:1663.206799+0.218672	test-rmse:1663.208899+2.668899 
## [4095]	train-rmse:1663.041150+0.218669	test-rmse:1663.043408+2.668817 
## [4096]	train-rmse:1662.875891+0.218854	test-rmse:1662.877698+2.668651 
## [4097]	train-rmse:1662.710657+0.218042	test-rmse:1662.712390+2.668646 
## [4098]	train-rmse:1662.545019+0.218389	test-rmse:1662.546545+2.668567 
## [4099]	train-rmse:1662.379675+0.218568	test-rmse:1662.381165+2.668359 
## [4100]	train-rmse:1662.213672+0.219036	test-rmse:1662.215430+2.668363 
## [4101]	train-rmse:1662.048242+0.218635	test-rmse:1662.050073+2.668314 
## [4102]	train-rmse:1661.882239+0.218826	test-rmse:1661.884546+2.668350 
## [4103]	train-rmse:1661.717102+0.218253	test-rmse:1661.718994+2.668510 
## [4104]	train-rmse:1661.551502+0.218493	test-rmse:1661.553662+2.668421 
## [4105]	train-rmse:1661.387183+0.218620	test-rmse:1661.388001+2.668059 
## [4106]	train-rmse:1661.219800+0.218553	test-rmse:1661.222693+2.668098 
## [4107]	train-rmse:1661.055090+0.218539	test-rmse:1661.057117+2.668053 
## [4108]	train-rmse:1660.890039+0.218596	test-rmse:1660.891858+2.667732 
## [4109]	train-rmse:1660.724719+0.218509	test-rmse:1660.726526+2.667993 
## [4110]	train-rmse:1660.559314+0.218623	test-rmse:1660.561108+2.667824 
## [4111]	train-rmse:1660.393750+0.218629	test-rmse:1660.395788+2.667570 
## [4112]	train-rmse:1660.228772+0.218216	test-rmse:1660.230274+2.667509 
## [4113]	train-rmse:1660.063061+0.218942	test-rmse:1660.064954+2.667628 
## [4114]	train-rmse:1659.897949+0.218293	test-rmse:1659.899585+2.667471 
## [4115]	train-rmse:1659.732141+0.218031	test-rmse:1659.734314+2.667408 
## [4116]	train-rmse:1659.567468+0.217776	test-rmse:1659.569165+2.667400 
## [4117]	train-rmse:1659.401441+0.217821	test-rmse:1659.403955+2.667164 
## [4118]	train-rmse:1659.237183+0.218490	test-rmse:1659.238733+2.667259 
## [4119]	train-rmse:1659.070947+0.218190	test-rmse:1659.073364+2.667004 
## [4120]	train-rmse:1658.907202+0.218372	test-rmse:1658.908093+2.667075 
## [4121]	train-rmse:1658.740796+0.217795	test-rmse:1658.742908+2.667032 
## [4122]	train-rmse:1658.576050+0.217866	test-rmse:1658.577734+2.666919 
## [4123]	train-rmse:1658.410303+0.218036	test-rmse:1658.412561+2.666906 
## [4124]	train-rmse:1658.246045+0.218169	test-rmse:1658.247376+2.666639 
## [4125]	train-rmse:1658.080359+0.218150	test-rmse:1658.082373+2.666709 
## [4126]	train-rmse:1657.915491+0.217669	test-rmse:1657.917407+2.666667 
## [4127]	train-rmse:1657.750330+0.218018	test-rmse:1657.752270+2.666584 
## [4128]	train-rmse:1657.585522+0.218011	test-rmse:1657.587024+2.666377 
## [4129]	train-rmse:1657.419910+0.217637	test-rmse:1657.421912+2.666304 
## [4130]	train-rmse:1657.255274+0.217629	test-rmse:1657.256995+2.666324 
## [4131]	train-rmse:1657.089502+0.218993	test-rmse:1657.091956+2.666254 
## [4132]	train-rmse:1656.925232+0.217661	test-rmse:1656.926868+2.666156 
## [4133]	train-rmse:1656.759729+0.217785	test-rmse:1656.761853+2.666042 
## [4134]	train-rmse:1656.595276+0.217374	test-rmse:1656.597143+2.665862 
## [4135]	train-rmse:1656.429907+0.218279	test-rmse:1656.431812+2.666050 
## [4136]	train-rmse:1656.265137+0.217396	test-rmse:1656.266846+2.665820 
## [4137]	train-rmse:1656.099439+0.217448	test-rmse:1656.102185+2.666028 
## [4138]	train-rmse:1655.935522+0.217585	test-rmse:1655.937366+2.665745 
## [4139]	train-rmse:1655.769873+0.217882	test-rmse:1655.772315+2.665702 
## [4140]	train-rmse:1655.606067+0.217509	test-rmse:1655.607434+2.665555 
## [4141]	train-rmse:1655.440186+0.217968	test-rmse:1655.442578+2.665555 
## [4142]	train-rmse:1655.275793+0.217930	test-rmse:1655.277783+2.665538 
## [4143]	train-rmse:1655.110217+0.217891	test-rmse:1655.112964+2.665282 
## [4144]	train-rmse:1654.946167+0.217976	test-rmse:1654.948022+2.665392 
## [4145]	train-rmse:1654.780701+0.217752	test-rmse:1654.783142+2.665436 
## [4146]	train-rmse:1654.616211+0.218107	test-rmse:1654.618445+2.665262 
## [4147]	train-rmse:1654.451074+0.217818	test-rmse:1654.453687+2.665110 
## [4148]	train-rmse:1654.287110+0.217464	test-rmse:1654.289075+2.665173 
## [4149]	train-rmse:1654.121778+0.218232	test-rmse:1654.124084+2.664931 
## [4150]	train-rmse:1653.957471+0.217355	test-rmse:1653.959619+2.664995 
## [4151]	train-rmse:1653.792126+0.217746	test-rmse:1653.794946+2.664918 
## [4152]	train-rmse:1653.628015+0.217099	test-rmse:1653.630139+2.664826 
## [4153]	train-rmse:1653.463098+0.217969	test-rmse:1653.465454+2.664912 
## [4154]	train-rmse:1653.299145+0.217269	test-rmse:1653.300769+2.664798 
## [4155]	train-rmse:1653.133887+0.217587	test-rmse:1653.136438+2.664679 
## [4156]	train-rmse:1652.969812+0.216957	test-rmse:1652.971631+2.664621 
## [4157]	train-rmse:1652.804370+0.217190	test-rmse:1652.806982+2.664432 
## [4158]	train-rmse:1652.640222+0.217169	test-rmse:1652.642419+2.664298 
## [4159]	train-rmse:1652.475684+0.217534	test-rmse:1652.477905+2.664089 
## [4160]	train-rmse:1652.311365+0.217266	test-rmse:1652.313281+2.664135 
## [4161]	train-rmse:1652.146606+0.217181	test-rmse:1652.148767+2.664175 
## [4162]	train-rmse:1651.981689+0.217105	test-rmse:1651.984216+2.664196 
## [4163]	train-rmse:1651.817090+0.217229	test-rmse:1651.819678+2.663893 
## [4164]	train-rmse:1651.653186+0.217390	test-rmse:1651.655274+2.664133 
## [4165]	train-rmse:1651.487891+0.217098	test-rmse:1651.490698+2.663958 
## [4166]	train-rmse:1651.324084+0.217390	test-rmse:1651.326501+2.663720 
## [4167]	train-rmse:1651.158911+0.216121	test-rmse:1651.161816+2.663666 
## [4168]	train-rmse:1650.995752+0.217420	test-rmse:1650.997437+2.663565 
## [4169]	train-rmse:1650.829956+0.216793	test-rmse:1650.833008+2.663715 
## [4170]	train-rmse:1650.666272+0.216982	test-rmse:1650.668640+2.663551 
## [4171]	train-rmse:1650.501831+0.217171	test-rmse:1650.504455+2.663661 
## [4172]	train-rmse:1650.337402+0.216579	test-rmse:1650.339868+2.663219 
## [4173]	train-rmse:1650.173205+0.216322	test-rmse:1650.175720+2.663348 
## [4174]	train-rmse:1650.008691+0.216812	test-rmse:1650.011365+2.663280 
## [4175]	train-rmse:1649.844641+0.216775	test-rmse:1649.846875+2.663087 
## [4176]	train-rmse:1649.680298+0.217157	test-rmse:1649.682764+2.663063 
## [4177]	train-rmse:1649.515991+0.216506	test-rmse:1649.518359+2.662929 
## [4178]	train-rmse:1649.351843+0.217513	test-rmse:1649.354065+2.663002 
## [4179]	train-rmse:1649.187976+0.216593	test-rmse:1649.189770+2.662977 
## [4180]	train-rmse:1649.023254+0.217056	test-rmse:1649.025684+2.662901 
## [4181]	train-rmse:1648.859082+0.216922	test-rmse:1648.861353+2.662498 
## [4182]	train-rmse:1648.694104+0.216879	test-rmse:1648.697278+2.662887 
## [4183]	train-rmse:1648.531018+0.216287	test-rmse:1648.533130+2.662753 
## [4184]	train-rmse:1648.366309+0.216936	test-rmse:1648.368945+2.662531 
## [4185]	train-rmse:1648.202356+0.215919	test-rmse:1648.204883+2.662458 
## [4186]	train-rmse:1648.038294+0.216660	test-rmse:1648.040662+2.662560 
## [4187]	train-rmse:1647.874085+0.216177	test-rmse:1647.876501+2.662404 
## [4188]	train-rmse:1647.710010+0.216625	test-rmse:1647.712439+2.662378 
## [4189]	train-rmse:1647.545886+0.215955	test-rmse:1647.548340+2.662265 
## [4190]	train-rmse:1647.382092+0.217151	test-rmse:1647.384387+2.662143 
## [4191]	train-rmse:1647.217944+0.216363	test-rmse:1647.220337+2.662156 
## [4192]	train-rmse:1647.053589+0.216899	test-rmse:1647.056274+2.661961 
## [4193]	train-rmse:1646.889624+0.216661	test-rmse:1646.892322+2.662058 
## [4194]	train-rmse:1646.726013+0.216370	test-rmse:1646.728210+2.661708 
## [4195]	train-rmse:1646.561499+0.216533	test-rmse:1646.564368+2.661821 
## [4196]	train-rmse:1646.398071+0.215644	test-rmse:1646.400476+2.661767 
## [4197]	train-rmse:1646.233801+0.216832	test-rmse:1646.236585+2.661583 
## [4198]	train-rmse:1646.070264+0.215830	test-rmse:1646.072510+2.661653 
## [4199]	train-rmse:1645.905518+0.216571	test-rmse:1645.908667+2.661568 
## [4200]	train-rmse:1645.742700+0.216249	test-rmse:1645.744678+2.661435 
## [4201]	train-rmse:1645.578015+0.216639	test-rmse:1645.580749+2.661313 
## [4202]	train-rmse:1645.414599+0.215705	test-rmse:1645.416846+2.661254 
## [4203]	train-rmse:1645.250464+0.216539	test-rmse:1645.253235+2.661238 
## [4204]	train-rmse:1645.086780+0.215718	test-rmse:1645.089307+2.661241 
## [4205]	train-rmse:1644.922595+0.216268	test-rmse:1644.925549+2.661159 
## [4206]	train-rmse:1644.759509+0.216386	test-rmse:1644.761694+2.661123 
## [4207]	train-rmse:1644.595178+0.216305	test-rmse:1644.597925+2.660969 
## [4208]	train-rmse:1644.431701+0.215493	test-rmse:1644.434143+2.660964 
## [4209]	train-rmse:1644.267822+0.216094	test-rmse:1644.270422+2.660729 
## [4210]	train-rmse:1644.103735+0.215676	test-rmse:1644.106702+2.660728 
## [4211]	train-rmse:1643.939978+0.215569	test-rmse:1643.943103+2.660776 
## [4212]	train-rmse:1643.776819+0.215476	test-rmse:1643.779407+2.660592 
## [4213]	train-rmse:1643.612915+0.215865	test-rmse:1643.615588+2.660503 
## [4214]	train-rmse:1643.449573+0.215798	test-rmse:1643.451965+2.660427 
## [4215]	train-rmse:1643.285474+0.215877	test-rmse:1643.288196+2.660214 
## [4216]	train-rmse:1643.121826+0.215935	test-rmse:1643.124634+2.660406 
## [4217]	train-rmse:1642.958386+0.216693	test-rmse:1642.960962+2.660335 
## [4218]	train-rmse:1642.794470+0.215343	test-rmse:1642.797461+2.660176 
## [4219]	train-rmse:1642.631372+0.216646	test-rmse:1642.633911+2.660018 
## [4220]	train-rmse:1642.467456+0.215298	test-rmse:1642.470374+2.660057 
## [4221]	train-rmse:1642.304651+0.216201	test-rmse:1642.306799+2.660206 
## [4222]	train-rmse:1642.140686+0.214901	test-rmse:1642.143286+2.659846 
## [4223]	train-rmse:1641.977307+0.215839	test-rmse:1641.979736+2.659914 
## [4224]	train-rmse:1641.813220+0.215482	test-rmse:1641.816187+2.659811 
## [4225]	train-rmse:1641.650012+0.215987	test-rmse:1641.652637+2.659709 
## [4226]	train-rmse:1641.486719+0.215350	test-rmse:1641.489355+2.659701 
## [4227]	train-rmse:1641.323010+0.215307	test-rmse:1641.325964+2.659703 
## [4228]	train-rmse:1641.159656+0.215121	test-rmse:1641.162353+2.659615 
## [4229]	train-rmse:1640.996130+0.214920	test-rmse:1640.998901+2.659675 
## [4230]	train-rmse:1640.832874+0.215368	test-rmse:1640.835754+2.659527 
## [4231]	train-rmse:1640.669470+0.215193	test-rmse:1640.672339+2.659286 
## [4232]	train-rmse:1640.505762+0.215697	test-rmse:1640.508789+2.659407 
## [4233]	train-rmse:1640.343347+0.215149	test-rmse:1640.345361+2.659244 
## [4234]	train-rmse:1640.179175+0.215456	test-rmse:1640.182141+2.659149 
## [4235]	train-rmse:1640.016126+0.215522	test-rmse:1640.018652+2.659199 
## [4236]	train-rmse:1639.852014+0.215333	test-rmse:1639.855481+2.659105 
## [4237]	train-rmse:1639.689416+0.215388	test-rmse:1639.692395+2.658972 
## [4238]	train-rmse:1639.525952+0.215062	test-rmse:1639.528943+2.659174 
## [4239]	train-rmse:1639.362878+0.214994	test-rmse:1639.365564+2.658909 
## [4240]	train-rmse:1639.199353+0.214669	test-rmse:1639.202466+2.658778 
## [4241]	train-rmse:1639.037060+0.215955	test-rmse:1639.039197+2.658644 
## [4242]	train-rmse:1638.873047+0.214732	test-rmse:1638.876013+2.658745 
## [4243]	train-rmse:1638.710193+0.215487	test-rmse:1638.712927+2.658649 
## [4244]	train-rmse:1638.546789+0.215227	test-rmse:1638.549695+2.658586 
## [4245]	train-rmse:1638.384021+0.215069	test-rmse:1638.386499+2.658537 
## [4246]	train-rmse:1638.219898+0.214943	test-rmse:1638.223450+2.658336 
## [4247]	train-rmse:1638.057385+0.215849	test-rmse:1638.060352+2.658374 
## [4248]	train-rmse:1637.894385+0.215000	test-rmse:1637.897131+2.658114 
## [4249]	train-rmse:1637.730945+0.215957	test-rmse:1637.734168+2.658238 
## [4250]	train-rmse:1637.568067+0.214563	test-rmse:1637.571045+2.658039 
## [4251]	train-rmse:1637.405103+0.215528	test-rmse:1637.408081+2.658030 
## [4252]	train-rmse:1637.241773+0.214355	test-rmse:1637.244922+2.657833 
## [4253]	train-rmse:1637.079016+0.215476	test-rmse:1637.081909+2.658118 
## [4254]	train-rmse:1636.916077+0.214676	test-rmse:1636.919092+2.657967 
## [4255]	train-rmse:1636.753101+0.215369	test-rmse:1636.756152+2.657662 
## [4256]	train-rmse:1636.590137+0.214356	test-rmse:1636.593030+2.657696 
## [4257]	train-rmse:1636.427612+0.215544	test-rmse:1636.430115+2.657736 
## [4258]	train-rmse:1636.263623+0.214417	test-rmse:1636.267029+2.657551 
## [4259]	train-rmse:1636.102039+0.214926	test-rmse:1636.104199+2.657666 
## [4260]	train-rmse:1635.937488+0.214870	test-rmse:1635.941345+2.657499 
## [4261]	train-rmse:1635.775549+0.215248	test-rmse:1635.778564+2.657480 
## [4262]	train-rmse:1635.612048+0.215168	test-rmse:1635.615515+2.657638 
## [4263]	train-rmse:1635.450024+0.215153	test-rmse:1635.452808+2.657258 
## [4264]	train-rmse:1635.286853+0.214925	test-rmse:1635.289954+2.657188 
## [4265]	train-rmse:1635.123914+0.214428	test-rmse:1635.127063+2.657148 
## [4266]	train-rmse:1634.961182+0.214787	test-rmse:1634.964307+2.657370 
## [4267]	train-rmse:1634.798303+0.214569	test-rmse:1634.801441+2.657076 
## [4268]	train-rmse:1634.635388+0.214543	test-rmse:1634.638660+2.656984 
## [4269]	train-rmse:1634.472815+0.214564	test-rmse:1634.475793+2.656813 
## [4270]	train-rmse:1634.310388+0.214355	test-rmse:1634.313037+2.656830 
## [4271]	train-rmse:1634.147290+0.214712	test-rmse:1634.150403+2.656991 
## [4272]	train-rmse:1633.984729+0.214125	test-rmse:1633.987610+2.656775 
## [4273]	train-rmse:1633.821289+0.214901	test-rmse:1633.825110+2.656703 
## [4274]	train-rmse:1633.659192+0.213834	test-rmse:1633.662378+2.656652 
## [4275]	train-rmse:1633.496130+0.214775	test-rmse:1633.499597+2.656520 
## [4276]	train-rmse:1633.333801+0.214236	test-rmse:1633.336939+2.656386 
## [4277]	train-rmse:1633.170605+0.215017	test-rmse:1633.174451+2.656586 
## [4278]	train-rmse:1633.008264+0.214040	test-rmse:1633.011670+2.656254 
## [4279]	train-rmse:1632.845679+0.215007	test-rmse:1632.849170+2.656292 
## [4280]	train-rmse:1632.682971+0.213734	test-rmse:1632.686706+2.656404 
## [4281]	train-rmse:1632.520935+0.214699	test-rmse:1632.524072+2.656195 
## [4282]	train-rmse:1632.358423+0.213955	test-rmse:1632.361463+2.656120 
## [4283]	train-rmse:1632.195593+0.214129	test-rmse:1632.198999+2.655962 
## [4284]	train-rmse:1632.033008+0.214189	test-rmse:1632.036328+2.656084 
## [4285]	train-rmse:1631.870691+0.214345	test-rmse:1631.873975+2.656009 
## [4286]	train-rmse:1631.707837+0.213714	test-rmse:1631.711426+2.655880 
## [4287]	train-rmse:1631.545947+0.214217	test-rmse:1631.549170+2.655923 
## [4288]	train-rmse:1631.382495+0.213939	test-rmse:1631.386475+2.656007 
## [4289]	train-rmse:1631.221106+0.214241	test-rmse:1631.224341+2.655625 
## [4290]	train-rmse:1631.057263+0.214119	test-rmse:1631.061792+2.655554 
## [4291]	train-rmse:1630.896643+0.214273	test-rmse:1630.899353+2.655650 
## [4292]	train-rmse:1630.733142+0.213814	test-rmse:1630.737122+2.655464 
## [4293]	train-rmse:1630.571924+0.213659	test-rmse:1630.574731+2.655449 
## [4294]	train-rmse:1630.408032+0.213752	test-rmse:1630.412170+2.655273 
## [4295]	train-rmse:1630.246509+0.213900	test-rmse:1630.250085+2.655231 
## [4296]	train-rmse:1630.083472+0.213696	test-rmse:1630.087756+2.655130 
## [4297]	train-rmse:1629.922363+0.214252	test-rmse:1629.925330+2.655160 
## [4298]	train-rmse:1629.758960+0.213532	test-rmse:1629.762988+2.655121 
## [4299]	train-rmse:1629.597461+0.213774	test-rmse:1629.600867+2.655214 
## [4300]	train-rmse:1629.434387+0.213559	test-rmse:1629.438464+2.654908 
## [4301]	train-rmse:1629.272815+0.213714	test-rmse:1629.276221+2.654907 
## [4302]	train-rmse:1629.110107+0.213797	test-rmse:1629.113965+2.654836 
## [4303]	train-rmse:1628.948328+0.213771	test-rmse:1628.951965+2.654706 
## [4304]	train-rmse:1628.785937+0.214137	test-rmse:1628.789770+2.654891 
## [4305]	train-rmse:1628.623608+0.213404	test-rmse:1628.627466+2.654536 
## [4306]	train-rmse:1628.461463+0.214115	test-rmse:1628.465234+2.654547 
## [4307]	train-rmse:1628.299536+0.213121	test-rmse:1628.303235+2.654501 
## [4308]	train-rmse:1628.137366+0.213909	test-rmse:1628.141126+2.654493 
## [4309]	train-rmse:1627.975037+0.213507	test-rmse:1627.979004+2.654433 
## [4310]	train-rmse:1627.813184+0.214592	test-rmse:1627.816748+2.654353 
## [4311]	train-rmse:1627.650818+0.213115	test-rmse:1627.654553+2.654294 
## [4312]	train-rmse:1627.489453+0.213930	test-rmse:1627.492615+2.654116 
## [4313]	train-rmse:1627.326270+0.213529	test-rmse:1627.330530+2.654140 
## [4314]	train-rmse:1627.165637+0.213787	test-rmse:1627.168726+2.654227 
## [4315]	train-rmse:1627.002002+0.213075	test-rmse:1627.006458+2.654009 
## [4316]	train-rmse:1626.841504+0.213254	test-rmse:1626.844763+2.654032 
## [4317]	train-rmse:1626.678125+0.213023	test-rmse:1626.682812+2.653991 
## [4318]	train-rmse:1626.517346+0.213202	test-rmse:1626.520740+2.653850 
## [4319]	train-rmse:1626.354492+0.213051	test-rmse:1626.358740+2.653520 
## [4320]	train-rmse:1626.193872+0.212946	test-rmse:1626.196594+2.653633 
## [4321]	train-rmse:1626.030810+0.213723	test-rmse:1626.034888+2.653606 
## [4322]	train-rmse:1625.869763+0.213375	test-rmse:1625.872852+2.653701 
## [4323]	train-rmse:1625.707153+0.213577	test-rmse:1625.711072+2.653429 
## [4324]	train-rmse:1625.545972+0.212931	test-rmse:1625.549194+2.653446 
## [4325]	train-rmse:1625.383533+0.213326	test-rmse:1625.387329+2.653418 
## [4326]	train-rmse:1625.222058+0.213445	test-rmse:1625.225623+2.653211 
## [4327]	train-rmse:1625.059814+0.213484	test-rmse:1625.063879+2.652953 
## [4328]	train-rmse:1624.898376+0.212956	test-rmse:1624.902149+2.653117 
## [4329]	train-rmse:1624.736365+0.212960	test-rmse:1624.740283+2.653098 
## [4330]	train-rmse:1624.574841+0.212939	test-rmse:1624.578296+2.653110 
## [4331]	train-rmse:1624.412878+0.213076	test-rmse:1624.416687+2.653062 
## [4332]	train-rmse:1624.250842+0.212818	test-rmse:1624.254919+2.652899 
## [4333]	train-rmse:1624.089502+0.212965	test-rmse:1624.093225+2.652855 
## [4334]	train-rmse:1623.927637+0.213195	test-rmse:1623.931555+2.652882 
## [4335]	train-rmse:1623.765698+0.212904	test-rmse:1623.769910+2.652876 
## [4336]	train-rmse:1623.604126+0.212927	test-rmse:1623.608044+2.652659 
## [4337]	train-rmse:1623.442456+0.212945	test-rmse:1623.446765+2.652702 
## [4338]	train-rmse:1623.280127+0.212755	test-rmse:1623.284985+2.652575 
## [4339]	train-rmse:1623.119372+0.212810	test-rmse:1623.123132+2.652505 
## [4340]	train-rmse:1622.957947+0.212470	test-rmse:1622.961560+2.652441 
## [4341]	train-rmse:1622.796216+0.212777	test-rmse:1622.800098+2.652363 
## [4342]	train-rmse:1622.634375+0.212621	test-rmse:1622.638721+2.652188 
## [4343]	train-rmse:1622.473474+0.212830	test-rmse:1622.477112+2.652188 
## [4344]	train-rmse:1622.310974+0.212905	test-rmse:1622.315503+2.652193 
## [4345]	train-rmse:1622.150220+0.212992	test-rmse:1622.153894+2.652087 
## [4346]	train-rmse:1621.988306+0.213170	test-rmse:1621.992309+2.652207 
## [4347]	train-rmse:1621.826868+0.212631	test-rmse:1621.831042+2.651937 
## [4348]	train-rmse:1621.665125+0.212729	test-rmse:1621.669287+2.651818 
## [4349]	train-rmse:1621.503967+0.212584	test-rmse:1621.507849+2.652160 
## [4350]	train-rmse:1621.342383+0.212248	test-rmse:1621.346497+2.652067 
## [4351]	train-rmse:1621.181299+0.213080	test-rmse:1621.185071+2.651779 
## [4352]	train-rmse:1621.019702+0.212597	test-rmse:1621.023816+2.651572 
## [4353]	train-rmse:1620.858203+0.212791	test-rmse:1620.862329+2.651758 
## [4354]	train-rmse:1620.696435+0.211949	test-rmse:1620.700940+2.651741 
## [4355]	train-rmse:1620.535962+0.212793	test-rmse:1620.539649+2.651440 
## [4356]	train-rmse:1620.373450+0.211967	test-rmse:1620.378113+2.651408 
## [4357]	train-rmse:1620.213184+0.212803	test-rmse:1620.217004+2.651467 
## [4358]	train-rmse:1620.051294+0.211624	test-rmse:1620.055347+2.651292 
## [4359]	train-rmse:1619.890063+0.213118	test-rmse:1619.894312+2.651272 
## [4360]	train-rmse:1619.729028+0.211728	test-rmse:1619.733215+2.651436 
## [4361]	train-rmse:1619.567090+0.212797	test-rmse:1619.571851+2.651328 
## [4362]	train-rmse:1619.405945+0.212028	test-rmse:1619.410583+2.651137 
## [4363]	train-rmse:1619.245239+0.212591	test-rmse:1619.249292+2.651158 
## [4364]	train-rmse:1619.083667+0.212624	test-rmse:1619.088074+2.650898 
## [4365]	train-rmse:1618.922583+0.212191	test-rmse:1618.927038+2.650970 
## [4366]	train-rmse:1618.761682+0.212270	test-rmse:1618.765808+2.650768 
## [4367]	train-rmse:1618.600281+0.211822	test-rmse:1618.604639+2.650750 
## [4368]	train-rmse:1618.439246+0.212362	test-rmse:1618.443335+2.650779 
## [4369]	train-rmse:1618.278003+0.212279	test-rmse:1618.282117+2.650593 
## [4370]	train-rmse:1618.116370+0.212439	test-rmse:1618.121118+2.650448 
## [4371]	train-rmse:1617.955615+0.212339	test-rmse:1617.959949+2.650733 
## [4372]	train-rmse:1617.794409+0.212035	test-rmse:1617.798865+2.650248 
## [4373]	train-rmse:1617.633813+0.212408	test-rmse:1617.637891+2.650393 
## [4374]	train-rmse:1617.471741+0.211763	test-rmse:1617.476611+2.650311 
## [4375]	train-rmse:1617.311536+0.212584	test-rmse:1617.315833+2.650309 
## [4376]	train-rmse:1617.149975+0.211514	test-rmse:1617.154541+2.650040 
## [4377]	train-rmse:1616.989123+0.212821	test-rmse:1616.993555+2.649889 
## [4378]	train-rmse:1616.828332+0.211203	test-rmse:1616.832703+2.649926 
## [4379]	train-rmse:1616.667212+0.212125	test-rmse:1616.671668+2.649698 
## [4380]	train-rmse:1616.505969+0.211305	test-rmse:1616.510889+2.650040 
## [4381]	train-rmse:1616.345727+0.212282	test-rmse:1616.349817+2.649913 
## [4382]	train-rmse:1616.184546+0.211718	test-rmse:1616.188733+2.649778 
## [4383]	train-rmse:1616.023279+0.212531	test-rmse:1616.027954+2.649780 
## [4384]	train-rmse:1615.862988+0.211779	test-rmse:1615.867053+2.649652 
## [4385]	train-rmse:1615.702063+0.212221	test-rmse:1615.706201+2.649644 
## [4386]	train-rmse:1615.540881+0.211958	test-rmse:1615.545288+2.649581 
## [4387]	train-rmse:1615.380408+0.211707	test-rmse:1615.384741+2.649449 
## [4388]	train-rmse:1615.218579+0.212117	test-rmse:1615.223804+2.649242 
## [4389]	train-rmse:1615.059155+0.211722	test-rmse:1615.062891+2.649283 
## [4390]	train-rmse:1614.897424+0.212025	test-rmse:1614.901904+2.649340 
## [4391]	train-rmse:1614.736829+0.211688	test-rmse:1614.741174+2.649412 
## [4392]	train-rmse:1614.575598+0.211652	test-rmse:1614.580554+2.649161 
## [4393]	train-rmse:1614.414795+0.211371	test-rmse:1614.419848+2.649036 
## [4394]	train-rmse:1614.254626+0.212009	test-rmse:1614.259021+2.649184 
## [4395]	train-rmse:1614.093884+0.211548	test-rmse:1614.098315+2.649103 
## [4396]	train-rmse:1613.933411+0.212006	test-rmse:1613.937659+2.648945 
## [4397]	train-rmse:1613.772717+0.211710	test-rmse:1613.777002+2.648713 
## [4398]	train-rmse:1613.612231+0.212193	test-rmse:1613.616284+2.648883 
## [4399]	train-rmse:1613.451245+0.211413	test-rmse:1613.455615+2.648832 
## [4400]	train-rmse:1613.291186+0.211737	test-rmse:1613.295117+2.648670 
## [4401]	train-rmse:1613.129578+0.210992	test-rmse:1613.134399+2.648784 
## [4402]	train-rmse:1612.969421+0.211721	test-rmse:1612.973633+2.648543 
## [4403]	train-rmse:1612.808325+0.211312	test-rmse:1612.813098+2.648442 
## [4404]	train-rmse:1612.648779+0.211135	test-rmse:1612.652527+2.648513 
## [4405]	train-rmse:1612.487024+0.210776	test-rmse:1612.491931+2.648311 
## [4406]	train-rmse:1612.327246+0.211404	test-rmse:1612.331616+2.648287 
## [4407]	train-rmse:1612.165906+0.211049	test-rmse:1612.170923+2.648420 
## [4408]	train-rmse:1612.006189+0.211226	test-rmse:1612.010449+2.648333 
## [4409]	train-rmse:1611.844629+0.211484	test-rmse:1611.849817+2.648058 
## [4410]	train-rmse:1611.685413+0.211083	test-rmse:1611.689392+2.647949 
## [4411]	train-rmse:1611.523547+0.211533	test-rmse:1611.528980+2.648043 
## [4412]	train-rmse:1611.364612+0.210992	test-rmse:1611.368506+2.648013 
## [4413]	train-rmse:1611.203064+0.212238	test-rmse:1611.208057+2.647925 
## [4414]	train-rmse:1611.043652+0.210416	test-rmse:1611.047693+2.647878 
## [4415]	train-rmse:1610.882324+0.212186	test-rmse:1610.887366+2.647793 
## [4416]	train-rmse:1610.722217+0.210285	test-rmse:1610.727063+2.647754 
## [4417]	train-rmse:1610.561389+0.212240	test-rmse:1610.566736+2.647834 
## [4418]	train-rmse:1610.401941+0.210698	test-rmse:1610.406213+2.647658 
## [4419]	train-rmse:1610.241052+0.211633	test-rmse:1610.245850+2.647568 
## [4420]	train-rmse:1610.081140+0.210696	test-rmse:1610.085498+2.647509 
## [4421]	train-rmse:1609.920349+0.211244	test-rmse:1609.925342+2.647441 
## [4422]	train-rmse:1609.759644+0.211085	test-rmse:1609.765039+2.647271 
## [4423]	train-rmse:1609.599853+0.211345	test-rmse:1609.604602+2.647413 
## [4424]	train-rmse:1609.439758+0.211353	test-rmse:1609.444495+2.647379 
## [4425]	train-rmse:1609.279871+0.210935	test-rmse:1609.284046+2.647262 
## [4426]	train-rmse:1609.119250+0.211149	test-rmse:1609.124023+2.647156 
## [4427]	train-rmse:1608.959473+0.210968	test-rmse:1608.963904+2.647167 
## [4428]	train-rmse:1608.798547+0.211139	test-rmse:1608.803796+2.647053 
## [4429]	train-rmse:1608.639441+0.210784	test-rmse:1608.643457+2.647102 
## [4430]	train-rmse:1608.477954+0.210320	test-rmse:1608.483277+2.646957 
## [4431]	train-rmse:1608.319128+0.210555	test-rmse:1608.323108+2.646891 
## [4432]	train-rmse:1608.157764+0.210445	test-rmse:1608.163013+2.646681 
## [4433]	train-rmse:1607.998877+0.210666	test-rmse:1608.003039+2.646739 
## [4434]	train-rmse:1607.837451+0.210378	test-rmse:1607.842688+2.646845 
## [4435]	train-rmse:1607.678808+0.210874	test-rmse:1607.682739+2.646659 
## [4436]	train-rmse:1607.517639+0.210097	test-rmse:1607.522681+2.646591 
## [4437]	train-rmse:1607.358081+0.210539	test-rmse:1607.362683+2.646473 
## [4438]	train-rmse:1607.197754+0.209898	test-rmse:1607.202771+2.646390 
## [4439]	train-rmse:1607.038330+0.210647	test-rmse:1607.042529+2.646283 
## [4440]	train-rmse:1606.877710+0.209951	test-rmse:1606.882617+2.646324 
## [4441]	train-rmse:1606.718091+0.210783	test-rmse:1606.722669+2.646331 
## [4442]	train-rmse:1606.557385+0.210162	test-rmse:1606.562781+2.645967 
## [4443]	train-rmse:1606.398010+0.210652	test-rmse:1606.402698+2.646039 
## [4444]	train-rmse:1606.237903+0.210132	test-rmse:1606.242822+2.646113 
## [4445]	train-rmse:1606.077771+0.210337	test-rmse:1606.082873+2.646149 
## [4446]	train-rmse:1605.918335+0.210488	test-rmse:1605.923096+2.646064 
## [4447]	train-rmse:1605.757752+0.210259	test-rmse:1605.763098+2.645846 
## [4448]	train-rmse:1605.598889+0.210688	test-rmse:1605.603211+2.645703 
## [4449]	train-rmse:1605.437842+0.209959	test-rmse:1605.443591+2.645656 
## [4450]	train-rmse:1605.279053+0.210486	test-rmse:1605.283472+2.645620 
## [4451]	train-rmse:1605.118518+0.209733	test-rmse:1605.123779+2.645531 
## [4452]	train-rmse:1604.959607+0.210782	test-rmse:1604.963721+2.645748 
## [4453]	train-rmse:1604.798657+0.209463	test-rmse:1604.804346+2.645457 
## [4454]	train-rmse:1604.639758+0.210763	test-rmse:1604.644482+2.645321 
## [4455]	train-rmse:1604.478833+0.209314	test-rmse:1604.484668+2.645357 
## [4456]	train-rmse:1604.320312+0.210875	test-rmse:1604.324939+2.645363 
## [4457]	train-rmse:1604.160010+0.209690	test-rmse:1604.165137+2.645295 
## [4458]	train-rmse:1604.000647+0.210601	test-rmse:1604.005457+2.645170 
## [4459]	train-rmse:1603.840881+0.209357	test-rmse:1603.845703+2.645151 
## [4460]	train-rmse:1603.681580+0.210515	test-rmse:1603.686096+2.645152 
## [4461]	train-rmse:1603.521423+0.209628	test-rmse:1603.526404+2.645051 
## [4462]	train-rmse:1603.361926+0.210096	test-rmse:1603.366760+2.644941 
## [4463]	train-rmse:1603.201941+0.209548	test-rmse:1603.207202+2.644942 
## [4464]	train-rmse:1603.041748+0.209769	test-rmse:1603.047632+2.644757 
## [4465]	train-rmse:1602.882788+0.209991	test-rmse:1602.887915+2.644692 
## [4466]	train-rmse:1602.722876+0.209134	test-rmse:1602.728455+2.644600 
## [4467]	train-rmse:1602.564282+0.210092	test-rmse:1602.568835+2.644584 
## [4468]	train-rmse:1602.403479+0.208906	test-rmse:1602.409253+2.644541 
## [4469]	train-rmse:1602.245251+0.210215	test-rmse:1602.249768+2.644479 
## [4470]	train-rmse:1602.084656+0.209187	test-rmse:1602.090332+2.644485 
## [4471]	train-rmse:1601.926282+0.210465	test-rmse:1601.930762+2.644523 
## [4472]	train-rmse:1601.765820+0.209202	test-rmse:1601.771314+2.644468 
## [4473]	train-rmse:1601.606811+0.210194	test-rmse:1601.611890+2.644420 
## [4474]	train-rmse:1601.446863+0.209424	test-rmse:1601.452344+2.644298 
## [4475]	train-rmse:1601.287878+0.209983	test-rmse:1601.292737+2.644333 
## [4476]	train-rmse:1601.128296+0.209286	test-rmse:1601.133411+2.644035 
## [4477]	train-rmse:1600.969336+0.209437	test-rmse:1600.974072+2.644162 
## [4478]	train-rmse:1600.809814+0.209521	test-rmse:1600.814697+2.644118 
## [4479]	train-rmse:1600.649817+0.209544	test-rmse:1600.655383+2.644035 
## [4480]	train-rmse:1600.490601+0.209588	test-rmse:1600.495923+2.643889 
## [4481]	train-rmse:1600.330957+0.209372	test-rmse:1600.336646+2.643765 
## [4482]	train-rmse:1600.172168+0.209997	test-rmse:1600.177307+2.643761 
## [4483]	train-rmse:1600.012463+0.209928	test-rmse:1600.017981+2.643543 
## [4484]	train-rmse:1599.853955+0.209467	test-rmse:1599.858569+2.643750 
## [4485]	train-rmse:1599.694141+0.209456	test-rmse:1599.699463+2.643611 
## [4486]	train-rmse:1599.534961+0.209526	test-rmse:1599.540198+2.643368 
## [4487]	train-rmse:1599.375647+0.209085	test-rmse:1599.381055+2.643620 
## [4488]	train-rmse:1599.216309+0.209455	test-rmse:1599.221704+2.643433 
## [4489]	train-rmse:1599.057129+0.209172	test-rmse:1599.062439+2.643327 
## [4490]	train-rmse:1598.898767+0.209648	test-rmse:1598.903467+2.643467 
## [4491]	train-rmse:1598.739331+0.208992	test-rmse:1598.744348+2.643167 
## [4492]	train-rmse:1598.580005+0.209366	test-rmse:1598.584851+2.643319 
## [4493]	train-rmse:1598.420911+0.208617	test-rmse:1598.425940+2.643196 
## [4494]	train-rmse:1598.261328+0.209640	test-rmse:1598.266675+2.643030 
## [4495]	train-rmse:1598.102442+0.208588	test-rmse:1598.107581+2.642995 
## [4496]	train-rmse:1597.942932+0.209701	test-rmse:1597.948181+2.642934 
## [4497]	train-rmse:1597.784070+0.208933	test-rmse:1597.789197+2.642644 
## [4498]	train-rmse:1597.624951+0.209199	test-rmse:1597.630261+2.642805 
## [4499]	train-rmse:1597.466052+0.208977	test-rmse:1597.471240+2.642578 
## [4500]	train-rmse:1597.306824+0.208847	test-rmse:1597.312244+2.642655 
## [4501]	train-rmse:1597.148401+0.208798	test-rmse:1597.153198+2.642554 
## [4502]	train-rmse:1596.988782+0.208771	test-rmse:1596.994190+2.642563 
## [4503]	train-rmse:1596.830713+0.209219	test-rmse:1596.835144+2.642640 
## [4504]	train-rmse:1596.670618+0.208898	test-rmse:1596.676074+2.642460 
## [4505]	train-rmse:1596.512512+0.208903	test-rmse:1596.517224+2.642322 
## [4506]	train-rmse:1596.352002+0.209201	test-rmse:1596.358313+2.642276 
## [4507]	train-rmse:1596.194519+0.208739	test-rmse:1596.199329+2.642235 
## [4508]	train-rmse:1596.034326+0.208745	test-rmse:1596.040637+2.641840 
## [4509]	train-rmse:1595.876416+0.209248	test-rmse:1595.881580+2.642114 
## [4510]	train-rmse:1595.717212+0.208986	test-rmse:1595.722620+2.642129 
## [4511]	train-rmse:1595.558740+0.209269	test-rmse:1595.563733+2.642083 
## [4512]	train-rmse:1595.400146+0.208634	test-rmse:1595.405139+2.641795 
## [4513]	train-rmse:1595.240918+0.209499	test-rmse:1595.246106+2.641805 
## [4514]	train-rmse:1595.082056+0.209012	test-rmse:1595.087085+2.641817 
## [4515]	train-rmse:1594.923193+0.209641	test-rmse:1594.928626+2.641751 
## [4516]	train-rmse:1594.764563+0.208363	test-rmse:1594.769690+2.641429 
## [4517]	train-rmse:1594.605518+0.209062	test-rmse:1594.610864+2.641612 
## [4518]	train-rmse:1594.446777+0.208402	test-rmse:1594.452356+2.641494 
## [4519]	train-rmse:1594.287207+0.208650	test-rmse:1594.293543+2.641616 
## [4520]	train-rmse:1594.129785+0.208214	test-rmse:1594.134583+2.641440 
## [4521]	train-rmse:1593.970166+0.209092	test-rmse:1593.976025+2.641284 
## [4522]	train-rmse:1593.812378+0.208323	test-rmse:1593.817432+2.641450 
## [4523]	train-rmse:1593.652918+0.208427	test-rmse:1593.658631+2.641140 
## [4524]	train-rmse:1593.495032+0.208165	test-rmse:1593.500098+2.641288 
## [4525]	train-rmse:1593.335046+0.208199	test-rmse:1593.341443+2.641225 
## [4526]	train-rmse:1593.178040+0.208171	test-rmse:1593.182861+2.641065 
## [4527]	train-rmse:1593.017896+0.208280	test-rmse:1593.024109+2.640961 
## [4528]	train-rmse:1592.860962+0.208643	test-rmse:1592.865613+2.640840 
## [4529]	train-rmse:1592.700977+0.208137	test-rmse:1592.707104+2.640992 
## [4530]	train-rmse:1592.543506+0.208735	test-rmse:1592.548474+2.640890 
## [4531]	train-rmse:1592.384302+0.207941	test-rmse:1592.389966+2.640897 
## [4532]	train-rmse:1592.226257+0.208703	test-rmse:1592.231336+2.640638 
## [4533]	train-rmse:1592.067163+0.208167	test-rmse:1592.072791+2.640593 
## [4534]	train-rmse:1591.909289+0.208894	test-rmse:1591.914233+2.640523 
## [4535]	train-rmse:1591.750598+0.208179	test-rmse:1591.755750+2.640289 
## [4536]	train-rmse:1591.591504+0.208771	test-rmse:1591.597363+2.640610 
## [4537]	train-rmse:1591.433386+0.208140	test-rmse:1591.438953+2.640375 
## [4538]	train-rmse:1591.274475+0.208273	test-rmse:1591.280615+2.640368 
## [4539]	train-rmse:1591.116919+0.208361	test-rmse:1591.122168+2.640332 
## [4540]	train-rmse:1590.957422+0.208240	test-rmse:1590.963647+2.640240 
## [4541]	train-rmse:1590.800415+0.208212	test-rmse:1590.805371+2.640146 
## [4542]	train-rmse:1590.641065+0.208439	test-rmse:1590.646851+2.640032 
## [4543]	train-rmse:1590.483691+0.207998	test-rmse:1590.488660+2.639957 
## [4544]	train-rmse:1590.324097+0.207852	test-rmse:1590.330225+2.639850 
## [4545]	train-rmse:1590.166418+0.208380	test-rmse:1590.171948+2.639876 
## [4546]	train-rmse:1590.007715+0.207901	test-rmse:1590.013794+2.639781 
## [4547]	train-rmse:1589.849878+0.208576	test-rmse:1589.855444+2.639822 
## [4548]	train-rmse:1589.691418+0.207992	test-rmse:1589.697217+2.639728 
## [4549]	train-rmse:1589.532812+0.208429	test-rmse:1589.538782+2.639398 
## [4550]	train-rmse:1589.375330+0.208095	test-rmse:1589.380566+2.639580 
## [4551]	train-rmse:1589.216162+0.208046	test-rmse:1589.222351+2.639590 
## [4552]	train-rmse:1589.058814+0.208173	test-rmse:1589.064197+2.639451 
## [4553]	train-rmse:1588.899780+0.207579	test-rmse:1588.905859+2.639455 
## [4554]	train-rmse:1588.742261+0.208016	test-rmse:1588.747852+2.639446 
## [4555]	train-rmse:1588.583765+0.207581	test-rmse:1588.589477+2.639217 
## [4556]	train-rmse:1588.426025+0.208029	test-rmse:1588.431628+2.639301 
## [4557]	train-rmse:1588.267346+0.207670	test-rmse:1588.273181+2.639189 
## [4558]	train-rmse:1588.109973+0.208011	test-rmse:1588.115137+2.639126 
## [4559]	train-rmse:1587.950830+0.207515	test-rmse:1587.957068+2.638930 
## [4560]	train-rmse:1587.793079+0.207976	test-rmse:1587.798975+2.638957 
## [4561]	train-rmse:1587.634985+0.207466	test-rmse:1587.641028+2.638926 
## [4562]	train-rmse:1587.476929+0.208002	test-rmse:1587.482813+2.638967 
## [4563]	train-rmse:1587.318970+0.207739	test-rmse:1587.324817+2.638983 
## [4564]	train-rmse:1587.161584+0.207999	test-rmse:1587.166614+2.638775 
## [4565]	train-rmse:1587.003344+0.207492	test-rmse:1587.008728+2.638655 
## [4566]	train-rmse:1586.845252+0.208295	test-rmse:1586.850708+2.638547 
## [4567]	train-rmse:1586.687036+0.206965	test-rmse:1586.692712+2.638712 
## [4568]	train-rmse:1586.529224+0.207651	test-rmse:1586.534595+2.638597 
## [4569]	train-rmse:1586.371729+0.206599	test-rmse:1586.376575+2.638522 
## [4570]	train-rmse:1586.213110+0.207671	test-rmse:1586.218945+2.638349 
## [4571]	train-rmse:1586.055981+0.206961	test-rmse:1586.061072+2.638209 
## [4572]	train-rmse:1585.897571+0.207234	test-rmse:1585.903223+2.638279 
## [4573]	train-rmse:1585.739783+0.207311	test-rmse:1585.745154+2.638181 
## [4574]	train-rmse:1585.582214+0.207399	test-rmse:1585.587390+2.638005 
## [4575]	train-rmse:1585.423938+0.207280	test-rmse:1585.429566+2.637886 
## [4576]	train-rmse:1585.266565+0.207085	test-rmse:1585.271887+2.637969 
## [4577]	train-rmse:1585.108008+0.207077	test-rmse:1585.113806+2.638019 
## [4578]	train-rmse:1584.950867+0.207272	test-rmse:1584.956079+2.637975 
## [4579]	train-rmse:1584.792688+0.207093	test-rmse:1584.798315+2.637933 
## [4580]	train-rmse:1584.634814+0.207379	test-rmse:1584.640564+2.637799 
## [4581]	train-rmse:1584.477625+0.207963	test-rmse:1584.482996+2.637797 
## [4582]	train-rmse:1584.318909+0.207122	test-rmse:1584.325268+2.637898 
## [4583]	train-rmse:1584.161853+0.207596	test-rmse:1584.167407+2.637570 
## [4584]	train-rmse:1584.003980+0.207001	test-rmse:1584.009595+2.637731 
## [4585]	train-rmse:1583.846460+0.207472	test-rmse:1583.851953+2.637337 
## [4586]	train-rmse:1583.688782+0.206868	test-rmse:1583.694238+2.637608 
## [4587]	train-rmse:1583.530615+0.207631	test-rmse:1583.536914+2.637462 
## [4588]	train-rmse:1583.373071+0.206706	test-rmse:1583.379285+2.637297 
## [4589]	train-rmse:1583.215259+0.207287	test-rmse:1583.221631+2.637192 
## [4590]	train-rmse:1583.057886+0.207035	test-rmse:1583.063770+2.637082 
## [4591]	train-rmse:1582.900354+0.206821	test-rmse:1582.906311+2.637207 
## [4592]	train-rmse:1582.742688+0.206877	test-rmse:1582.748535+2.637023 
## [4593]	train-rmse:1582.585205+0.206645	test-rmse:1582.590820+2.636828 
## [4594]	train-rmse:1582.427600+0.207233	test-rmse:1582.433423+2.636939 
## [4595]	train-rmse:1582.270581+0.207233	test-rmse:1582.275818+2.636782 
## [4596]	train-rmse:1582.112659+0.207516	test-rmse:1582.118372+2.636651 
## [4597]	train-rmse:1581.955310+0.206778	test-rmse:1581.960901+2.636746 
## [4598]	train-rmse:1581.797974+0.207239	test-rmse:1581.803589+2.636815 
## [4599]	train-rmse:1581.640405+0.206839	test-rmse:1581.646094+2.636752 
## [4600]	train-rmse:1581.482544+0.207270	test-rmse:1581.488525+2.636685 
## [4601]	train-rmse:1581.325342+0.206769	test-rmse:1581.331067+2.636385 
## [4602]	train-rmse:1581.167871+0.207180	test-rmse:1581.173694+2.636616 
## [4603]	train-rmse:1581.010413+0.206537	test-rmse:1581.016431+2.636561 
## [4604]	train-rmse:1580.852832+0.206671	test-rmse:1580.858972+2.636376 
## [4605]	train-rmse:1580.695813+0.206810	test-rmse:1580.701575+2.636260 
## [4606]	train-rmse:1580.538782+0.206379	test-rmse:1580.544141+2.636369 
## [4607]	train-rmse:1580.380823+0.207167	test-rmse:1580.386755+2.636282 
## [4608]	train-rmse:1580.224365+0.206489	test-rmse:1580.229541+2.636051 
## [4609]	train-rmse:1580.066028+0.206814	test-rmse:1580.072205+2.635950 
## [4610]	train-rmse:1579.909546+0.206334	test-rmse:1579.914893+2.636019 
## [4611]	train-rmse:1579.750976+0.206710	test-rmse:1579.757568+2.636134 
## [4612]	train-rmse:1579.594836+0.206085	test-rmse:1579.600342+2.635859 
## [4613]	train-rmse:1579.436304+0.206856	test-rmse:1579.443091+2.635845 
## [4614]	train-rmse:1579.280298+0.206061	test-rmse:1579.285889+2.635605 
## [4615]	train-rmse:1579.122314+0.207202	test-rmse:1579.128686+2.635662 
## [4616]	train-rmse:1578.966284+0.206135	test-rmse:1578.971387+2.635809 
## [4617]	train-rmse:1578.808105+0.207013	test-rmse:1578.814038+2.635612 
## [4618]	train-rmse:1578.651562+0.206351	test-rmse:1578.657227+2.635540 
## [4619]	train-rmse:1578.493970+0.207041	test-rmse:1578.499805+2.635415 
## [4620]	train-rmse:1578.336926+0.206265	test-rmse:1578.342676+2.635288 
## [4621]	train-rmse:1578.180176+0.206900	test-rmse:1578.185547+2.635412 
## [4622]	train-rmse:1578.022546+0.206083	test-rmse:1578.028504+2.635357 
## [4623]	train-rmse:1577.866345+0.206483	test-rmse:1577.871362+2.635247 
## [4624]	train-rmse:1577.708167+0.206296	test-rmse:1577.714356+2.635098 
## [4625]	train-rmse:1577.551953+0.206126	test-rmse:1577.557251+2.635175 
## [4626]	train-rmse:1577.393909+0.206888	test-rmse:1577.400378+2.635032 
## [4627]	train-rmse:1577.238294+0.206388	test-rmse:1577.243201+2.635160 
## [4628]	train-rmse:1577.079541+0.206699	test-rmse:1577.086084+2.634890 
## [4629]	train-rmse:1576.924060+0.205914	test-rmse:1576.929138+2.634889 
## [4630]	train-rmse:1576.765784+0.206116	test-rmse:1576.772339+2.634588 
## [4631]	train-rmse:1576.610193+0.205524	test-rmse:1576.615283+2.634784 
## [4632]	train-rmse:1576.452209+0.206080	test-rmse:1576.458386+2.634764 
## [4633]	train-rmse:1576.295715+0.204918	test-rmse:1576.301453+2.634848 
## [4634]	train-rmse:1576.138196+0.206355	test-rmse:1576.144519+2.634732 
## [4635]	train-rmse:1575.981470+0.205412	test-rmse:1575.987451+2.634365 
## [4636]	train-rmse:1575.825195+0.206060	test-rmse:1575.830640+2.634446 
## [4637]	train-rmse:1575.667615+0.205498	test-rmse:1575.673865+2.634473 
## [4638]	train-rmse:1575.511706+0.206023	test-rmse:1575.516919+2.634453 
## [4639]	train-rmse:1575.353796+0.205528	test-rmse:1575.360169+2.634410 
## [4640]	train-rmse:1575.198206+0.205816	test-rmse:1575.203235+2.634149 
## [4641]	train-rmse:1575.040222+0.205772	test-rmse:1575.046472+2.634264 
## [4642]	train-rmse:1574.884143+0.205741	test-rmse:1574.889770+2.634025 
## [4643]	train-rmse:1574.726807+0.205745	test-rmse:1574.732996+2.634186 
## [4644]	train-rmse:1574.570007+0.205533	test-rmse:1574.576245+2.633893 
## [4645]	train-rmse:1574.413708+0.206333	test-rmse:1574.419556+2.633950 
## [4646]	train-rmse:1574.256299+0.205458	test-rmse:1574.262659+2.633842 
## [4647]	train-rmse:1574.100427+0.206174	test-rmse:1574.105871+2.633811 
## [4648]	train-rmse:1573.943201+0.205135	test-rmse:1573.949133+2.633607 
## [4649]	train-rmse:1573.787146+0.205723	test-rmse:1573.792688+2.633740 
## [4650]	train-rmse:1573.630225+0.205363	test-rmse:1573.635974+2.633831 
## [4651]	train-rmse:1573.473267+0.205548	test-rmse:1573.479309+2.633419 
## [4652]	train-rmse:1573.316858+0.204973	test-rmse:1573.322656+2.633413 
## [4653]	train-rmse:1573.159839+0.205706	test-rmse:1573.166016+2.633508 
## [4654]	train-rmse:1573.003955+0.205412	test-rmse:1573.009497+2.633432 
## [4655]	train-rmse:1572.846399+0.205475	test-rmse:1572.852734+2.633379 
## [4656]	train-rmse:1572.690515+0.205189	test-rmse:1572.696313+2.633267 
## [4657]	train-rmse:1572.533276+0.205455	test-rmse:1572.539746+2.633207 
## [4658]	train-rmse:1572.377307+0.204958	test-rmse:1572.383240+2.633173 
## [4659]	train-rmse:1572.220300+0.205331	test-rmse:1572.226660+2.633048 
## [4660]	train-rmse:1572.064771+0.205316	test-rmse:1572.070032+2.633033 
## [4661]	train-rmse:1571.907251+0.205300	test-rmse:1571.913586+2.632897 
## [4662]	train-rmse:1571.751514+0.205638	test-rmse:1571.757165+2.633009 
## [4663]	train-rmse:1571.594409+0.205225	test-rmse:1571.600561+2.632874 
## [4664]	train-rmse:1571.438196+0.205322	test-rmse:1571.444116+2.632694 
## [4665]	train-rmse:1571.281702+0.205194	test-rmse:1571.287830+2.632727 
## [4666]	train-rmse:1571.125366+0.205607	test-rmse:1571.131445+2.632757 
## [4667]	train-rmse:1570.969251+0.204996	test-rmse:1570.975012+2.632657 
## [4668]	train-rmse:1570.811938+0.205819	test-rmse:1570.818640+2.632562 
## [4669]	train-rmse:1570.656665+0.204712	test-rmse:1570.661987+2.632624 
## [4670]	train-rmse:1570.499853+0.205433	test-rmse:1570.505847+2.632448 
## [4671]	train-rmse:1570.344092+0.204606	test-rmse:1570.349548+2.632520 
## [4672]	train-rmse:1570.187012+0.205522	test-rmse:1570.193250+2.632537 
## [4673]	train-rmse:1570.031287+0.204562	test-rmse:1570.037000+2.632369 
## [4674]	train-rmse:1569.874451+0.205485	test-rmse:1569.880542+2.632234 
## [4675]	train-rmse:1569.718701+0.204867	test-rmse:1569.724353+2.632253 
## [4676]	train-rmse:1569.561951+0.205376	test-rmse:1569.567993+2.632075 
## [4677]	train-rmse:1569.406177+0.204784	test-rmse:1569.411828+2.631916 
## [4678]	train-rmse:1569.249927+0.205229	test-rmse:1569.255664+2.632023 
## [4679]	train-rmse:1569.093518+0.205140	test-rmse:1569.099390+2.631976 
## [4680]	train-rmse:1568.937366+0.204995	test-rmse:1568.943066+2.631691 
## [4681]	train-rmse:1568.781433+0.205039	test-rmse:1568.787024+2.631724 
## [4682]	train-rmse:1568.624914+0.204446	test-rmse:1568.630859+2.631749 
## [4683]	train-rmse:1568.468787+0.205357	test-rmse:1568.474792+2.631720 
## [4684]	train-rmse:1568.312366+0.204797	test-rmse:1568.318518+2.631610 
## [4685]	train-rmse:1568.156348+0.204911	test-rmse:1568.162427+2.631451 
## [4686]	train-rmse:1568.000696+0.204813	test-rmse:1568.006323+2.631621 
## [4687]	train-rmse:1567.844153+0.204973	test-rmse:1567.850110+2.631469 
## [4688]	train-rmse:1567.688647+0.204987	test-rmse:1567.694068+2.631309 
## [4689]	train-rmse:1567.531519+0.204976	test-rmse:1567.538135+2.631293 
## [4690]	train-rmse:1567.375879+0.204891	test-rmse:1567.382141+2.631257 
## [4691]	train-rmse:1567.219165+0.204624	test-rmse:1567.226172+2.631115 
## [4692]	train-rmse:1567.064282+0.204557	test-rmse:1567.070276+2.631197 
## [4693]	train-rmse:1566.907666+0.204249	test-rmse:1566.914099+2.631065 
## [4694]	train-rmse:1566.751672+0.204506	test-rmse:1566.758044+2.631151 
## [4695]	train-rmse:1566.596582+0.204433	test-rmse:1566.602124+2.630792 
## [4696]	train-rmse:1566.439941+0.204760	test-rmse:1566.446057+2.630987 
## [4697]	train-rmse:1566.284936+0.204463	test-rmse:1566.290149+2.630731 
## [4698]	train-rmse:1566.128272+0.204732	test-rmse:1566.134326+2.630626 
## [4699]	train-rmse:1565.972839+0.204242	test-rmse:1565.978479+2.630569 
## [4700]	train-rmse:1565.816418+0.204554	test-rmse:1565.822546+2.630543 
## [4701]	train-rmse:1565.660950+0.204101	test-rmse:1565.666895+2.630684 
## [4702]	train-rmse:1565.504907+0.205001	test-rmse:1565.510876+2.630407 
## [4703]	train-rmse:1565.349133+0.204038	test-rmse:1565.354968+2.630558 
## [4704]	train-rmse:1565.193140+0.204605	test-rmse:1565.199145+2.630530 
## [4705]	train-rmse:1565.037939+0.204191	test-rmse:1565.043445+2.630302 
## [4706]	train-rmse:1564.881555+0.204562	test-rmse:1564.887634+2.630387 
## [4707]	train-rmse:1564.726099+0.204545	test-rmse:1564.731836+2.630197 
## [4708]	train-rmse:1564.570056+0.204066	test-rmse:1564.575891+2.630105 
## [4709]	train-rmse:1564.414197+0.204640	test-rmse:1564.420288+2.630221 
## [4710]	train-rmse:1564.258545+0.203763	test-rmse:1564.264649+2.629852 
## [4711]	train-rmse:1564.103210+0.204567	test-rmse:1564.109021+2.629857 
## [4712]	train-rmse:1563.946582+0.203766	test-rmse:1563.953247+2.630046 
## [4713]	train-rmse:1563.791589+0.204747	test-rmse:1563.797522+2.630014 
## [4714]	train-rmse:1563.635669+0.203997	test-rmse:1563.641943+2.629861 
## [4715]	train-rmse:1563.480078+0.204838	test-rmse:1563.486414+2.629835 
## [4716]	train-rmse:1563.324597+0.203749	test-rmse:1563.330615+2.629607 
## [4717]	train-rmse:1563.168713+0.204845	test-rmse:1563.175024+2.629553 
## [4718]	train-rmse:1563.014075+0.203307	test-rmse:1563.019580+2.629541 
## [4719]	train-rmse:1562.857434+0.204488	test-rmse:1562.863916+2.629393 
## [4720]	train-rmse:1562.702600+0.203775	test-rmse:1562.708203+2.629540 
## [4721]	train-rmse:1562.546313+0.203986	test-rmse:1562.552783+2.629368 
## [4722]	train-rmse:1562.391980+0.204186	test-rmse:1562.397095+2.629142 
## [4723]	train-rmse:1562.235315+0.203752	test-rmse:1562.241711+2.629211 
## [4724]	train-rmse:1562.080274+0.204017	test-rmse:1562.086108+2.629391 
## [4725]	train-rmse:1561.924048+0.203767	test-rmse:1561.930505+2.628978 
## [4726]	train-rmse:1561.769287+0.204317	test-rmse:1561.775073+2.629164 
## [4727]	train-rmse:1561.613013+0.203074	test-rmse:1561.619592+2.629219 
## [4728]	train-rmse:1561.458191+0.204197	test-rmse:1561.464319+2.629050 
## [4729]	train-rmse:1561.302515+0.203162	test-rmse:1561.308887+2.628756 
## [4730]	train-rmse:1561.147485+0.204185	test-rmse:1561.153430+2.628801 
## [4731]	train-rmse:1560.991833+0.203222	test-rmse:1560.997937+2.628780 
## [4732]	train-rmse:1560.836304+0.204057	test-rmse:1560.842700+2.628488 
## [4733]	train-rmse:1560.681238+0.203014	test-rmse:1560.687525+2.628770 
## [4734]	train-rmse:1560.525244+0.204203	test-rmse:1560.531738+2.628747 
## [4735]	train-rmse:1560.370666+0.203552	test-rmse:1560.376599+2.628530 
## [4736]	train-rmse:1560.214392+0.204304	test-rmse:1560.221374+2.628529 
## [4737]	train-rmse:1560.060156+0.204260	test-rmse:1560.066125+2.628488 
## [4738]	train-rmse:1559.903809+0.203592	test-rmse:1559.910730+2.628490 
## [4739]	train-rmse:1559.749500+0.204054	test-rmse:1559.755457+2.628324 
## [4740]	train-rmse:1559.593506+0.203152	test-rmse:1559.600146+2.628354 
## [4741]	train-rmse:1559.439368+0.203800	test-rmse:1559.444995+2.628363 
## [4742]	train-rmse:1559.282959+0.203139	test-rmse:1559.289661+2.628264 
## [4743]	train-rmse:1559.129004+0.203603	test-rmse:1559.134570+2.628093 
## [4744]	train-rmse:1558.972937+0.203391	test-rmse:1558.979395+2.627913 
## [4745]	train-rmse:1558.818457+0.203635	test-rmse:1558.823975+2.627913 
## [4746]	train-rmse:1558.663037+0.203747	test-rmse:1558.669031+2.627879 
## [4747]	train-rmse:1558.507800+0.203357	test-rmse:1558.513843+2.627783 
## [4748]	train-rmse:1558.352588+0.204085	test-rmse:1558.358484+2.627919 
## [4749]	train-rmse:1558.197058+0.203189	test-rmse:1558.203540+2.627793 
## [4750]	train-rmse:1558.042334+0.203657	test-rmse:1558.048413+2.627705 
## [4751]	train-rmse:1557.886560+0.203417	test-rmse:1557.893457+2.627650 
## [4752]	train-rmse:1557.732422+0.203048	test-rmse:1557.738391+2.627686 
## [4753]	train-rmse:1557.576563+0.203561	test-rmse:1557.583130+2.627522 
## [4754]	train-rmse:1557.422461+0.202456	test-rmse:1557.428076+2.627503 
## [4755]	train-rmse:1557.266821+0.203529	test-rmse:1557.273132+2.627191 
## [4756]	train-rmse:1557.112695+0.202414	test-rmse:1557.118017+2.627271 
## [4757]	train-rmse:1556.956738+0.203760	test-rmse:1556.963293+2.627213 
## [4758]	train-rmse:1556.802063+0.201928	test-rmse:1556.808179+2.627183 
## [4759]	train-rmse:1556.647266+0.203948	test-rmse:1556.653210+2.627154 
## [4760]	train-rmse:1556.491785+0.202926	test-rmse:1556.498352+2.627064 
## [4761]	train-rmse:1556.337268+0.203230	test-rmse:1556.343347+2.626934 
## [4762]	train-rmse:1556.182275+0.203024	test-rmse:1556.188477+2.626920 
## [4763]	train-rmse:1556.027625+0.203427	test-rmse:1556.033618+2.626863 
## [4764]	train-rmse:1555.872632+0.203077	test-rmse:1555.878564+2.626829 
## [4765]	train-rmse:1555.718140+0.203376	test-rmse:1555.723950+2.626721 
## [4766]	train-rmse:1555.562256+0.203128	test-rmse:1555.568860+2.626397 
## [4767]	train-rmse:1555.407971+0.203095	test-rmse:1555.413977+2.626456 
## [4768]	train-rmse:1555.252209+0.202720	test-rmse:1555.259302+2.626462 
## [4769]	train-rmse:1555.098486+0.203156	test-rmse:1555.104504+2.626524 
## [4770]	train-rmse:1554.943091+0.202781	test-rmse:1554.949573+2.626396 
## [4771]	train-rmse:1554.788770+0.202618	test-rmse:1554.794971+2.626438 
## [4772]	train-rmse:1554.633569+0.203059	test-rmse:1554.640161+2.626218 
## [4773]	train-rmse:1554.478687+0.202459	test-rmse:1554.485352+2.626359 
## [4774]	train-rmse:1554.324682+0.202945	test-rmse:1554.330615+2.626289 
## [4775]	train-rmse:1554.168897+0.202914	test-rmse:1554.175916+2.626127 
## [4776]	train-rmse:1554.015747+0.202604	test-rmse:1554.021094+2.626226 
## [4777]	train-rmse:1553.859216+0.203255	test-rmse:1553.866369+2.625980 
## [4778]	train-rmse:1553.705774+0.202792	test-rmse:1553.711890+2.625931 
## [4779]	train-rmse:1553.550415+0.202844	test-rmse:1553.557373+2.625918 
## [4780]	train-rmse:1553.396082+0.202790	test-rmse:1553.402503+2.625953 
## [4781]	train-rmse:1553.241663+0.203057	test-rmse:1553.248083+2.625675 
## [4782]	train-rmse:1553.087439+0.202810	test-rmse:1553.093237+2.625704 
## [4783]	train-rmse:1552.932898+0.203013	test-rmse:1552.938733+2.625712 
## [4784]	train-rmse:1552.777576+0.202703	test-rmse:1552.784229+2.625624 
## [4785]	train-rmse:1552.624109+0.202825	test-rmse:1552.629541+2.625580 
## [4786]	train-rmse:1552.467688+0.202584	test-rmse:1552.475171+2.625270 
## [4787]	train-rmse:1552.315393+0.202718	test-rmse:1552.320544+2.625537 
## [4788]	train-rmse:1552.158960+0.202497	test-rmse:1552.166211+2.625416 
## [4789]	train-rmse:1552.006079+0.202809	test-rmse:1552.011389+2.625245 
## [4790]	train-rmse:1551.850024+0.202378	test-rmse:1551.857043+2.625221 
## [4791]	train-rmse:1551.696729+0.202288	test-rmse:1551.702502+2.625199 
## [4792]	train-rmse:1551.541211+0.202302	test-rmse:1551.548035+2.625078 
## [4793]	train-rmse:1551.387537+0.202204	test-rmse:1551.393664+2.624964 
## [4794]	train-rmse:1551.232642+0.202488	test-rmse:1551.239355+2.624968 
## [4795]	train-rmse:1551.078674+0.201977	test-rmse:1551.085022+2.625042 
## [4796]	train-rmse:1550.924609+0.202690	test-rmse:1550.930493+2.625101 
## [4797]	train-rmse:1550.769470+0.201748	test-rmse:1550.776172+2.624972 
## [4798]	train-rmse:1550.616150+0.202080	test-rmse:1550.621851+2.624645 
## [4799]	train-rmse:1550.460303+0.202214	test-rmse:1550.467346+2.624615 
## [4800]	train-rmse:1550.307141+0.201838	test-rmse:1550.313123+2.624878 
## [4801]	train-rmse:1550.151794+0.202435	test-rmse:1550.158923+2.624639 
## [4802]	train-rmse:1549.998633+0.201651	test-rmse:1550.004358+2.624517 
## [4803]	train-rmse:1549.843481+0.202343	test-rmse:1549.850330+2.624385 
## [4804]	train-rmse:1549.690015+0.201807	test-rmse:1549.695947+2.624633 
## [4805]	train-rmse:1549.534680+0.202665	test-rmse:1549.541651+2.624348 
## [4806]	train-rmse:1549.381592+0.202391	test-rmse:1549.387390+2.624388 
## [4807]	train-rmse:1549.226575+0.202098	test-rmse:1549.233374+2.624356 
## [4808]	train-rmse:1549.073010+0.201961	test-rmse:1549.079150+2.624184 
## [4809]	train-rmse:1548.918225+0.202246	test-rmse:1548.924939+2.624021 
## [4810]	train-rmse:1548.764136+0.201538	test-rmse:1548.770825+2.624115 
## [4811]	train-rmse:1548.609985+0.202277	test-rmse:1548.616638+2.623943 
## [4812]	train-rmse:1548.455200+0.201762	test-rmse:1548.462585+2.624002 
## [4813]	train-rmse:1548.301868+0.202084	test-rmse:1548.308325+2.623801 
## [4814]	train-rmse:1548.147473+0.201697	test-rmse:1548.154407+2.623873 
## [4815]	train-rmse:1547.994189+0.202248	test-rmse:1547.999963+2.623831 
## [4816]	train-rmse:1547.839270+0.201866	test-rmse:1547.845972+2.623765 
## [4817]	train-rmse:1547.686023+0.201947	test-rmse:1547.692004+2.623821 
## [4818]	train-rmse:1547.531067+0.201598	test-rmse:1547.537976+2.623599 
## [4819]	train-rmse:1547.377283+0.201390	test-rmse:1547.383984+2.623297 
## [4820]	train-rmse:1547.222876+0.201971	test-rmse:1547.229858+2.623284 
## [4821]	train-rmse:1547.069177+0.201907	test-rmse:1547.075769+2.623262 
## [4822]	train-rmse:1546.915271+0.201862	test-rmse:1546.921741+2.623367 
## [4823]	train-rmse:1546.761780+0.202072	test-rmse:1546.767615+2.623044 
## [4824]	train-rmse:1546.607690+0.202140	test-rmse:1546.613953+2.623024 
## [4825]	train-rmse:1546.453980+0.201424	test-rmse:1546.460010+2.623102 
## [4826]	train-rmse:1546.299414+0.201701	test-rmse:1546.306152+2.623022 
## [4827]	train-rmse:1546.145776+0.201666	test-rmse:1546.152100+2.622840 
## [4828]	train-rmse:1545.991101+0.201394	test-rmse:1545.998279+2.623116 
## [4829]	train-rmse:1545.838135+0.201873	test-rmse:1545.844556+2.622823 
## [4830]	train-rmse:1545.683411+0.201129	test-rmse:1545.690466+2.622917 
## [4831]	train-rmse:1545.530212+0.201416	test-rmse:1545.536707+2.622860 
## [4832]	train-rmse:1545.376074+0.201351	test-rmse:1545.382800+2.622832 
## [4833]	train-rmse:1545.222608+0.201844	test-rmse:1545.228845+2.622629 
## [4834]	train-rmse:1545.068933+0.201493	test-rmse:1545.075232+2.622577 
## [4835]	train-rmse:1544.915186+0.201992	test-rmse:1544.921521+2.622465 
## [4836]	train-rmse:1544.761206+0.201173	test-rmse:1544.767493+2.622477 
## [4837]	train-rmse:1544.607593+0.201660	test-rmse:1544.614014+2.622493 
## [4838]	train-rmse:1544.454016+0.200210	test-rmse:1544.460181+2.622386 
## [4839]	train-rmse:1544.299524+0.201873	test-rmse:1544.306445+2.622359 
## [4840]	train-rmse:1544.146509+0.200649	test-rmse:1544.152698+2.622428 
## [4841]	train-rmse:1543.992041+0.201943	test-rmse:1543.999243+2.622150 
## [4842]	train-rmse:1543.839185+0.200793	test-rmse:1543.845471+2.622228 
## [4843]	train-rmse:1543.684839+0.201778	test-rmse:1543.691565+2.622034 
## [4844]	train-rmse:1543.531506+0.201074	test-rmse:1543.537915+2.621949 
## [4845]	train-rmse:1543.377759+0.201224	test-rmse:1543.384509+2.621839 
## [4846]	train-rmse:1543.223877+0.201445	test-rmse:1543.230884+2.621776 
## [4847]	train-rmse:1543.070837+0.201048	test-rmse:1543.077319+2.621751 
## [4848]	train-rmse:1542.916870+0.201392	test-rmse:1542.923792+2.622032 
## [4849]	train-rmse:1542.763489+0.200178	test-rmse:1542.770191+2.621570 
## [4850]	train-rmse:1542.609802+0.201510	test-rmse:1542.616699+2.621462 
## [4851]	train-rmse:1542.456970+0.200221	test-rmse:1542.463001+2.621448 
## [4852]	train-rmse:1542.302869+0.201516	test-rmse:1542.309583+2.621667 
## [4853]	train-rmse:1542.149451+0.200820	test-rmse:1542.155945+2.621418 
## [4854]	train-rmse:1541.995947+0.201215	test-rmse:1542.002417+2.621411 
## [4855]	train-rmse:1541.842310+0.201173	test-rmse:1541.848987+2.621579 
## [4856]	train-rmse:1541.688879+0.200870	test-rmse:1541.695557+2.621351 
## [4857]	train-rmse:1541.535608+0.200638	test-rmse:1541.542029+2.621172 
## [4858]	train-rmse:1541.382336+0.200638	test-rmse:1541.388525+2.621108 
## [4859]	train-rmse:1541.228894+0.200846	test-rmse:1541.235339+2.621165 
## [4860]	train-rmse:1541.074927+0.200265	test-rmse:1541.081714+2.621111 
## [4861]	train-rmse:1540.922314+0.201291	test-rmse:1540.928430+2.621064 
## [4862]	train-rmse:1540.767908+0.200365	test-rmse:1540.775159+2.620986 
## [4863]	train-rmse:1540.615417+0.201901	test-rmse:1540.621863+2.620927 
## [4864]	train-rmse:1540.461401+0.200291	test-rmse:1540.468433+2.620726 
## [4865]	train-rmse:1540.308911+0.202043	test-rmse:1540.315002+2.620781 
## [4866]	train-rmse:1540.154456+0.200035	test-rmse:1540.161719+2.620840 
## [4867]	train-rmse:1540.002234+0.201580	test-rmse:1540.008459+2.620778 
## [4868]	train-rmse:1539.847790+0.200373	test-rmse:1539.855151+2.620613 
## [4869]	train-rmse:1539.695679+0.200544	test-rmse:1539.701953+2.620597 
## [4870]	train-rmse:1539.541736+0.200574	test-rmse:1539.548755+2.620519 
## [4871]	train-rmse:1539.388708+0.200820	test-rmse:1539.395496+2.620499 
## [4872]	train-rmse:1539.235559+0.200828	test-rmse:1539.242236+2.620294 
## [4873]	train-rmse:1539.081995+0.200451	test-rmse:1539.088782+2.620225 
## [4874]	train-rmse:1538.929639+0.200459	test-rmse:1538.935669+2.620284 
## [4875]	train-rmse:1538.775818+0.200177	test-rmse:1538.782751+2.620214 
## [4876]	train-rmse:1538.622876+0.200677	test-rmse:1538.629443+2.620033 
## [4877]	train-rmse:1538.469409+0.200230	test-rmse:1538.476550+2.620159 
## [4878]	train-rmse:1538.316614+0.200519	test-rmse:1538.323242+2.619928 
## [4879]	train-rmse:1538.163574+0.201045	test-rmse:1538.170178+2.619853 
## [4880]	train-rmse:1538.010864+0.200238	test-rmse:1538.016944+2.619898 
## [4881]	train-rmse:1537.857837+0.200670	test-rmse:1537.863989+2.619767 
## [4882]	train-rmse:1537.704785+0.200293	test-rmse:1537.711072+2.619655 
## [4883]	train-rmse:1537.551245+0.200229	test-rmse:1537.557983+2.619555 
## [4884]	train-rmse:1537.397717+0.200205	test-rmse:1537.404712+2.619785 
## [4885]	train-rmse:1537.244873+0.200829	test-rmse:1537.251868+2.619648 
## [4886]	train-rmse:1537.091590+0.200074	test-rmse:1537.098767+2.619450 
## [4887]	train-rmse:1536.938953+0.200409	test-rmse:1536.945899+2.619510 
## [4888]	train-rmse:1536.785779+0.200351	test-rmse:1536.792639+2.619417 
## [4889]	train-rmse:1536.633154+0.200331	test-rmse:1536.639929+2.619509 
## [4890]	train-rmse:1536.480102+0.199913	test-rmse:1536.486939+2.619308 
## [4891]	train-rmse:1536.327808+0.200121	test-rmse:1536.333985+2.619124 
## [4892]	train-rmse:1536.174121+0.200358	test-rmse:1536.181091+2.619194 
## [4893]	train-rmse:1536.021460+0.200485	test-rmse:1536.028345+2.619161 
## [4894]	train-rmse:1535.868530+0.200289	test-rmse:1535.875330+2.619142 
## [4895]	train-rmse:1535.715698+0.199496	test-rmse:1535.722449+2.618974 
## [4896]	train-rmse:1535.562817+0.200330	test-rmse:1535.569629+2.619044 
## [4897]	train-rmse:1535.410620+0.199525	test-rmse:1535.416711+2.618817 
## [4898]	train-rmse:1535.257019+0.200335	test-rmse:1535.264099+2.618965 
## [4899]	train-rmse:1535.103882+0.199795	test-rmse:1535.111255+2.618832 
## [4900]	train-rmse:1534.951587+0.200366	test-rmse:1534.958337+2.618741 
## [4901]	train-rmse:1534.798462+0.199638	test-rmse:1534.805505+2.618639 
## [4902]	train-rmse:1534.646497+0.200176	test-rmse:1534.652832+2.618679 
## [4903]	train-rmse:1534.493579+0.199533	test-rmse:1534.500122+2.618689 
## [4904]	train-rmse:1534.340479+0.199874	test-rmse:1534.347485+2.618289 
## [4905]	train-rmse:1534.187964+0.199840	test-rmse:1534.194702+2.618475 
## [4906]	train-rmse:1534.034973+0.199852	test-rmse:1534.041894+2.618405 
## [4907]	train-rmse:1533.882910+0.199896	test-rmse:1533.889392+2.618168 
## [4908]	train-rmse:1533.730188+0.199578	test-rmse:1533.736755+2.618077 
## [4909]	train-rmse:1533.577112+0.200198	test-rmse:1533.583887+2.618161 
## [4910]	train-rmse:1533.425159+0.199184	test-rmse:1533.431458+2.618128 
## [4911]	train-rmse:1533.271484+0.200354	test-rmse:1533.278845+2.617966 
## [4912]	train-rmse:1533.119751+0.199223	test-rmse:1533.126306+2.617929 
## [4913]	train-rmse:1532.966882+0.199527	test-rmse:1532.973633+2.617897 
## [4914]	train-rmse:1532.813818+0.199527	test-rmse:1532.821045+2.617984 
## [4915]	train-rmse:1532.661328+0.199342	test-rmse:1532.668494+2.617774 
## [4916]	train-rmse:1532.508838+0.199678	test-rmse:1532.515808+2.617788 
## [4917]	train-rmse:1532.355920+0.199737	test-rmse:1532.363220+2.617456 
## [4918]	train-rmse:1532.204309+0.199955	test-rmse:1532.210876+2.617629 
## [4919]	train-rmse:1532.050891+0.199454	test-rmse:1532.058447+2.617621 
## [4920]	train-rmse:1531.899463+0.199614	test-rmse:1531.905774+2.617538 
## [4921]	train-rmse:1531.746716+0.199076	test-rmse:1531.753430+2.617602 
## [4922]	train-rmse:1531.594507+0.199842	test-rmse:1531.601184+2.617271 
## [4923]	train-rmse:1531.441565+0.199028	test-rmse:1531.448462+2.617298 
## [4924]	train-rmse:1531.289111+0.199896	test-rmse:1531.296118+2.617191 
## [4925]	train-rmse:1531.137329+0.199476	test-rmse:1531.143860+2.617306 
## [4926]	train-rmse:1530.984229+0.199566	test-rmse:1530.991296+2.617145 
## [4927]	train-rmse:1530.833008+0.198521	test-rmse:1530.839075+2.617183 
## [4928]	train-rmse:1530.679187+0.199382	test-rmse:1530.686731+2.616951 
## [4929]	train-rmse:1530.527808+0.198977	test-rmse:1530.534253+2.616869 
## [4930]	train-rmse:1530.374768+0.199396	test-rmse:1530.381909+2.617030 
## [4931]	train-rmse:1530.223169+0.199267	test-rmse:1530.229578+2.616631 
## [4932]	train-rmse:1530.070251+0.198921	test-rmse:1530.077246+2.616710 
## [4933]	train-rmse:1529.918628+0.198833	test-rmse:1529.925183+2.616439 
## [4934]	train-rmse:1529.765600+0.199054	test-rmse:1529.772888+2.616881 
## [4935]	train-rmse:1529.613476+0.199220	test-rmse:1529.620459+2.616734 
## [4936]	train-rmse:1529.461316+0.198691	test-rmse:1529.468310+2.616626 
## [4937]	train-rmse:1529.309168+0.199417	test-rmse:1529.316028+2.616650 
## [4938]	train-rmse:1529.156970+0.198660	test-rmse:1529.163782+2.616437 
## [4939]	train-rmse:1529.004358+0.199432	test-rmse:1529.011585+2.616419 
## [4940]	train-rmse:1528.852807+0.198412	test-rmse:1528.859509+2.616203 
## [4941]	train-rmse:1528.700208+0.199511	test-rmse:1528.707410+2.616350 
## [4942]	train-rmse:1528.548303+0.198817	test-rmse:1528.555225+2.615939 
## [4943]	train-rmse:1528.395483+0.199176	test-rmse:1528.402905+2.616113 
## [4944]	train-rmse:1528.244214+0.199132	test-rmse:1528.250989+2.616002 
## [4945]	train-rmse:1528.091602+0.198855	test-rmse:1528.098914+2.616090 
## [4946]	train-rmse:1527.940222+0.199256	test-rmse:1527.946936+2.615831 
## [4947]	train-rmse:1527.787695+0.198677	test-rmse:1527.794702+2.615932 
## [4948]	train-rmse:1527.635755+0.199122	test-rmse:1527.642676+2.615917 
## [4949]	train-rmse:1527.483679+0.198408	test-rmse:1527.490430+2.615903 
## [4950]	train-rmse:1527.331787+0.199031	test-rmse:1527.338623+2.615841 
## [4951]	train-rmse:1527.180188+0.198274	test-rmse:1527.186584+2.615693 
## [4952]	train-rmse:1527.027417+0.199575	test-rmse:1527.034717+2.615765 
## [4953]	train-rmse:1526.875610+0.197763	test-rmse:1526.882788+2.615618 
## [4954]	train-rmse:1526.723425+0.199479	test-rmse:1526.730750+2.615398 
## [4955]	train-rmse:1526.571911+0.198358	test-rmse:1526.578760+2.615320 
## [4956]	train-rmse:1526.419556+0.199303	test-rmse:1526.426819+2.615397 
## [4957]	train-rmse:1526.268274+0.199024	test-rmse:1526.274963+2.615447 
## [4958]	train-rmse:1526.115344+0.199357	test-rmse:1526.122888+2.615291 
## [4959]	train-rmse:1525.964636+0.198543	test-rmse:1525.971204+2.615008 
## [4960]	train-rmse:1525.811792+0.198707	test-rmse:1525.819238+2.615153 
## [4961]	train-rmse:1525.660632+0.198950	test-rmse:1525.667322+2.615198 
## [4962]	train-rmse:1525.508581+0.198576	test-rmse:1525.515735+2.615187 
## [4963]	train-rmse:1525.357141+0.198969	test-rmse:1525.363843+2.614908 
## [4964]	train-rmse:1525.205225+0.198011	test-rmse:1525.211926+2.614924 
## [4965]	train-rmse:1525.052661+0.199029	test-rmse:1525.060119+2.614841 
## [4966]	train-rmse:1524.901465+0.197951	test-rmse:1524.908228+2.614751 
## [4967]	train-rmse:1524.749133+0.199032	test-rmse:1524.756555+2.614666 
## [4968]	train-rmse:1524.598084+0.198085	test-rmse:1524.604895+2.614822 
## [4969]	train-rmse:1524.446130+0.199484	test-rmse:1524.453076+2.614513 
## [4970]	train-rmse:1524.294641+0.197648	test-rmse:1524.301331+2.614434 
## [4971]	train-rmse:1524.142700+0.199010	test-rmse:1524.149915+2.614424 
## [4972]	train-rmse:1523.991077+0.198173	test-rmse:1523.998022+2.614506 
## [4973]	train-rmse:1523.839649+0.198070	test-rmse:1523.846179+2.614544 
## [4974]	train-rmse:1523.687915+0.198674	test-rmse:1523.694714+2.614577 
## [4975]	train-rmse:1523.535913+0.198216	test-rmse:1523.543079+2.614196 
## [4976]	train-rmse:1523.384558+0.198796	test-rmse:1523.391357+2.614241 
## [4977]	train-rmse:1523.232227+0.197044	test-rmse:1523.239783+2.613856 
## [4978]	train-rmse:1523.081140+0.199148	test-rmse:1523.088147+2.614186 
## [4979]	train-rmse:1522.929590+0.197721	test-rmse:1522.936462+2.614004 
## [4980]	train-rmse:1522.777612+0.198922	test-rmse:1522.785205+2.614030 
## [4981]	train-rmse:1522.625916+0.197448	test-rmse:1522.633411+2.613949 
## [4982]	train-rmse:1522.474756+0.198112	test-rmse:1522.481946+2.613789 
## [4983]	train-rmse:1522.323498+0.197789	test-rmse:1522.330310+2.613707 
## [4984]	train-rmse:1522.171667+0.197956	test-rmse:1522.178979+2.613714 
## [4985]	train-rmse:1522.020252+0.198204	test-rmse:1522.027478+2.613685 
## [4986]	train-rmse:1521.869019+0.198076	test-rmse:1521.876099+2.613671 
## [4987]	train-rmse:1521.717957+0.198323	test-rmse:1521.724512+2.613373 
## [4988]	train-rmse:1521.565332+0.197196	test-rmse:1521.572998+2.613644 
## [4989]	train-rmse:1521.415088+0.198735	test-rmse:1521.421838+2.613561 
## [4990]	train-rmse:1521.262476+0.197284	test-rmse:1521.270093+2.613372 
## [4991]	train-rmse:1521.111938+0.198760	test-rmse:1521.118847+2.613216 
## [4992]	train-rmse:1520.960144+0.196883	test-rmse:1520.967541+2.613306 
## [4993]	train-rmse:1520.809094+0.198002	test-rmse:1520.816199+2.613167 
## [4994]	train-rmse:1520.657288+0.196959	test-rmse:1520.664783+2.613281 
## [4995]	train-rmse:1520.506494+0.198208	test-rmse:1520.513635+2.612994 
## [4996]	train-rmse:1520.354480+0.198101	test-rmse:1520.362073+2.613234 
## [4997]	train-rmse:1520.203369+0.197876	test-rmse:1520.210742+2.613168 
## [4998]	train-rmse:1520.052356+0.198133	test-rmse:1520.059460+2.612935 
## [4999]	train-rmse:1519.900378+0.196865	test-rmse:1519.908020+2.612794 
## [5000]	train-rmse:1519.749817+0.198232	test-rmse:1519.757104+2.612983 
## [1]	train-rmse:2475.512769+0.383294	test-rmse:2475.508301+3.471923 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:2449.721558+0.379352	test-rmse:2449.718164+3.458663 
## [3]	train-rmse:2424.198950+0.376124	test-rmse:2424.197217+3.445740 
## [4]	train-rmse:2398.944678+0.371414	test-rmse:2398.943652+3.433316 
## [5]	train-rmse:2373.955615+0.369105	test-rmse:2373.950024+3.423250 
## [6]	train-rmse:2349.227612+0.364802	test-rmse:2349.221289+3.411324 
## [7]	train-rmse:2324.756665+0.361510	test-rmse:2324.751318+3.399931 
## [8]	train-rmse:2300.542627+0.357441	test-rmse:2300.545313+3.405268 
## [9]	train-rmse:2276.583130+0.354454	test-rmse:2276.580371+3.395887 
## [10]	train-rmse:2252.873315+0.350026	test-rmse:2252.875171+3.396466 
## [11]	train-rmse:2229.411157+0.347546	test-rmse:2229.408740+3.386818 
## [12]	train-rmse:2206.194873+0.342641	test-rmse:2206.193775+3.388101 
## [13]	train-rmse:2183.219507+0.340267	test-rmse:2183.217602+3.378841 
## [14]	train-rmse:2160.484839+0.336149	test-rmse:2160.480103+3.372527 
## [15]	train-rmse:2137.988696+0.333031	test-rmse:2137.987378+3.370928 
## [16]	train-rmse:2115.729053+0.328456	test-rmse:2115.722388+3.356244 
## [17]	train-rmse:2093.698682+0.326143	test-rmse:2093.702344+3.360672 
## [18]	train-rmse:2071.901270+0.322756	test-rmse:2071.900610+3.351939 
## [19]	train-rmse:2050.332007+0.318863	test-rmse:2050.334424+3.353279 
## [20]	train-rmse:2028.987341+0.316635	test-rmse:2028.986108+3.345211 
## [21]	train-rmse:2007.865662+0.312999	test-rmse:2007.866528+3.347490 
## [22]	train-rmse:1986.965784+0.310125	test-rmse:1986.964368+3.338472 
## [23]	train-rmse:1966.284167+0.306816	test-rmse:1966.286877+3.329276 
## [24]	train-rmse:1945.818127+0.303762	test-rmse:1945.821301+3.330705 
## [25]	train-rmse:1925.566394+0.301868	test-rmse:1925.568774+3.322461 
## [26]	train-rmse:1905.527356+0.298092	test-rmse:1905.536865+3.323328 
## [27]	train-rmse:1885.697131+0.295691	test-rmse:1885.704919+3.315843 
## [28]	train-rmse:1866.075818+0.292317	test-rmse:1866.088342+3.319884 
## [29]	train-rmse:1846.658581+0.289294	test-rmse:1846.664648+3.311612 
## [30]	train-rmse:1827.443701+0.285883	test-rmse:1827.461170+3.316172 
## [31]	train-rmse:1808.431347+0.283957	test-rmse:1808.439026+3.308489 
## [32]	train-rmse:1789.617175+0.280655	test-rmse:1789.630517+3.305132 
## [33]	train-rmse:1771.000659+0.278164	test-rmse:1771.010816+3.304246 
## [34]	train-rmse:1752.577405+0.275675	test-rmse:1752.590198+3.296975 
## [35]	train-rmse:1734.347436+0.271795	test-rmse:1734.363220+3.298116 
## [36]	train-rmse:1716.310254+0.270266	test-rmse:1716.321167+3.293336 
## [37]	train-rmse:1698.458899+0.267057	test-rmse:1698.476807+3.289796 
## [38]	train-rmse:1680.796948+0.264084	test-rmse:1680.808569+3.280600 
## [39]	train-rmse:1663.317395+0.261892	test-rmse:1663.333411+3.281214 
## [40]	train-rmse:1646.022754+0.259870	test-rmse:1646.032044+3.269810 
## [41]	train-rmse:1628.908057+0.256937	test-rmse:1628.917590+3.266975 
## [42]	train-rmse:1611.974085+0.254365	test-rmse:1611.974683+3.259003 
## [43]	train-rmse:1595.215259+0.251783	test-rmse:1595.219727+3.257052 
## [44]	train-rmse:1578.633240+0.248981	test-rmse:1578.631750+3.251248 
## [45]	train-rmse:1562.223804+0.246152	test-rmse:1562.226135+3.247419 
## [46]	train-rmse:1545.987439+0.243893	test-rmse:1545.990552+3.238362 
## [47]	train-rmse:1529.919714+0.240654	test-rmse:1529.919763+3.235370 
## [48]	train-rmse:1514.020618+0.239970	test-rmse:1514.020142+3.227709 
## [49]	train-rmse:1498.288916+0.236746	test-rmse:1498.289111+3.228989 
## [50]	train-rmse:1482.720605+0.233948	test-rmse:1482.718616+3.222495 
## [51]	train-rmse:1467.315857+0.231361	test-rmse:1467.313879+3.213955 
## [52]	train-rmse:1452.072510+0.229896	test-rmse:1452.067883+3.207053 
## [53]	train-rmse:1436.989429+0.226794	test-rmse:1436.985351+3.204371 
## [54]	train-rmse:1422.064014+0.224562	test-rmse:1422.066626+3.200757 
## [55]	train-rmse:1407.293591+0.221695	test-rmse:1407.295349+3.195415 
## [56]	train-rmse:1392.677954+0.220629	test-rmse:1392.678528+3.193862 
## [57]	train-rmse:1378.216821+0.218138	test-rmse:1378.218140+3.185176 
## [58]	train-rmse:1363.906811+0.215742	test-rmse:1363.904956+3.180014 
## [59]	train-rmse:1349.746875+0.213486	test-rmse:1349.747437+3.176565 
## [60]	train-rmse:1335.735034+0.211106	test-rmse:1335.736096+3.177761 
## [61]	train-rmse:1321.871399+0.208647	test-rmse:1321.871435+3.171633 
## [62]	train-rmse:1308.151270+0.207458	test-rmse:1308.152026+3.165249 
## [63]	train-rmse:1294.575061+0.205324	test-rmse:1294.574145+3.163439 
## [64]	train-rmse:1281.142285+0.202941	test-rmse:1281.143823+3.159984 
## [65]	train-rmse:1267.848901+0.200793	test-rmse:1267.848926+3.154898 
## [66]	train-rmse:1254.695606+0.198563	test-rmse:1254.694995+3.155864 
## [67]	train-rmse:1241.679175+0.197428	test-rmse:1241.682898+3.146135 
## [68]	train-rmse:1228.800537+0.194430	test-rmse:1228.805701+3.148308 
## [69]	train-rmse:1216.056848+0.192457	test-rmse:1216.061780+3.146696 
## [70]	train-rmse:1203.446777+0.190833	test-rmse:1203.456299+3.144020 
## [71]	train-rmse:1190.968970+0.188098	test-rmse:1190.984631+3.139598 
## [72]	train-rmse:1178.621765+0.186679	test-rmse:1178.637171+3.132171 
## [73]	train-rmse:1166.403760+0.184403	test-rmse:1166.417602+3.126179 
## [74]	train-rmse:1154.315063+0.183167	test-rmse:1154.333215+3.121462 
## [75]	train-rmse:1142.351758+0.181673	test-rmse:1142.365076+3.113976 
## [76]	train-rmse:1130.515430+0.179253	test-rmse:1130.526184+3.113513 
## [77]	train-rmse:1118.802612+0.177771	test-rmse:1118.816882+3.112329 
## [78]	train-rmse:1107.213062+0.175862	test-rmse:1107.228552+3.112223 
## [79]	train-rmse:1095.745251+0.173804	test-rmse:1095.758508+3.109807 
## [80]	train-rmse:1084.397083+0.172179	test-rmse:1084.414331+3.105978 
## [81]	train-rmse:1073.168128+0.170366	test-rmse:1073.187073+3.099038 
## [82]	train-rmse:1062.059009+0.169480	test-rmse:1062.072058+3.094174 
## [83]	train-rmse:1051.064551+0.167019	test-rmse:1051.076318+3.094628 
## [84]	train-rmse:1040.185779+0.166245	test-rmse:1040.194959+3.091380 
## [85]	train-rmse:1029.422913+0.165079	test-rmse:1029.430286+3.079771 
## [86]	train-rmse:1018.771478+0.162774	test-rmse:1018.777283+3.079308 
## [87]	train-rmse:1008.232526+0.161456	test-rmse:1008.243695+3.075350 
## [88]	train-rmse:997.804218+0.159174	test-rmse:997.819055+3.075841 
## [89]	train-rmse:987.485077+0.158383	test-rmse:987.496814+3.065063 
## [90]	train-rmse:977.275086+0.156299	test-rmse:977.286749+3.065015 
## [91]	train-rmse:967.172339+0.155046	test-rmse:967.186206+3.057589 
## [92]	train-rmse:957.176257+0.153148	test-rmse:957.183331+3.053362 
## [93]	train-rmse:947.284973+0.151563	test-rmse:947.294946+3.050638 
## [94]	train-rmse:937.496655+0.149680	test-rmse:937.504913+3.048192 
## [95]	train-rmse:927.813275+0.148509	test-rmse:927.824402+3.047088 
## [96]	train-rmse:918.231189+0.146883	test-rmse:918.241821+3.049454 
## [97]	train-rmse:908.749402+0.145895	test-rmse:908.760071+3.044453 
## [98]	train-rmse:899.367706+0.144087	test-rmse:899.380682+3.046520 
## [99]	train-rmse:890.084705+0.143663	test-rmse:890.095709+3.042112 
## [100]	train-rmse:880.899676+0.141466	test-rmse:880.914801+3.039177 
## [101]	train-rmse:871.811304+0.141288	test-rmse:871.828803+3.035450 
## [102]	train-rmse:862.818140+0.138731	test-rmse:862.837128+3.034616 
## [103]	train-rmse:853.920203+0.138156	test-rmse:853.939539+3.032296 
## [104]	train-rmse:845.116284+0.136847	test-rmse:845.133173+3.028958 
## [105]	train-rmse:836.404913+0.134504	test-rmse:836.430573+3.023976 
## [106]	train-rmse:827.786585+0.133742	test-rmse:827.811054+3.018748 
## [107]	train-rmse:819.256909+0.131840	test-rmse:819.284643+3.016930 
## [108]	train-rmse:810.818982+0.130703	test-rmse:810.846771+3.012825 
## [109]	train-rmse:802.468915+0.129563	test-rmse:802.499054+3.010001 
## [110]	train-rmse:794.208331+0.127680	test-rmse:794.239960+3.010797 
## [111]	train-rmse:786.033679+0.127217	test-rmse:786.062427+3.007819 
## [112]	train-rmse:777.946222+0.125745	test-rmse:777.979645+3.002720 
## [113]	train-rmse:769.943793+0.124878	test-rmse:769.977136+2.999463 
## [114]	train-rmse:762.025830+0.123225	test-rmse:762.063727+2.997574 
## [115]	train-rmse:754.191846+0.122080	test-rmse:754.227045+2.997066 
## [116]	train-rmse:746.440393+0.120916	test-rmse:746.476868+2.995936 
## [117]	train-rmse:738.771307+0.119489	test-rmse:738.805011+2.994994 
## [118]	train-rmse:731.182788+0.118418	test-rmse:731.221240+2.996330 
## [119]	train-rmse:723.675000+0.117109	test-rmse:723.715417+2.993777 
## [120]	train-rmse:716.246497+0.116349	test-rmse:716.287427+2.988726 
## [121]	train-rmse:708.896844+0.115320	test-rmse:708.942706+2.988152 
## [122]	train-rmse:701.624555+0.113974	test-rmse:701.671344+2.985954 
## [123]	train-rmse:694.429926+0.112951	test-rmse:694.475128+2.987318 
## [124]	train-rmse:687.310925+0.112154	test-rmse:687.361578+2.984862 
## [125]	train-rmse:680.267475+0.110491	test-rmse:680.317285+2.982713 
## [126]	train-rmse:673.298767+0.110397	test-rmse:673.347925+2.981811 
## [127]	train-rmse:666.403961+0.108385	test-rmse:666.457483+2.983798 
## [128]	train-rmse:659.582001+0.106961	test-rmse:659.638238+2.981446 
## [129]	train-rmse:652.832770+0.106554	test-rmse:652.889545+2.983790 
## [130]	train-rmse:646.155591+0.105623	test-rmse:646.214422+2.984334 
## [131]	train-rmse:639.548761+0.104751	test-rmse:639.608716+2.983822 
## [132]	train-rmse:633.012756+0.103431	test-rmse:633.078467+2.985353 
## [133]	train-rmse:626.545447+0.102118	test-rmse:626.614014+2.986616 
## [134]	train-rmse:620.147497+0.101013	test-rmse:620.214844+2.985070 
## [135]	train-rmse:613.817279+0.099902	test-rmse:613.891589+2.984099 
## [136]	train-rmse:607.554425+0.098686	test-rmse:607.636536+2.984016 
## [137]	train-rmse:601.358423+0.097736	test-rmse:601.441284+2.984268 
## [138]	train-rmse:595.228418+0.096983	test-rmse:595.314392+2.983865 
## [139]	train-rmse:589.163458+0.095954	test-rmse:589.250275+2.985752 
## [140]	train-rmse:583.162811+0.095034	test-rmse:583.249841+2.979576 
## [141]	train-rmse:577.226709+0.094280	test-rmse:577.320001+2.978109 
## [142]	train-rmse:571.354132+0.092994	test-rmse:571.449512+2.974709 
## [143]	train-rmse:565.543060+0.092130	test-rmse:565.640949+2.974059 
## [144]	train-rmse:559.795324+0.091333	test-rmse:559.894550+2.973638 
## [145]	train-rmse:554.108276+0.090158	test-rmse:554.212775+2.973374 
## [146]	train-rmse:548.482581+0.089393	test-rmse:548.587811+2.975109 
## [147]	train-rmse:542.915918+0.088149	test-rmse:543.021790+2.971076 
## [148]	train-rmse:537.410169+0.087382	test-rmse:537.519842+2.969034 
## [149]	train-rmse:531.962335+0.086409	test-rmse:532.075257+2.968841 
## [150]	train-rmse:526.572967+0.085106	test-rmse:526.686969+2.966140 
## [151]	train-rmse:521.241827+0.084566	test-rmse:521.356152+2.967184 
## [152]	train-rmse:515.967420+0.083421	test-rmse:516.084949+2.965581 
## [153]	train-rmse:510.749573+0.082564	test-rmse:510.867786+2.966956 
## [154]	train-rmse:505.587582+0.081960	test-rmse:505.710437+2.966918 
## [155]	train-rmse:500.481375+0.080573	test-rmse:500.604480+2.964676 
## [156]	train-rmse:495.429959+0.079837	test-rmse:495.551559+2.961581 
## [157]	train-rmse:490.432373+0.079295	test-rmse:490.556665+2.960900 
## [158]	train-rmse:485.488989+0.077831	test-rmse:485.615784+2.960983 
## [159]	train-rmse:480.598349+0.076989	test-rmse:480.726886+2.961826 
## [160]	train-rmse:475.760693+0.076640	test-rmse:475.893036+2.961445 
## [161]	train-rmse:470.974774+0.076218	test-rmse:471.108826+2.961960 
## [162]	train-rmse:466.240533+0.075255	test-rmse:466.380743+2.955967 
## [163]	train-rmse:461.557727+0.074356	test-rmse:461.702896+2.957919 
## [164]	train-rmse:456.924796+0.073780	test-rmse:457.070792+2.954796 
## [165]	train-rmse:452.342093+0.072590	test-rmse:452.496719+2.947613 
## [166]	train-rmse:447.808945+0.072341	test-rmse:447.965415+2.947224 
## [167]	train-rmse:443.324811+0.071443	test-rmse:443.483963+2.949453 
## [168]	train-rmse:438.889008+0.070657	test-rmse:439.055203+2.951616 
## [169]	train-rmse:434.501511+0.070271	test-rmse:434.673721+2.946853 
## [170]	train-rmse:430.161151+0.069315	test-rmse:430.333285+2.943383 
## [171]	train-rmse:425.868112+0.069246	test-rmse:426.043518+2.941419 
## [172]	train-rmse:421.621219+0.068020	test-rmse:421.801120+2.935422 
## [173]	train-rmse:417.420880+0.067791	test-rmse:417.605063+2.935472 
## [174]	train-rmse:413.265482+0.066953	test-rmse:413.453790+2.931974 
## [175]	train-rmse:409.155496+0.066772	test-rmse:409.346625+2.932060 
## [176]	train-rmse:405.090213+0.066379	test-rmse:405.289465+2.929219 
## [177]	train-rmse:401.069134+0.065894	test-rmse:401.273557+2.928090 
## [178]	train-rmse:397.091891+0.065491	test-rmse:397.305493+2.920748 
## [179]	train-rmse:393.157941+0.065050	test-rmse:393.376889+2.918508 
## [180]	train-rmse:389.266840+0.064546	test-rmse:389.492719+2.910321 
## [181]	train-rmse:385.418054+0.064072	test-rmse:385.651748+2.907914 
## [182]	train-rmse:381.611530+0.063656	test-rmse:381.850909+2.906215 
## [183]	train-rmse:377.846607+0.062852	test-rmse:378.089969+2.900440 
## [184]	train-rmse:374.122757+0.062675	test-rmse:374.376477+2.897045 
## [185]	train-rmse:370.439273+0.062300	test-rmse:370.698953+2.898025 
## [186]	train-rmse:366.796588+0.061886	test-rmse:367.064682+2.893979 
## [187]	train-rmse:363.194141+0.061725	test-rmse:363.472067+2.891714 
## [188]	train-rmse:359.630652+0.061475	test-rmse:359.918723+2.892412 
## [189]	train-rmse:356.106464+0.061088	test-rmse:356.402417+2.888513 
## [190]	train-rmse:352.620871+0.060730	test-rmse:352.929581+2.888416 
## [191]	train-rmse:349.173733+0.060384	test-rmse:349.490683+2.885417 
## [192]	train-rmse:345.764905+0.060370	test-rmse:346.090515+2.880280 
## [193]	train-rmse:342.393045+0.060057	test-rmse:342.728955+2.875250 
## [194]	train-rmse:339.058942+0.059682	test-rmse:339.403943+2.871792 
## [195]	train-rmse:335.761313+0.059882	test-rmse:336.113769+2.868636 
## [196]	train-rmse:332.500137+0.059964	test-rmse:332.867242+2.864668 
## [197]	train-rmse:329.274994+0.059637	test-rmse:329.651910+2.859713 
## [198]	train-rmse:326.086102+0.059696	test-rmse:326.475970+2.858954 
## [199]	train-rmse:322.932190+0.059597	test-rmse:323.334277+2.853702 
## [200]	train-rmse:319.813345+0.059726	test-rmse:320.222079+2.852450 
## [201]	train-rmse:316.729181+0.059442	test-rmse:317.149570+2.848112 
## [202]	train-rmse:313.679892+0.059594	test-rmse:314.113669+2.841638 
## [203]	train-rmse:310.663620+0.059914	test-rmse:311.104376+2.842265 
## [204]	train-rmse:307.681708+0.060170	test-rmse:308.133408+2.839257 
## [205]	train-rmse:304.732816+0.060389	test-rmse:305.197220+2.830905 
## [206]	train-rmse:301.816449+0.060318	test-rmse:302.289386+2.824452 
## [207]	train-rmse:298.933234+0.060313	test-rmse:299.418625+2.819726 
## [208]	train-rmse:296.082132+0.060979	test-rmse:296.583090+2.814007 
## [209]	train-rmse:293.263055+0.061990	test-rmse:293.773459+2.805774 
## [210]	train-rmse:290.476010+0.062342	test-rmse:290.997568+2.799874 
## [211]	train-rmse:287.719928+0.062387	test-rmse:288.256552+2.796886 
## [212]	train-rmse:284.994925+0.063025	test-rmse:285.545151+2.795791 
## [213]	train-rmse:282.300272+0.063587	test-rmse:282.862524+2.790024 
## [214]	train-rmse:279.636066+0.064629	test-rmse:280.208389+2.789615 
## [215]	train-rmse:277.002948+0.064810	test-rmse:277.589096+2.782544 
## [216]	train-rmse:274.399167+0.065100	test-rmse:274.997906+2.777085 
## [217]	train-rmse:271.824649+0.066020	test-rmse:272.439121+2.772247 
## [218]	train-rmse:269.279938+0.066090	test-rmse:269.915299+2.770228 
## [219]	train-rmse:266.763199+0.066846	test-rmse:267.415878+2.764689 
## [220]	train-rmse:264.276370+0.067931	test-rmse:264.942572+2.761665 
## [221]	train-rmse:261.816910+0.068268	test-rmse:262.499112+2.751102 
## [222]	train-rmse:259.385916+0.068619	test-rmse:260.079697+2.748271 
## [223]	train-rmse:256.982245+0.068735	test-rmse:257.696565+2.737623 
## [224]	train-rmse:254.606656+0.069682	test-rmse:255.337721+2.736045 
## [225]	train-rmse:252.257904+0.071348	test-rmse:253.005078+2.731529 
## [226]	train-rmse:249.936919+0.072011	test-rmse:250.698479+2.721768 
## [227]	train-rmse:247.642066+0.072606	test-rmse:248.422087+2.720376 
## [228]	train-rmse:245.374202+0.072569	test-rmse:246.167270+2.714881 
## [229]	train-rmse:243.131601+0.073896	test-rmse:243.945753+2.706926 
## [230]	train-rmse:240.915279+0.074680	test-rmse:241.746547+2.703610 
## [231]	train-rmse:238.724658+0.074631	test-rmse:239.573984+2.697784 
## [232]	train-rmse:236.560626+0.075255	test-rmse:237.426569+2.692173 
## [233]	train-rmse:234.420821+0.075779	test-rmse:235.302065+2.683171 
## [234]	train-rmse:232.305722+0.076070	test-rmse:233.206206+2.676050 
## [235]	train-rmse:230.216263+0.077686	test-rmse:231.136777+2.670865 
## [236]	train-rmse:228.149838+0.078875	test-rmse:229.087906+2.665784 
## [237]	train-rmse:226.108917+0.078899	test-rmse:227.066359+2.659682 
## [238]	train-rmse:224.091414+0.079696	test-rmse:225.070201+2.653616 
## [239]	train-rmse:222.097002+0.080159	test-rmse:223.098044+2.648177 
## [240]	train-rmse:220.127229+0.080657	test-rmse:221.147533+2.643439 
## [241]	train-rmse:218.181070+0.081709	test-rmse:219.222658+2.638362 
## [242]	train-rmse:216.256105+0.081835	test-rmse:217.316264+2.630753 
## [243]	train-rmse:214.355089+0.083234	test-rmse:215.437697+2.620997 
## [244]	train-rmse:212.476295+0.083814	test-rmse:213.581131+2.617007 
## [245]	train-rmse:210.619994+0.084755	test-rmse:211.745363+2.613179 
## [246]	train-rmse:208.787026+0.086407	test-rmse:209.930432+2.605169 
## [247]	train-rmse:206.975346+0.086593	test-rmse:208.138164+2.602483 
## [248]	train-rmse:205.185068+0.087494	test-rmse:206.367928+2.596274 
## [249]	train-rmse:203.415955+0.088390	test-rmse:204.620926+2.588745 
## [250]	train-rmse:201.668813+0.088499	test-rmse:202.893974+2.584117 
## [251]	train-rmse:199.942548+0.089389	test-rmse:201.187351+2.575856 
## [252]	train-rmse:198.236026+0.090329	test-rmse:199.504994+2.569401 
## [253]	train-rmse:196.550845+0.090180	test-rmse:197.844482+2.562560 
## [254]	train-rmse:194.886923+0.091877	test-rmse:196.200430+2.557238 
## [255]	train-rmse:193.242432+0.092672	test-rmse:194.576170+2.551345 
## [256]	train-rmse:191.618208+0.092973	test-rmse:192.977269+2.547503 
## [257]	train-rmse:190.014000+0.093414	test-rmse:191.398557+2.541653 
## [258]	train-rmse:188.429492+0.095031	test-rmse:189.839175+2.537671 
## [259]	train-rmse:186.864892+0.096009	test-rmse:188.298312+2.528304 
## [260]	train-rmse:185.319041+0.096827	test-rmse:186.776243+2.521418 
## [261]	train-rmse:183.791637+0.098256	test-rmse:185.274611+2.516499 
## [262]	train-rmse:182.284048+0.099389	test-rmse:183.791995+2.510900 
## [263]	train-rmse:180.795247+0.099449	test-rmse:182.324536+2.502992 
## [264]	train-rmse:179.324876+0.101066	test-rmse:180.882283+2.498989 
## [265]	train-rmse:177.873347+0.102216	test-rmse:179.453366+2.492985 
## [266]	train-rmse:176.440236+0.102056	test-rmse:178.045720+2.487006 
## [267]	train-rmse:175.024702+0.103392	test-rmse:176.652644+2.483509 
## [268]	train-rmse:173.627091+0.104309	test-rmse:175.283995+2.474624 
## [269]	train-rmse:172.246043+0.105595	test-rmse:173.929924+2.469218 
## [270]	train-rmse:170.882735+0.106606	test-rmse:172.592128+2.463352 
## [271]	train-rmse:169.537266+0.108254	test-rmse:171.270538+2.455709 
## [272]	train-rmse:168.209080+0.109135	test-rmse:169.967806+2.448700 
## [273]	train-rmse:166.897855+0.109915	test-rmse:168.680902+2.444531 
## [274]	train-rmse:165.603185+0.110752	test-rmse:167.409343+2.439082 
## [275]	train-rmse:164.326247+0.111894	test-rmse:166.154182+2.433279 
## [276]	train-rmse:163.064764+0.112240	test-rmse:164.920513+2.427986 
## [277]	train-rmse:161.818155+0.114540	test-rmse:163.702728+2.422362 
## [278]	train-rmse:160.589441+0.115485	test-rmse:162.500528+2.416633 
## [279]	train-rmse:159.376002+0.116752	test-rmse:161.310406+2.406530 
## [280]	train-rmse:158.177737+0.118072	test-rmse:160.144659+2.400682 
## [281]	train-rmse:156.995104+0.118056	test-rmse:158.987762+2.395063 
## [282]	train-rmse:155.827403+0.119694	test-rmse:157.847771+2.388221 
## [283]	train-rmse:154.675657+0.120531	test-rmse:156.726001+2.383067 
## [284]	train-rmse:153.539647+0.121936	test-rmse:155.615445+2.377154 
## [285]	train-rmse:152.418037+0.123162	test-rmse:154.522815+2.370085 
## [286]	train-rmse:151.311609+0.123280	test-rmse:153.444322+2.363091 
## [287]	train-rmse:150.219794+0.124183	test-rmse:152.381323+2.358649 
## [288]	train-rmse:149.141573+0.125266	test-rmse:151.332184+2.352792 
## [289]	train-rmse:148.076895+0.127098	test-rmse:150.298613+2.346295 
## [290]	train-rmse:147.028175+0.127507	test-rmse:149.279889+2.342691 
## [291]	train-rmse:145.992836+0.128417	test-rmse:148.272537+2.335916 
## [292]	train-rmse:144.972275+0.129226	test-rmse:147.279887+2.329176 
## [293]	train-rmse:143.964160+0.129607	test-rmse:146.300433+2.323679 
## [294]	train-rmse:142.970386+0.130717	test-rmse:145.335615+2.319606 
## [295]	train-rmse:141.989082+0.131230	test-rmse:144.384642+2.314085 
## [296]	train-rmse:141.021150+0.132485	test-rmse:143.447908+2.303961 
## [297]	train-rmse:140.067621+0.133494	test-rmse:142.526399+2.298111 
## [298]	train-rmse:139.127313+0.133832	test-rmse:141.613947+2.293624 
## [299]	train-rmse:138.199817+0.134680	test-rmse:140.717108+2.290355 
## [300]	train-rmse:137.284615+0.136348	test-rmse:139.834477+2.286477 
## [301]	train-rmse:136.381744+0.137363	test-rmse:138.961191+2.278156 
## [302]	train-rmse:135.492685+0.138198	test-rmse:138.102263+2.271262 
## [303]	train-rmse:134.614914+0.137885	test-rmse:137.255374+2.265830 
## [304]	train-rmse:133.749941+0.139417	test-rmse:136.418495+2.259099 
## [305]	train-rmse:132.895376+0.140493	test-rmse:135.596336+2.253764 
## [306]	train-rmse:132.054219+0.142154	test-rmse:134.787010+2.251321 
## [307]	train-rmse:131.225436+0.142593	test-rmse:133.989894+2.248441 
## [308]	train-rmse:130.406984+0.142745	test-rmse:133.204334+2.241000 
## [309]	train-rmse:129.600537+0.143829	test-rmse:132.431241+2.241508 
## [310]	train-rmse:128.805208+0.145018	test-rmse:131.668616+2.235931 
## [311]	train-rmse:128.022002+0.146106	test-rmse:130.916994+2.233621 
## [312]	train-rmse:127.250867+0.146785	test-rmse:130.174463+2.227049 
## [313]	train-rmse:126.489015+0.147895	test-rmse:129.446905+2.220779 
## [314]	train-rmse:125.739035+0.148967	test-rmse:128.726811+2.219648 
## [315]	train-rmse:124.999096+0.150778	test-rmse:128.019599+2.216211 
## [316]	train-rmse:124.268716+0.151549	test-rmse:127.319354+2.209201 
## [317]	train-rmse:123.550748+0.151457	test-rmse:126.633865+2.203708 
## [318]	train-rmse:122.842323+0.152898	test-rmse:125.957044+2.201262 
## [319]	train-rmse:122.145567+0.153411	test-rmse:125.292291+2.194484 
## [320]	train-rmse:121.459023+0.155133	test-rmse:124.636939+2.191469 
## [321]	train-rmse:120.781405+0.156321	test-rmse:123.994296+2.187830 
## [322]	train-rmse:120.113140+0.156199	test-rmse:123.359489+2.184657 
## [323]	train-rmse:119.455709+0.156608	test-rmse:122.736239+2.177726 
## [324]	train-rmse:118.808839+0.158277	test-rmse:122.121171+2.176370 
## [325]	train-rmse:118.169629+0.158669	test-rmse:121.511556+2.171172 
## [326]	train-rmse:117.540463+0.158807	test-rmse:120.917318+2.166879 
## [327]	train-rmse:116.919707+0.158737	test-rmse:120.327530+2.163840 
## [328]	train-rmse:116.308229+0.159311	test-rmse:119.748968+2.160348 
## [329]	train-rmse:115.706794+0.161554	test-rmse:119.179497+2.156375 
## [330]	train-rmse:115.115718+0.163356	test-rmse:118.618638+2.152138 
## [331]	train-rmse:114.531034+0.164028	test-rmse:118.067765+2.150011 
## [332]	train-rmse:113.957198+0.163365	test-rmse:117.525909+2.143216 
## [333]	train-rmse:113.390491+0.164667	test-rmse:116.991979+2.139554 
## [334]	train-rmse:112.834328+0.164206	test-rmse:116.470263+2.134072 
## [335]	train-rmse:112.285972+0.165679	test-rmse:115.952862+2.130956 
## [336]	train-rmse:111.745010+0.165270	test-rmse:115.443935+2.126259 
## [337]	train-rmse:111.212926+0.164539	test-rmse:114.943845+2.122487 
## [338]	train-rmse:110.687579+0.166183	test-rmse:114.449632+2.121624 
## [339]	train-rmse:110.171598+0.166342	test-rmse:113.966785+2.111636 
## [340]	train-rmse:109.661147+0.168041	test-rmse:113.491440+2.104849 
## [341]	train-rmse:109.161864+0.168321	test-rmse:113.022002+2.098919 
## [342]	train-rmse:108.670076+0.169989	test-rmse:112.561922+2.094832 
## [343]	train-rmse:108.184258+0.172232	test-rmse:112.111407+2.091816 
## [344]	train-rmse:107.705485+0.173152	test-rmse:111.667484+2.087738 
## [345]	train-rmse:107.235288+0.173654	test-rmse:111.229802+2.086695 
## [346]	train-rmse:106.773589+0.174656	test-rmse:110.801747+2.081850 
## [347]	train-rmse:106.318484+0.176157	test-rmse:110.377064+2.078231 
## [348]	train-rmse:105.871355+0.177266	test-rmse:109.961429+2.074463 
## [349]	train-rmse:105.429520+0.177877	test-rmse:109.552071+2.070562 
## [350]	train-rmse:104.992645+0.179326	test-rmse:109.152025+2.064918 
## [351]	train-rmse:104.565226+0.179807	test-rmse:108.759132+2.061981 
## [352]	train-rmse:104.144699+0.181349	test-rmse:108.372673+2.057652 
## [353]	train-rmse:103.728915+0.181892	test-rmse:107.988816+2.054931 
## [354]	train-rmse:103.322135+0.184476	test-rmse:107.613240+2.050713 
## [355]	train-rmse:102.921671+0.185819	test-rmse:107.244426+2.048953 
## [356]	train-rmse:102.527573+0.187892	test-rmse:106.883720+2.043531 
## [357]	train-rmse:102.139978+0.188704	test-rmse:106.527852+2.042773 
## [358]	train-rmse:101.758746+0.190146	test-rmse:106.176611+2.041446 
## [359]	train-rmse:101.385745+0.190974	test-rmse:105.834042+2.038359 
## [360]	train-rmse:101.014970+0.189527	test-rmse:105.498232+2.034863 
## [361]	train-rmse:100.651217+0.190581	test-rmse:105.167027+2.034109 
## [362]	train-rmse:100.292156+0.192281	test-rmse:104.837406+2.033085 
## [363]	train-rmse:99.940490+0.195031	test-rmse:104.517704+2.033758 
## [364]	train-rmse:99.596475+0.195626	test-rmse:104.203741+2.029611 
## [365]	train-rmse:99.257152+0.196075	test-rmse:103.898170+2.027819 
## [366]	train-rmse:98.922859+0.199347	test-rmse:103.593583+2.027705 
## [367]	train-rmse:98.592678+0.198584	test-rmse:103.296524+2.025171 
## [368]	train-rmse:98.270325+0.198015	test-rmse:103.004028+2.022691 
## [369]	train-rmse:97.951578+0.200094	test-rmse:102.715305+2.022109 
## [370]	train-rmse:97.639111+0.202148	test-rmse:102.431550+2.020175 
## [371]	train-rmse:97.330332+0.202191	test-rmse:102.156059+2.017584 
## [372]	train-rmse:97.027537+0.205819	test-rmse:101.883363+2.015908 
## [373]	train-rmse:96.728454+0.205689	test-rmse:101.617470+2.015985 
## [374]	train-rmse:96.436614+0.207012	test-rmse:101.356751+2.016430 
## [375]	train-rmse:96.148406+0.206927	test-rmse:101.099012+2.015756 
## [376]	train-rmse:95.865097+0.207343	test-rmse:100.846142+2.015948 
## [377]	train-rmse:95.586337+0.209846	test-rmse:100.598177+2.012638 
## [378]	train-rmse:95.313400+0.210941	test-rmse:100.354758+2.012406 
## [379]	train-rmse:95.045530+0.213805	test-rmse:100.115357+2.012873 
## [380]	train-rmse:94.780425+0.213929	test-rmse:99.881742+2.012564 
## [381]	train-rmse:94.519570+0.216278	test-rmse:99.651168+2.012792 
## [382]	train-rmse:94.263139+0.215840	test-rmse:99.425886+2.013058 
## [383]	train-rmse:94.011664+0.218202	test-rmse:99.204268+2.013211 
## [384]	train-rmse:93.763182+0.220054	test-rmse:98.986872+2.013886 
## [385]	train-rmse:93.518150+0.220718	test-rmse:98.771332+2.014213 
## [386]	train-rmse:93.278611+0.222234	test-rmse:98.560124+2.013858 
## [387]	train-rmse:93.042895+0.225038	test-rmse:98.353877+2.015420 
## [388]	train-rmse:92.811448+0.224087	test-rmse:98.152900+2.014854 
## [389]	train-rmse:92.584727+0.225648	test-rmse:97.954252+2.016086 
## [390]	train-rmse:92.360052+0.227833	test-rmse:97.759122+2.017376 
## [391]	train-rmse:92.141588+0.228549	test-rmse:97.568080+2.018675 
## [392]	train-rmse:91.923379+0.228283	test-rmse:97.378793+2.019055 
## [393]	train-rmse:91.711280+0.229250	test-rmse:97.195633+2.018247 
## [394]	train-rmse:91.501682+0.231260	test-rmse:97.013535+2.017856 
## [395]	train-rmse:91.295644+0.231590	test-rmse:96.835381+2.019703 
## [396]	train-rmse:91.092144+0.230377	test-rmse:96.661561+2.018672 
## [397]	train-rmse:90.892244+0.230668	test-rmse:96.490211+2.017647 
## [398]	train-rmse:90.698355+0.229208	test-rmse:96.322802+2.017120 
## [399]	train-rmse:90.506571+0.229504	test-rmse:96.160886+2.016643 
## [400]	train-rmse:90.318428+0.228763	test-rmse:95.999330+2.018681 
## [401]	train-rmse:90.132228+0.229135	test-rmse:95.843807+2.021270 
## [402]	train-rmse:89.949657+0.228266	test-rmse:95.688625+2.020918 
## [403]	train-rmse:89.767865+0.228308	test-rmse:95.535273+2.024527 
## [404]	train-rmse:89.589656+0.230811	test-rmse:95.389149+2.026625 
## [405]	train-rmse:89.415061+0.231153	test-rmse:95.243321+2.026402 
## [406]	train-rmse:89.243201+0.231171	test-rmse:95.101630+2.027917 
## [407]	train-rmse:89.074978+0.228621	test-rmse:94.959947+2.032503 
## [408]	train-rmse:88.908464+0.228733	test-rmse:94.820592+2.033142 
## [409]	train-rmse:88.747002+0.228772	test-rmse:94.684548+2.034808 
## [410]	train-rmse:88.585075+0.228699	test-rmse:94.551317+2.034751 
## [411]	train-rmse:88.428857+0.229636	test-rmse:94.419200+2.032750 
## [412]	train-rmse:88.273720+0.230019	test-rmse:94.293482+2.035766 
## [413]	train-rmse:88.122613+0.229534	test-rmse:94.166129+2.037232 
## [414]	train-rmse:87.972260+0.231232	test-rmse:94.042607+2.038329 
## [415]	train-rmse:87.824493+0.234252	test-rmse:93.920447+2.040737 
## [416]	train-rmse:87.679160+0.234470	test-rmse:93.803618+2.041693 
## [417]	train-rmse:87.537798+0.234548	test-rmse:93.686585+2.040118 
## [418]	train-rmse:87.397204+0.234548	test-rmse:93.569905+2.038745 
## [419]	train-rmse:87.261472+0.234018	test-rmse:93.460383+2.039102 
## [420]	train-rmse:87.127673+0.233119	test-rmse:93.353306+2.041630 
## [421]	train-rmse:86.993865+0.231458	test-rmse:93.242144+2.040953 
## [422]	train-rmse:86.864086+0.231963	test-rmse:93.138178+2.039698 
## [423]	train-rmse:86.734846+0.231804	test-rmse:93.035910+2.040740 
## [424]	train-rmse:86.609381+0.233673	test-rmse:92.936431+2.044226 
## [425]	train-rmse:86.486137+0.234214	test-rmse:92.834952+2.043173 
## [426]	train-rmse:86.364886+0.233432	test-rmse:92.737605+2.046015 
## [427]	train-rmse:86.245283+0.234554	test-rmse:92.640496+2.047024 
## [428]	train-rmse:86.125993+0.235939	test-rmse:92.545331+2.050491 
## [429]	train-rmse:86.010509+0.236155	test-rmse:92.456076+2.050935 
## [430]	train-rmse:85.895757+0.236349	test-rmse:92.366823+2.054424 
## [431]	train-rmse:85.783756+0.238744	test-rmse:92.278489+2.054054 
## [432]	train-rmse:85.671035+0.237974	test-rmse:92.194116+2.054772 
## [433]	train-rmse:85.562084+0.237489	test-rmse:92.111124+2.057002 
## [434]	train-rmse:85.457639+0.239170	test-rmse:92.029293+2.060592 
## [435]	train-rmse:85.353131+0.240589	test-rmse:91.949103+2.061402 
## [436]	train-rmse:85.249047+0.240670	test-rmse:91.867887+2.062927 
## [437]	train-rmse:85.146405+0.239772	test-rmse:91.791282+2.065186 
## [438]	train-rmse:85.044254+0.240875	test-rmse:91.715595+2.066663 
## [439]	train-rmse:84.948099+0.241150	test-rmse:91.641323+2.069313 
## [440]	train-rmse:84.851946+0.242972	test-rmse:91.567402+2.071120 
## [441]	train-rmse:84.755607+0.242255	test-rmse:91.496115+2.072861 
## [442]	train-rmse:84.660688+0.243783	test-rmse:91.428423+2.073830 
## [443]	train-rmse:84.571928+0.243563	test-rmse:91.359910+2.076006 
## [444]	train-rmse:84.482109+0.245326	test-rmse:91.292293+2.075876 
## [445]	train-rmse:84.392353+0.244433	test-rmse:91.226290+2.081226 
## [446]	train-rmse:84.302738+0.243689	test-rmse:91.161237+2.082615 
## [447]	train-rmse:84.218448+0.244360	test-rmse:91.097566+2.085176 
## [448]	train-rmse:84.131693+0.244718	test-rmse:91.034852+2.089841 
## [449]	train-rmse:84.048648+0.244244	test-rmse:90.973794+2.093743 
## [450]	train-rmse:83.966836+0.244277	test-rmse:90.914828+2.091958 
## [451]	train-rmse:83.888037+0.241860	test-rmse:90.857266+2.092153 
## [452]	train-rmse:83.805425+0.241629	test-rmse:90.797896+2.095861 
## [453]	train-rmse:83.728623+0.242331	test-rmse:90.742158+2.097455 
## [454]	train-rmse:83.649860+0.244954	test-rmse:90.685513+2.098309 
## [455]	train-rmse:83.575417+0.243270	test-rmse:90.630816+2.101196 
## [456]	train-rmse:83.501228+0.243378	test-rmse:90.577787+2.101861 
## [457]	train-rmse:83.426093+0.244686	test-rmse:90.523190+2.106328 
## [458]	train-rmse:83.354563+0.246793	test-rmse:90.472470+2.106913 
## [459]	train-rmse:83.283710+0.247344	test-rmse:90.421989+2.107535 
## [460]	train-rmse:83.212780+0.245988	test-rmse:90.374007+2.109516 
## [461]	train-rmse:83.144051+0.248055	test-rmse:90.325583+2.110723 
## [462]	train-rmse:83.073424+0.250533	test-rmse:90.278539+2.113925 
## [463]	train-rmse:83.005670+0.249671	test-rmse:90.231395+2.116233 
## [464]	train-rmse:82.941091+0.250946	test-rmse:90.188171+2.117650 
## [465]	train-rmse:82.877611+0.251512	test-rmse:90.144173+2.119269 
## [466]	train-rmse:82.814784+0.252095	test-rmse:90.104337+2.120553 
## [467]	train-rmse:82.750739+0.251361	test-rmse:90.059754+2.122735 
## [468]	train-rmse:82.689276+0.252011	test-rmse:90.017516+2.123893 
## [469]	train-rmse:82.631081+0.252695	test-rmse:89.976377+2.125100 
## [470]	train-rmse:82.570023+0.254558	test-rmse:89.935142+2.126634 
## [471]	train-rmse:82.509736+0.255249	test-rmse:89.895264+2.129688 
## [472]	train-rmse:82.453375+0.256378	test-rmse:89.859558+2.131539 
## [473]	train-rmse:82.394606+0.256405	test-rmse:89.819319+2.134502 
## [474]	train-rmse:82.335847+0.255658	test-rmse:89.781554+2.133281 
## [475]	train-rmse:82.280000+0.254783	test-rmse:89.748631+2.136442 
## [476]	train-rmse:82.226345+0.254084	test-rmse:89.711292+2.138997 
## [477]	train-rmse:82.173587+0.254786	test-rmse:89.678388+2.142525 
## [478]	train-rmse:82.120062+0.256910	test-rmse:89.643449+2.140901 
## [479]	train-rmse:82.070595+0.254993	test-rmse:89.608194+2.143640 
## [480]	train-rmse:82.015257+0.254405	test-rmse:89.575654+2.144637 
## [481]	train-rmse:81.964351+0.253036	test-rmse:89.542876+2.146217 
## [482]	train-rmse:81.912685+0.252109	test-rmse:89.507804+2.148031 
## [483]	train-rmse:81.864289+0.251817	test-rmse:89.476282+2.150270 
## [484]	train-rmse:81.813708+0.251858	test-rmse:89.443589+2.153300 
## [485]	train-rmse:81.765605+0.252536	test-rmse:89.412740+2.154488 
## [486]	train-rmse:81.717876+0.254606	test-rmse:89.383101+2.158458 
## [487]	train-rmse:81.671302+0.256559	test-rmse:89.355164+2.159447 
## [488]	train-rmse:81.627000+0.255820	test-rmse:89.327238+2.162765 
## [489]	train-rmse:81.580353+0.256478	test-rmse:89.298969+2.164658 
## [490]	train-rmse:81.531136+0.258044	test-rmse:89.271784+2.162425 
## [491]	train-rmse:81.487621+0.255924	test-rmse:89.244779+2.160079 
## [492]	train-rmse:81.444781+0.257163	test-rmse:89.216292+2.163113 
## [493]	train-rmse:81.400525+0.257137	test-rmse:89.188985+2.160517 
## [494]	train-rmse:81.359008+0.257138	test-rmse:89.161810+2.163353 
## [495]	train-rmse:81.318392+0.254804	test-rmse:89.135708+2.162421 
## [496]	train-rmse:81.276044+0.253547	test-rmse:89.111785+2.164986 
## [497]	train-rmse:81.232914+0.256038	test-rmse:89.088544+2.162320 
## [498]	train-rmse:81.192000+0.259561	test-rmse:89.064531+2.163103 
## [499]	train-rmse:81.152113+0.257246	test-rmse:89.042950+2.162081 
## [500]	train-rmse:81.114167+0.257590	test-rmse:89.021197+2.158671 
## [501]	train-rmse:81.075941+0.260690	test-rmse:88.998438+2.161616 
## [502]	train-rmse:81.036868+0.260214	test-rmse:88.978307+2.161357 
## [503]	train-rmse:80.998205+0.261985	test-rmse:88.957286+2.163368 
## [504]	train-rmse:80.961079+0.261910	test-rmse:88.935614+2.159864 
## [505]	train-rmse:80.922958+0.261371	test-rmse:88.917767+2.158089 
## [506]	train-rmse:80.889287+0.261103	test-rmse:88.898730+2.159308 
## [507]	train-rmse:80.855157+0.260825	test-rmse:88.880725+2.163967 
## [508]	train-rmse:80.815902+0.262085	test-rmse:88.861735+2.159684 
## [509]	train-rmse:80.779961+0.264332	test-rmse:88.842573+2.156941 
## [510]	train-rmse:80.747288+0.264266	test-rmse:88.824840+2.160922 
## [511]	train-rmse:80.714482+0.264125	test-rmse:88.808285+2.159881 
## [512]	train-rmse:80.680098+0.265259	test-rmse:88.792196+2.161415 
## [513]	train-rmse:80.647584+0.266014	test-rmse:88.774845+2.161297 
## [514]	train-rmse:80.616917+0.265879	test-rmse:88.757483+2.162525 
## [515]	train-rmse:80.583374+0.266968	test-rmse:88.742892+2.163921 
## [516]	train-rmse:80.551781+0.268212	test-rmse:88.726782+2.165179 
## [517]	train-rmse:80.519339+0.268549	test-rmse:88.710594+2.164700 
## [518]	train-rmse:80.487887+0.265851	test-rmse:88.695152+2.167208 
## [519]	train-rmse:80.456909+0.265130	test-rmse:88.681074+2.172166 
## [520]	train-rmse:80.427176+0.265637	test-rmse:88.668679+2.169315 
## [521]	train-rmse:80.397954+0.268121	test-rmse:88.655771+2.171963 
## [522]	train-rmse:80.366727+0.269532	test-rmse:88.642958+2.173662 
## [523]	train-rmse:80.339622+0.269831	test-rmse:88.628538+2.173684 
## [524]	train-rmse:80.311498+0.269359	test-rmse:88.613423+2.175262 
## [525]	train-rmse:80.282402+0.271316	test-rmse:88.600013+2.177343 
## [526]	train-rmse:80.253108+0.270343	test-rmse:88.584544+2.179408 
## [527]	train-rmse:80.222211+0.269230	test-rmse:88.572241+2.181707 
## [528]	train-rmse:80.195487+0.268177	test-rmse:88.559905+2.183224 
## [529]	train-rmse:80.168250+0.265424	test-rmse:88.547808+2.188419 
## [530]	train-rmse:80.141068+0.266812	test-rmse:88.534203+2.190354 
## [531]	train-rmse:80.111852+0.265928	test-rmse:88.522559+2.193960 
## [532]	train-rmse:80.080785+0.264504	test-rmse:88.508117+2.196209 
## [533]	train-rmse:80.057836+0.264879	test-rmse:88.496745+2.198544 
## [534]	train-rmse:80.028251+0.263082	test-rmse:88.486846+2.202007 
## [535]	train-rmse:80.005189+0.260062	test-rmse:88.476972+2.203686 
## [536]	train-rmse:79.981875+0.260207	test-rmse:88.464033+2.205347 
## [537]	train-rmse:79.954773+0.261729	test-rmse:88.455642+2.205753 
## [538]	train-rmse:79.931326+0.260372	test-rmse:88.444981+2.206609 
## [539]	train-rmse:79.905532+0.260604	test-rmse:88.435021+2.210047 
## [540]	train-rmse:79.883680+0.260294	test-rmse:88.424915+2.212704 
## [541]	train-rmse:79.859969+0.261550	test-rmse:88.416012+2.214811 
## [542]	train-rmse:79.831763+0.257790	test-rmse:88.407251+2.217242 
## [543]	train-rmse:79.808331+0.253340	test-rmse:88.398506+2.219423 
## [544]	train-rmse:79.784402+0.253082	test-rmse:88.391030+2.222421 
## [545]	train-rmse:79.761656+0.256408	test-rmse:88.379373+2.223739 
## [546]	train-rmse:79.740586+0.256453	test-rmse:88.373498+2.227459 
## [547]	train-rmse:79.716893+0.256354	test-rmse:88.364414+2.225080 
## [548]	train-rmse:79.689594+0.250828	test-rmse:88.356367+2.227321 
## [549]	train-rmse:79.668245+0.249612	test-rmse:88.350259+2.229088 
## [550]	train-rmse:79.646159+0.250919	test-rmse:88.341199+2.226292 
## [551]	train-rmse:79.623415+0.249914	test-rmse:88.334572+2.228670 
## [552]	train-rmse:79.599423+0.247439	test-rmse:88.326278+2.230171 
## [553]	train-rmse:79.580352+0.246884	test-rmse:88.317714+2.232262 
## [554]	train-rmse:79.558637+0.248134	test-rmse:88.311072+2.234834 
## [555]	train-rmse:79.538074+0.249519	test-rmse:88.303404+2.236221 
## [556]	train-rmse:79.517535+0.246943	test-rmse:88.296388+2.237727 
## [557]	train-rmse:79.495531+0.243699	test-rmse:88.288377+2.238749 
## [558]	train-rmse:79.472544+0.239881	test-rmse:88.281564+2.240209 
## [559]	train-rmse:79.453838+0.239519	test-rmse:88.275725+2.241670 
## [560]	train-rmse:79.433615+0.240177	test-rmse:88.269606+2.244122 
## [561]	train-rmse:79.413442+0.239325	test-rmse:88.261386+2.246232 
## [562]	train-rmse:79.393792+0.241582	test-rmse:88.255514+2.246759 
## [563]	train-rmse:79.374710+0.243251	test-rmse:88.251195+2.248390 
## [564]	train-rmse:79.355043+0.243246	test-rmse:88.246204+2.247441 
## [565]	train-rmse:79.336279+0.243906	test-rmse:88.239117+2.247104 
## [566]	train-rmse:79.317686+0.244455	test-rmse:88.235452+2.250180 
## [567]	train-rmse:79.294455+0.241459	test-rmse:88.230834+2.254029 
## [568]	train-rmse:79.278473+0.240705	test-rmse:88.226166+2.255491 
## [569]	train-rmse:79.260727+0.240003	test-rmse:88.220191+2.257962 
## [570]	train-rmse:79.242982+0.242640	test-rmse:88.214227+2.258436 
## [571]	train-rmse:79.223753+0.239194	test-rmse:88.209112+2.259534 
## [572]	train-rmse:79.206481+0.238958	test-rmse:88.202138+2.261761 
## [573]	train-rmse:79.188589+0.236919	test-rmse:88.195338+2.265608 
## [574]	train-rmse:79.168638+0.238163	test-rmse:88.190606+2.267178 
## [575]	train-rmse:79.150732+0.237864	test-rmse:88.188906+2.265538 
## [576]	train-rmse:79.132500+0.241374	test-rmse:88.185314+2.267816 
## [577]	train-rmse:79.114764+0.240647	test-rmse:88.181271+2.269011 
## [578]	train-rmse:79.097822+0.238372	test-rmse:88.176504+2.273363 
## [579]	train-rmse:79.082307+0.238229	test-rmse:88.171871+2.275795 
## [580]	train-rmse:79.064032+0.237140	test-rmse:88.167108+2.280270 
## [581]	train-rmse:79.044621+0.237694	test-rmse:88.162816+2.280514 
## [582]	train-rmse:79.027901+0.238906	test-rmse:88.157629+2.281852 
## [583]	train-rmse:79.009419+0.238765	test-rmse:88.155071+2.283040 
## [584]	train-rmse:78.992163+0.241751	test-rmse:88.150017+2.284448 
## [585]	train-rmse:78.978278+0.242198	test-rmse:88.145559+2.286262 
## [586]	train-rmse:78.964553+0.242089	test-rmse:88.141464+2.287799 
## [587]	train-rmse:78.944833+0.241748	test-rmse:88.134574+2.290687 
## [588]	train-rmse:78.930532+0.241206	test-rmse:88.129027+2.290587 
## [589]	train-rmse:78.915385+0.239318	test-rmse:88.125527+2.292542 
## [590]	train-rmse:78.897460+0.236671	test-rmse:88.120986+2.293650 
## [591]	train-rmse:78.881711+0.239043	test-rmse:88.117612+2.295538 
## [592]	train-rmse:78.866289+0.237467	test-rmse:88.114744+2.299808 
## [593]	train-rmse:78.850109+0.241392	test-rmse:88.113124+2.301612 
## [594]	train-rmse:78.832649+0.243214	test-rmse:88.110219+2.302316 
## [595]	train-rmse:78.816617+0.241670	test-rmse:88.108223+2.302551 
## [596]	train-rmse:78.799354+0.241225	test-rmse:88.105682+2.304833 
## [597]	train-rmse:78.785452+0.241949	test-rmse:88.102634+2.307232 
## [598]	train-rmse:78.773597+0.240122	test-rmse:88.100652+2.308296 
## [599]	train-rmse:78.755385+0.240708	test-rmse:88.099716+2.309728 
## [600]	train-rmse:78.740002+0.240871	test-rmse:88.094657+2.312603 
## [601]	train-rmse:78.722832+0.241441	test-rmse:88.092918+2.314021 
## [602]	train-rmse:78.707439+0.241028	test-rmse:88.089386+2.313635 
## [603]	train-rmse:78.691568+0.241867	test-rmse:88.087404+2.316254 
## [604]	train-rmse:78.678228+0.242453	test-rmse:88.084295+2.318013 
## [605]	train-rmse:78.662820+0.245871	test-rmse:88.081790+2.319934 
## [606]	train-rmse:78.648217+0.244668	test-rmse:88.079312+2.320734 
## [607]	train-rmse:78.632040+0.244465	test-rmse:88.080329+2.321653 
## [608]	train-rmse:78.617691+0.246448	test-rmse:88.079775+2.323862 
## [609]	train-rmse:78.606876+0.247658	test-rmse:88.077782+2.323425 
## [610]	train-rmse:78.590310+0.245008	test-rmse:88.074920+2.325712 
## [611]	train-rmse:78.578108+0.245787	test-rmse:88.072299+2.325492 
## [612]	train-rmse:78.561402+0.245770	test-rmse:88.071373+2.326679 
## [613]	train-rmse:78.545752+0.247288	test-rmse:88.068820+2.327295 
## [614]	train-rmse:78.533135+0.246080	test-rmse:88.066435+2.327263 
## [615]	train-rmse:78.519592+0.248778	test-rmse:88.064733+2.328478 
## [616]	train-rmse:78.504115+0.245619	test-rmse:88.061158+2.329882 
## [617]	train-rmse:78.490218+0.249496	test-rmse:88.059735+2.332418 
## [618]	train-rmse:78.476788+0.247743	test-rmse:88.057943+2.333699 
## [619]	train-rmse:78.461208+0.249549	test-rmse:88.057087+2.334845 
## [620]	train-rmse:78.446155+0.250495	test-rmse:88.055442+2.334192 
## [621]	train-rmse:78.434129+0.249252	test-rmse:88.054574+2.337742 
## [622]	train-rmse:78.421986+0.250409	test-rmse:88.053304+2.338414 
## [623]	train-rmse:78.408213+0.253592	test-rmse:88.050291+2.341105 
## [624]	train-rmse:78.396219+0.255055	test-rmse:88.048204+2.342588 
## [625]	train-rmse:78.381823+0.254931	test-rmse:88.047710+2.347349 
## [626]	train-rmse:78.368306+0.255766	test-rmse:88.047026+2.348827 
## [627]	train-rmse:78.356959+0.255871	test-rmse:88.045985+2.350788 
## [628]	train-rmse:78.344437+0.255310	test-rmse:88.042864+2.353768 
## [629]	train-rmse:78.331426+0.257602	test-rmse:88.043397+2.354851 
## [630]	train-rmse:78.317550+0.260089	test-rmse:88.042956+2.354835 
## [631]	train-rmse:78.302608+0.258639	test-rmse:88.039026+2.357402 
## [632]	train-rmse:78.288270+0.260413	test-rmse:88.039130+2.355957 
## [633]	train-rmse:78.277231+0.260888	test-rmse:88.037707+2.356764 
## [634]	train-rmse:78.263866+0.261939	test-rmse:88.038012+2.357768 
## [635]	train-rmse:78.252014+0.262454	test-rmse:88.037389+2.360676 
## [636]	train-rmse:78.238381+0.261981	test-rmse:88.036450+2.363201 
## [637]	train-rmse:78.224902+0.263427	test-rmse:88.034764+2.366180 
## [638]	train-rmse:78.211399+0.262583	test-rmse:88.033593+2.366724 
## [639]	train-rmse:78.197773+0.262995	test-rmse:88.032957+2.367518 
## [640]	train-rmse:78.185917+0.260994	test-rmse:88.032646+2.369642 
## [641]	train-rmse:78.175031+0.264194	test-rmse:88.030677+2.370554 
## [642]	train-rmse:78.158668+0.261576	test-rmse:88.028799+2.373473 
## [643]	train-rmse:78.145946+0.263822	test-rmse:88.028627+2.374835 
## [644]	train-rmse:78.133475+0.262639	test-rmse:88.026410+2.376323 
## [645]	train-rmse:78.122439+0.262819	test-rmse:88.026028+2.375786 
## [646]	train-rmse:78.109947+0.264085	test-rmse:88.025509+2.377175 
## [647]	train-rmse:78.097798+0.264936	test-rmse:88.022801+2.377633 
## [648]	train-rmse:78.084416+0.263575	test-rmse:88.023586+2.377300 
## [649]	train-rmse:78.068007+0.264652	test-rmse:88.022833+2.377454 
## [650]	train-rmse:78.059502+0.264344	test-rmse:88.024282+2.375659 
## [651]	train-rmse:78.046122+0.266090	test-rmse:88.023006+2.375419 
## [652]	train-rmse:78.033420+0.266804	test-rmse:88.022021+2.380113 
## [653]	train-rmse:78.023526+0.266486	test-rmse:88.022619+2.380425 
## [654]	train-rmse:78.011816+0.267458	test-rmse:88.022893+2.383424 
## [655]	train-rmse:77.999455+0.268716	test-rmse:88.022609+2.384864 
## [656]	train-rmse:77.987304+0.268933	test-rmse:88.022667+2.386585 
## [657]	train-rmse:77.977706+0.269475	test-rmse:88.019817+2.384979 
## [658]	train-rmse:77.965030+0.269015	test-rmse:88.021082+2.385884 
## [659]	train-rmse:77.953782+0.269441	test-rmse:88.020629+2.386277 
## [660]	train-rmse:77.941841+0.272576	test-rmse:88.018597+2.388503 
## [661]	train-rmse:77.931405+0.271903	test-rmse:88.018030+2.390132 
## [662]	train-rmse:77.917882+0.273066	test-rmse:88.017029+2.390242 
## [663]	train-rmse:77.904262+0.271618	test-rmse:88.015504+2.393066 
## [664]	train-rmse:77.893736+0.271745	test-rmse:88.018737+2.392948 
## [665]	train-rmse:77.881464+0.271819	test-rmse:88.018641+2.393273 
## [666]	train-rmse:77.870025+0.274999	test-rmse:88.016258+2.395404 
## [667]	train-rmse:77.855452+0.274974	test-rmse:88.014858+2.396364 
## [668]	train-rmse:77.845303+0.275335	test-rmse:88.013312+2.397168 
## [669]	train-rmse:77.829694+0.274832	test-rmse:88.016159+2.396950 
## [670]	train-rmse:77.818733+0.274054	test-rmse:88.018578+2.394957 
## [671]	train-rmse:77.807864+0.277231	test-rmse:88.016513+2.393347 
## [672]	train-rmse:77.796648+0.275686	test-rmse:88.016544+2.397095 
## [673]	train-rmse:77.782182+0.277215	test-rmse:88.015786+2.400387 
## [674]	train-rmse:77.772915+0.276866	test-rmse:88.017385+2.401231 
## [675]	train-rmse:77.760503+0.275337	test-rmse:88.017403+2.405924 
## [676]	train-rmse:77.750008+0.274660	test-rmse:88.017223+2.405927 
## [677]	train-rmse:77.735932+0.275322	test-rmse:88.017517+2.406599 
## [678]	train-rmse:77.726660+0.277139	test-rmse:88.018854+2.405031 
## [679]	train-rmse:77.715372+0.277702	test-rmse:88.018163+2.406834 
## [680]	train-rmse:77.704987+0.274746	test-rmse:88.017607+2.407118 
## [681]	train-rmse:77.693895+0.275015	test-rmse:88.019100+2.408918 
## [682]	train-rmse:77.682974+0.273655	test-rmse:88.020169+2.408542 
## [683]	train-rmse:77.670076+0.273522	test-rmse:88.022628+2.409068 
## [684]	train-rmse:77.660023+0.275483	test-rmse:88.021903+2.409936 
## [685]	train-rmse:77.649259+0.277534	test-rmse:88.021943+2.412360 
## [686]	train-rmse:77.635760+0.274308	test-rmse:88.021466+2.413703 
## [687]	train-rmse:77.623097+0.274924	test-rmse:88.022710+2.413473 
## [688]	train-rmse:77.612790+0.274500	test-rmse:88.023382+2.413231 
## Stopping. Best iteration:
## [668]	train-rmse:77.845303+0.275335	test-rmse:88.013312+2.397168
## 
## [1]	train-rmse:2449.698975+0.409500	test-rmse:2449.699414+3.733919 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:2398.902002+0.400167	test-rmse:2398.902710+3.697744 
## [3]	train-rmse:2349.163403+0.393186	test-rmse:2349.163354+3.663152 
## [4]	train-rmse:2300.460962+0.384344	test-rmse:2300.459302+3.642724 
## [5]	train-rmse:2252.770435+0.375522	test-rmse:2252.762769+3.607715 
## [6]	train-rmse:2206.074463+0.368991	test-rmse:2206.069287+3.598768 
## [7]	train-rmse:2160.345996+0.360826	test-rmse:2160.340503+3.566572 
## [8]	train-rmse:2115.571387+0.353422	test-rmse:2115.574609+3.543546 
## [9]	train-rmse:2071.733935+0.345623	test-rmse:2071.725220+3.526999 
## [10]	train-rmse:2028.804297+0.339201	test-rmse:2028.801282+3.506561 
## [11]	train-rmse:1986.768518+0.329641	test-rmse:1986.764026+3.490795 
## [12]	train-rmse:1945.604724+0.324012	test-rmse:1945.599463+3.471439 
## [13]	train-rmse:1905.302271+0.317166	test-rmse:1905.292541+3.452318 
## [14]	train-rmse:1865.836060+0.310737	test-rmse:1865.824731+3.424628 
## [15]	train-rmse:1827.194373+0.303188	test-rmse:1827.193359+3.417557 
## [16]	train-rmse:1789.356177+0.298385	test-rmse:1789.340393+3.389746 
## [17]	train-rmse:1752.304932+0.290533	test-rmse:1752.295947+3.376097 
## [18]	train-rmse:1716.028613+0.285074	test-rmse:1716.012671+3.361891 
## [19]	train-rmse:1680.503674+0.278441	test-rmse:1680.492871+3.343266 
## [20]	train-rmse:1645.722717+0.273152	test-rmse:1645.717114+3.335979 
## [21]	train-rmse:1611.663672+0.266566	test-rmse:1611.662720+3.301081 
## [22]	train-rmse:1578.314893+0.262773	test-rmse:1578.310632+3.284247 
## [23]	train-rmse:1545.662537+0.256247	test-rmse:1545.662903+3.258998 
## [24]	train-rmse:1513.689185+0.252009	test-rmse:1513.691394+3.250257 
## [25]	train-rmse:1482.382800+0.245162	test-rmse:1482.380395+3.225412 
## [26]	train-rmse:1451.730774+0.238651	test-rmse:1451.736072+3.216208 
## [27]	train-rmse:1421.713562+0.233652	test-rmse:1421.723633+3.196743 
## [28]	train-rmse:1392.324829+0.226790	test-rmse:1392.324292+3.174241 
## [29]	train-rmse:1363.547607+0.223802	test-rmse:1363.549805+3.154593 
## [30]	train-rmse:1335.371741+0.218083	test-rmse:1335.378906+3.136459 
## [31]	train-rmse:1307.781958+0.214203	test-rmse:1307.783447+3.129594 
## [32]	train-rmse:1280.769104+0.209606	test-rmse:1280.770459+3.115744 
## [33]	train-rmse:1254.319446+0.203606	test-rmse:1254.321924+3.115161 
## [34]	train-rmse:1228.420435+0.199767	test-rmse:1228.425049+3.106851 
## [35]	train-rmse:1203.065064+0.194644	test-rmse:1203.075452+3.097624 
## [36]	train-rmse:1178.236206+0.189431	test-rmse:1178.251294+3.095770 
## [37]	train-rmse:1153.926636+0.186834	test-rmse:1153.938098+3.075436 
## [38]	train-rmse:1130.126465+0.181491	test-rmse:1130.131775+3.068705 
## [39]	train-rmse:1106.821057+0.177890	test-rmse:1106.831421+3.056622 
## [40]	train-rmse:1084.006189+0.174211	test-rmse:1084.024915+3.049118 
## [41]	train-rmse:1061.666003+0.171174	test-rmse:1061.677820+3.041494 
## [42]	train-rmse:1039.792944+0.167170	test-rmse:1039.810706+3.041201 
## [43]	train-rmse:1018.376477+0.162545	test-rmse:1018.386145+3.044382 
## [44]	train-rmse:997.407953+0.160555	test-rmse:997.420203+3.041135 
## [45]	train-rmse:976.878760+0.155968	test-rmse:976.892987+3.032253 
## [46]	train-rmse:956.779309+0.153675	test-rmse:956.791772+3.024422 
## [47]	train-rmse:937.099420+0.150528	test-rmse:937.106348+3.025631 
## [48]	train-rmse:917.833337+0.147180	test-rmse:917.843897+3.022506 
## [49]	train-rmse:898.971075+0.145290	test-rmse:898.977496+3.017608 
## [50]	train-rmse:880.503699+0.141937	test-rmse:880.513714+3.016494 
## [51]	train-rmse:862.423554+0.140095	test-rmse:862.431415+3.002543 
## [52]	train-rmse:844.722815+0.135867	test-rmse:844.740454+2.997817 
## [53]	train-rmse:827.392236+0.134721	test-rmse:827.406543+2.988795 
## [54]	train-rmse:810.426312+0.130825	test-rmse:810.443134+2.978386 
## [55]	train-rmse:793.816248+0.127893	test-rmse:793.830804+2.968109 
## [56]	train-rmse:777.556238+0.125105	test-rmse:777.570599+2.969888 
## [57]	train-rmse:761.636420+0.122279	test-rmse:761.652917+2.961012 
## [58]	train-rmse:746.053259+0.121483	test-rmse:746.073169+2.958521 
## [59]	train-rmse:730.796460+0.118640	test-rmse:730.817993+2.951040 
## [60]	train-rmse:715.862323+0.116538	test-rmse:715.894305+2.945634 
## [61]	train-rmse:701.242609+0.113824	test-rmse:701.274213+2.945727 
## [62]	train-rmse:686.931305+0.112206	test-rmse:686.961920+2.940031 
## [63]	train-rmse:672.921521+0.109956	test-rmse:672.956555+2.942671 
## [64]	train-rmse:659.207056+0.108417	test-rmse:659.241589+2.942631 
## [65]	train-rmse:645.782519+0.105930	test-rmse:645.816827+2.942625 
## [66]	train-rmse:632.641772+0.104985	test-rmse:632.683106+2.936908 
## [67]	train-rmse:619.778497+0.104789	test-rmse:619.823053+2.929150 
## [68]	train-rmse:607.187964+0.103199	test-rmse:607.238544+2.923191 
## [69]	train-rmse:594.863165+0.102307	test-rmse:594.910413+2.924243 
## [70]	train-rmse:582.801446+0.101610	test-rmse:582.856110+2.923253 
## [71]	train-rmse:570.995270+0.099526	test-rmse:571.051147+2.921836 
## [72]	train-rmse:559.439942+0.099231	test-rmse:559.500684+2.914041 
## [73]	train-rmse:548.129669+0.098870	test-rmse:548.197888+2.916526 
## [74]	train-rmse:537.060553+0.098333	test-rmse:537.129101+2.912414 
## [75]	train-rmse:526.226239+0.098628	test-rmse:526.295319+2.910961 
## [76]	train-rmse:515.623804+0.097965	test-rmse:515.695615+2.909152 
## [77]	train-rmse:505.247324+0.098308	test-rmse:505.317526+2.915099 
## [78]	train-rmse:495.092953+0.097687	test-rmse:495.166083+2.905215 
## [79]	train-rmse:485.154242+0.098128	test-rmse:485.238458+2.898926 
## [80]	train-rmse:475.428760+0.098146	test-rmse:475.523264+2.898211 
## [81]	train-rmse:465.912616+0.098760	test-rmse:466.005054+2.903529 
## [82]	train-rmse:456.600082+0.099661	test-rmse:456.696576+2.903153 
## [83]	train-rmse:447.487616+0.101438	test-rmse:447.588239+2.895551 
## [84]	train-rmse:438.570334+0.101991	test-rmse:438.672906+2.893560 
## [85]	train-rmse:429.846081+0.102822	test-rmse:429.959094+2.889700 
## [86]	train-rmse:421.309198+0.103817	test-rmse:421.434045+2.891987 
## [87]	train-rmse:412.956802+0.106101	test-rmse:413.093515+2.896895 
## [88]	train-rmse:404.785330+0.107186	test-rmse:404.929895+2.896929 
## [89]	train-rmse:396.790088+0.108325	test-rmse:396.945898+2.898630 
## [90]	train-rmse:388.968179+0.109489	test-rmse:389.130636+2.888686 
## [91]	train-rmse:381.316660+0.112019	test-rmse:381.491419+2.888168 
## [92]	train-rmse:373.830881+0.113537	test-rmse:374.022049+2.886264 
## [93]	train-rmse:366.508685+0.115844	test-rmse:366.723566+2.885106 
## [94]	train-rmse:359.346130+0.117689	test-rmse:359.578250+2.895384 
## [95]	train-rmse:352.339105+0.120647	test-rmse:352.591458+2.900957 
## [96]	train-rmse:345.486423+0.123334	test-rmse:345.752618+2.896910 
## [97]	train-rmse:338.784451+0.125101	test-rmse:339.069855+2.894022 
## [98]	train-rmse:332.229159+0.127109	test-rmse:332.536807+2.912599 
## [99]	train-rmse:325.818158+0.130027	test-rmse:326.140955+2.908388 
## [100]	train-rmse:319.548303+0.131961	test-rmse:319.891238+2.913053 
## [101]	train-rmse:313.417966+0.133405	test-rmse:313.771921+2.899140 
## [102]	train-rmse:307.422434+0.137189	test-rmse:307.795114+2.910599 
## [103]	train-rmse:301.561481+0.139563	test-rmse:301.960742+2.922957 
## [104]	train-rmse:295.831338+0.142601	test-rmse:296.245486+2.928221 
## [105]	train-rmse:290.226065+0.144989	test-rmse:290.673654+2.927268 
## [106]	train-rmse:284.749042+0.147100	test-rmse:285.218387+2.938203 
## [107]	train-rmse:279.393777+0.150770	test-rmse:279.892957+2.939687 
## [108]	train-rmse:274.159641+0.153655	test-rmse:274.687820+2.957690 
## [109]	train-rmse:269.043051+0.157149	test-rmse:269.604770+2.961171 
## [110]	train-rmse:264.043494+0.159206	test-rmse:264.634671+2.957783 
## [111]	train-rmse:259.155340+0.161408	test-rmse:259.774594+2.969151 
## [112]	train-rmse:254.379698+0.163513	test-rmse:255.032091+2.984822 
## [113]	train-rmse:249.713147+0.164991	test-rmse:250.389885+2.992415 
## [114]	train-rmse:245.150410+0.167727	test-rmse:245.855855+2.993350 
## [115]	train-rmse:240.695744+0.169893	test-rmse:241.434714+3.003528 
## [116]	train-rmse:236.344731+0.171233	test-rmse:237.107738+3.013057 
## [117]	train-rmse:232.093524+0.174634	test-rmse:232.886400+3.017803 
## [118]	train-rmse:227.941145+0.176584	test-rmse:228.769763+3.028849 
## [119]	train-rmse:223.886913+0.180917	test-rmse:224.746442+3.038487 
## [120]	train-rmse:219.926097+0.183516	test-rmse:220.822739+3.044935 
## [121]	train-rmse:216.057164+0.185574	test-rmse:216.990543+3.055596 
## [122]	train-rmse:212.279762+0.188789	test-rmse:213.250709+3.068742 
## [123]	train-rmse:208.591913+0.191951	test-rmse:209.594409+3.084974 
## [124]	train-rmse:204.993361+0.196899	test-rmse:206.029811+3.090378 
## [125]	train-rmse:201.480962+0.199802	test-rmse:202.560556+3.099041 
## [126]	train-rmse:198.051831+0.203388	test-rmse:199.171974+3.109848 
## [127]	train-rmse:194.703729+0.205447	test-rmse:195.866144+3.121917 
## [128]	train-rmse:191.434967+0.210635	test-rmse:192.644492+3.140828 
## [129]	train-rmse:188.248328+0.215092	test-rmse:189.502391+3.152282 
## [130]	train-rmse:185.141684+0.217783	test-rmse:186.438690+3.167128 
## [131]	train-rmse:182.109123+0.223683	test-rmse:183.456000+3.181206 
## [132]	train-rmse:179.152803+0.227614	test-rmse:180.528708+3.190197 
## [133]	train-rmse:176.271141+0.231766	test-rmse:177.689792+3.202657 
## [134]	train-rmse:173.459082+0.236784	test-rmse:174.930861+3.224708 
## [135]	train-rmse:170.717381+0.241385	test-rmse:172.230684+3.242780 
## [136]	train-rmse:168.047114+0.243889	test-rmse:169.616174+3.253731 
## [137]	train-rmse:165.441937+0.246587	test-rmse:167.062430+3.272945 
## [138]	train-rmse:162.903123+0.250270	test-rmse:164.574466+3.295039 
## [139]	train-rmse:160.430803+0.253844	test-rmse:162.146155+3.316205 
## [140]	train-rmse:158.020009+0.256498	test-rmse:159.791957+3.337388 
## [141]	train-rmse:155.671668+0.261525	test-rmse:157.499265+3.357704 
## [142]	train-rmse:153.387663+0.267031	test-rmse:155.269226+3.374145 
## [143]	train-rmse:151.159988+0.269614	test-rmse:153.105994+3.386631 
## [144]	train-rmse:148.993587+0.274204	test-rmse:150.993565+3.414858 
## [145]	train-rmse:146.882625+0.280653	test-rmse:148.940303+3.445765 
## [146]	train-rmse:144.830899+0.287515	test-rmse:146.944079+3.467870 
## [147]	train-rmse:142.833983+0.293383	test-rmse:145.007097+3.484695 
## [148]	train-rmse:140.885718+0.293225	test-rmse:143.122160+3.501934 
## [149]	train-rmse:138.996443+0.300763	test-rmse:141.288541+3.519527 
## [150]	train-rmse:137.154893+0.303879	test-rmse:139.511154+3.544172 
## [151]	train-rmse:135.363235+0.310284	test-rmse:137.783324+3.559939 
## [152]	train-rmse:133.622188+0.313477	test-rmse:136.106427+3.584971 
## [153]	train-rmse:131.932726+0.317342	test-rmse:134.480225+3.610402 
## [154]	train-rmse:130.288191+0.322787	test-rmse:132.897535+3.632999 
## [155]	train-rmse:128.692018+0.328133	test-rmse:131.367262+3.659196 
## [156]	train-rmse:127.136775+0.333809	test-rmse:129.879645+3.681217 
## [157]	train-rmse:125.627306+0.334839	test-rmse:128.432091+3.700514 
## [158]	train-rmse:124.162213+0.340482	test-rmse:127.032050+3.718139 
## [159]	train-rmse:122.736723+0.344150	test-rmse:125.671320+3.742864 
## [160]	train-rmse:121.350207+0.348976	test-rmse:124.347340+3.764066 
## [161]	train-rmse:120.006924+0.354959	test-rmse:123.072614+3.780378 
## [162]	train-rmse:118.705269+0.359567	test-rmse:121.830418+3.799174 
## [163]	train-rmse:117.437380+0.364305	test-rmse:120.624696+3.825041 
## [164]	train-rmse:116.212452+0.368519	test-rmse:119.464553+3.847178 
## [165]	train-rmse:115.020302+0.372581	test-rmse:118.336981+3.869254 
## [166]	train-rmse:113.866469+0.372881	test-rmse:117.248876+3.886906 
## [167]	train-rmse:112.747719+0.379164	test-rmse:116.197286+3.910573 
## [168]	train-rmse:111.660097+0.385594	test-rmse:115.177449+3.927901 
## [169]	train-rmse:110.604673+0.389740	test-rmse:114.185902+3.952611 
## [170]	train-rmse:109.581732+0.387267	test-rmse:113.230385+3.971856 
## [171]	train-rmse:108.590657+0.389521	test-rmse:112.309183+4.003779 
## [172]	train-rmse:107.632445+0.395376	test-rmse:111.417258+4.023072 
## [173]	train-rmse:106.703096+0.398256	test-rmse:110.556399+4.044387 
## [174]	train-rmse:105.800632+0.400506	test-rmse:109.724769+4.072230 
## [175]	train-rmse:104.930846+0.404380	test-rmse:108.918338+4.092378 
## [176]	train-rmse:104.086377+0.406757	test-rmse:108.143317+4.105631 
## [177]	train-rmse:103.270429+0.408098	test-rmse:107.383216+4.126174 
## [178]	train-rmse:102.477840+0.411060	test-rmse:106.655277+4.142488 
## [179]	train-rmse:101.710970+0.410752	test-rmse:105.953038+4.157938 
## [180]	train-rmse:100.966894+0.414450	test-rmse:105.265085+4.178798 
## [181]	train-rmse:100.249721+0.416558	test-rmse:104.607884+4.192108 
## [182]	train-rmse:99.549494+0.423448	test-rmse:103.972140+4.207579 
## [183]	train-rmse:98.876579+0.428931	test-rmse:103.360710+4.225898 
## [184]	train-rmse:98.226534+0.427576	test-rmse:102.768546+4.242129 
## [185]	train-rmse:97.600340+0.430938	test-rmse:102.202102+4.260837 
## [186]	train-rmse:96.989360+0.430080	test-rmse:101.654570+4.281321 
## [187]	train-rmse:96.398576+0.429702	test-rmse:101.121767+4.298448 
## [188]	train-rmse:95.826918+0.431005	test-rmse:100.611655+4.316843 
## [189]	train-rmse:95.275896+0.432832	test-rmse:100.115532+4.330251 
## [190]	train-rmse:94.739765+0.434249	test-rmse:99.643180+4.355603 
## [191]	train-rmse:94.226141+0.438692	test-rmse:99.184113+4.372461 
## [192]	train-rmse:93.725835+0.442862	test-rmse:98.746139+4.395747 
## [193]	train-rmse:93.241163+0.443738	test-rmse:98.315942+4.405324 
## [194]	train-rmse:92.772317+0.446713	test-rmse:97.906941+4.420908 
## [195]	train-rmse:92.323534+0.445336	test-rmse:97.508554+4.436751 
## [196]	train-rmse:91.884913+0.448592	test-rmse:97.125730+4.446760 
## [197]	train-rmse:91.466185+0.448988	test-rmse:96.757015+4.457776 
## [198]	train-rmse:91.061808+0.455678	test-rmse:96.400469+4.467998 
## [199]	train-rmse:90.667457+0.457089	test-rmse:96.058766+4.477743 
## [200]	train-rmse:90.285455+0.460830	test-rmse:95.731891+4.488070 
## [201]	train-rmse:89.912717+0.465192	test-rmse:95.420321+4.497134 
## [202]	train-rmse:89.553192+0.471398	test-rmse:95.114535+4.508334 
## [203]	train-rmse:89.210833+0.468316	test-rmse:94.821956+4.521331 
## [204]	train-rmse:88.880506+0.473205	test-rmse:94.539932+4.534139 
## [205]	train-rmse:88.561393+0.475247	test-rmse:94.273056+4.540426 
## [206]	train-rmse:88.248226+0.478351	test-rmse:94.015087+4.557680 
## [207]	train-rmse:87.948779+0.478719	test-rmse:93.768349+4.565778 
## [208]	train-rmse:87.656488+0.481361	test-rmse:93.527731+4.576347 
## [209]	train-rmse:87.373463+0.487958	test-rmse:93.295227+4.588969 
## [210]	train-rmse:87.101613+0.486683	test-rmse:93.074961+4.589845 
## [211]	train-rmse:86.840131+0.486815	test-rmse:92.860178+4.596841 
## [212]	train-rmse:86.591396+0.487232	test-rmse:92.651958+4.606043 
## [213]	train-rmse:86.343490+0.493143	test-rmse:92.453037+4.617343 
## [214]	train-rmse:86.108630+0.497113	test-rmse:92.259249+4.619835 
## [215]	train-rmse:85.880550+0.499549	test-rmse:92.080368+4.629504 
## [216]	train-rmse:85.661554+0.494606	test-rmse:91.907435+4.636694 
## [217]	train-rmse:85.444897+0.494028	test-rmse:91.738439+4.641842 
## [218]	train-rmse:85.239014+0.496841	test-rmse:91.576450+4.646380 
## [219]	train-rmse:85.034260+0.497694	test-rmse:91.416926+4.650302 
## [220]	train-rmse:84.842898+0.499199	test-rmse:91.263615+4.655888 
## [221]	train-rmse:84.655198+0.499427	test-rmse:91.119216+4.665666 
## [222]	train-rmse:84.471590+0.503955	test-rmse:90.981924+4.672435 
## [223]	train-rmse:84.294560+0.503287	test-rmse:90.845328+4.678380 
## [224]	train-rmse:84.128037+0.505829	test-rmse:90.718266+4.678938 
## [225]	train-rmse:83.962408+0.508609	test-rmse:90.596584+4.681396 
## [226]	train-rmse:83.799422+0.509228	test-rmse:90.475484+4.690225 
## [227]	train-rmse:83.644890+0.512447	test-rmse:90.364505+4.690596 
## [228]	train-rmse:83.498282+0.515287	test-rmse:90.256881+4.697672 
## [229]	train-rmse:83.350748+0.515162	test-rmse:90.154127+4.700156 
## [230]	train-rmse:83.215212+0.517074	test-rmse:90.052052+4.706242 
## [231]	train-rmse:83.075733+0.518707	test-rmse:89.960546+4.714665 
## [232]	train-rmse:82.943970+0.516313	test-rmse:89.863136+4.717962 
## [233]	train-rmse:82.813567+0.518356	test-rmse:89.776515+4.725665 
## [234]	train-rmse:82.690376+0.520164	test-rmse:89.687366+4.725150 
## [235]	train-rmse:82.571941+0.523635	test-rmse:89.605219+4.730437 
## [236]	train-rmse:82.449470+0.517812	test-rmse:89.523888+4.737196 
## [237]	train-rmse:82.338523+0.520778	test-rmse:89.444885+4.742421 
## [238]	train-rmse:82.228152+0.522166	test-rmse:89.375772+4.744610 
## [239]	train-rmse:82.119090+0.518947	test-rmse:89.307018+4.749787 
## [240]	train-rmse:82.015739+0.522794	test-rmse:89.239876+4.755675 
## [241]	train-rmse:81.912254+0.524733	test-rmse:89.175118+4.753841 
## [242]	train-rmse:81.813611+0.520139	test-rmse:89.113440+4.760108 
## [243]	train-rmse:81.715517+0.518642	test-rmse:89.048220+4.766883 
## [244]	train-rmse:81.620795+0.518634	test-rmse:88.997821+4.767160 
## [245]	train-rmse:81.533634+0.526259	test-rmse:88.946824+4.768341 
## [246]	train-rmse:81.441648+0.524845	test-rmse:88.890470+4.771067 
## [247]	train-rmse:81.356907+0.522144	test-rmse:88.842541+4.772231 
## [248]	train-rmse:81.276973+0.519893	test-rmse:88.794520+4.777043 
## [249]	train-rmse:81.193912+0.522357	test-rmse:88.747740+4.776601 
## [250]	train-rmse:81.108567+0.525655	test-rmse:88.701695+4.782138 
## [251]	train-rmse:81.037383+0.527450	test-rmse:88.658910+4.781343 
## [252]	train-rmse:80.960763+0.529879	test-rmse:88.623292+4.786397 
## [253]	train-rmse:80.888307+0.536513	test-rmse:88.587717+4.787442 
## [254]	train-rmse:80.816076+0.536081	test-rmse:88.552287+4.792344 
## [255]	train-rmse:80.745009+0.533563	test-rmse:88.519209+4.797185 
## [256]	train-rmse:80.677319+0.541926	test-rmse:88.488040+4.801018 
## [257]	train-rmse:80.615263+0.545182	test-rmse:88.456091+4.805664 
## [258]	train-rmse:80.551466+0.547697	test-rmse:88.423598+4.807181 
## [259]	train-rmse:80.490478+0.547695	test-rmse:88.396747+4.811257 
## [260]	train-rmse:80.430106+0.539789	test-rmse:88.368780+4.814754 
## [261]	train-rmse:80.374645+0.545673	test-rmse:88.340363+4.815333 
## [262]	train-rmse:80.314394+0.551150	test-rmse:88.309862+4.817309 
## [263]	train-rmse:80.251297+0.546717	test-rmse:88.292709+4.816720 
## [264]	train-rmse:80.201785+0.549457	test-rmse:88.267143+4.819341 
## [265]	train-rmse:80.150780+0.545890	test-rmse:88.244891+4.818229 
## [266]	train-rmse:80.097964+0.546697	test-rmse:88.222266+4.823660 
## [267]	train-rmse:80.041795+0.551810	test-rmse:88.207251+4.824063 
## [268]	train-rmse:79.992278+0.549213	test-rmse:88.186685+4.827688 
## [269]	train-rmse:79.936104+0.547602	test-rmse:88.166870+4.829380 
## [270]	train-rmse:79.888844+0.550993	test-rmse:88.149096+4.828856 
## [271]	train-rmse:79.842364+0.553900	test-rmse:88.128980+4.824837 
## [272]	train-rmse:79.796044+0.548828	test-rmse:88.111358+4.821976 
## [273]	train-rmse:79.751549+0.553368	test-rmse:88.093109+4.824841 
## [274]	train-rmse:79.708892+0.550866	test-rmse:88.074341+4.826762 
## [275]	train-rmse:79.665864+0.546543	test-rmse:88.065237+4.823429 
## [276]	train-rmse:79.626373+0.550336	test-rmse:88.049332+4.827960 
## [277]	train-rmse:79.588577+0.551470	test-rmse:88.033381+4.832657 
## [278]	train-rmse:79.548508+0.551903	test-rmse:88.023704+4.830013 
## [279]	train-rmse:79.509795+0.547417	test-rmse:88.009842+4.829242 
## [280]	train-rmse:79.470033+0.554736	test-rmse:87.992927+4.826515 
## [281]	train-rmse:79.429824+0.554195	test-rmse:87.983057+4.823969 
## [282]	train-rmse:79.396365+0.550701	test-rmse:87.968711+4.822743 
## [283]	train-rmse:79.355006+0.552026	test-rmse:87.960976+4.824343 
## [284]	train-rmse:79.319728+0.549577	test-rmse:87.949045+4.823639 
## [285]	train-rmse:79.289553+0.553923	test-rmse:87.936515+4.824858 
## [286]	train-rmse:79.249805+0.547409	test-rmse:87.926813+4.828520 
## [287]	train-rmse:79.208052+0.547909	test-rmse:87.921604+4.822121 
## [288]	train-rmse:79.173376+0.550536	test-rmse:87.915942+4.821036 
## [289]	train-rmse:79.142287+0.545729	test-rmse:87.906446+4.821566 
## [290]	train-rmse:79.108069+0.548265	test-rmse:87.902554+4.822783 
## [291]	train-rmse:79.075705+0.545467	test-rmse:87.896105+4.822912 
## [292]	train-rmse:79.042106+0.548319	test-rmse:87.889543+4.826894 
## [293]	train-rmse:79.013977+0.552533	test-rmse:87.881353+4.830528 
## [294]	train-rmse:78.982296+0.553191	test-rmse:87.872913+4.828410 
## [295]	train-rmse:78.947127+0.557968	test-rmse:87.865664+4.831500 
## [296]	train-rmse:78.917446+0.556656	test-rmse:87.862117+4.825372 
## [297]	train-rmse:78.885938+0.564911	test-rmse:87.855973+4.827698 
## [298]	train-rmse:78.856023+0.564760	test-rmse:87.852270+4.825688 
## [299]	train-rmse:78.827510+0.564643	test-rmse:87.844917+4.825423 
## [300]	train-rmse:78.800965+0.563430	test-rmse:87.841195+4.827292 
## [301]	train-rmse:78.769382+0.564694	test-rmse:87.835433+4.823212 
## [302]	train-rmse:78.740848+0.562502	test-rmse:87.832361+4.827645 
## [303]	train-rmse:78.713384+0.568215	test-rmse:87.831120+4.831999 
## [304]	train-rmse:78.684648+0.566348	test-rmse:87.827710+4.830794 
## [305]	train-rmse:78.655240+0.566991	test-rmse:87.823202+4.832446 
## [306]	train-rmse:78.626075+0.569404	test-rmse:87.818971+4.831872 
## [307]	train-rmse:78.598475+0.570336	test-rmse:87.811392+4.831192 
## [308]	train-rmse:78.568771+0.568286	test-rmse:87.810596+4.830641 
## [309]	train-rmse:78.544934+0.568915	test-rmse:87.806630+4.832817 
## [310]	train-rmse:78.515646+0.571309	test-rmse:87.804845+4.834271 
## [311]	train-rmse:78.489148+0.571443	test-rmse:87.805163+4.833625 
## [312]	train-rmse:78.462584+0.563960	test-rmse:87.799620+4.828723 
## [313]	train-rmse:78.434890+0.570071	test-rmse:87.797332+4.829320 
## [314]	train-rmse:78.413181+0.573450	test-rmse:87.794827+4.832100 
## [315]	train-rmse:78.392426+0.574803	test-rmse:87.795357+4.830643 
## [316]	train-rmse:78.362140+0.568387	test-rmse:87.794706+4.834321 
## [317]	train-rmse:78.339120+0.569103	test-rmse:87.793624+4.832093 
## [318]	train-rmse:78.315431+0.572250	test-rmse:87.789229+4.834347 
## [319]	train-rmse:78.285043+0.569326	test-rmse:87.785458+4.838440 
## [320]	train-rmse:78.252055+0.570689	test-rmse:87.783297+4.838127 
## [321]	train-rmse:78.227392+0.569555	test-rmse:87.781220+4.837371 
## [322]	train-rmse:78.204596+0.571304	test-rmse:87.781851+4.836339 
## [323]	train-rmse:78.183797+0.575320	test-rmse:87.782327+4.835556 
## [324]	train-rmse:78.155961+0.563804	test-rmse:87.780902+4.838379 
## [325]	train-rmse:78.126608+0.568727	test-rmse:87.781397+4.839873 
## [326]	train-rmse:78.100769+0.565743	test-rmse:87.782213+4.843947 
## [327]	train-rmse:78.078870+0.566237	test-rmse:87.785753+4.844526 
## [328]	train-rmse:78.059911+0.568055	test-rmse:87.784976+4.844264 
## [329]	train-rmse:78.032750+0.576283	test-rmse:87.786751+4.846637 
## [330]	train-rmse:78.009428+0.579559	test-rmse:87.783151+4.848412 
## [331]	train-rmse:77.982582+0.572929	test-rmse:87.791115+4.844549 
## [332]	train-rmse:77.950525+0.573691	test-rmse:87.786964+4.846880 
## [333]	train-rmse:77.931746+0.572553	test-rmse:87.787484+4.844689 
## [334]	train-rmse:77.903125+0.572018	test-rmse:87.787987+4.850796 
## [335]	train-rmse:77.882627+0.575808	test-rmse:87.787084+4.850519 
## [336]	train-rmse:77.858128+0.571547	test-rmse:87.786498+4.850249 
## [337]	train-rmse:77.835500+0.572030	test-rmse:87.788050+4.851338 
## [338]	train-rmse:77.814973+0.570735	test-rmse:87.787133+4.850998 
## [339]	train-rmse:77.793553+0.571965	test-rmse:87.787273+4.851726 
## [340]	train-rmse:77.764426+0.567351	test-rmse:87.789511+4.854649 
## [341]	train-rmse:77.740536+0.572230	test-rmse:87.790579+4.855977 
## [342]	train-rmse:77.720615+0.574475	test-rmse:87.791907+4.862070 
## [343]	train-rmse:77.698563+0.572025	test-rmse:87.790587+4.862106 
## [344]	train-rmse:77.674173+0.573906	test-rmse:87.792729+4.862826 
## Stopping. Best iteration:
## [324]	train-rmse:78.155961+0.563804	test-rmse:87.780902+4.838379
## 
## [1]	train-rmse:2423.886499+0.418851	test-rmse:2423.885083+3.853275 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:2348.620801+0.405395	test-rmse:2348.620899+3.814611 
## [3]	train-rmse:2275.699072+0.393755	test-rmse:2275.719482+3.789791 
## [4]	train-rmse:2205.053906+0.380493	test-rmse:2205.056128+3.753322 
## [5]	train-rmse:2136.606250+0.369702	test-rmse:2136.619751+3.722189 
## [6]	train-rmse:2070.294727+0.359076	test-rmse:2070.291333+3.696601 
## [7]	train-rmse:2006.049560+0.346254	test-rmse:2006.063684+3.668607 
## [8]	train-rmse:1943.806543+0.336158	test-rmse:1943.795532+3.641676 
## [9]	train-rmse:1883.504077+0.324618	test-rmse:1883.511414+3.629094 
## [10]	train-rmse:1825.081091+0.315806	test-rmse:1825.102087+3.609258 
## [11]	train-rmse:1768.483435+0.304748	test-rmse:1768.493518+3.569515 
## [12]	train-rmse:1713.648181+0.298218	test-rmse:1713.667432+3.543707 
## [13]	train-rmse:1660.527808+0.285846	test-rmse:1660.533960+3.521127 
## [14]	train-rmse:1609.060107+0.275898	test-rmse:1609.068787+3.511922 
## [15]	train-rmse:1559.201550+0.268754	test-rmse:1559.206067+3.497048 
## [16]	train-rmse:1510.895349+0.259204	test-rmse:1510.911865+3.478580 
## [17]	train-rmse:1464.099280+0.252425	test-rmse:1464.120618+3.443899 
## [18]	train-rmse:1418.763342+0.244444	test-rmse:1418.777808+3.420781 
## [19]	train-rmse:1374.843835+0.237019	test-rmse:1374.849097+3.394140 
## [20]	train-rmse:1332.295703+0.228663	test-rmse:1332.316675+3.377463 
## [21]	train-rmse:1291.076514+0.220810	test-rmse:1291.089856+3.358019 
## [22]	train-rmse:1251.144531+0.215055	test-rmse:1251.169739+3.341610 
## [23]	train-rmse:1212.459753+0.207291	test-rmse:1212.466992+3.315027 
## [24]	train-rmse:1174.984436+0.201765	test-rmse:1175.005420+3.298707 
## [25]	train-rmse:1138.681592+0.195863	test-rmse:1138.692065+3.280878 
## [26]	train-rmse:1103.513782+0.189871	test-rmse:1103.521655+3.293032 
## [27]	train-rmse:1069.447229+0.184850	test-rmse:1069.457581+3.274392 
## [28]	train-rmse:1036.447400+0.178588	test-rmse:1036.443738+3.255546 
## [29]	train-rmse:1004.480762+0.175503	test-rmse:1004.478088+3.250635 
## [30]	train-rmse:973.516492+0.168716	test-rmse:973.518445+3.234379 
## [31]	train-rmse:943.521796+0.164374	test-rmse:943.511603+3.226190 
## [32]	train-rmse:914.469415+0.160675	test-rmse:914.474890+3.222980 
## [33]	train-rmse:886.326966+0.154825	test-rmse:886.340033+3.236758 
## [34]	train-rmse:859.069147+0.150828	test-rmse:859.100366+3.227569 
## [35]	train-rmse:832.665936+0.147401	test-rmse:832.683368+3.232115 
## [36]	train-rmse:807.094159+0.144512	test-rmse:807.103473+3.232467 
## [37]	train-rmse:782.325543+0.140511	test-rmse:782.334686+3.245776 
## [38]	train-rmse:758.336298+0.138224	test-rmse:758.339209+3.239811 
## [39]	train-rmse:735.103686+0.134725	test-rmse:735.116730+3.235655 
## [40]	train-rmse:712.603998+0.132515	test-rmse:712.610602+3.235784 
## [41]	train-rmse:690.813281+0.130078	test-rmse:690.817682+3.220482 
## [42]	train-rmse:669.711877+0.127344	test-rmse:669.724194+3.224246 
## [43]	train-rmse:649.275201+0.125521	test-rmse:649.293207+3.222592 
## [44]	train-rmse:629.487549+0.124841	test-rmse:629.505463+3.222237 
## [45]	train-rmse:610.325989+0.123497	test-rmse:610.345941+3.212347 
## [46]	train-rmse:591.772638+0.121671	test-rmse:591.799512+3.209001 
## [47]	train-rmse:573.808618+0.122099	test-rmse:573.851605+3.205220 
## [48]	train-rmse:556.414551+0.121152	test-rmse:556.470911+3.221825 
## [49]	train-rmse:539.574835+0.119465	test-rmse:539.636298+3.220926 
## [50]	train-rmse:523.273102+0.118525	test-rmse:523.338281+3.225391 
## [51]	train-rmse:507.489618+0.116751	test-rmse:507.572989+3.222246 
## [52]	train-rmse:492.211929+0.117506	test-rmse:492.318616+3.221937 
## [53]	train-rmse:477.423474+0.118619	test-rmse:477.541492+3.223160 
## [54]	train-rmse:463.109366+0.117997	test-rmse:463.248068+3.229714 
## [55]	train-rmse:449.255673+0.118926	test-rmse:449.416595+3.238647 
## [56]	train-rmse:435.848800+0.119952	test-rmse:436.020706+3.242279 
## [57]	train-rmse:422.872687+0.119933	test-rmse:423.058319+3.243300 
## [58]	train-rmse:410.315823+0.121162	test-rmse:410.524017+3.260235 
## [59]	train-rmse:398.165994+0.122992	test-rmse:398.387195+3.269667 
## [60]	train-rmse:386.409924+0.124877	test-rmse:386.647726+3.276132 
## [61]	train-rmse:375.036517+0.126433	test-rmse:375.284949+3.297339 
## [62]	train-rmse:364.033859+0.129003	test-rmse:364.306601+3.319662 
## [63]	train-rmse:353.391068+0.131242	test-rmse:353.698700+3.330581 
## [64]	train-rmse:343.097339+0.133386	test-rmse:343.421485+3.351687 
## [65]	train-rmse:333.142401+0.135743	test-rmse:333.498169+3.367939 
## [66]	train-rmse:323.514871+0.138702	test-rmse:323.903772+3.382108 
## [67]	train-rmse:314.205035+0.140516	test-rmse:314.624377+3.406533 
## [68]	train-rmse:305.204465+0.143602	test-rmse:305.663141+3.437010 
## [69]	train-rmse:296.503155+0.145516	test-rmse:296.999057+3.455332 
## [70]	train-rmse:288.091721+0.148339	test-rmse:288.634015+3.485791 
## [71]	train-rmse:279.964819+0.152754	test-rmse:280.558850+3.504129 
## [72]	train-rmse:272.111587+0.154106	test-rmse:272.743051+3.530102 
## [73]	train-rmse:264.522351+0.157449	test-rmse:265.186014+3.551267 
## [74]	train-rmse:257.192227+0.161502	test-rmse:257.911682+3.579477 
## [75]	train-rmse:250.111778+0.164734	test-rmse:250.876340+3.603487 
## [76]	train-rmse:243.273274+0.168383	test-rmse:244.089893+3.636941 
## [77]	train-rmse:236.672719+0.172083	test-rmse:237.516937+3.651366 
## [78]	train-rmse:230.300129+0.176325	test-rmse:231.196278+3.686359 
## [79]	train-rmse:224.149301+0.179636	test-rmse:225.104498+3.710049 
## [80]	train-rmse:218.212961+0.181117	test-rmse:219.214983+3.744742 
## [81]	train-rmse:212.486989+0.185109	test-rmse:213.558598+3.778058 
## [82]	train-rmse:206.966065+0.189869	test-rmse:208.094508+3.819227 
## [83]	train-rmse:201.639531+0.192927	test-rmse:202.817679+3.845682 
## [84]	train-rmse:196.505730+0.195913	test-rmse:197.738238+3.876555 
## [85]	train-rmse:191.555139+0.199995	test-rmse:192.853496+3.909851 
## [86]	train-rmse:186.788107+0.204241	test-rmse:188.160843+3.939699 
## [87]	train-rmse:182.195477+0.208664	test-rmse:183.637077+3.970747 
## [88]	train-rmse:177.772217+0.209283	test-rmse:179.280858+3.991946 
## [89]	train-rmse:173.513670+0.213900	test-rmse:175.100829+4.019011 
## [90]	train-rmse:169.413060+0.218254	test-rmse:171.079707+4.049171 
## [91]	train-rmse:165.467261+0.221682	test-rmse:167.210683+4.071051 
## [92]	train-rmse:161.672058+0.227551	test-rmse:163.498659+4.088655 
## [93]	train-rmse:158.020595+0.227504	test-rmse:159.935705+4.120192 
## [94]	train-rmse:154.514475+0.234995	test-rmse:156.513182+4.139784 
## [95]	train-rmse:151.142169+0.236041	test-rmse:153.229489+4.173545 
## [96]	train-rmse:147.903441+0.241754	test-rmse:150.083101+4.206406 
## [97]	train-rmse:144.791946+0.243886	test-rmse:147.062379+4.235163 
## [98]	train-rmse:141.807861+0.247866	test-rmse:144.164177+4.265035 
## [99]	train-rmse:138.943942+0.251429	test-rmse:141.383447+4.290732 
## [100]	train-rmse:136.196906+0.256440	test-rmse:138.720953+4.315647 
## [101]	train-rmse:133.560802+0.263011	test-rmse:136.182579+4.349925 
## [102]	train-rmse:131.037514+0.269086	test-rmse:133.745152+4.381238 
## [103]	train-rmse:128.616850+0.276478	test-rmse:131.419302+4.403414 
## [104]	train-rmse:126.299959+0.280322	test-rmse:129.189192+4.427370 
## [105]	train-rmse:124.081990+0.287647	test-rmse:127.074823+4.465189 
## [106]	train-rmse:121.961216+0.290691	test-rmse:125.046812+4.483904 
## [107]	train-rmse:119.928675+0.299423	test-rmse:123.122909+4.523280 
## [108]	train-rmse:117.988565+0.301756	test-rmse:121.269550+4.550196 
## [109]	train-rmse:116.133618+0.311247	test-rmse:119.505776+4.570452 
## [110]	train-rmse:114.363160+0.312988	test-rmse:117.831781+4.593494 
## [111]	train-rmse:112.668736+0.319848	test-rmse:116.248198+4.625946 
## [112]	train-rmse:111.052329+0.327047	test-rmse:114.729620+4.660230 
## [113]	train-rmse:109.508070+0.328790	test-rmse:113.283528+4.687569 
## [114]	train-rmse:108.034724+0.338579	test-rmse:111.905498+4.701684 
## [115]	train-rmse:106.636887+0.343179	test-rmse:110.605479+4.729447 
## [116]	train-rmse:105.297213+0.346920	test-rmse:109.358041+4.750032 
## [117]	train-rmse:104.019298+0.352592	test-rmse:108.174820+4.775080 
## [118]	train-rmse:102.808263+0.354163	test-rmse:107.048935+4.793218 
## [119]	train-rmse:101.647701+0.359128	test-rmse:105.992003+4.805330 
## [120]	train-rmse:100.549134+0.361141	test-rmse:104.986389+4.821704 
## [121]	train-rmse:99.503555+0.364710	test-rmse:104.037977+4.838886 
## [122]	train-rmse:98.506275+0.364231	test-rmse:103.133269+4.849332 
## [123]	train-rmse:97.553590+0.366150	test-rmse:102.275988+4.857056 
## [124]	train-rmse:96.651554+0.367578	test-rmse:101.469591+4.867947 
## [125]	train-rmse:95.789442+0.372983	test-rmse:100.702814+4.876764 
## [126]	train-rmse:94.975761+0.375125	test-rmse:99.981391+4.882173 
## [127]	train-rmse:94.198151+0.376694	test-rmse:99.288977+4.901868 
## [128]	train-rmse:93.456247+0.382582	test-rmse:98.638290+4.904417 
## [129]	train-rmse:92.746003+0.380000	test-rmse:98.018428+4.912841 
## [130]	train-rmse:92.076055+0.387799	test-rmse:97.431919+4.924274 
## [131]	train-rmse:91.450214+0.389431	test-rmse:96.884580+4.931049 
## [132]	train-rmse:90.845305+0.392371	test-rmse:96.361127+4.941484 
## [133]	train-rmse:90.276131+0.391366	test-rmse:95.875433+4.943542 
## [134]	train-rmse:89.737327+0.389608	test-rmse:95.407452+4.944930 
## [135]	train-rmse:89.221635+0.393069	test-rmse:94.966887+4.955069 
## [136]	train-rmse:88.725392+0.400695	test-rmse:94.560953+4.954934 
## [137]	train-rmse:88.258195+0.401233	test-rmse:94.174341+4.955974 
## [138]	train-rmse:87.811909+0.410425	test-rmse:93.811749+4.957380 
## [139]	train-rmse:87.393571+0.411702	test-rmse:93.465430+4.957458 
## [140]	train-rmse:86.996896+0.419262	test-rmse:93.139912+4.960537 
## [141]	train-rmse:86.618618+0.423963	test-rmse:92.837604+4.962698 
## [142]	train-rmse:86.256815+0.424547	test-rmse:92.548929+4.960781 
## [143]	train-rmse:85.913865+0.428554	test-rmse:92.284296+4.966819 
## [144]	train-rmse:85.583376+0.425827	test-rmse:92.031946+4.967507 
## [145]	train-rmse:85.272726+0.429269	test-rmse:91.797940+4.964637 
## [146]	train-rmse:84.978076+0.434016	test-rmse:91.559688+4.957581 
## [147]	train-rmse:84.696613+0.436311	test-rmse:91.352379+4.960047 
## [148]	train-rmse:84.422681+0.440867	test-rmse:91.145343+4.948651 
## [149]	train-rmse:84.167400+0.438992	test-rmse:90.957466+4.944876 
## [150]	train-rmse:83.924779+0.440763	test-rmse:90.783394+4.946764 
## [151]	train-rmse:83.692692+0.441778	test-rmse:90.620135+4.952874 
## [152]	train-rmse:83.466785+0.444237	test-rmse:90.456347+4.952646 
## [153]	train-rmse:83.255566+0.446814	test-rmse:90.312081+4.955618 
## [154]	train-rmse:83.059380+0.452066	test-rmse:90.170914+4.946488 
## [155]	train-rmse:82.867704+0.458033	test-rmse:90.043953+4.939656 
## [156]	train-rmse:82.683627+0.461902	test-rmse:89.924587+4.934674 
## [157]	train-rmse:82.509109+0.465072	test-rmse:89.803947+4.936117 
## [158]	train-rmse:82.333944+0.471689	test-rmse:89.703675+4.933567 
## [159]	train-rmse:82.170443+0.479582	test-rmse:89.603343+4.931325 
## [160]	train-rmse:82.016693+0.484646	test-rmse:89.509859+4.929042 
## [161]	train-rmse:81.873011+0.485091	test-rmse:89.421560+4.920791 
## [162]	train-rmse:81.723817+0.481577	test-rmse:89.339850+4.921661 
## [163]	train-rmse:81.596883+0.477179	test-rmse:89.261533+4.916307 
## [164]	train-rmse:81.470899+0.480014	test-rmse:89.184660+4.906254 
## [165]	train-rmse:81.344812+0.484012	test-rmse:89.116951+4.908525 
## [166]	train-rmse:81.223813+0.486999	test-rmse:89.054642+4.909802 
## [167]	train-rmse:81.107966+0.497069	test-rmse:88.992538+4.905366 
## [168]	train-rmse:81.006806+0.497778	test-rmse:88.933427+4.902611 
## [169]	train-rmse:80.896890+0.503899	test-rmse:88.880914+4.898114 
## [170]	train-rmse:80.789956+0.505233	test-rmse:88.819614+4.891135 
## [171]	train-rmse:80.691380+0.508701	test-rmse:88.771774+4.893953 
## [172]	train-rmse:80.600623+0.503390	test-rmse:88.726144+4.894655 
## [173]	train-rmse:80.498892+0.513949	test-rmse:88.683210+4.894166 
## [174]	train-rmse:80.401697+0.517016	test-rmse:88.644053+4.890209 
## [175]	train-rmse:80.318118+0.523865	test-rmse:88.612581+4.894541 
## [176]	train-rmse:80.239813+0.521716	test-rmse:88.578644+4.886972 
## [177]	train-rmse:80.153445+0.523866	test-rmse:88.539667+4.879948 
## [178]	train-rmse:80.072747+0.527178	test-rmse:88.503944+4.880589 
## [179]	train-rmse:80.001730+0.524712	test-rmse:88.472452+4.881667 
## [180]	train-rmse:79.921835+0.535701	test-rmse:88.434094+4.874067 
## [181]	train-rmse:79.849680+0.535664	test-rmse:88.414916+4.879158 
## [182]	train-rmse:79.779040+0.530438	test-rmse:88.390206+4.874886 
## [183]	train-rmse:79.712547+0.535109	test-rmse:88.363143+4.875420 
## [184]	train-rmse:79.647969+0.531266	test-rmse:88.345389+4.877729 
## [185]	train-rmse:79.590462+0.529899	test-rmse:88.322240+4.879100 
## [186]	train-rmse:79.531065+0.530610	test-rmse:88.299401+4.878981 
## [187]	train-rmse:79.467739+0.533899	test-rmse:88.278464+4.878672 
## [188]	train-rmse:79.410761+0.539225	test-rmse:88.260328+4.881160 
## [189]	train-rmse:79.354095+0.546319	test-rmse:88.246117+4.882420 
## [190]	train-rmse:79.302871+0.547601	test-rmse:88.232578+4.877538 
## [191]	train-rmse:79.247968+0.552901	test-rmse:88.224906+4.874728 
## [192]	train-rmse:79.196107+0.558782	test-rmse:88.210898+4.879667 
## [193]	train-rmse:79.135389+0.553610	test-rmse:88.189365+4.883186 
## [194]	train-rmse:79.084306+0.558174	test-rmse:88.179460+4.884580 
## [195]	train-rmse:79.041883+0.564350	test-rmse:88.165768+4.879221 
## [196]	train-rmse:78.993775+0.568642	test-rmse:88.151546+4.879696 
## [197]	train-rmse:78.944672+0.569847	test-rmse:88.141110+4.884749 
## [198]	train-rmse:78.894768+0.579276	test-rmse:88.128301+4.878922 
## [199]	train-rmse:78.855393+0.575722	test-rmse:88.125060+4.882199 
## [200]	train-rmse:78.809950+0.576089	test-rmse:88.117759+4.883221 
## [201]	train-rmse:78.766006+0.591287	test-rmse:88.109471+4.886300 
## [202]	train-rmse:78.726344+0.590909	test-rmse:88.105309+4.890082 
## [203]	train-rmse:78.687412+0.592800	test-rmse:88.099065+4.887637 
## [204]	train-rmse:78.639899+0.594804	test-rmse:88.095321+4.888014 
## [205]	train-rmse:78.593649+0.598416	test-rmse:88.088249+4.891057 
## [206]	train-rmse:78.553007+0.602675	test-rmse:88.083737+4.896200 
## [207]	train-rmse:78.513437+0.604974	test-rmse:88.085304+4.894629 
## [208]	train-rmse:78.469490+0.612945	test-rmse:88.082822+4.891745 
## [209]	train-rmse:78.440497+0.616901	test-rmse:88.077641+4.895654 
## [210]	train-rmse:78.411433+0.616334	test-rmse:88.073451+4.896858 
## [211]	train-rmse:78.355675+0.616882	test-rmse:88.069599+4.898547 
## [212]	train-rmse:78.313937+0.619035	test-rmse:88.064784+4.893772 
## [213]	train-rmse:78.273969+0.617148	test-rmse:88.061449+4.896635 
## [214]	train-rmse:78.236886+0.623914	test-rmse:88.063166+4.897204 
## [215]	train-rmse:78.198988+0.625073	test-rmse:88.068218+4.901472 
## [216]	train-rmse:78.167459+0.624903	test-rmse:88.068232+4.901082 
## [217]	train-rmse:78.125225+0.633530	test-rmse:88.066353+4.904608 
## [218]	train-rmse:78.092711+0.636329	test-rmse:88.068008+4.907786 
## [219]	train-rmse:78.057603+0.635352	test-rmse:88.065728+4.911512 
## [220]	train-rmse:78.029681+0.634459	test-rmse:88.064448+4.910698 
## [221]	train-rmse:77.994900+0.633384	test-rmse:88.067958+4.914990 
## [222]	train-rmse:77.960551+0.634910	test-rmse:88.065721+4.910216 
## [223]	train-rmse:77.921524+0.633079	test-rmse:88.063322+4.913385 
## [224]	train-rmse:77.888309+0.639200	test-rmse:88.064467+4.915233 
## [225]	train-rmse:77.847783+0.641466	test-rmse:88.065270+4.916648 
## [226]	train-rmse:77.810267+0.631236	test-rmse:88.063103+4.918126 
## [227]	train-rmse:77.775327+0.627371	test-rmse:88.068323+4.915473 
## [228]	train-rmse:77.743071+0.631419	test-rmse:88.070053+4.916075 
## [229]	train-rmse:77.709148+0.630873	test-rmse:88.062164+4.916985 
## [230]	train-rmse:77.670798+0.631569	test-rmse:88.062549+4.918641 
## [231]	train-rmse:77.633320+0.638001	test-rmse:88.067025+4.923982 
## [232]	train-rmse:77.606827+0.641124	test-rmse:88.061787+4.926353 
## [233]	train-rmse:77.576568+0.638571	test-rmse:88.062589+4.931176 
## Stopping. Best iteration:
## [213]	train-rmse:78.273969+0.617148	test-rmse:88.061449+4.896635
## 
## [1]	train-rmse:2398.074097+0.510880	test-rmse:2398.075024+4.790519 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:2298.873047+0.489504	test-rmse:2298.880517+4.816958 
## [3]	train-rmse:2203.791431+0.468880	test-rmse:2203.792871+4.813226 
## [4]	train-rmse:2112.656152+0.447884	test-rmse:2112.655176+4.792926 
## [5]	train-rmse:2025.304394+0.429068	test-rmse:2025.326282+4.801139 
## [6]	train-rmse:1941.584290+0.414274	test-rmse:1941.588684+4.780029 
## [7]	train-rmse:1861.337439+0.392543	test-rmse:1861.354395+4.796821 
## [8]	train-rmse:1784.432263+0.377346	test-rmse:1784.428223+4.780270 
## [9]	train-rmse:1710.713049+0.358657	test-rmse:1710.736694+4.782432 
## [10]	train-rmse:1640.063550+0.342306	test-rmse:1640.058081+4.788764 
## [11]	train-rmse:1572.345984+0.330015	test-rmse:1572.349304+4.770441 
## [12]	train-rmse:1507.447852+0.314613	test-rmse:1507.426978+4.743713 
## [13]	train-rmse:1445.246960+0.301902	test-rmse:1445.249402+4.743849 
## [14]	train-rmse:1385.635498+0.285088	test-rmse:1385.639355+4.733932 
## [15]	train-rmse:1328.500696+0.274621	test-rmse:1328.487061+4.745383 
## [16]	train-rmse:1273.745679+0.260540	test-rmse:1273.720813+4.726866 
## [17]	train-rmse:1221.268457+0.248962	test-rmse:1221.270447+4.736110 
## [18]	train-rmse:1170.979004+0.236844	test-rmse:1170.970959+4.723340 
## [19]	train-rmse:1122.783838+0.226118	test-rmse:1122.798657+4.714666 
## [20]	train-rmse:1076.597022+0.216728	test-rmse:1076.619348+4.694650 
## [21]	train-rmse:1032.337683+0.208898	test-rmse:1032.357812+4.679859 
## [22]	train-rmse:989.921826+0.196617	test-rmse:989.918335+4.685841 
## [23]	train-rmse:949.279699+0.188819	test-rmse:949.277100+4.666258 
## [24]	train-rmse:910.335168+0.177167	test-rmse:910.327539+4.646667 
## [25]	train-rmse:873.019891+0.165920	test-rmse:873.004010+4.648804 
## [26]	train-rmse:837.263684+0.159101	test-rmse:837.246771+4.616472 
## [27]	train-rmse:803.001025+0.150237	test-rmse:802.999469+4.615926 
## [28]	train-rmse:770.181421+0.142484	test-rmse:770.188092+4.611592 
## [29]	train-rmse:738.733405+0.135307	test-rmse:738.738281+4.610844 
## [30]	train-rmse:708.606726+0.129612	test-rmse:708.615466+4.594952 
## [31]	train-rmse:679.747516+0.122090	test-rmse:679.758551+4.575393 
## [32]	train-rmse:652.102374+0.116081	test-rmse:652.111011+4.573325 
## [33]	train-rmse:625.622668+0.109309	test-rmse:625.632074+4.565566 
## [34]	train-rmse:600.263110+0.104809	test-rmse:600.278107+4.554436 
## [35]	train-rmse:575.972357+0.096917	test-rmse:575.989294+4.538912 
## [36]	train-rmse:552.712933+0.090573	test-rmse:552.746655+4.526268 
## [37]	train-rmse:530.439020+0.085682	test-rmse:530.483173+4.523470 
## [38]	train-rmse:509.110739+0.080556	test-rmse:509.172449+4.505874 
## [39]	train-rmse:488.690802+0.077832	test-rmse:488.766312+4.502635 
## [40]	train-rmse:469.143814+0.072957	test-rmse:469.244778+4.479938 
## [41]	train-rmse:450.432178+0.069543	test-rmse:450.549185+4.455016 
## [42]	train-rmse:432.522131+0.065055	test-rmse:432.651266+4.423990 
## [43]	train-rmse:415.381323+0.062981	test-rmse:415.529755+4.409762 
## [44]	train-rmse:398.979785+0.061460	test-rmse:399.139731+4.383510 
## [45]	train-rmse:383.286398+0.059371	test-rmse:383.475372+4.365892 
## [46]	train-rmse:368.273489+0.060514	test-rmse:368.505557+4.331468 
## [47]	train-rmse:353.914212+0.060340	test-rmse:354.158325+4.293348 
## [48]	train-rmse:340.182129+0.060846	test-rmse:340.456924+4.269167 
## [49]	train-rmse:327.051153+0.061504	test-rmse:327.351138+4.248153 
## [50]	train-rmse:314.496530+0.064255	test-rmse:314.837988+4.233453 
## [51]	train-rmse:302.498804+0.065922	test-rmse:302.880746+4.202647 
## [52]	train-rmse:291.033246+0.066642	test-rmse:291.459400+4.161318 
## [53]	train-rmse:280.077859+0.070299	test-rmse:280.558020+4.127541 
## [54]	train-rmse:269.614264+0.073984	test-rmse:270.146255+4.088860 
## [55]	train-rmse:259.621170+0.077481	test-rmse:260.219997+4.063434 
## [56]	train-rmse:250.083177+0.077862	test-rmse:250.734462+4.023648 
## [57]	train-rmse:240.982005+0.079778	test-rmse:241.694807+3.983326 
## [58]	train-rmse:232.296268+0.085898	test-rmse:233.092622+3.939837 
## [59]	train-rmse:224.015219+0.092106	test-rmse:224.890645+3.895523 
## [60]	train-rmse:216.119696+0.096732	test-rmse:217.075719+3.851085 
## [61]	train-rmse:208.594934+0.099789	test-rmse:209.643974+3.796349 
## [62]	train-rmse:201.426706+0.103847	test-rmse:202.563124+3.747637 
## [63]	train-rmse:194.601964+0.106348	test-rmse:195.822566+3.693287 
## [64]	train-rmse:188.106450+0.115614	test-rmse:189.411908+3.633297 
## [65]	train-rmse:181.925255+0.120289	test-rmse:183.325374+3.573315 
## [66]	train-rmse:176.053159+0.124408	test-rmse:177.543229+3.496858 
## [67]	train-rmse:170.468330+0.131230	test-rmse:172.060774+3.450029 
## [68]	train-rmse:165.166856+0.135085	test-rmse:166.863824+3.387622 
## [69]	train-rmse:160.139442+0.139886	test-rmse:161.938307+3.313773 
## [70]	train-rmse:155.358342+0.145614	test-rmse:157.283810+3.259370 
## [71]	train-rmse:150.823311+0.153118	test-rmse:152.870317+3.191599 
## [72]	train-rmse:146.536555+0.157009	test-rmse:148.696422+3.123061 
## [73]	train-rmse:142.472641+0.164256	test-rmse:144.751048+3.055102 
## [74]	train-rmse:138.624269+0.169489	test-rmse:141.030664+2.985661 
## [75]	train-rmse:134.988416+0.174251	test-rmse:137.516182+2.923816 
## [76]	train-rmse:131.549352+0.179123	test-rmse:134.203998+2.865732 
## [77]	train-rmse:128.306697+0.183657	test-rmse:131.097708+2.798294 
## [78]	train-rmse:125.244653+0.189311	test-rmse:128.189438+2.725182 
## [79]	train-rmse:122.359491+0.192555	test-rmse:125.440558+2.666114 
## [80]	train-rmse:119.640598+0.197604	test-rmse:122.853825+2.598463 
## [81]	train-rmse:117.078986+0.203808	test-rmse:120.442446+2.522571 
## [82]	train-rmse:114.668261+0.212671	test-rmse:118.154355+2.458747 
## [83]	train-rmse:112.396769+0.217108	test-rmse:116.059492+2.391579 
## [84]	train-rmse:110.264611+0.228501	test-rmse:114.066738+2.332070 
## [85]	train-rmse:108.265705+0.231381	test-rmse:112.221150+2.283267 
## [86]	train-rmse:106.387531+0.233702	test-rmse:110.487764+2.229039 
## [87]	train-rmse:104.625716+0.242081	test-rmse:108.872227+2.173384 
## [88]	train-rmse:102.975196+0.251893	test-rmse:107.353502+2.115759 
## [89]	train-rmse:101.429188+0.257649	test-rmse:105.946581+2.079101 
## [90]	train-rmse:99.974654+0.257702	test-rmse:104.626572+2.045907 
## [91]	train-rmse:98.612105+0.271004	test-rmse:103.399329+2.010100 
## [92]	train-rmse:97.345924+0.272450	test-rmse:102.262343+1.978737 
## [93]	train-rmse:96.153970+0.270405	test-rmse:101.197328+1.965890 
## [94]	train-rmse:95.048796+0.277219	test-rmse:100.223974+1.936033 
## [95]	train-rmse:94.004069+0.285003	test-rmse:99.319200+1.929447 
## [96]	train-rmse:93.035816+0.298689	test-rmse:98.471857+1.912302 
## [97]	train-rmse:92.123576+0.300325	test-rmse:97.697193+1.917784 
## [98]	train-rmse:91.274569+0.304840	test-rmse:96.966418+1.913951 
## [99]	train-rmse:90.495320+0.302598	test-rmse:96.297598+1.915557 
## [100]	train-rmse:89.753883+0.297467	test-rmse:95.669924+1.933016 
## [101]	train-rmse:89.063945+0.294511	test-rmse:95.097770+1.945358 
## [102]	train-rmse:88.425192+0.300503	test-rmse:94.564561+1.948865 
## [103]	train-rmse:87.832124+0.300654	test-rmse:94.073531+1.950386 
## [104]	train-rmse:87.248355+0.308155	test-rmse:93.603672+1.977727 
## [105]	train-rmse:86.719547+0.314252	test-rmse:93.180630+1.982309 
## [106]	train-rmse:86.226730+0.312191	test-rmse:92.799327+2.000628 
## [107]	train-rmse:85.763032+0.314091	test-rmse:92.433400+2.019154 
## [108]	train-rmse:85.331153+0.314650	test-rmse:92.100223+2.039636 
## [109]	train-rmse:84.927318+0.320840	test-rmse:91.789294+2.061572 
## [110]	train-rmse:84.554797+0.321031	test-rmse:91.510283+2.088318 
## [111]	train-rmse:84.207343+0.321733	test-rmse:91.253917+2.097286 
## [112]	train-rmse:83.876875+0.324210	test-rmse:91.019031+2.114894 
## [113]	train-rmse:83.566106+0.324838	test-rmse:90.797227+2.128577 
## [114]	train-rmse:83.272969+0.327244	test-rmse:90.598899+2.151205 
## [115]	train-rmse:83.000071+0.330774	test-rmse:90.410163+2.164831 
## [116]	train-rmse:82.736745+0.327092	test-rmse:90.231273+2.184066 
## [117]	train-rmse:82.503333+0.330612	test-rmse:90.065613+2.200731 
## [118]	train-rmse:82.275227+0.336871	test-rmse:89.919592+2.231882 
## [119]	train-rmse:82.059796+0.336857	test-rmse:89.783331+2.247990 
## [120]	train-rmse:81.853815+0.333287	test-rmse:89.650849+2.268159 
## [121]	train-rmse:81.660077+0.333969	test-rmse:89.541035+2.282567 
## [122]	train-rmse:81.478095+0.341916	test-rmse:89.437448+2.303675 
## [123]	train-rmse:81.301119+0.348582	test-rmse:89.327146+2.321106 
## [124]	train-rmse:81.151647+0.355032	test-rmse:89.240988+2.334623 
## [125]	train-rmse:80.991681+0.371198	test-rmse:89.157385+2.345478 
## [126]	train-rmse:80.846514+0.373509	test-rmse:89.072170+2.364786 
## [127]	train-rmse:80.711543+0.373460	test-rmse:88.990203+2.377143 
## [128]	train-rmse:80.584370+0.371950	test-rmse:88.919523+2.390393 
## [129]	train-rmse:80.463199+0.382146	test-rmse:88.860564+2.400037 
## [130]	train-rmse:80.338849+0.368696	test-rmse:88.811409+2.410739 
## [131]	train-rmse:80.223080+0.378210	test-rmse:88.762254+2.423929 
## [132]	train-rmse:80.122878+0.381547	test-rmse:88.713808+2.433060 
## [133]	train-rmse:80.019099+0.380432	test-rmse:88.670264+2.444268 
## [134]	train-rmse:79.919034+0.381693	test-rmse:88.635101+2.453919 
## [135]	train-rmse:79.831470+0.383460	test-rmse:88.594897+2.464266 
## [136]	train-rmse:79.733666+0.372693	test-rmse:88.559824+2.475648 
## [137]	train-rmse:79.635610+0.384742	test-rmse:88.538622+2.493957 
## [138]	train-rmse:79.544864+0.385869	test-rmse:88.506919+2.508154 
## [139]	train-rmse:79.471681+0.385603	test-rmse:88.485749+2.515089 
## [140]	train-rmse:79.392986+0.379829	test-rmse:88.458075+2.524319 
## [141]	train-rmse:79.319031+0.378267	test-rmse:88.429912+2.529585 
## [142]	train-rmse:79.238098+0.376189	test-rmse:88.417558+2.532937 
## [143]	train-rmse:79.178036+0.376852	test-rmse:88.400636+2.544589 
## [144]	train-rmse:79.123860+0.374960	test-rmse:88.383182+2.555622 
## [145]	train-rmse:79.053416+0.380834	test-rmse:88.370979+2.557026 
## [146]	train-rmse:78.980820+0.389797	test-rmse:88.362342+2.570082 
## [147]	train-rmse:78.935966+0.383289	test-rmse:88.348977+2.575909 
## [148]	train-rmse:78.865224+0.383782	test-rmse:88.334467+2.582930 
## [149]	train-rmse:78.807305+0.391331	test-rmse:88.319011+2.588347 
## [150]	train-rmse:78.757411+0.400408	test-rmse:88.303877+2.588680 
## [151]	train-rmse:78.708710+0.402290	test-rmse:88.297623+2.601188 
## [152]	train-rmse:78.658232+0.410263	test-rmse:88.287360+2.610361 
## [153]	train-rmse:78.607472+0.406205	test-rmse:88.267901+2.614533 
## [154]	train-rmse:78.548377+0.396273	test-rmse:88.264530+2.619676 
## [155]	train-rmse:78.497147+0.396788	test-rmse:88.259477+2.631293 
## [156]	train-rmse:78.435152+0.407952	test-rmse:88.247672+2.646970 
## [157]	train-rmse:78.381420+0.413618	test-rmse:88.234254+2.658560 
## [158]	train-rmse:78.338286+0.407933	test-rmse:88.227367+2.669836 
## [159]	train-rmse:78.290402+0.406575	test-rmse:88.233231+2.682900 
## [160]	train-rmse:78.238782+0.408129	test-rmse:88.225381+2.688046 
## [161]	train-rmse:78.181503+0.414279	test-rmse:88.214497+2.687908 
## [162]	train-rmse:78.132627+0.410292	test-rmse:88.214641+2.688108 
## [163]	train-rmse:78.070422+0.412031	test-rmse:88.215480+2.695392 
## [164]	train-rmse:78.032742+0.416741	test-rmse:88.212111+2.700461 
## [165]	train-rmse:77.987441+0.412167	test-rmse:88.208067+2.702378 
## [166]	train-rmse:77.940477+0.409397	test-rmse:88.200603+2.709936 
## [167]	train-rmse:77.900864+0.411326	test-rmse:88.199421+2.708095 
## [168]	train-rmse:77.855518+0.411938	test-rmse:88.200633+2.709418 
## [169]	train-rmse:77.801959+0.396970	test-rmse:88.200568+2.710985 
## [170]	train-rmse:77.766871+0.400691	test-rmse:88.201295+2.722881 
## [171]	train-rmse:77.715193+0.395392	test-rmse:88.203515+2.734641 
## [172]	train-rmse:77.659935+0.376654	test-rmse:88.198520+2.736980 
## [173]	train-rmse:77.607417+0.388581	test-rmse:88.197945+2.740784 
## [174]	train-rmse:77.564419+0.385800	test-rmse:88.198302+2.747949 
## [175]	train-rmse:77.517031+0.386982	test-rmse:88.191603+2.744356 
## [176]	train-rmse:77.458419+0.376038	test-rmse:88.191555+2.747095 
## [177]	train-rmse:77.428719+0.378686	test-rmse:88.191542+2.748751 
## [178]	train-rmse:77.371619+0.369820	test-rmse:88.192186+2.747392 
## [179]	train-rmse:77.333012+0.373483	test-rmse:88.192154+2.747808 
## [180]	train-rmse:77.289413+0.363274	test-rmse:88.191499+2.755753 
## [181]	train-rmse:77.241832+0.365589	test-rmse:88.198987+2.762918 
## [182]	train-rmse:77.208752+0.363975	test-rmse:88.201334+2.766585 
## [183]	train-rmse:77.163769+0.372561	test-rmse:88.206670+2.768346 
## [184]	train-rmse:77.122269+0.372068	test-rmse:88.207018+2.763021 
## [185]	train-rmse:77.082713+0.371510	test-rmse:88.202182+2.773870 
## [186]	train-rmse:77.042135+0.371786	test-rmse:88.205327+2.774253 
## [187]	train-rmse:76.984274+0.369428	test-rmse:88.205452+2.777470 
## [188]	train-rmse:76.946087+0.369823	test-rmse:88.210883+2.784861 
## [189]	train-rmse:76.906572+0.372072	test-rmse:88.211860+2.786816 
## [190]	train-rmse:76.874036+0.379808	test-rmse:88.206922+2.788970 
## [191]	train-rmse:76.825033+0.381221	test-rmse:88.207633+2.792000 
## [192]	train-rmse:76.770910+0.385052	test-rmse:88.205857+2.789499 
## [193]	train-rmse:76.723510+0.369345	test-rmse:88.200086+2.790884 
## [194]	train-rmse:76.684771+0.372291	test-rmse:88.200622+2.793478 
## [195]	train-rmse:76.647009+0.365869	test-rmse:88.195499+2.800392 
## [196]	train-rmse:76.611537+0.363321	test-rmse:88.197191+2.805828 
## [197]	train-rmse:76.567686+0.362207	test-rmse:88.201521+2.806465 
## [198]	train-rmse:76.519312+0.375846	test-rmse:88.198667+2.807099 
## [199]	train-rmse:76.474368+0.367552	test-rmse:88.197910+2.816176 
## [200]	train-rmse:76.428972+0.361865	test-rmse:88.205238+2.812247 
## Stopping. Best iteration:
## [180]	train-rmse:77.289413+0.363274	test-rmse:88.191499+2.755753
## 
## [1]	train-rmse:2372.260791+0.746715	test-rmse:2372.251660+7.046058 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:2249.663355+0.706111	test-rmse:2249.675537+7.010886 
## [3]	train-rmse:2133.423853+0.669806	test-rmse:2133.422632+7.010820 
## [4]	train-rmse:2023.210754+0.633546	test-rmse:2023.223853+6.972767 
## [5]	train-rmse:1918.718164+0.601729	test-rmse:1918.704138+6.987737 
## [6]	train-rmse:1819.645654+0.567218	test-rmse:1819.651502+6.940667 
## [7]	train-rmse:1725.722156+0.538757	test-rmse:1725.720227+6.962422 
## [8]	train-rmse:1636.673926+0.508661	test-rmse:1636.660364+6.910469 
## [9]	train-rmse:1552.249365+0.479110	test-rmse:1552.241687+6.881868 
## [10]	train-rmse:1472.210608+0.454187	test-rmse:1472.191809+6.859807 
## [11]	train-rmse:1396.327478+0.429976	test-rmse:1396.306067+6.833172 
## [12]	train-rmse:1324.392102+0.405954	test-rmse:1324.342261+6.844049 
## [13]	train-rmse:1256.193176+0.384974	test-rmse:1256.180786+6.812529 
## [14]	train-rmse:1191.545215+0.361833	test-rmse:1191.520898+6.807677 
## [15]	train-rmse:1130.258850+0.344427	test-rmse:1130.248889+6.755497 
## [16]	train-rmse:1072.166699+0.325274	test-rmse:1072.139050+6.754081 
## [17]	train-rmse:1017.100214+0.306580	test-rmse:1017.100079+6.716450 
## [18]	train-rmse:964.909693+0.288617	test-rmse:964.882025+6.680833 
## [19]	train-rmse:915.435022+0.271671	test-rmse:915.410437+6.654087 
## [20]	train-rmse:868.547162+0.252804	test-rmse:868.530811+6.607954 
## [21]	train-rmse:824.110010+0.241364	test-rmse:824.071143+6.581279 
## [22]	train-rmse:781.997186+0.223079	test-rmse:781.974054+6.538267 
## [23]	train-rmse:742.091278+0.212031	test-rmse:742.058295+6.493843 
## [24]	train-rmse:704.276367+0.198915	test-rmse:704.259216+6.468085 
## [25]	train-rmse:668.448889+0.186331	test-rmse:668.423443+6.432689 
## [26]	train-rmse:634.508740+0.177546	test-rmse:634.503711+6.415660 
## [27]	train-rmse:602.358771+0.164890	test-rmse:602.354724+6.376820 
## [28]	train-rmse:571.905798+0.154687	test-rmse:571.893097+6.339147 
## [29]	train-rmse:543.062744+0.145452	test-rmse:543.071790+6.292795 
## [30]	train-rmse:515.748755+0.136561	test-rmse:515.766461+6.251498 
## [31]	train-rmse:489.890948+0.129749	test-rmse:489.911526+6.220739 
## [32]	train-rmse:465.406729+0.120712	test-rmse:465.433752+6.179551 
## [33]	train-rmse:442.231986+0.109821	test-rmse:442.263031+6.137581 
## [34]	train-rmse:420.302090+0.102524	test-rmse:420.365183+6.091594 
## [35]	train-rmse:399.549439+0.095618	test-rmse:399.642853+6.046807 
## [36]	train-rmse:379.917654+0.088571	test-rmse:380.046460+5.971658 
## [37]	train-rmse:361.351294+0.082703	test-rmse:361.508691+5.918315 
## [38]	train-rmse:343.793399+0.076903	test-rmse:343.979031+5.863646 
## [39]	train-rmse:327.196289+0.072534	test-rmse:327.409543+5.800337 
## [40]	train-rmse:311.508118+0.069772	test-rmse:311.772061+5.755369 
## [41]	train-rmse:296.689792+0.071412	test-rmse:297.002716+5.680085 
## [42]	train-rmse:282.691394+0.075405	test-rmse:283.071430+5.626344 
## [43]	train-rmse:269.479733+0.078245	test-rmse:269.919611+5.569743 
## [44]	train-rmse:257.010211+0.083659	test-rmse:257.538464+5.494252 
## [45]	train-rmse:245.251891+0.088670	test-rmse:245.842316+5.432224 
## [46]	train-rmse:234.160809+0.090240	test-rmse:234.835410+5.349115 
## [47]	train-rmse:223.709813+0.098969	test-rmse:224.485910+5.260827 
## [48]	train-rmse:213.868411+0.107657	test-rmse:214.748727+5.176078 
## [49]	train-rmse:204.608257+0.119637	test-rmse:205.594174+5.071026 
## [50]	train-rmse:195.898961+0.126417	test-rmse:196.982184+4.970570 
## [51]	train-rmse:187.712202+0.136977	test-rmse:188.884111+4.862968 
## [52]	train-rmse:180.025607+0.145321	test-rmse:181.321320+4.764906 
## [53]	train-rmse:172.810551+0.147610	test-rmse:174.233498+4.661866 
## [54]	train-rmse:166.047516+0.152340	test-rmse:167.610475+4.545036 
## [55]	train-rmse:159.712547+0.157334	test-rmse:161.406262+4.432735 
## [56]	train-rmse:153.783885+0.165602	test-rmse:155.588127+4.308311 
## [57]	train-rmse:148.236502+0.175008	test-rmse:150.185256+4.187520 
## [58]	train-rmse:143.053160+0.179879	test-rmse:145.144417+4.058137 
## [59]	train-rmse:138.219253+0.186454	test-rmse:140.448872+3.927615 
## [60]	train-rmse:133.714871+0.190953	test-rmse:136.084174+3.786491 
## [61]	train-rmse:129.520607+0.194716	test-rmse:132.048191+3.663586 
## [62]	train-rmse:125.613047+0.198624	test-rmse:128.300559+3.529082 
## [63]	train-rmse:121.989333+0.202462	test-rmse:124.859049+3.385741 
## [64]	train-rmse:118.617009+0.203393	test-rmse:121.651386+3.260405 
## [65]	train-rmse:115.499629+0.207393	test-rmse:118.705048+3.142762 
## [66]	train-rmse:112.615373+0.213401	test-rmse:115.966319+3.040015 
## [67]	train-rmse:109.941636+0.219675	test-rmse:113.451345+2.930872 
## [68]	train-rmse:107.465683+0.224482	test-rmse:111.140864+2.809938 
## [69]	train-rmse:105.186420+0.238490	test-rmse:109.033514+2.703272 
## [70]	train-rmse:103.088526+0.237311	test-rmse:107.114505+2.589296 
## [71]	train-rmse:101.146533+0.249933	test-rmse:105.319679+2.489648 
## [72]	train-rmse:99.357200+0.253711	test-rmse:103.714301+2.400507 
## [73]	train-rmse:97.716432+0.264266	test-rmse:102.225206+2.335948 
## [74]	train-rmse:96.220441+0.276399	test-rmse:100.877771+2.277321 
## [75]	train-rmse:94.824381+0.283644	test-rmse:99.637031+2.212242 
## [76]	train-rmse:93.547492+0.289147	test-rmse:98.510941+2.158335 
## [77]	train-rmse:92.370882+0.301624	test-rmse:97.483971+2.130790 
## [78]	train-rmse:91.295468+0.304174	test-rmse:96.551296+2.111954 
## [79]	train-rmse:90.314198+0.303054	test-rmse:95.706001+2.096730 
## [80]	train-rmse:89.421732+0.305342	test-rmse:94.941023+2.088489 
## [81]	train-rmse:88.586003+0.310661	test-rmse:94.255891+2.077542 
## [82]	train-rmse:87.826246+0.314141	test-rmse:93.637629+2.067524 
## [83]	train-rmse:87.122879+0.315929	test-rmse:93.062576+2.090490 
## [84]	train-rmse:86.494559+0.319445	test-rmse:92.552540+2.104647 
## [85]	train-rmse:85.887749+0.339275	test-rmse:92.070960+2.110938 
## [86]	train-rmse:85.336057+0.330561	test-rmse:91.629436+2.150338 
## [87]	train-rmse:84.825944+0.335397	test-rmse:91.253399+2.163578 
## [88]	train-rmse:84.375387+0.338261	test-rmse:90.909104+2.196825 
## [89]	train-rmse:83.942888+0.330721	test-rmse:90.596448+2.226812 
## [90]	train-rmse:83.542264+0.341144	test-rmse:90.305956+2.256910 
## [91]	train-rmse:83.186059+0.340927	test-rmse:90.041452+2.292744 
## [92]	train-rmse:82.844671+0.346159	test-rmse:89.816384+2.330662 
## [93]	train-rmse:82.530578+0.353357	test-rmse:89.600371+2.351552 
## [94]	train-rmse:82.233777+0.358076	test-rmse:89.406911+2.372637 
## [95]	train-rmse:81.969820+0.355859	test-rmse:89.237474+2.402457 
## [96]	train-rmse:81.712332+0.355894	test-rmse:89.078654+2.436086 
## [97]	train-rmse:81.495772+0.351847	test-rmse:88.938061+2.471123 
## [98]	train-rmse:81.289133+0.350128	test-rmse:88.814956+2.498337 
## [99]	train-rmse:81.081704+0.346692	test-rmse:88.705220+2.525426 
## [100]	train-rmse:80.884705+0.357565	test-rmse:88.622955+2.556460 
## [101]	train-rmse:80.705113+0.356186	test-rmse:88.520202+2.589275 
## [102]	train-rmse:80.535713+0.367658	test-rmse:88.435191+2.618384 
## [103]	train-rmse:80.382195+0.372966	test-rmse:88.363689+2.633526 
## [104]	train-rmse:80.235765+0.366305	test-rmse:88.296335+2.664112 
## [105]	train-rmse:80.090875+0.383019	test-rmse:88.237525+2.683478 
## [106]	train-rmse:79.964415+0.392713	test-rmse:88.182506+2.713011 
## [107]	train-rmse:79.843589+0.393081	test-rmse:88.140481+2.741033 
## [108]	train-rmse:79.739246+0.406820	test-rmse:88.077743+2.756073 
## [109]	train-rmse:79.635814+0.424210	test-rmse:88.037800+2.775634 
## [110]	train-rmse:79.528799+0.435345	test-rmse:88.000966+2.790503 
## [111]	train-rmse:79.445750+0.437186	test-rmse:87.962668+2.803333 
## [112]	train-rmse:79.359441+0.445876	test-rmse:87.943317+2.829161 
## [113]	train-rmse:79.259650+0.431605	test-rmse:87.915866+2.848524 
## [114]	train-rmse:79.180266+0.427428	test-rmse:87.893749+2.866329 
## [115]	train-rmse:79.095301+0.428578	test-rmse:87.864282+2.889901 
## [116]	train-rmse:79.000526+0.430810	test-rmse:87.840920+2.909280 
## [117]	train-rmse:78.921249+0.429417	test-rmse:87.822154+2.932378 
## [118]	train-rmse:78.832432+0.453157	test-rmse:87.801959+2.943429 
## [119]	train-rmse:78.750488+0.451884	test-rmse:87.794044+2.957767 
## [120]	train-rmse:78.663505+0.460658	test-rmse:87.785595+2.971259 
## [121]	train-rmse:78.583200+0.465669	test-rmse:87.775480+2.988739 
## [122]	train-rmse:78.523040+0.463399	test-rmse:87.761308+2.995459 
## [123]	train-rmse:78.455306+0.457449	test-rmse:87.756770+3.008559 
## [124]	train-rmse:78.399166+0.459556	test-rmse:87.743438+3.025209 
## [125]	train-rmse:78.313121+0.468449	test-rmse:87.732997+3.039780 
## [126]	train-rmse:78.241191+0.471948	test-rmse:87.730135+3.056841 
## [127]	train-rmse:78.167344+0.477957	test-rmse:87.723668+3.064716 
## [128]	train-rmse:78.094164+0.481130	test-rmse:87.723836+3.090647 
## [129]	train-rmse:78.040873+0.473786	test-rmse:87.722206+3.096814 
## [130]	train-rmse:77.970701+0.458627	test-rmse:87.720956+3.103487 
## [131]	train-rmse:77.909628+0.472228	test-rmse:87.722857+3.120935 
## [132]	train-rmse:77.854948+0.475760	test-rmse:87.704681+3.134957 
## [133]	train-rmse:77.802799+0.479178	test-rmse:87.714687+3.142378 
## [134]	train-rmse:77.751239+0.478565	test-rmse:87.717037+3.146594 
## [135]	train-rmse:77.691707+0.484036	test-rmse:87.714600+3.149235 
## [136]	train-rmse:77.637350+0.490502	test-rmse:87.709646+3.168245 
## [137]	train-rmse:77.573384+0.476015	test-rmse:87.706293+3.173696 
## [138]	train-rmse:77.519656+0.478552	test-rmse:87.709288+3.179268 
## [139]	train-rmse:77.475842+0.472396	test-rmse:87.707472+3.177786 
## [140]	train-rmse:77.423614+0.474328	test-rmse:87.701767+3.174465 
## [141]	train-rmse:77.372810+0.469068	test-rmse:87.690853+3.177961 
## [142]	train-rmse:77.313551+0.467463	test-rmse:87.694695+3.187074 
## [143]	train-rmse:77.265024+0.462928	test-rmse:87.697485+3.193240 
## [144]	train-rmse:77.201527+0.466675	test-rmse:87.704984+3.203480 
## [145]	train-rmse:77.133076+0.470295	test-rmse:87.709530+3.202555 
## [146]	train-rmse:77.089555+0.465822	test-rmse:87.710529+3.198632 
## [147]	train-rmse:77.038922+0.475816	test-rmse:87.712077+3.210565 
## [148]	train-rmse:76.987210+0.470050	test-rmse:87.713493+3.208042 
## [149]	train-rmse:76.937972+0.470949	test-rmse:87.708404+3.216241 
## [150]	train-rmse:76.887286+0.478324	test-rmse:87.710076+3.216856 
## [151]	train-rmse:76.845758+0.475836	test-rmse:87.711656+3.229837 
## [152]	train-rmse:76.805456+0.477667	test-rmse:87.703455+3.237734 
## [153]	train-rmse:76.764677+0.479014	test-rmse:87.714400+3.246363 
## [154]	train-rmse:76.695751+0.484069	test-rmse:87.723362+3.254960 
## [155]	train-rmse:76.655519+0.480962	test-rmse:87.725415+3.257161 
## [156]	train-rmse:76.622129+0.476716	test-rmse:87.730219+3.259315 
## [157]	train-rmse:76.546412+0.480324	test-rmse:87.724762+3.255219 
## [158]	train-rmse:76.487856+0.489726	test-rmse:87.726007+3.259032 
## [159]	train-rmse:76.434737+0.490361	test-rmse:87.727062+3.259855 
## [160]	train-rmse:76.371155+0.492305	test-rmse:87.734687+3.261612 
## [161]	train-rmse:76.319834+0.490300	test-rmse:87.736694+3.270959 
## Stopping. Best iteration:
## [141]	train-rmse:77.372810+0.469068	test-rmse:87.690853+3.177961
## 
## [1]	train-rmse:2346.452685+0.282246	test-rmse:2346.449463+2.686030 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:2200.991138+0.267358	test-rmse:2200.999365+2.667409 
## [3]	train-rmse:2064.571729+0.246930	test-rmse:2064.570068+2.635374 
## [4]	train-rmse:1936.644898+0.229373	test-rmse:1936.631274+2.625421 
## [5]	train-rmse:1816.693018+0.214400	test-rmse:1816.679980+2.598917 
## [6]	train-rmse:1704.196167+0.200694	test-rmse:1704.178735+2.601763 
## [7]	train-rmse:1598.723328+0.190071	test-rmse:1598.710351+2.566934 
## [8]	train-rmse:1499.805566+0.174840	test-rmse:1499.773193+2.524360 
## [9]	train-rmse:1407.065784+0.165571	test-rmse:1407.028906+2.477213 
## [10]	train-rmse:1320.099499+0.151618	test-rmse:1320.040430+2.449186 
## [11]	train-rmse:1238.561060+0.141295	test-rmse:1238.542981+2.432131 
## [12]	train-rmse:1162.108862+0.131406	test-rmse:1162.070630+2.407712 
## [13]	train-rmse:1090.432654+0.122724	test-rmse:1090.452771+2.374483 
## [14]	train-rmse:1023.235492+0.114266	test-rmse:1023.204687+2.376841 
## [15]	train-rmse:960.239002+0.105850	test-rmse:960.238074+2.362042 
## [16]	train-rmse:901.187750+0.100274	test-rmse:901.174915+2.330354 
## [17]	train-rmse:845.836414+0.099724	test-rmse:845.834827+2.305417 
## [18]	train-rmse:793.958276+0.088133	test-rmse:793.946918+2.294350 
## [19]	train-rmse:745.341388+0.081228	test-rmse:745.342529+2.301617 
## [20]	train-rmse:699.781738+0.076288	test-rmse:699.787451+2.266543 
## [21]	train-rmse:657.094812+0.072654	test-rmse:657.076123+2.222435 
## [22]	train-rmse:617.101825+0.072781	test-rmse:617.128625+2.232474 
## [23]	train-rmse:579.638403+0.068853	test-rmse:579.639087+2.196061 
## [24]	train-rmse:544.550500+0.064328	test-rmse:544.577081+2.196345 
## [25]	train-rmse:511.698975+0.065728	test-rmse:511.723447+2.164685 
## [26]	train-rmse:480.941467+0.067690	test-rmse:480.979987+2.147457 
## [27]	train-rmse:452.150507+0.066219	test-rmse:452.219278+2.134913 
## [28]	train-rmse:425.211304+0.068007	test-rmse:425.302805+2.104477 
## [29]	train-rmse:400.003339+0.070745	test-rmse:400.117862+2.094237 
## [30]	train-rmse:376.431875+0.074772	test-rmse:376.593817+2.056733 
## [31]	train-rmse:354.390359+0.076559	test-rmse:354.570227+2.034645 
## [32]	train-rmse:333.790643+0.078757	test-rmse:334.027918+2.049221 
## [33]	train-rmse:314.542108+0.084862	test-rmse:314.854107+2.039003 
## [34]	train-rmse:296.572629+0.090162	test-rmse:296.954712+2.021183 
## [35]	train-rmse:279.797220+0.095725	test-rmse:280.251697+1.972926 
## [36]	train-rmse:264.153580+0.102175	test-rmse:264.690503+1.996457 
## [37]	train-rmse:249.563618+0.103125	test-rmse:250.212319+1.956807 
## [38]	train-rmse:235.976006+0.106959	test-rmse:236.717087+1.937041 
## [39]	train-rmse:223.326404+0.107492	test-rmse:224.171095+1.892757 
## [40]	train-rmse:211.565918+0.112441	test-rmse:212.529556+1.876136 
## [41]	train-rmse:200.629817+0.115692	test-rmse:201.730794+1.851421 
## [42]	train-rmse:190.484628+0.126795	test-rmse:191.713594+1.818752 
## [43]	train-rmse:181.070149+0.126980	test-rmse:182.441443+1.796594 
## [44]	train-rmse:172.359079+0.128280	test-rmse:173.862190+1.787107 
## [45]	train-rmse:164.289110+0.135688	test-rmse:165.936531+1.767910 
## [46]	train-rmse:156.838782+0.152028	test-rmse:158.645556+1.711033 
## [47]	train-rmse:149.961417+0.160672	test-rmse:151.916753+1.694632 
## [48]	train-rmse:143.626166+0.161337	test-rmse:145.746048+1.689084 
## [49]	train-rmse:137.801509+0.171063	test-rmse:140.085963+1.657100 
## [50]	train-rmse:132.444290+0.167923	test-rmse:134.925490+1.632355 
## [51]	train-rmse:127.538961+0.182056	test-rmse:130.195030+1.622885 
## [52]	train-rmse:123.046393+0.186270	test-rmse:125.883225+1.621741 
## [53]	train-rmse:118.929562+0.183342	test-rmse:121.961437+1.614292 
## [54]	train-rmse:115.169549+0.195968	test-rmse:118.404956+1.612305 
## [55]	train-rmse:111.759213+0.198830	test-rmse:115.179699+1.650169 
## [56]	train-rmse:108.644792+0.207948	test-rmse:112.253108+1.671775 
## [57]	train-rmse:105.816369+0.211165	test-rmse:109.624001+1.693436 
## [58]	train-rmse:103.250955+0.208221	test-rmse:107.241089+1.721052 
## [59]	train-rmse:100.925436+0.214659	test-rmse:105.098980+1.742684 
## [60]	train-rmse:98.806933+0.233148	test-rmse:103.177642+1.774538 
## [61]	train-rmse:96.892466+0.233794	test-rmse:101.487228+1.821182 
## [62]	train-rmse:95.177445+0.238949	test-rmse:99.963319+1.846433 
## [63]	train-rmse:93.618455+0.246424	test-rmse:98.594349+1.893509 
## [64]	train-rmse:92.209776+0.243670	test-rmse:97.383452+1.912754 
## [65]	train-rmse:90.953809+0.249183	test-rmse:96.301853+1.954696 
## [66]	train-rmse:89.815343+0.248175	test-rmse:95.325455+1.990111 
## [67]	train-rmse:88.804060+0.260208	test-rmse:94.474725+2.030946 
## [68]	train-rmse:87.881245+0.275287	test-rmse:93.696970+2.064697 
## [69]	train-rmse:87.041407+0.288525	test-rmse:93.034606+2.100152 
## [70]	train-rmse:86.271767+0.280636	test-rmse:92.414191+2.140168 
## [71]	train-rmse:85.602140+0.286873	test-rmse:91.871490+2.148417 
## [72]	train-rmse:84.988260+0.289955	test-rmse:91.399410+2.185335 
## [73]	train-rmse:84.418251+0.269799	test-rmse:90.972300+2.239625 
## [74]	train-rmse:83.917695+0.267724	test-rmse:90.580677+2.267706 
## [75]	train-rmse:83.466347+0.279527	test-rmse:90.255626+2.287137 
## [76]	train-rmse:83.043740+0.277685	test-rmse:89.960265+2.313559 
## [77]	train-rmse:82.648911+0.266217	test-rmse:89.697890+2.340492 
## [78]	train-rmse:82.309015+0.272226	test-rmse:89.477953+2.375597 
## [79]	train-rmse:81.992679+0.263360	test-rmse:89.274359+2.390466 
## [80]	train-rmse:81.713902+0.259363	test-rmse:89.098953+2.422705 
## [81]	train-rmse:81.449609+0.260758	test-rmse:88.961114+2.449406 
## [82]	train-rmse:81.197922+0.266787	test-rmse:88.813709+2.476481 
## [83]	train-rmse:80.980187+0.271495	test-rmse:88.693120+2.493164 
## [84]	train-rmse:80.770077+0.269139	test-rmse:88.587133+2.518772 
## [85]	train-rmse:80.555363+0.268004	test-rmse:88.509580+2.545703 
## [86]	train-rmse:80.375276+0.299706	test-rmse:88.426607+2.567412 
## [87]	train-rmse:80.194804+0.302800	test-rmse:88.350087+2.580393 
## [88]	train-rmse:80.049580+0.332207	test-rmse:88.283396+2.601834 
## [89]	train-rmse:79.906113+0.322041	test-rmse:88.222572+2.616096 
## [90]	train-rmse:79.772380+0.311877	test-rmse:88.177512+2.637090 
## [91]	train-rmse:79.656619+0.330925	test-rmse:88.136068+2.654754 
## [92]	train-rmse:79.544807+0.329213	test-rmse:88.106073+2.670687 
## [93]	train-rmse:79.426443+0.331807	test-rmse:88.067327+2.677946 
## [94]	train-rmse:79.314456+0.332930	test-rmse:88.045394+2.701162 
## [95]	train-rmse:79.205502+0.343775	test-rmse:88.009362+2.710838 
## [96]	train-rmse:79.098163+0.341352	test-rmse:87.994019+2.710337 
## [97]	train-rmse:78.998081+0.351262	test-rmse:87.967306+2.710565 
## [98]	train-rmse:78.892375+0.346379	test-rmse:87.945091+2.722569 
## [99]	train-rmse:78.809156+0.357311	test-rmse:87.922872+2.741238 
## [100]	train-rmse:78.715879+0.335974	test-rmse:87.914150+2.743339 
## [101]	train-rmse:78.638297+0.334053	test-rmse:87.902375+2.743844 
## [102]	train-rmse:78.559241+0.347982	test-rmse:87.889930+2.762964 
## [103]	train-rmse:78.458337+0.328325	test-rmse:87.875277+2.769115 
## [104]	train-rmse:78.393266+0.320271	test-rmse:87.859884+2.775112 
## [105]	train-rmse:78.317312+0.322558	test-rmse:87.844849+2.787964 
## [106]	train-rmse:78.233318+0.324024	test-rmse:87.840171+2.802749 
## [107]	train-rmse:78.163780+0.329478	test-rmse:87.840338+2.804532 
## [108]	train-rmse:78.067244+0.328687	test-rmse:87.846192+2.811404 
## [109]	train-rmse:77.999630+0.345288	test-rmse:87.839228+2.806084 
## [110]	train-rmse:77.929487+0.332585	test-rmse:87.833067+2.818036 
## [111]	train-rmse:77.848302+0.330423	test-rmse:87.828588+2.823187 
## [112]	train-rmse:77.768190+0.320808	test-rmse:87.816388+2.837088 
## [113]	train-rmse:77.698450+0.339119	test-rmse:87.794373+2.834557 
## [114]	train-rmse:77.647231+0.337602	test-rmse:87.805294+2.827339 
## [115]	train-rmse:77.575181+0.343459	test-rmse:87.800555+2.819563 
## [116]	train-rmse:77.531345+0.339472	test-rmse:87.804188+2.821801 
## [117]	train-rmse:77.472340+0.345608	test-rmse:87.800276+2.825515 
## [118]	train-rmse:77.391837+0.359297	test-rmse:87.818897+2.837458 
## [119]	train-rmse:77.327249+0.353717	test-rmse:87.814459+2.841312 
## [120]	train-rmse:77.259687+0.358989	test-rmse:87.821660+2.827876 
## [121]	train-rmse:77.189234+0.370622	test-rmse:87.838454+2.827054 
## [122]	train-rmse:77.126895+0.384190	test-rmse:87.844294+2.824907 
## [123]	train-rmse:77.054550+0.376764	test-rmse:87.855026+2.838960 
## [124]	train-rmse:77.000216+0.376580	test-rmse:87.859384+2.849852 
## [125]	train-rmse:76.943170+0.380157	test-rmse:87.879024+2.844439 
## [126]	train-rmse:76.871667+0.389317	test-rmse:87.881647+2.855479 
## [127]	train-rmse:76.795592+0.387768	test-rmse:87.877532+2.862535 
## [128]	train-rmse:76.723747+0.390588	test-rmse:87.877558+2.859518 
## [129]	train-rmse:76.647402+0.400491	test-rmse:87.878387+2.840351 
## [130]	train-rmse:76.593746+0.396847	test-rmse:87.877655+2.846293 
## [131]	train-rmse:76.522181+0.408707	test-rmse:87.877130+2.850267 
## [132]	train-rmse:76.461461+0.402614	test-rmse:87.880263+2.856380 
## [133]	train-rmse:76.403292+0.400131	test-rmse:87.882575+2.857997 
## Stopping. Best iteration:
## [113]	train-rmse:77.698450+0.339119	test-rmse:87.794373+2.834557
## 
## [1]	train-rmse:2320.643164+0.629555	test-rmse:2320.668408+6.003709 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:2152.853613+0.585455	test-rmse:2152.827368+5.946705 
## [3]	train-rmse:1997.229785+0.540764	test-rmse:1997.251904+5.872152 
## [4]	train-rmse:1852.907434+0.506777	test-rmse:1852.890234+5.825357 
## [5]	train-rmse:1719.078174+0.464891	test-rmse:1719.107446+5.754607 
## [6]	train-rmse:1594.959228+0.432639	test-rmse:1594.973731+5.690826 
## [7]	train-rmse:1479.872815+0.398557	test-rmse:1479.843042+5.651152 
## [8]	train-rmse:1373.142883+0.368303	test-rmse:1373.141699+5.603447 
## [9]	train-rmse:1274.185730+0.339399	test-rmse:1274.197766+5.542170 
## [10]	train-rmse:1182.419409+0.314484	test-rmse:1182.408630+5.494479 
## [11]	train-rmse:1097.344031+0.295091	test-rmse:1097.327759+5.438733 
## [12]	train-rmse:1018.459039+0.270136	test-rmse:1018.431122+5.362636 
## [13]	train-rmse:945.339758+0.252058	test-rmse:945.325812+5.341656 
## [14]	train-rmse:877.548474+0.232454	test-rmse:877.554663+5.276038 
## [15]	train-rmse:814.724145+0.212233	test-rmse:814.750696+5.223306 
## [16]	train-rmse:756.493323+0.202995	test-rmse:756.513971+5.138449 
## [17]	train-rmse:702.537140+0.184440	test-rmse:702.547797+5.103177 
## [18]	train-rmse:652.543701+0.168224	test-rmse:652.541107+5.070715 
## [19]	train-rmse:606.237610+0.157283	test-rmse:606.258380+5.024126 
## [20]	train-rmse:563.346851+0.145467	test-rmse:563.377368+4.976983 
## [21]	train-rmse:523.634650+0.137466	test-rmse:523.689856+4.937449 
## [22]	train-rmse:486.874518+0.129568	test-rmse:486.921036+4.879610 
## [23]	train-rmse:452.856952+0.120493	test-rmse:452.952731+4.849207 
## [24]	train-rmse:421.387067+0.112661	test-rmse:421.479022+4.804604 
## [25]	train-rmse:392.282929+0.105436	test-rmse:392.427603+4.756502 
## [26]	train-rmse:365.379669+0.102166	test-rmse:365.558429+4.712969 
## [27]	train-rmse:340.521576+0.099256	test-rmse:340.752286+4.678624 
## [28]	train-rmse:317.565518+0.098961	test-rmse:317.858160+4.641890 
## [29]	train-rmse:296.379446+0.098285	test-rmse:296.727872+4.589297 
## [30]	train-rmse:276.840476+0.098208	test-rmse:277.288974+4.544358 
## [31]	train-rmse:258.833417+0.101016	test-rmse:259.394988+4.466077 
## [32]	train-rmse:242.254785+0.104829	test-rmse:242.945869+4.411813 
## [33]	train-rmse:227.008635+0.108343	test-rmse:227.845900+4.391620 
## [34]	train-rmse:212.993683+0.120580	test-rmse:213.958145+4.358370 
## [35]	train-rmse:200.137227+0.130569	test-rmse:201.230911+4.304148 
## [36]	train-rmse:188.348522+0.142670	test-rmse:189.602780+4.228494 
## [37]	train-rmse:177.569075+0.156675	test-rmse:178.981073+4.169083 
## [38]	train-rmse:167.719196+0.173693	test-rmse:169.323993+4.103096 
## [39]	train-rmse:158.733180+0.177790	test-rmse:160.497954+4.046956 
## [40]	train-rmse:150.551718+0.185108	test-rmse:152.497598+3.987866 
## [41]	train-rmse:143.118108+0.195090	test-rmse:145.283366+3.907923 
## [42]	train-rmse:136.385963+0.201063	test-rmse:138.782771+3.820879 
## [43]	train-rmse:130.280749+0.206405	test-rmse:132.890486+3.745601 
## [44]	train-rmse:124.770059+0.215166	test-rmse:127.608149+3.678730 
## [45]	train-rmse:119.810649+0.221845	test-rmse:122.883091+3.576720 
## [46]	train-rmse:115.348119+0.228405	test-rmse:118.666439+3.484849 
## [47]	train-rmse:111.342191+0.228885	test-rmse:114.883820+3.423634 
## [48]	train-rmse:107.770124+0.228684	test-rmse:111.530825+3.344370 
## [49]	train-rmse:104.571304+0.245656	test-rmse:108.562118+3.305795 
## [50]	train-rmse:101.718170+0.245750	test-rmse:105.930924+3.243249 
## [51]	train-rmse:99.187436+0.248439	test-rmse:103.594696+3.183474 
## [52]	train-rmse:96.908702+0.243306	test-rmse:101.557426+3.127337 
## [53]	train-rmse:94.907736+0.249221	test-rmse:99.755894+3.079855 
## [54]	train-rmse:93.134964+0.244417	test-rmse:98.186527+3.018004 
## [55]	train-rmse:91.568590+0.253359	test-rmse:96.814976+2.980145 
## [56]	train-rmse:90.153606+0.257261	test-rmse:95.617187+2.933120 
## [57]	train-rmse:88.923988+0.247511	test-rmse:94.573317+2.905414 
## [58]	train-rmse:87.825951+0.247132	test-rmse:93.676577+2.867771 
## [59]	train-rmse:86.852419+0.255145	test-rmse:92.883041+2.867418 
## [60]	train-rmse:85.985934+0.259225	test-rmse:92.198017+2.851220 
## [61]	train-rmse:85.235792+0.256269	test-rmse:91.613411+2.838573 
## [62]	train-rmse:84.558237+0.267095	test-rmse:91.093726+2.818856 
## [63]	train-rmse:83.942817+0.265251	test-rmse:90.659325+2.805752 
## [64]	train-rmse:83.406677+0.272285	test-rmse:90.268125+2.822756 
## [65]	train-rmse:82.924593+0.284395	test-rmse:89.921240+2.810214 
## [66]	train-rmse:82.490846+0.270679	test-rmse:89.628161+2.802845 
## [67]	train-rmse:82.092738+0.278440	test-rmse:89.386539+2.773399 
## [68]	train-rmse:81.746545+0.286177	test-rmse:89.174091+2.786201 
## [69]	train-rmse:81.427091+0.303026	test-rmse:88.958366+2.774303 
## [70]	train-rmse:81.138013+0.287313	test-rmse:88.790278+2.761076 
## [71]	train-rmse:80.866146+0.304306	test-rmse:88.641406+2.771514 
## [72]	train-rmse:80.621545+0.297503	test-rmse:88.519549+2.766547 
## [73]	train-rmse:80.396421+0.304422	test-rmse:88.425648+2.774784 
## [74]	train-rmse:80.184694+0.299373	test-rmse:88.341437+2.775502 
## [75]	train-rmse:80.013392+0.316221	test-rmse:88.258207+2.778536 
## [76]	train-rmse:79.855471+0.308353	test-rmse:88.197301+2.796133 
## [77]	train-rmse:79.700822+0.312994	test-rmse:88.138038+2.800662 
## [78]	train-rmse:79.566498+0.327414	test-rmse:88.093266+2.801988 
## [79]	train-rmse:79.438753+0.327106	test-rmse:88.033640+2.806836 
## [80]	train-rmse:79.300057+0.325877	test-rmse:87.990828+2.794260 
## [81]	train-rmse:79.189476+0.327988	test-rmse:87.955053+2.802545 
## [82]	train-rmse:79.069752+0.332369	test-rmse:87.929431+2.790448 
## [83]	train-rmse:78.972517+0.329564	test-rmse:87.909924+2.797475 
## [84]	train-rmse:78.859036+0.347053	test-rmse:87.917513+2.780589 
## [85]	train-rmse:78.751173+0.339657	test-rmse:87.909408+2.786601 
## [86]	train-rmse:78.661605+0.343080	test-rmse:87.888056+2.795141 
## [87]	train-rmse:78.557170+0.338992	test-rmse:87.878162+2.790941 
## [88]	train-rmse:78.468956+0.347142	test-rmse:87.876186+2.798711 
## [89]	train-rmse:78.363262+0.341459	test-rmse:87.859564+2.803057 
## [90]	train-rmse:78.267183+0.339084	test-rmse:87.857896+2.792730 
## [91]	train-rmse:78.174500+0.322587	test-rmse:87.857448+2.789487 
## [92]	train-rmse:78.064627+0.336594	test-rmse:87.862156+2.787456 
## [93]	train-rmse:77.981386+0.347688	test-rmse:87.854291+2.790476 
## [94]	train-rmse:77.904674+0.349285	test-rmse:87.851712+2.793782 
## [95]	train-rmse:77.814568+0.348581	test-rmse:87.859332+2.789753 
## [96]	train-rmse:77.728769+0.359519	test-rmse:87.842139+2.784083 
## [97]	train-rmse:77.661749+0.365614	test-rmse:87.839789+2.774055 
## [98]	train-rmse:77.585944+0.351554	test-rmse:87.838766+2.766467 
## [99]	train-rmse:77.525484+0.351936	test-rmse:87.837841+2.768319 
## [100]	train-rmse:77.456435+0.341025	test-rmse:87.842745+2.777643 
## [101]	train-rmse:77.377140+0.341982	test-rmse:87.856306+2.779235 
## [102]	train-rmse:77.312422+0.340241	test-rmse:87.860570+2.776120 
## [103]	train-rmse:77.241457+0.333212	test-rmse:87.860949+2.779292 
## [104]	train-rmse:77.135774+0.328278	test-rmse:87.838888+2.794298 
## [105]	train-rmse:77.055928+0.331189	test-rmse:87.838426+2.795340 
## [106]	train-rmse:76.981661+0.322969	test-rmse:87.824890+2.794558 
## [107]	train-rmse:76.895528+0.324397	test-rmse:87.830964+2.794359 
## [108]	train-rmse:76.816308+0.323300	test-rmse:87.831479+2.783107 
## [109]	train-rmse:76.728705+0.315701	test-rmse:87.836353+2.791468 
## [110]	train-rmse:76.637910+0.313126	test-rmse:87.842302+2.779679 
## [111]	train-rmse:76.571883+0.325089	test-rmse:87.844169+2.772054 
## [112]	train-rmse:76.498721+0.327989	test-rmse:87.849302+2.768678 
## [113]	train-rmse:76.419154+0.335476	test-rmse:87.868936+2.786895 
## [114]	train-rmse:76.347957+0.329939	test-rmse:87.874289+2.779943 
## [115]	train-rmse:76.271797+0.355440	test-rmse:87.870478+2.773300 
## [116]	train-rmse:76.207963+0.342929	test-rmse:87.881860+2.780111 
## [117]	train-rmse:76.139501+0.352078	test-rmse:87.887265+2.778257 
## [118]	train-rmse:76.052458+0.336913	test-rmse:87.880211+2.784709 
## [119]	train-rmse:75.985108+0.345646	test-rmse:87.882240+2.801546 
## [120]	train-rmse:75.906905+0.353916	test-rmse:87.881704+2.792673 
## [121]	train-rmse:75.838434+0.366351	test-rmse:87.893066+2.800158 
## [122]	train-rmse:75.757629+0.363175	test-rmse:87.895909+2.809284 
## [123]	train-rmse:75.701113+0.362636	test-rmse:87.892616+2.796934 
## [124]	train-rmse:75.639435+0.372781	test-rmse:87.900868+2.798148 
## [125]	train-rmse:75.599577+0.372248	test-rmse:87.906058+2.794209 
## [126]	train-rmse:75.520989+0.375489	test-rmse:87.910665+2.797812 
## Stopping. Best iteration:
## [106]	train-rmse:76.981661+0.322969	test-rmse:87.824890+2.794558
## 
## [1]	train-rmse:2294.834058+0.483509	test-rmse:2294.834448+4.627103 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:2105.248657+0.439400	test-rmse:2105.232642+4.537884 
## [3]	train-rmse:1931.375903+0.405630	test-rmse:1931.376660+4.423813 
## [4]	train-rmse:1771.938635+0.370118	test-rmse:1771.985119+4.348163 
## [5]	train-rmse:1625.731885+0.336030	test-rmse:1625.725989+4.267929 
## [6]	train-rmse:1491.660230+0.311680	test-rmse:1491.649231+4.167708 
## [7]	train-rmse:1368.741443+0.280861	test-rmse:1368.719592+4.042429 
## [8]	train-rmse:1256.019031+0.258550	test-rmse:1255.983374+3.993739 
## [9]	train-rmse:1152.683996+0.239204	test-rmse:1152.643225+3.886861 
## [10]	train-rmse:1057.944788+0.217225	test-rmse:1057.853100+3.859349 
## [11]	train-rmse:971.100805+0.205106	test-rmse:971.042920+3.815969 
## [12]	train-rmse:891.506384+0.187870	test-rmse:891.449011+3.750970 
## [13]	train-rmse:818.551245+0.173790	test-rmse:818.493323+3.690617 
## [14]	train-rmse:751.705115+0.154063	test-rmse:751.676910+3.640392 
## [15]	train-rmse:690.459863+0.143169	test-rmse:690.446918+3.577803 
## [16]	train-rmse:634.356927+0.130098	test-rmse:634.352283+3.534861 
## [17]	train-rmse:582.984149+0.121756	test-rmse:582.960254+3.500674 
## [18]	train-rmse:535.947613+0.115672	test-rmse:535.949329+3.467617 
## [19]	train-rmse:492.904327+0.114914	test-rmse:492.911130+3.420605 
## [20]	train-rmse:453.527963+0.107128	test-rmse:453.559097+3.384301 
## [21]	train-rmse:417.519110+0.104461	test-rmse:417.584613+3.376859 
## [22]	train-rmse:384.603854+0.107387	test-rmse:384.711829+3.332355 
## [23]	train-rmse:354.539203+0.111043	test-rmse:354.685474+3.316079 
## [24]	train-rmse:327.092026+0.111862	test-rmse:327.335980+3.296374 
## [25]	train-rmse:302.053202+0.114765	test-rmse:302.371600+3.244130 
## [26]	train-rmse:279.234644+0.119547	test-rmse:279.677515+3.215735 
## [27]	train-rmse:258.455545+0.126265	test-rmse:258.983856+3.179977 
## [28]	train-rmse:239.554916+0.132195	test-rmse:240.196143+3.146153 
## [29]	train-rmse:222.383769+0.146086	test-rmse:223.178615+3.113845 
## [30]	train-rmse:206.817935+0.151823	test-rmse:207.741052+3.095577 
## [31]	train-rmse:192.731911+0.163043	test-rmse:193.801917+3.081781 
## [32]	train-rmse:179.993596+0.175314	test-rmse:181.249734+3.052139 
## [33]	train-rmse:168.508723+0.188432	test-rmse:169.961752+2.992635 
## [34]	train-rmse:158.175783+0.191664	test-rmse:159.823860+2.969425 
## [35]	train-rmse:148.900214+0.210232	test-rmse:150.796992+2.931877 
## [36]	train-rmse:140.599329+0.211642	test-rmse:142.750474+2.904964 
## [37]	train-rmse:133.190755+0.224027	test-rmse:135.564858+2.866258 
## [38]	train-rmse:126.594250+0.226484	test-rmse:129.186335+2.841416 
## [39]	train-rmse:120.733132+0.243879	test-rmse:123.612184+2.834030 
## [40]	train-rmse:115.545495+0.244831	test-rmse:118.686523+2.789756 
## [41]	train-rmse:110.965504+0.246966	test-rmse:114.410611+2.791163 
## [42]	train-rmse:106.933818+0.260326	test-rmse:110.642032+2.778577 
## [43]	train-rmse:103.394327+0.263772	test-rmse:107.386253+2.768398 
## [44]	train-rmse:100.302520+0.281009	test-rmse:104.550243+2.783266 
## [45]	train-rmse:97.598145+0.279285	test-rmse:102.098480+2.784054 
## [46]	train-rmse:95.224453+0.293397	test-rmse:99.962075+2.795147 
## [47]	train-rmse:93.182993+0.282978	test-rmse:98.150918+2.809864 
## [48]	train-rmse:91.405830+0.291199	test-rmse:96.627759+2.840018 
## [49]	train-rmse:89.850561+0.315168	test-rmse:95.294993+2.867305 
## [50]	train-rmse:88.487717+0.333614	test-rmse:94.164658+2.883117 
## [51]	train-rmse:87.316070+0.325679	test-rmse:93.203245+2.876503 
## [52]	train-rmse:86.265649+0.336243	test-rmse:92.369755+2.905569 
## [53]	train-rmse:85.370400+0.339234	test-rmse:91.675150+2.938325 
## [54]	train-rmse:84.591234+0.346897	test-rmse:91.078414+2.974600 
## [55]	train-rmse:83.932701+0.338727	test-rmse:90.575541+2.991245 
## [56]	train-rmse:83.325714+0.340204	test-rmse:90.146744+3.013906 
## [57]	train-rmse:82.789077+0.339743	test-rmse:89.781364+3.030371 
## [58]	train-rmse:82.323268+0.324916	test-rmse:89.503511+3.058000 
## [59]	train-rmse:81.877311+0.344377	test-rmse:89.248697+3.066594 
## [60]	train-rmse:81.504787+0.364725	test-rmse:89.026588+3.088707 
## [61]	train-rmse:81.173776+0.356670	test-rmse:88.838172+3.104896 
## [62]	train-rmse:80.884013+0.372730	test-rmse:88.678154+3.132931 
## [63]	train-rmse:80.639292+0.368549	test-rmse:88.552730+3.149387 
## [64]	train-rmse:80.387561+0.360550	test-rmse:88.447771+3.135949 
## [65]	train-rmse:80.178166+0.372989	test-rmse:88.345371+3.138278 
## [66]	train-rmse:79.950513+0.382859	test-rmse:88.256288+3.158853 
## [67]	train-rmse:79.779264+0.373076	test-rmse:88.206096+3.165223 
## [68]	train-rmse:79.591330+0.397521	test-rmse:88.150977+3.167750 
## [69]	train-rmse:79.425757+0.410914	test-rmse:88.094858+3.173770 
## [70]	train-rmse:79.271307+0.412981	test-rmse:88.055945+3.192941 
## [71]	train-rmse:79.078596+0.398985	test-rmse:88.011259+3.209234 
## [72]	train-rmse:78.936671+0.397001	test-rmse:88.007127+3.220398 
## [73]	train-rmse:78.838704+0.403456	test-rmse:87.992952+3.226587 
## [74]	train-rmse:78.704623+0.395666	test-rmse:87.984584+3.237901 
## [75]	train-rmse:78.596911+0.390161	test-rmse:87.965170+3.244956 
## [76]	train-rmse:78.454057+0.424211	test-rmse:87.950263+3.251745 
## [77]	train-rmse:78.364785+0.411341	test-rmse:87.967252+3.252594 
## [78]	train-rmse:78.268400+0.412657	test-rmse:87.959518+3.274808 
## [79]	train-rmse:78.169433+0.427943	test-rmse:87.947990+3.291598 
## [80]	train-rmse:78.060469+0.416120	test-rmse:87.944442+3.293359 
## [81]	train-rmse:77.959293+0.418712	test-rmse:87.940574+3.297922 
## [82]	train-rmse:77.865171+0.408685	test-rmse:87.922402+3.301393 
## [83]	train-rmse:77.764091+0.418217	test-rmse:87.924895+3.310047 
## [84]	train-rmse:77.646999+0.427119	test-rmse:87.917989+3.320636 
## [85]	train-rmse:77.567819+0.409372	test-rmse:87.940336+3.325720 
## [86]	train-rmse:77.496555+0.415552	test-rmse:87.935410+3.341988 
## [87]	train-rmse:77.430894+0.420236	test-rmse:87.933971+3.345405 
## [88]	train-rmse:77.315365+0.442507	test-rmse:87.936390+3.340486 
## [89]	train-rmse:77.178226+0.476065	test-rmse:87.947668+3.337424 
## [90]	train-rmse:77.091827+0.466171	test-rmse:87.936140+3.336641 
## [91]	train-rmse:77.026981+0.487630	test-rmse:87.932164+3.343607 
## [92]	train-rmse:76.959077+0.499399	test-rmse:87.936154+3.355443 
## [93]	train-rmse:76.868038+0.483608	test-rmse:87.950648+3.363331 
## [94]	train-rmse:76.768714+0.483058	test-rmse:87.960943+3.373019 
## [95]	train-rmse:76.678027+0.482771	test-rmse:87.966492+3.387529 
## [96]	train-rmse:76.598044+0.512581	test-rmse:87.972636+3.378537 
## [97]	train-rmse:76.505930+0.505354	test-rmse:87.983180+3.379261 
## [98]	train-rmse:76.427791+0.507720	test-rmse:87.996381+3.377465 
## [99]	train-rmse:76.350201+0.521211	test-rmse:87.997910+3.370309 
## [100]	train-rmse:76.275000+0.525694	test-rmse:88.009780+3.369478 
## [101]	train-rmse:76.201106+0.540331	test-rmse:88.017504+3.368122 
## [102]	train-rmse:76.090723+0.540314	test-rmse:88.030791+3.369020 
## [103]	train-rmse:76.021982+0.535731	test-rmse:88.031296+3.374887 
## [104]	train-rmse:75.934450+0.546468	test-rmse:88.056629+3.359841 
## Stopping. Best iteration:
## [84]	train-rmse:77.646999+0.427119	test-rmse:87.917989+3.320636
## 
## [1]	train-rmse:2269.022925+0.296554	test-rmse:2269.034766+2.914058 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:2058.180420+0.269097	test-rmse:2058.175781+2.854150 
## [3]	train-rmse:1866.992224+0.243261	test-rmse:1867.003064+2.823504 
## [4]	train-rmse:1693.663892+0.217081	test-rmse:1693.667700+2.799244 
## [5]	train-rmse:1536.521509+0.197971	test-rmse:1536.508386+2.743795 
## [6]	train-rmse:1394.052002+0.182249	test-rmse:1394.036316+2.739338 
## [7]	train-rmse:1264.913196+0.164826	test-rmse:1264.901257+2.703375 
## [8]	train-rmse:1147.838635+0.156049	test-rmse:1147.839258+2.709659 
## [9]	train-rmse:1041.743225+0.142996	test-rmse:1041.711743+2.695139 
## [10]	train-rmse:945.569141+0.128482	test-rmse:945.548657+2.691074 
## [11]	train-rmse:858.439111+0.117549	test-rmse:858.458948+2.671740 
## [12]	train-rmse:779.499548+0.105194	test-rmse:779.504492+2.675612 
## [13]	train-rmse:707.989288+0.099088	test-rmse:708.049078+2.675162 
## [14]	train-rmse:643.237634+0.093258	test-rmse:643.323712+2.698346 
## [15]	train-rmse:584.611035+0.092929	test-rmse:584.726135+2.710201 
## [16]	train-rmse:531.555750+0.097474	test-rmse:531.669971+2.725653 
## [17]	train-rmse:483.566452+0.101372	test-rmse:483.668234+2.754065 
## [18]	train-rmse:440.181406+0.105758	test-rmse:440.316907+2.746338 
## [19]	train-rmse:400.978323+0.108649	test-rmse:401.151956+2.791064 
## [20]	train-rmse:365.569318+0.116359	test-rmse:365.791107+2.804582 
## [21]	train-rmse:333.625873+0.122670	test-rmse:333.897357+2.847343 
## [22]	train-rmse:304.825818+0.129438	test-rmse:305.176282+2.892761 
## [23]	train-rmse:278.897586+0.141564	test-rmse:279.367523+2.891088 
## [24]	train-rmse:255.567187+0.153102	test-rmse:256.195926+2.947923 
## [25]	train-rmse:234.623604+0.172936	test-rmse:235.418634+2.996940 
## [26]	train-rmse:215.850743+0.186668	test-rmse:216.787656+3.040756 
## [27]	train-rmse:199.042973+0.210846	test-rmse:200.184300+3.077993 
## [28]	train-rmse:184.049162+0.224479	test-rmse:185.330249+3.118192 
## [29]	train-rmse:170.695043+0.258253	test-rmse:172.244832+3.165882 
## [30]	train-rmse:158.840674+0.272272	test-rmse:160.613417+3.276859 
## [31]	train-rmse:148.347974+0.281002	test-rmse:150.405527+3.315142 
## [32]	train-rmse:139.087994+0.292100	test-rmse:141.409737+3.378625 
## [33]	train-rmse:130.956152+0.307589	test-rmse:133.541357+3.430379 
## [34]	train-rmse:123.833389+0.320771	test-rmse:126.709999+3.497906 
## [35]	train-rmse:117.610703+0.326721	test-rmse:120.819637+3.603785 
## [36]	train-rmse:112.192760+0.332548	test-rmse:115.724416+3.678836 
## [37]	train-rmse:107.518679+0.335837	test-rmse:111.342409+3.756604 
## [38]	train-rmse:103.459615+0.332620	test-rmse:107.614296+3.830811 
## [39]	train-rmse:99.991051+0.347286	test-rmse:104.420623+3.890827 
## [40]	train-rmse:97.001984+0.352693	test-rmse:101.754764+3.962742 
## [41]	train-rmse:94.449752+0.359966	test-rmse:99.494783+3.999970 
## [42]	train-rmse:92.263487+0.366929	test-rmse:97.542287+4.058181 
## [43]	train-rmse:90.404763+0.378562	test-rmse:95.925737+4.091655 
## [44]	train-rmse:88.801690+0.390072	test-rmse:94.580814+4.154556 
## [45]	train-rmse:87.428438+0.387776	test-rmse:93.460938+4.205154 
## [46]	train-rmse:86.275867+0.395885	test-rmse:92.516354+4.248548 
## [47]	train-rmse:85.283213+0.392280	test-rmse:91.732982+4.311129 
## [48]	train-rmse:84.411991+0.387537	test-rmse:91.063443+4.334058 
## [49]	train-rmse:83.668391+0.380160	test-rmse:90.539507+4.366255 
## [50]	train-rmse:83.040198+0.379542	test-rmse:90.089274+4.396704 
## [51]	train-rmse:82.475289+0.376419	test-rmse:89.714838+4.411893 
## [52]	train-rmse:81.988598+0.353720	test-rmse:89.436346+4.408381 
## [53]	train-rmse:81.571516+0.346259	test-rmse:89.193912+4.431723 
## [54]	train-rmse:81.194840+0.341003	test-rmse:88.971710+4.455981 
## [55]	train-rmse:80.845295+0.354693	test-rmse:88.783614+4.462568 
## [56]	train-rmse:80.563968+0.353590	test-rmse:88.642915+4.475594 
## [57]	train-rmse:80.301222+0.338999	test-rmse:88.543595+4.475608 
## [58]	train-rmse:80.057423+0.365757	test-rmse:88.477370+4.528337 
## [59]	train-rmse:79.806525+0.370957	test-rmse:88.396677+4.516435 
## [60]	train-rmse:79.611299+0.389684	test-rmse:88.352200+4.528294 
## [61]	train-rmse:79.406255+0.380474	test-rmse:88.300403+4.532060 
## [62]	train-rmse:79.197170+0.404587	test-rmse:88.266280+4.538149 
## [63]	train-rmse:79.029259+0.418459	test-rmse:88.250200+4.529308 
## [64]	train-rmse:78.864966+0.417410	test-rmse:88.214774+4.535830 
## [65]	train-rmse:78.716155+0.420104	test-rmse:88.189882+4.521111 
## [66]	train-rmse:78.580858+0.410838	test-rmse:88.187847+4.540640 
## [67]	train-rmse:78.433739+0.402429	test-rmse:88.193378+4.542724 
## [68]	train-rmse:78.285291+0.374014	test-rmse:88.192669+4.557415 
## [69]	train-rmse:78.199645+0.380370	test-rmse:88.189854+4.568391 
## [70]	train-rmse:78.079719+0.396812	test-rmse:88.202765+4.573581 
## [71]	train-rmse:77.963386+0.420983	test-rmse:88.201099+4.572638 
## [72]	train-rmse:77.869655+0.429975	test-rmse:88.203445+4.576887 
## [73]	train-rmse:77.739825+0.401280	test-rmse:88.178549+4.598866 
## [74]	train-rmse:77.602640+0.399377	test-rmse:88.197627+4.592300 
## [75]	train-rmse:77.490100+0.388208	test-rmse:88.209008+4.597565 
## [76]	train-rmse:77.391196+0.370999	test-rmse:88.199434+4.591601 
## [77]	train-rmse:77.275441+0.385809	test-rmse:88.186667+4.581279 
## [78]	train-rmse:77.197371+0.386121	test-rmse:88.206033+4.584171 
## [79]	train-rmse:77.089671+0.404697	test-rmse:88.232879+4.571405 
## [80]	train-rmse:76.990335+0.410566	test-rmse:88.240086+4.596822 
## [81]	train-rmse:76.905900+0.409804	test-rmse:88.234940+4.593990 
## [82]	train-rmse:76.790632+0.403766	test-rmse:88.246867+4.593490 
## [83]	train-rmse:76.683664+0.413331	test-rmse:88.236633+4.599021 
## [84]	train-rmse:76.585776+0.404110	test-rmse:88.243753+4.586435 
## [85]	train-rmse:76.493456+0.408365	test-rmse:88.238225+4.585080 
## [86]	train-rmse:76.419489+0.403129	test-rmse:88.242504+4.587988 
## [87]	train-rmse:76.363151+0.395031	test-rmse:88.249067+4.590704 
## [88]	train-rmse:76.279028+0.392279	test-rmse:88.252810+4.569636 
## [89]	train-rmse:76.188430+0.404327	test-rmse:88.279272+4.589909 
## [90]	train-rmse:76.084190+0.432925	test-rmse:88.284559+4.585561 
## [91]	train-rmse:75.992870+0.437034	test-rmse:88.284556+4.582863 
## [92]	train-rmse:75.905665+0.447646	test-rmse:88.293863+4.616719 
## [93]	train-rmse:75.824772+0.468399	test-rmse:88.311939+4.628524 
## Stopping. Best iteration:
## [73]	train-rmse:77.739825+0.401280	test-rmse:88.178549+4.598866
## 
## [1]	train-rmse:2243.215698+0.480836	test-rmse:2243.214038+4.761681 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:2011.647656+0.431423	test-rmse:2011.657788+4.677158 
## [3]	train-rmse:1804.068018+0.385573	test-rmse:1804.074927+4.586132 
## [4]	train-rmse:1618.040332+0.344157	test-rmse:1618.027393+4.482556 
## [5]	train-rmse:1451.296985+0.307575	test-rmse:1451.253699+4.388798 
## [6]	train-rmse:1301.866370+0.274518	test-rmse:1301.821228+4.334902 
## [7]	train-rmse:1167.979724+0.244939	test-rmse:1167.929688+4.145080 
## [8]	train-rmse:1047.993811+0.216812	test-rmse:1047.986450+4.114064 
## [9]	train-rmse:940.525372+0.193284	test-rmse:940.531158+3.985078 
## [10]	train-rmse:844.243878+0.175287	test-rmse:844.270941+3.915617 
## [11]	train-rmse:758.026294+0.148590	test-rmse:758.083038+3.879383 
## [12]	train-rmse:680.836188+0.133862	test-rmse:680.887756+3.798693 
## [13]	train-rmse:611.752838+0.117918	test-rmse:611.838153+3.708624 
## [14]	train-rmse:549.954425+0.108677	test-rmse:550.041290+3.644139 
## [15]	train-rmse:494.697858+0.102303	test-rmse:494.833734+3.572661 
## [16]	train-rmse:445.314063+0.093609	test-rmse:445.465601+3.509016 
## [17]	train-rmse:401.220862+0.092598	test-rmse:401.401987+3.386853 
## [18]	train-rmse:361.873761+0.095347	test-rmse:362.083679+3.346921 
## [19]	train-rmse:326.796622+0.098595	test-rmse:327.116003+3.279046 
## [20]	train-rmse:295.566367+0.103548	test-rmse:295.956625+3.212959 
## [21]	train-rmse:267.802405+0.111762	test-rmse:268.304004+3.154268 
## [22]	train-rmse:243.154486+0.110294	test-rmse:243.829611+3.075337 
## [23]	train-rmse:221.321100+0.124793	test-rmse:222.173906+3.034855 
## [24]	train-rmse:202.032172+0.136460	test-rmse:203.046924+2.976411 
## [25]	train-rmse:185.022249+0.153461	test-rmse:186.269060+2.964425 
## [26]	train-rmse:170.087202+0.181905	test-rmse:171.567941+2.921445 
## [27]	train-rmse:157.011021+0.191379	test-rmse:158.765134+2.899297 
## [28]	train-rmse:145.620927+0.207982	test-rmse:147.636409+2.877038 
## [29]	train-rmse:135.712499+0.227303	test-rmse:138.038804+2.821582 
## [30]	train-rmse:127.176201+0.263637	test-rmse:129.814654+2.832087 
## [31]	train-rmse:119.788274+0.273287	test-rmse:122.770219+2.840177 
## [32]	train-rmse:113.486518+0.283082	test-rmse:116.771210+2.833037 
## [33]	train-rmse:108.099960+0.282782	test-rmse:111.756096+2.832647 
## [34]	train-rmse:103.539185+0.304080	test-rmse:107.520669+2.816202 
## [35]	train-rmse:99.666285+0.315060	test-rmse:103.998009+2.892220 
## [36]	train-rmse:96.417315+0.338167	test-rmse:101.020575+2.937979 
## [37]	train-rmse:93.688288+0.334915	test-rmse:98.599713+2.947475 
## [38]	train-rmse:91.378828+0.311381	test-rmse:96.582988+2.992830 
## [39]	train-rmse:89.443082+0.313339	test-rmse:94.941871+3.036316 
## [40]	train-rmse:87.830739+0.329136	test-rmse:93.589904+3.073257 
## [41]	train-rmse:86.488780+0.358576	test-rmse:92.502921+3.090817 
## [42]	train-rmse:85.357199+0.375074	test-rmse:91.579909+3.115458 
## [43]	train-rmse:84.384191+0.383850	test-rmse:90.835765+3.138234 
## [44]	train-rmse:83.558483+0.364847	test-rmse:90.257962+3.143014 
## [45]	train-rmse:82.860843+0.358276	test-rmse:89.761570+3.172915 
## [46]	train-rmse:82.240715+0.345756	test-rmse:89.400121+3.181496 
## [47]	train-rmse:81.731399+0.330630	test-rmse:89.104301+3.196195 
## [48]	train-rmse:81.292239+0.330257	test-rmse:88.862765+3.239914 
## [49]	train-rmse:80.883915+0.333698	test-rmse:88.638013+3.242471 
## [50]	train-rmse:80.522384+0.330959	test-rmse:88.474414+3.238495 
## [51]	train-rmse:80.210400+0.307420	test-rmse:88.351298+3.269045 
## [52]	train-rmse:79.941246+0.331858	test-rmse:88.245850+3.278467 
## [53]	train-rmse:79.690460+0.355567	test-rmse:88.184775+3.267883 
## [54]	train-rmse:79.487123+0.343081	test-rmse:88.132221+3.271087 
## [55]	train-rmse:79.263337+0.344001	test-rmse:88.078005+3.285294 
## [56]	train-rmse:79.087715+0.343634	test-rmse:88.042354+3.303838 
## [57]	train-rmse:78.940881+0.309955	test-rmse:87.991805+3.326490 
## [58]	train-rmse:78.774018+0.306269	test-rmse:87.962350+3.316789 
## [59]	train-rmse:78.571789+0.322465	test-rmse:87.959544+3.330170 
## [60]	train-rmse:78.445400+0.295898	test-rmse:87.930323+3.329018 
## [61]	train-rmse:78.299486+0.300792	test-rmse:87.917004+3.364833 
## [62]	train-rmse:78.130956+0.284893	test-rmse:87.890169+3.364200 
## [63]	train-rmse:77.989432+0.274266	test-rmse:87.893841+3.366583 
## [64]	train-rmse:77.860645+0.329325	test-rmse:87.900664+3.378786 
## [65]	train-rmse:77.744886+0.322573	test-rmse:87.891398+3.374156 
## [66]	train-rmse:77.612820+0.324752	test-rmse:87.881647+3.381133 
## [67]	train-rmse:77.467731+0.343643	test-rmse:87.880903+3.364571 
## [68]	train-rmse:77.364193+0.318426	test-rmse:87.907595+3.366199 
## [69]	train-rmse:77.246471+0.364567	test-rmse:87.918568+3.365292 
## [70]	train-rmse:77.109596+0.371644	test-rmse:87.927173+3.358925 
## [71]	train-rmse:76.977959+0.384556	test-rmse:87.911658+3.355165 
## [72]	train-rmse:76.867078+0.358728	test-rmse:87.891598+3.355749 
## [73]	train-rmse:76.755046+0.352564	test-rmse:87.883523+3.368229 
## [74]	train-rmse:76.660330+0.350074	test-rmse:87.885486+3.373813 
## [75]	train-rmse:76.554050+0.349172	test-rmse:87.875952+3.396600 
## [76]	train-rmse:76.423400+0.319585	test-rmse:87.892216+3.394324 
## [77]	train-rmse:76.292505+0.333643	test-rmse:87.891544+3.380606 
## [78]	train-rmse:76.198423+0.315414	test-rmse:87.900620+3.369760 
## [79]	train-rmse:76.098455+0.306771	test-rmse:87.909213+3.370305 
## [80]	train-rmse:75.984830+0.320648	test-rmse:87.921380+3.387794 
## [81]	train-rmse:75.887000+0.318730	test-rmse:87.931048+3.368519 
## [82]	train-rmse:75.752061+0.318717	test-rmse:87.916428+3.394003 
## [83]	train-rmse:75.664263+0.324596	test-rmse:87.925337+3.378161 
## [84]	train-rmse:75.546533+0.317302	test-rmse:87.932205+3.377621 
## [85]	train-rmse:75.468414+0.338263	test-rmse:87.937814+3.373175 
## [86]	train-rmse:75.375280+0.340276	test-rmse:87.943665+3.382506 
## [87]	train-rmse:75.265765+0.352024	test-rmse:87.967243+3.381037 
## [88]	train-rmse:75.161703+0.382950	test-rmse:87.985160+3.366750 
## [89]	train-rmse:75.071869+0.380760	test-rmse:87.996926+3.370371 
## [90]	train-rmse:74.987196+0.371396	test-rmse:88.009680+3.378490 
## [91]	train-rmse:74.885944+0.359931	test-rmse:88.009190+3.377053 
## [92]	train-rmse:74.796860+0.328878	test-rmse:88.011360+3.377551 
## [93]	train-rmse:74.682242+0.321442	test-rmse:88.019861+3.375778 
## [94]	train-rmse:74.577951+0.333500	test-rmse:88.047485+3.386985 
## [95]	train-rmse:74.474961+0.326549	test-rmse:88.056032+3.389499 
## Stopping. Best iteration:
## [75]	train-rmse:76.554050+0.349172	test-rmse:87.875952+3.396600
## 
## [1]	train-rmse:2217.405176+0.389063	test-rmse:2217.436255+3.844210 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1965.648682+0.344505	test-rmse:1965.653943+3.878048 
## [3]	train-rmse:1742.584094+0.309364	test-rmse:1742.621204+3.790158 
## [4]	train-rmse:1544.984143+0.267849	test-rmse:1545.072693+3.843632 
## [5]	train-rmse:1369.934583+0.246178	test-rmse:1369.985217+3.785420 
## [6]	train-rmse:1214.878870+0.223101	test-rmse:1214.940662+3.695229 
## [7]	train-rmse:1077.565039+0.198468	test-rmse:1077.604626+3.699089 
## [8]	train-rmse:955.957611+0.183346	test-rmse:955.995954+3.677468 
## [9]	train-rmse:848.303851+0.160965	test-rmse:848.334961+3.650577 
## [10]	train-rmse:753.015564+0.146686	test-rmse:753.033044+3.642483 
## [11]	train-rmse:668.699737+0.138902	test-rmse:668.713800+3.638304 
## [12]	train-rmse:594.129785+0.128874	test-rmse:594.194312+3.567299 
## [13]	train-rmse:528.215326+0.120160	test-rmse:528.274054+3.591685 
## [14]	train-rmse:469.984979+0.114973	test-rmse:470.069443+3.580576 
## [15]	train-rmse:418.586783+0.109065	test-rmse:418.707626+3.566881 
## [16]	train-rmse:373.263297+0.109109	test-rmse:373.429169+3.512543 
## [17]	train-rmse:333.334985+0.105193	test-rmse:333.566281+3.510402 
## [18]	train-rmse:298.214237+0.104011	test-rmse:298.564130+3.536337 
## [19]	train-rmse:267.368756+0.109126	test-rmse:267.834235+3.507406 
## [20]	train-rmse:240.328212+0.113275	test-rmse:240.971844+3.487454 
## [21]	train-rmse:216.702344+0.119515	test-rmse:217.523683+3.483488 
## [22]	train-rmse:196.104437+0.119845	test-rmse:197.139845+3.452745 
## [23]	train-rmse:178.199088+0.124105	test-rmse:179.552675+3.440075 
## [24]	train-rmse:162.743609+0.136096	test-rmse:164.357661+3.459204 
## [25]	train-rmse:149.419151+0.149313	test-rmse:151.341829+3.472102 
## [26]	train-rmse:138.001500+0.148883	test-rmse:140.263210+3.479048 
## [27]	train-rmse:128.282078+0.146864	test-rmse:130.913942+3.444312 
## [28]	train-rmse:120.037023+0.153944	test-rmse:123.024327+3.421678 
## [29]	train-rmse:113.094827+0.172933	test-rmse:116.481950+3.392028 
## [30]	train-rmse:107.281275+0.207160	test-rmse:111.037621+3.409767 
## [31]	train-rmse:102.412115+0.216868	test-rmse:106.515110+3.366574 
## [32]	train-rmse:98.386631+0.226049	test-rmse:102.850000+3.340589 
## [33]	train-rmse:95.037636+0.239573	test-rmse:99.843883+3.334554 
## [34]	train-rmse:92.294852+0.250379	test-rmse:97.452710+3.302885 
## [35]	train-rmse:90.001932+0.226010	test-rmse:95.512204+3.272469 
## [36]	train-rmse:88.132990+0.246722	test-rmse:93.965163+3.229534 
## [37]	train-rmse:86.630973+0.257877	test-rmse:92.721247+3.188645 
## [38]	train-rmse:85.352966+0.255893	test-rmse:91.729625+3.178680 
## [39]	train-rmse:84.305543+0.244013	test-rmse:90.915739+3.180361 
## [40]	train-rmse:83.463918+0.251223	test-rmse:90.282786+3.117820 
## [41]	train-rmse:82.732510+0.237659	test-rmse:89.802946+3.089042 
## [42]	train-rmse:82.095289+0.258255	test-rmse:89.395339+3.113754 
## [43]	train-rmse:81.550774+0.284689	test-rmse:89.088931+3.060042 
## [44]	train-rmse:81.084198+0.256917	test-rmse:88.831311+3.057384 
## [45]	train-rmse:80.727988+0.274125	test-rmse:88.623779+3.043785 
## [46]	train-rmse:80.384608+0.275932	test-rmse:88.461574+3.043855 
## [47]	train-rmse:80.091072+0.257624	test-rmse:88.332059+3.029053 
## [48]	train-rmse:79.805426+0.255736	test-rmse:88.228398+3.016989 
## [49]	train-rmse:79.601808+0.238827	test-rmse:88.155098+3.007117 
## [50]	train-rmse:79.370851+0.253817	test-rmse:88.090952+2.981446 
## [51]	train-rmse:79.148026+0.237641	test-rmse:88.055544+2.959640 
## [52]	train-rmse:78.972569+0.261311	test-rmse:88.007906+2.925341 
## [53]	train-rmse:78.801913+0.257055	test-rmse:87.998609+2.918323 
## [54]	train-rmse:78.657903+0.265081	test-rmse:87.977364+2.920929 
## [55]	train-rmse:78.506372+0.252353	test-rmse:87.949966+2.916664 
## [56]	train-rmse:78.327771+0.262239	test-rmse:87.949457+2.932982 
## [57]	train-rmse:78.164110+0.279667	test-rmse:87.960814+2.922858 
## [58]	train-rmse:78.015052+0.295584	test-rmse:87.952056+2.914705 
## [59]	train-rmse:77.897942+0.345656	test-rmse:87.948994+2.922074 
## [60]	train-rmse:77.754755+0.347426	test-rmse:87.957767+2.909451 
## [61]	train-rmse:77.626463+0.366638	test-rmse:87.932799+2.885758 
## [62]	train-rmse:77.513335+0.357984	test-rmse:87.950116+2.884761 
## [63]	train-rmse:77.382683+0.386135	test-rmse:87.953228+2.883216 
## [64]	train-rmse:77.262820+0.392926	test-rmse:87.936703+2.887862 
## [65]	train-rmse:77.154906+0.376529	test-rmse:87.935286+2.867591 
## [66]	train-rmse:77.029765+0.375890	test-rmse:87.926556+2.846456 
## [67]	train-rmse:76.906980+0.361614	test-rmse:87.931090+2.851295 
## [68]	train-rmse:76.795355+0.387908	test-rmse:87.926516+2.840736 
## [69]	train-rmse:76.675178+0.356694	test-rmse:87.926242+2.826622 
## [70]	train-rmse:76.549396+0.362948	test-rmse:87.931061+2.828153 
## [71]	train-rmse:76.429498+0.384134	test-rmse:87.941178+2.844186 
## [72]	train-rmse:76.288328+0.405510	test-rmse:87.965720+2.838818 
## [73]	train-rmse:76.177433+0.413444	test-rmse:87.972926+2.825494 
## [74]	train-rmse:76.026981+0.419924	test-rmse:87.987363+2.797092 
## [75]	train-rmse:75.903833+0.431985	test-rmse:87.984840+2.789519 
## [76]	train-rmse:75.762120+0.438828	test-rmse:88.015160+2.807329 
## [77]	train-rmse:75.675507+0.454068	test-rmse:88.003241+2.802907 
## [78]	train-rmse:75.557001+0.479781	test-rmse:88.002104+2.792075 
## [79]	train-rmse:75.455592+0.483102	test-rmse:87.988454+2.777642 
## [80]	train-rmse:75.349895+0.482493	test-rmse:87.995831+2.789890 
## [81]	train-rmse:75.248033+0.473014	test-rmse:88.009319+2.804497 
## [82]	train-rmse:75.115113+0.455283	test-rmse:88.011411+2.764335 
## [83]	train-rmse:74.978534+0.430247	test-rmse:88.020684+2.765382 
## [84]	train-rmse:74.867132+0.446172	test-rmse:88.047314+2.759678 
## [85]	train-rmse:74.757690+0.463016	test-rmse:88.055786+2.762954 
## [86]	train-rmse:74.682530+0.467672	test-rmse:88.058215+2.767446 
## [87]	train-rmse:74.573827+0.485817	test-rmse:88.049076+2.760527 
## [88]	train-rmse:74.423564+0.502126	test-rmse:88.073090+2.747295 
## [89]	train-rmse:74.298741+0.510002	test-rmse:88.066090+2.748671 
## Stopping. Best iteration:
## [69]	train-rmse:76.675178+0.356694	test-rmse:87.926242+2.826622
## 
## [1]	train-rmse:2191.598462+0.546671	test-rmse:2191.590307+5.578281 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1920.191406+0.480907	test-rmse:1920.183215+5.493124 
## [3]	train-rmse:1682.523865+0.414924	test-rmse:1682.485864+5.363027 
## [4]	train-rmse:1474.471838+0.357810	test-rmse:1474.478796+5.204911 
## [5]	train-rmse:1292.302466+0.315806	test-rmse:1292.324072+5.074909 
## [6]	train-rmse:1132.846985+0.269398	test-rmse:1132.824365+5.003019 
## [7]	train-rmse:993.303662+0.232325	test-rmse:993.351794+4.852680 
## [8]	train-rmse:871.190826+0.205410	test-rmse:871.236121+4.788560 
## [9]	train-rmse:764.391547+0.172501	test-rmse:764.404706+4.643228 
## [10]	train-rmse:670.998175+0.143373	test-rmse:671.015997+4.490133 
## [11]	train-rmse:589.377539+0.124075	test-rmse:589.404541+4.354658 
## [12]	train-rmse:518.089411+0.103482	test-rmse:518.154144+4.181125 
## [13]	train-rmse:455.873575+0.089666	test-rmse:455.949084+4.041434 
## [14]	train-rmse:401.635260+0.078976	test-rmse:401.769806+3.902415 
## [15]	train-rmse:354.404541+0.076311	test-rmse:354.613431+3.746216 
## [16]	train-rmse:313.338858+0.073905	test-rmse:313.614624+3.562080 
## [17]	train-rmse:277.691257+0.075908	test-rmse:278.095425+3.431937 
## [18]	train-rmse:246.827979+0.080089	test-rmse:247.404274+3.292478 
## [19]	train-rmse:220.186142+0.087470	test-rmse:220.981039+3.135259 
## [20]	train-rmse:197.258864+0.097375	test-rmse:198.290793+3.002462 
## [21]	train-rmse:177.612334+0.109572	test-rmse:178.901364+2.873160 
## [22]	train-rmse:160.854738+0.123020	test-rmse:162.488823+2.706620 
## [23]	train-rmse:146.640608+0.125876	test-rmse:148.586371+2.544717 
## [24]	train-rmse:134.679749+0.122344	test-rmse:136.995727+2.403226 
## [25]	train-rmse:124.661487+0.134623	test-rmse:127.351701+2.202090 
## [26]	train-rmse:116.288976+0.142640	test-rmse:119.426922+2.021656 
## [27]	train-rmse:109.405451+0.156469	test-rmse:112.925321+1.907755 
## [28]	train-rmse:103.720224+0.171242	test-rmse:107.697376+1.829913 
## [29]	train-rmse:99.079342+0.176866	test-rmse:103.475893+1.752808 
## [30]	train-rmse:95.341197+0.203489	test-rmse:100.087608+1.678675 
## [31]	train-rmse:92.332262+0.193418	test-rmse:97.381326+1.698340 
## [32]	train-rmse:89.856739+0.225490	test-rmse:95.288767+1.756519 
## [33]	train-rmse:87.886043+0.260320	test-rmse:93.643771+1.762397 
## [34]	train-rmse:86.259519+0.252914	test-rmse:92.349882+1.777261 
## [35]	train-rmse:84.951333+0.247689	test-rmse:91.334266+1.801964 
## [36]	train-rmse:83.903216+0.289226	test-rmse:90.542271+1.849532 
## [37]	train-rmse:83.025633+0.315582	test-rmse:89.908185+1.870581 
## [38]	train-rmse:82.312633+0.299762	test-rmse:89.418385+1.911895 
## [39]	train-rmse:81.692610+0.276710	test-rmse:89.038577+1.938687 
## [40]	train-rmse:81.176257+0.247068	test-rmse:88.770021+1.998031 
## [41]	train-rmse:80.771433+0.274071	test-rmse:88.569273+2.021093 
## [42]	train-rmse:80.395004+0.285659	test-rmse:88.394007+2.040826 
## [43]	train-rmse:80.095092+0.323115	test-rmse:88.242206+2.087171 
## [44]	train-rmse:79.817759+0.312278	test-rmse:88.131271+2.142595 
## [45]	train-rmse:79.545973+0.279643	test-rmse:88.031160+2.179251 
## [46]	train-rmse:79.272600+0.314128	test-rmse:87.960567+2.195827 
## [47]	train-rmse:79.092669+0.296366	test-rmse:87.927176+2.194940 
## [48]	train-rmse:78.872028+0.341199	test-rmse:87.860506+2.206249 
## [49]	train-rmse:78.669263+0.339365	test-rmse:87.839883+2.203714 
## [50]	train-rmse:78.503555+0.367958	test-rmse:87.817070+2.225137 
## [51]	train-rmse:78.350516+0.350049	test-rmse:87.810458+2.229566 
## [52]	train-rmse:78.191785+0.363597	test-rmse:87.808337+2.250057 
## [53]	train-rmse:78.052110+0.366180	test-rmse:87.768780+2.271452 
## [54]	train-rmse:77.924467+0.349470	test-rmse:87.791765+2.269479 
## [55]	train-rmse:77.772544+0.362074	test-rmse:87.767753+2.255857 
## [56]	train-rmse:77.598115+0.374922	test-rmse:87.791252+2.275420 
## [57]	train-rmse:77.462301+0.343944	test-rmse:87.771891+2.302636 
## [58]	train-rmse:77.299104+0.326753	test-rmse:87.767044+2.295048 
## [59]	train-rmse:77.127584+0.340158	test-rmse:87.773074+2.312347 
## [60]	train-rmse:77.019567+0.308165	test-rmse:87.772276+2.315488 
## [61]	train-rmse:76.868452+0.323544	test-rmse:87.783368+2.320497 
## [62]	train-rmse:76.742605+0.323158	test-rmse:87.784294+2.316868 
## [63]	train-rmse:76.599748+0.336372	test-rmse:87.794501+2.317760 
## [64]	train-rmse:76.465141+0.392063	test-rmse:87.791038+2.318686 
## [65]	train-rmse:76.342038+0.408859	test-rmse:87.803967+2.311028 
## [66]	train-rmse:76.196077+0.437297	test-rmse:87.822960+2.308805 
## [67]	train-rmse:76.109462+0.451543	test-rmse:87.828971+2.313737 
## [68]	train-rmse:76.006499+0.430221	test-rmse:87.843694+2.306855 
## [69]	train-rmse:75.863764+0.426973	test-rmse:87.863768+2.305362 
## [70]	train-rmse:75.708820+0.436874	test-rmse:87.846663+2.298212 
## [71]	train-rmse:75.587488+0.446707	test-rmse:87.861008+2.280662 
## [72]	train-rmse:75.476810+0.438578	test-rmse:87.851884+2.272240 
## [73]	train-rmse:75.337947+0.407102	test-rmse:87.837142+2.263633 
## [74]	train-rmse:75.207836+0.384712	test-rmse:87.843094+2.267027 
## [75]	train-rmse:75.094897+0.396920	test-rmse:87.848993+2.252155 
## [76]	train-rmse:74.969726+0.362381	test-rmse:87.873366+2.254993 
## [77]	train-rmse:74.820014+0.364745	test-rmse:87.864182+2.264881 
## [78]	train-rmse:74.660049+0.366518	test-rmse:87.876506+2.280086 
## Stopping. Best iteration:
## [58]	train-rmse:77.299104+0.326753	test-rmse:87.767044+2.295048
## 
## [1]	train-rmse:2165.793188+0.388294	test-rmse:2165.792432+3.865024 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1875.262610+0.331352	test-rmse:1875.217114+3.831620 
## [3]	train-rmse:1623.869543+0.290117	test-rmse:1623.862048+3.752331 
## [4]	train-rmse:1406.399561+0.248367	test-rmse:1406.327673+3.714001 
## [5]	train-rmse:1218.268323+0.214452	test-rmse:1218.205713+3.654864 
## [6]	train-rmse:1055.548755+0.178896	test-rmse:1055.524963+3.537967 
## [7]	train-rmse:914.857178+0.149466	test-rmse:914.824695+3.563669 
## [8]	train-rmse:793.233997+0.119515	test-rmse:793.220715+3.500099 
## [9]	train-rmse:688.147247+0.101894	test-rmse:688.124719+3.450005 
## [10]	train-rmse:597.394263+0.078039	test-rmse:597.377380+3.473610 
## [11]	train-rmse:519.076788+0.070254	test-rmse:519.098187+3.452915 
## [12]	train-rmse:451.560925+0.068616	test-rmse:451.621234+3.432071 
## [13]	train-rmse:393.417853+0.067716	test-rmse:393.487882+3.420882 
## [14]	train-rmse:343.422671+0.067103	test-rmse:343.620722+3.353136 
## [15]	train-rmse:300.514261+0.072291	test-rmse:300.833337+3.303805 
## [16]	train-rmse:263.778113+0.083400	test-rmse:264.271164+3.226099 
## [17]	train-rmse:232.407002+0.093334	test-rmse:233.165662+3.160916 
## [18]	train-rmse:205.720120+0.105996	test-rmse:206.630859+3.089419 
## [19]	train-rmse:183.141551+0.116558	test-rmse:184.334460+3.027612 
## [20]	train-rmse:164.123933+0.125064	test-rmse:165.648843+2.959262 
## [21]	train-rmse:148.202418+0.148702	test-rmse:150.128958+2.864031 
## [22]	train-rmse:134.961418+0.172252	test-rmse:137.291580+2.784659 
## [23]	train-rmse:124.052486+0.185848	test-rmse:126.814591+2.734397 
## [24]	train-rmse:115.150779+0.196623	test-rmse:118.322739+2.678425 
## [25]	train-rmse:107.877808+0.243157	test-rmse:111.531079+2.603266 
## [26]	train-rmse:102.040059+0.242189	test-rmse:106.144203+2.560074 
## [27]	train-rmse:97.388761+0.263168	test-rmse:101.884390+2.461549 
## [28]	train-rmse:93.678423+0.291961	test-rmse:98.578013+2.418437 
## [29]	train-rmse:90.739555+0.286187	test-rmse:96.006444+2.351421 
## [30]	train-rmse:88.410773+0.315802	test-rmse:94.060284+2.336432 
## [31]	train-rmse:86.529223+0.324833	test-rmse:92.528324+2.348959 
## [32]	train-rmse:85.081597+0.321740	test-rmse:91.370613+2.323538 
## [33]	train-rmse:83.909294+0.360713	test-rmse:90.505741+2.374673 
## [34]	train-rmse:82.980971+0.371952	test-rmse:89.813603+2.397262 
## [35]	train-rmse:82.223016+0.380800	test-rmse:89.288514+2.400253 
## [36]	train-rmse:81.578710+0.385875	test-rmse:88.912314+2.417300 
## [37]	train-rmse:81.066032+0.404417	test-rmse:88.634769+2.423657 
## [38]	train-rmse:80.626602+0.419596	test-rmse:88.430223+2.428692 
## [39]	train-rmse:80.223851+0.427975	test-rmse:88.262070+2.442194 
## [40]	train-rmse:79.890325+0.410524	test-rmse:88.150847+2.453443 
## [41]	train-rmse:79.601118+0.457826	test-rmse:88.067633+2.468422 
## [42]	train-rmse:79.339521+0.427114	test-rmse:88.006406+2.485979 
## [43]	train-rmse:79.103642+0.418534	test-rmse:87.964194+2.483705 
## [44]	train-rmse:78.834440+0.449131	test-rmse:87.923104+2.495103 
## [45]	train-rmse:78.624892+0.431804	test-rmse:87.913537+2.508855 
## [46]	train-rmse:78.456369+0.416086	test-rmse:87.871979+2.498204 
## [47]	train-rmse:78.235390+0.417327	test-rmse:87.826199+2.482560 
## [48]	train-rmse:78.040253+0.465409	test-rmse:87.806406+2.510171 
## [49]	train-rmse:77.897298+0.431930	test-rmse:87.800653+2.499505 
## [50]	train-rmse:77.741938+0.460270	test-rmse:87.801251+2.495220 
## [51]	train-rmse:77.638187+0.471245	test-rmse:87.808440+2.496315 
## [52]	train-rmse:77.484820+0.472419	test-rmse:87.771863+2.518265 
## [53]	train-rmse:77.304674+0.468113	test-rmse:87.800593+2.547455 
## [54]	train-rmse:77.158663+0.426972	test-rmse:87.808478+2.552629 
## [55]	train-rmse:77.026633+0.459477	test-rmse:87.791435+2.552978 
## [56]	train-rmse:76.836462+0.434206	test-rmse:87.777986+2.570415 
## [57]	train-rmse:76.707314+0.425423	test-rmse:87.801041+2.578615 
## [58]	train-rmse:76.559200+0.410534	test-rmse:87.810083+2.580358 
## [59]	train-rmse:76.440565+0.400886	test-rmse:87.818417+2.594820 
## [60]	train-rmse:76.284569+0.414642	test-rmse:87.801595+2.619860 
## [61]	train-rmse:76.163516+0.416744	test-rmse:87.826509+2.615908 
## [62]	train-rmse:76.045911+0.425987	test-rmse:87.821317+2.619110 
## [63]	train-rmse:75.902621+0.405246	test-rmse:87.862877+2.601634 
## [64]	train-rmse:75.781616+0.420634	test-rmse:87.861567+2.607255 
## [65]	train-rmse:75.665041+0.434395	test-rmse:87.845815+2.604559 
## [66]	train-rmse:75.530551+0.419786	test-rmse:87.850639+2.621305 
## [67]	train-rmse:75.400572+0.443620	test-rmse:87.860923+2.645212 
## [68]	train-rmse:75.273869+0.444928	test-rmse:87.873086+2.628577 
## [69]	train-rmse:75.146014+0.418734	test-rmse:87.890862+2.632848 
## [70]	train-rmse:75.027709+0.420803	test-rmse:87.903317+2.628180 
## [71]	train-rmse:74.892971+0.423198	test-rmse:87.898668+2.632316 
## [72]	train-rmse:74.749191+0.441806	test-rmse:87.898079+2.643329 
## Stopping. Best iteration:
## [52]	train-rmse:77.484820+0.472419	test-rmse:87.771863+2.518265
## 
## [1]	train-rmse:2139.985669+0.339651	test-rmse:2139.983276+3.501443 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1830.876526+0.288410	test-rmse:1830.874487+3.492398 
## [3]	train-rmse:1566.604529+0.245832	test-rmse:1566.569043+3.419689 
## [4]	train-rmse:1340.739148+0.209072	test-rmse:1340.646191+3.377211 
## [5]	train-rmse:1147.703467+0.176788	test-rmse:1147.616919+3.324768 
## [6]	train-rmse:982.759381+0.150570	test-rmse:982.740857+3.264368 
## [7]	train-rmse:841.873407+0.125910	test-rmse:841.852795+3.256001 
## [8]	train-rmse:721.585992+0.105644	test-rmse:721.583960+3.224329 
## [9]	train-rmse:618.949182+0.087167	test-rmse:618.954321+3.166590 
## [10]	train-rmse:531.442041+0.073788	test-rmse:531.494061+3.151636 
## [11]	train-rmse:456.907797+0.071547	test-rmse:457.010110+3.106369 
## [12]	train-rmse:393.511844+0.064345	test-rmse:393.692288+3.039056 
## [13]	train-rmse:339.674854+0.060096	test-rmse:339.979882+3.008627 
## [14]	train-rmse:294.067444+0.072562	test-rmse:294.590109+3.008820 
## [15]	train-rmse:255.527057+0.072934	test-rmse:256.263980+2.865646 
## [16]	train-rmse:223.097754+0.087351	test-rmse:224.036937+2.762517 
## [17]	train-rmse:195.916847+0.092105	test-rmse:197.155945+2.664387 
## [18]	train-rmse:173.287605+0.113449	test-rmse:174.779299+2.561360 
## [19]	train-rmse:154.555617+0.127131	test-rmse:156.503313+2.405598 
## [20]	train-rmse:139.182484+0.142252	test-rmse:141.560324+2.331726 
## [21]	train-rmse:126.682759+0.162511	test-rmse:129.506082+2.189398 
## [22]	train-rmse:116.611576+0.192417	test-rmse:119.846745+2.127560 
## [23]	train-rmse:108.561388+0.188281	test-rmse:112.315985+2.123373 
## [24]	train-rmse:102.189684+0.206532	test-rmse:106.435126+2.094982 
## [25]	train-rmse:97.154841+0.265940	test-rmse:101.906935+2.129276 
## [26]	train-rmse:93.210218+0.271588	test-rmse:98.475870+2.211397 
## [27]	train-rmse:90.176862+0.307050	test-rmse:95.845725+2.291193 
## [28]	train-rmse:87.792315+0.299865	test-rmse:93.908376+2.353737 
## [29]	train-rmse:85.953890+0.325605	test-rmse:92.462925+2.463928 
## [30]	train-rmse:84.526275+0.332185	test-rmse:91.392757+2.527795 
## [31]	train-rmse:83.414319+0.314668	test-rmse:90.595901+2.606211 
## [32]	train-rmse:82.508953+0.346014	test-rmse:89.978515+2.682976 
## [33]	train-rmse:81.755186+0.355930	test-rmse:89.552335+2.739438 
## [34]	train-rmse:81.190649+0.390222	test-rmse:89.238647+2.792091 
## [35]	train-rmse:80.680924+0.389086	test-rmse:88.984670+2.849736 
## [36]	train-rmse:80.270177+0.425492	test-rmse:88.809465+2.885745 
## [37]	train-rmse:79.911600+0.427232	test-rmse:88.680703+2.928101 
## [38]	train-rmse:79.581282+0.445444	test-rmse:88.576450+2.960281 
## [39]	train-rmse:79.318427+0.434225	test-rmse:88.566592+2.971366 
## [40]	train-rmse:79.103170+0.435175	test-rmse:88.510270+2.998203 
## [41]	train-rmse:78.919231+0.430459	test-rmse:88.504448+3.000436 
## [42]	train-rmse:78.683755+0.450976	test-rmse:88.533643+3.067031 
## [43]	train-rmse:78.480133+0.418646	test-rmse:88.525948+3.112801 
## [44]	train-rmse:78.288151+0.448765	test-rmse:88.498381+3.098770 
## [45]	train-rmse:78.094762+0.447511	test-rmse:88.468152+3.132962 
## [46]	train-rmse:77.911879+0.447007	test-rmse:88.466340+3.132863 
## [47]	train-rmse:77.717447+0.476868	test-rmse:88.440441+3.123393 
## [48]	train-rmse:77.534009+0.476041	test-rmse:88.449266+3.165273 
## [49]	train-rmse:77.363547+0.475589	test-rmse:88.450114+3.206186 
## [50]	train-rmse:77.212211+0.447636	test-rmse:88.419976+3.189416 
## [51]	train-rmse:77.074908+0.483241	test-rmse:88.398227+3.174300 
## [52]	train-rmse:76.933737+0.475894	test-rmse:88.381564+3.200706 
## [53]	train-rmse:76.766025+0.444104	test-rmse:88.378760+3.201203 
## [54]	train-rmse:76.572232+0.474508	test-rmse:88.419099+3.214552 
## [55]	train-rmse:76.444162+0.497312	test-rmse:88.417076+3.217329 
## [56]	train-rmse:76.258846+0.505216	test-rmse:88.463008+3.211378 
## [57]	train-rmse:76.051557+0.520753	test-rmse:88.485663+3.226017 
## [58]	train-rmse:75.884611+0.533656	test-rmse:88.482397+3.248677 
## [59]	train-rmse:75.759651+0.561294	test-rmse:88.486239+3.272621 
## [60]	train-rmse:75.592152+0.559930	test-rmse:88.496970+3.293088 
## [61]	train-rmse:75.446966+0.571512	test-rmse:88.539367+3.301661 
## [62]	train-rmse:75.290266+0.545788	test-rmse:88.547404+3.308026 
## [63]	train-rmse:75.133351+0.538878	test-rmse:88.529842+3.287533 
## [64]	train-rmse:75.002865+0.554495	test-rmse:88.539542+3.273445 
## [65]	train-rmse:74.878834+0.551172	test-rmse:88.561943+3.258778 
## [66]	train-rmse:74.764538+0.514456	test-rmse:88.592845+3.254146 
## [67]	train-rmse:74.612176+0.498702	test-rmse:88.603833+3.242926 
## [68]	train-rmse:74.457040+0.487537	test-rmse:88.632185+3.277456 
## [69]	train-rmse:74.323409+0.494525	test-rmse:88.657628+3.285612 
## [70]	train-rmse:74.156229+0.501197	test-rmse:88.701993+3.272248 
## [71]	train-rmse:74.033803+0.491899	test-rmse:88.704034+3.296735 
## [72]	train-rmse:73.914688+0.468180	test-rmse:88.750390+3.310720 
## [73]	train-rmse:73.785455+0.493080	test-rmse:88.748111+3.309285 
## Stopping. Best iteration:
## [53]	train-rmse:76.766025+0.444104	test-rmse:88.378760+3.201203
## 
## [1]	train-rmse:2114.181763+0.555727	test-rmse:2114.225952+5.933804 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1787.020166+0.472640	test-rmse:1787.068445+5.793007 
## [3]	train-rmse:1510.719434+0.398418	test-rmse:1510.735242+5.744629 
## [4]	train-rmse:1277.443640+0.344469	test-rmse:1277.448401+5.600169 
## [5]	train-rmse:1080.497156+0.289272	test-rmse:1080.487146+5.435004 
## [6]	train-rmse:914.285645+0.253764	test-rmse:914.363232+5.233244 
## [7]	train-rmse:774.080768+0.211870	test-rmse:774.151337+5.192015 
## [8]	train-rmse:655.872034+0.185142	test-rmse:655.960437+5.004720 
## [9]	train-rmse:556.294055+0.160438	test-rmse:556.383173+4.867607 
## [10]	train-rmse:472.497067+0.136844	test-rmse:472.614273+4.722870 
## [11]	train-rmse:402.094214+0.120196	test-rmse:402.280679+4.626741 
## [12]	train-rmse:343.047205+0.110652	test-rmse:343.332019+4.505959 
## [13]	train-rmse:293.648166+0.095723	test-rmse:294.032202+4.304458 
## [14]	train-rmse:252.453540+0.094316	test-rmse:253.041374+4.173429 
## [15]	train-rmse:218.252795+0.103999	test-rmse:219.061098+4.064481 
## [16]	train-rmse:190.032938+0.107119	test-rmse:191.086639+3.939741 
## [17]	train-rmse:166.874860+0.120992	test-rmse:168.359561+3.849845 
## [18]	train-rmse:148.055026+0.109477	test-rmse:149.959818+3.667768 
## [19]	train-rmse:132.919257+0.138107	test-rmse:135.286336+3.481115 
## [20]	train-rmse:120.854061+0.176320	test-rmse:123.670621+3.320001 
## [21]	train-rmse:111.337454+0.183398	test-rmse:114.669968+3.160823 
## [22]	train-rmse:103.926555+0.212775	test-rmse:107.727956+2.997755 
## [23]	train-rmse:98.173674+0.247730	test-rmse:102.484937+2.776450 
## [24]	train-rmse:93.794229+0.239053	test-rmse:98.559853+2.626272 
## [25]	train-rmse:90.421776+0.231461	test-rmse:95.669729+2.539184 
## [26]	train-rmse:87.869508+0.283941	test-rmse:93.543175+2.463533 
## [27]	train-rmse:85.917217+0.317766	test-rmse:91.995135+2.451462 
## [28]	train-rmse:84.429861+0.351985	test-rmse:90.874141+2.404168 
## [29]	train-rmse:83.275921+0.346495	test-rmse:90.075826+2.371321 
## [30]	train-rmse:82.337004+0.333067	test-rmse:89.479325+2.342935 
## [31]	train-rmse:81.594496+0.337035	test-rmse:89.049541+2.325874 
## [32]	train-rmse:80.977929+0.307723	test-rmse:88.762829+2.296007 
## [33]	train-rmse:80.512672+0.317823	test-rmse:88.552682+2.271668 
## [34]	train-rmse:80.090144+0.295349	test-rmse:88.424640+2.241213 
## [35]	train-rmse:79.744024+0.283898	test-rmse:88.315500+2.206230 
## [36]	train-rmse:79.419831+0.294268	test-rmse:88.257370+2.184015 
## [37]	train-rmse:79.152496+0.267657	test-rmse:88.201013+2.161359 
## [38]	train-rmse:78.916306+0.279743	test-rmse:88.156460+2.190348 
## [39]	train-rmse:78.718504+0.297816	test-rmse:88.093793+2.197004 
## [40]	train-rmse:78.494929+0.344970	test-rmse:88.057725+2.188245 
## [41]	train-rmse:78.263010+0.360182	test-rmse:88.044408+2.182681 
## [42]	train-rmse:78.088248+0.351797	test-rmse:88.042244+2.200463 
## [43]	train-rmse:77.871215+0.400252	test-rmse:88.043022+2.200888 
## [44]	train-rmse:77.735769+0.406720	test-rmse:88.034918+2.188399 
## [45]	train-rmse:77.574252+0.383055	test-rmse:88.037884+2.190850 
## [46]	train-rmse:77.428577+0.422352	test-rmse:88.049700+2.195855 
## [47]	train-rmse:77.275719+0.447936	test-rmse:88.016959+2.201978 
## [48]	train-rmse:77.120505+0.435007	test-rmse:88.046075+2.209416 
## [49]	train-rmse:76.972626+0.415544	test-rmse:88.056984+2.219865 
## [50]	train-rmse:76.816336+0.432307	test-rmse:88.071242+2.223506 
## [51]	train-rmse:76.605507+0.435591	test-rmse:88.070061+2.203170 
## [52]	train-rmse:76.451859+0.455890	test-rmse:88.089416+2.206266 
## [53]	train-rmse:76.246227+0.428919	test-rmse:88.110535+2.239572 
## [54]	train-rmse:76.093829+0.410072	test-rmse:88.138986+2.273767 
## [55]	train-rmse:75.928039+0.408060	test-rmse:88.156074+2.301052 
## [56]	train-rmse:75.796076+0.407908	test-rmse:88.170266+2.305972 
## [57]	train-rmse:75.598558+0.399107	test-rmse:88.196001+2.301477 
## [58]	train-rmse:75.400835+0.446346	test-rmse:88.203468+2.303255 
## [59]	train-rmse:75.234831+0.454982	test-rmse:88.224703+2.298780 
## [60]	train-rmse:75.035969+0.447064	test-rmse:88.243135+2.313565 
## [61]	train-rmse:74.862874+0.503864	test-rmse:88.293428+2.337114 
## [62]	train-rmse:74.712115+0.474910	test-rmse:88.271842+2.325361 
## [63]	train-rmse:74.553777+0.457790	test-rmse:88.255469+2.340083 
## [64]	train-rmse:74.324810+0.468650	test-rmse:88.283159+2.363858 
## [65]	train-rmse:74.194417+0.499804	test-rmse:88.302150+2.352246 
## [66]	train-rmse:73.986233+0.532643	test-rmse:88.314042+2.392863 
## [67]	train-rmse:73.853063+0.526809	test-rmse:88.287960+2.410270 
## Stopping. Best iteration:
## [47]	train-rmse:77.275719+0.447936	test-rmse:88.016959+2.201978
## 
## [1]	train-rmse:2088.374732+0.468028	test-rmse:2088.399341+4.840286 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1743.705396+0.392631	test-rmse:1743.705054+4.797882 
## [3]	train-rmse:1456.188025+0.323626	test-rmse:1456.218274+4.619121 
## [4]	train-rmse:1216.438183+0.265835	test-rmse:1216.490857+4.497998 
## [5]	train-rmse:1016.515796+0.230018	test-rmse:1016.524622+4.231805 
## [6]	train-rmse:849.902502+0.184811	test-rmse:849.981177+4.080279 
## [7]	train-rmse:711.138709+0.157229	test-rmse:711.238074+3.960513 
## [8]	train-rmse:595.637482+0.125948	test-rmse:595.699591+3.767460 
## [9]	train-rmse:499.603824+0.107026	test-rmse:499.687668+3.611565 
## [10]	train-rmse:419.894305+0.091912	test-rmse:420.024884+3.485978 
## [11]	train-rmse:353.858850+0.090401	test-rmse:354.044879+3.366635 
## [12]	train-rmse:299.304898+0.097242	test-rmse:299.670532+3.280953 
## [13]	train-rmse:254.394609+0.098436	test-rmse:255.039218+3.129748 
## [14]	train-rmse:217.598230+0.118120	test-rmse:218.447574+3.044643 
## [15]	train-rmse:187.631950+0.135258	test-rmse:188.871741+2.929350 
## [16]	train-rmse:163.412959+0.135526	test-rmse:165.039653+2.896367 
## [17]	train-rmse:144.068459+0.151583	test-rmse:146.165051+2.729665 
## [18]	train-rmse:128.754802+0.177911	test-rmse:131.402077+2.638362 
## [19]	train-rmse:116.816422+0.180320	test-rmse:120.018767+2.517232 
## [20]	train-rmse:107.592885+0.200658	test-rmse:111.397884+2.395882 
## [21]	train-rmse:100.585368+0.228473	test-rmse:104.967790+2.347917 
## [22]	train-rmse:95.270229+0.216734	test-rmse:100.187358+2.269161 
## [23]	train-rmse:91.324336+0.220267	test-rmse:96.731519+2.219371 
## [24]	train-rmse:88.367031+0.230652	test-rmse:94.219673+2.154800 
## [25]	train-rmse:86.154787+0.221219	test-rmse:92.416792+2.099937 
## [26]	train-rmse:84.516119+0.232269	test-rmse:91.203684+2.090666 
## [27]	train-rmse:83.263657+0.235597	test-rmse:90.308765+2.081593 
## [28]	train-rmse:82.312412+0.272994	test-rmse:89.667580+2.070756 
## [29]	train-rmse:81.512302+0.290769	test-rmse:89.203893+2.082614 
## [30]	train-rmse:80.904631+0.233244	test-rmse:88.905917+2.083808 
## [31]	train-rmse:80.417104+0.244041	test-rmse:88.695491+2.075629 
## [32]	train-rmse:79.975365+0.270489	test-rmse:88.537111+2.106402 
## [33]	train-rmse:79.599872+0.279821	test-rmse:88.488211+2.158238 
## [34]	train-rmse:79.283527+0.303765	test-rmse:88.380655+2.141594 
## [35]	train-rmse:79.011087+0.271939	test-rmse:88.341103+2.159182 
## [36]	train-rmse:78.711443+0.308375	test-rmse:88.318775+2.181137 
## [37]	train-rmse:78.440659+0.300966	test-rmse:88.268506+2.198882 
## [38]	train-rmse:78.220142+0.292787	test-rmse:88.251093+2.212143 
## [39]	train-rmse:77.999694+0.348975	test-rmse:88.207874+2.226098 
## [40]	train-rmse:77.775427+0.357093	test-rmse:88.148262+2.246192 
## [41]	train-rmse:77.531988+0.336115	test-rmse:88.146632+2.227841 
## [42]	train-rmse:77.360618+0.350777	test-rmse:88.190411+2.220334 
## [43]	train-rmse:77.157227+0.376857	test-rmse:88.175976+2.206022 
## [44]	train-rmse:76.974142+0.366735	test-rmse:88.212770+2.208754 
## [45]	train-rmse:76.773568+0.358563	test-rmse:88.206097+2.214309 
## [46]	train-rmse:76.591480+0.347060	test-rmse:88.218821+2.223468 
## [47]	train-rmse:76.430189+0.287445	test-rmse:88.262081+2.281560 
## [48]	train-rmse:76.274195+0.338940	test-rmse:88.267123+2.295445 
## [49]	train-rmse:76.138866+0.330065	test-rmse:88.280622+2.300605 
## [50]	train-rmse:75.950709+0.355992	test-rmse:88.276341+2.314367 
## [51]	train-rmse:75.777298+0.330449	test-rmse:88.290511+2.327362 
## [52]	train-rmse:75.591532+0.330366	test-rmse:88.313686+2.353108 
## [53]	train-rmse:75.422063+0.334255	test-rmse:88.325036+2.346044 
## [54]	train-rmse:75.295772+0.333163	test-rmse:88.336163+2.360192 
## [55]	train-rmse:75.137648+0.360498	test-rmse:88.330507+2.373055 
## [56]	train-rmse:74.954362+0.404658	test-rmse:88.379817+2.392324 
## [57]	train-rmse:74.839340+0.403533	test-rmse:88.377559+2.386597 
## [58]	train-rmse:74.704782+0.382792	test-rmse:88.383667+2.397571 
## [59]	train-rmse:74.543863+0.348965	test-rmse:88.380525+2.410162 
## [60]	train-rmse:74.342436+0.315619	test-rmse:88.449851+2.418864 
## [61]	train-rmse:74.172579+0.303962	test-rmse:88.443072+2.414029 
## Stopping. Best iteration:
## [41]	train-rmse:77.531988+0.336115	test-rmse:88.146632+2.227841
## 
## [1]	train-rmse:2062.572388+0.486893	test-rmse:2062.527930+5.092869 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1700.924414+0.399418	test-rmse:1700.902051+5.231970 
## [3]	train-rmse:1402.996789+0.328759	test-rmse:1402.971838+5.131083 
## [4]	train-rmse:1157.666723+0.264939	test-rmse:1157.702503+5.013607 
## [5]	train-rmse:955.661633+0.222188	test-rmse:955.554279+4.992554 
## [6]	train-rmse:789.441998+0.187241	test-rmse:789.353882+4.937023 
## [7]	train-rmse:652.770722+0.160549	test-rmse:652.656238+4.899391 
## [8]	train-rmse:540.498212+0.125332	test-rmse:540.385693+4.797973 
## [9]	train-rmse:448.412558+0.111552	test-rmse:448.403784+4.743134 
## [10]	train-rmse:373.054434+0.098879	test-rmse:373.130350+4.654169 
## [11]	train-rmse:311.550912+0.103320	test-rmse:311.673501+4.502427 
## [12]	train-rmse:261.536841+0.119873	test-rmse:261.940657+4.290419 
## [13]	train-rmse:221.078729+0.144051	test-rmse:221.780963+4.115147 
## [14]	train-rmse:188.603174+0.155382	test-rmse:189.562169+3.912001 
## [15]	train-rmse:162.759895+0.174629	test-rmse:164.190633+3.594557 
## [16]	train-rmse:142.422563+0.196423	test-rmse:144.321243+3.346557 
## [17]	train-rmse:126.599815+0.221153	test-rmse:129.078165+3.121218 
## [18]	train-rmse:114.527177+0.220194	test-rmse:117.515427+2.851057 
## [19]	train-rmse:105.358578+0.245917	test-rmse:108.963754+2.664134 
## [20]	train-rmse:98.524882+0.239021	test-rmse:102.837562+2.572790 
## [21]	train-rmse:93.480465+0.267984	test-rmse:98.402673+2.511214 
## [22]	train-rmse:89.782976+0.271729	test-rmse:95.243661+2.460303 
## [23]	train-rmse:87.086346+0.231587	test-rmse:93.003658+2.539944 
## [24]	train-rmse:85.065022+0.249498	test-rmse:91.420912+2.596580 
## [25]	train-rmse:83.607118+0.231982	test-rmse:90.316949+2.630334 
## [26]	train-rmse:82.465170+0.241966	test-rmse:89.566257+2.655559 
## [27]	train-rmse:81.621285+0.254336	test-rmse:89.095368+2.697546 
## [28]	train-rmse:80.952845+0.243736	test-rmse:88.789988+2.709779 
## [29]	train-rmse:80.342351+0.296389	test-rmse:88.572852+2.759285 
## [30]	train-rmse:79.904199+0.307727	test-rmse:88.438819+2.809218 
## [31]	train-rmse:79.565280+0.337551	test-rmse:88.337852+2.814381 
## [32]	train-rmse:79.265336+0.325182	test-rmse:88.240100+2.817674 
## [33]	train-rmse:79.027911+0.338881	test-rmse:88.206063+2.792912 
## [34]	train-rmse:78.720993+0.340033	test-rmse:88.187962+2.852000 
## [35]	train-rmse:78.500923+0.313318	test-rmse:88.161411+2.889192 
## [36]	train-rmse:78.249725+0.273362	test-rmse:88.154341+2.931811 
## [37]	train-rmse:77.980459+0.267780	test-rmse:88.153064+2.967378 
## [38]	train-rmse:77.764814+0.224965	test-rmse:88.170786+2.970047 
## [39]	train-rmse:77.610285+0.270937	test-rmse:88.167683+2.961019 
## [40]	train-rmse:77.410980+0.299400	test-rmse:88.156220+2.917135 
## [41]	train-rmse:77.252322+0.301909	test-rmse:88.151489+2.914207 
## [42]	train-rmse:77.060254+0.297324	test-rmse:88.162627+2.905734 
## [43]	train-rmse:76.824825+0.273207	test-rmse:88.200131+2.944190 
## [44]	train-rmse:76.626619+0.287303	test-rmse:88.228013+2.914675 
## [45]	train-rmse:76.463014+0.311302	test-rmse:88.254434+2.916794 
## [46]	train-rmse:76.245909+0.287412	test-rmse:88.240527+2.931942 
## [47]	train-rmse:76.100887+0.293537	test-rmse:88.266572+2.936051 
## [48]	train-rmse:75.901592+0.296087	test-rmse:88.270875+2.953561 
## [49]	train-rmse:75.691198+0.283609	test-rmse:88.290009+2.969942 
## [50]	train-rmse:75.501836+0.350541	test-rmse:88.309006+2.980161 
## [51]	train-rmse:75.348955+0.355323	test-rmse:88.304253+2.997425 
## [52]	train-rmse:75.173860+0.356420	test-rmse:88.317731+2.991312 
## [53]	train-rmse:74.965290+0.345579	test-rmse:88.332878+2.985679 
## [54]	train-rmse:74.763781+0.328242	test-rmse:88.359170+3.002643 
## [55]	train-rmse:74.538526+0.330027	test-rmse:88.371719+3.004282 
## [56]	train-rmse:74.323563+0.323213	test-rmse:88.369169+2.987801 
## [57]	train-rmse:74.154212+0.348836	test-rmse:88.371156+3.003055 
## [58]	train-rmse:74.026605+0.340152	test-rmse:88.388409+2.975026 
## [59]	train-rmse:73.900860+0.333629	test-rmse:88.409025+2.990508 
## [60]	train-rmse:73.758816+0.350854	test-rmse:88.436315+2.978400 
## [61]	train-rmse:73.558712+0.321846	test-rmse:88.433360+2.981486 
## Stopping. Best iteration:
## [41]	train-rmse:77.252322+0.301909	test-rmse:88.151489+2.914207
## 
## [1]	train-rmse:2036.768140+0.493108	test-rmse:2036.779834+5.475553 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1658.680249+0.401322	test-rmse:1658.679736+5.488757 
## [3]	train-rmse:1351.139612+0.326604	test-rmse:1351.128113+5.466551 
## [4]	train-rmse:1101.091296+0.261688	test-rmse:1101.054187+5.415396 
## [5]	train-rmse:897.816565+0.212203	test-rmse:897.817560+5.353788 
## [6]	train-rmse:732.708301+0.173729	test-rmse:732.721088+5.275719 
## [7]	train-rmse:598.722205+0.143814	test-rmse:598.789807+5.193526 
## [8]	train-rmse:490.150476+0.123056	test-rmse:490.192270+5.081957 
## [9]	train-rmse:402.350009+0.114361	test-rmse:402.418744+4.890740 
## [10]	train-rmse:331.525800+0.108750	test-rmse:331.733887+4.721985 
## [11]	train-rmse:274.614148+0.119705	test-rmse:274.986194+4.643771 
## [12]	train-rmse:229.152913+0.131075	test-rmse:229.832649+4.439945 
## [13]	train-rmse:193.075494+0.150329	test-rmse:194.156615+4.332233 
## [14]	train-rmse:164.738931+0.178963	test-rmse:166.269626+4.227539 
## [15]	train-rmse:142.764430+0.224325	test-rmse:144.844846+4.046004 
## [16]	train-rmse:125.972791+0.244420	test-rmse:128.592322+3.908001 
## [17]	train-rmse:113.293750+0.275516	test-rmse:116.558822+3.745367 
## [18]	train-rmse:103.941280+0.306744	test-rmse:107.959949+3.644451 
## [19]	train-rmse:97.115961+0.351982	test-rmse:101.729898+3.604642 
## [20]	train-rmse:92.223322+0.348881	test-rmse:97.351980+3.525880 
## [21]	train-rmse:88.668723+0.344396	test-rmse:94.392526+3.523945 
## [22]	train-rmse:86.096249+0.297913	test-rmse:92.331265+3.467640 
## [23]	train-rmse:84.259051+0.294251	test-rmse:90.936665+3.440332 
## [24]	train-rmse:82.839080+0.337720	test-rmse:90.039700+3.359223 
## [25]	train-rmse:81.864266+0.357409	test-rmse:89.451099+3.320801 
## [26]	train-rmse:81.059622+0.344542	test-rmse:89.019005+3.350245 
## [27]	train-rmse:80.441167+0.401173	test-rmse:88.751018+3.359914 
## [28]	train-rmse:79.934873+0.356944	test-rmse:88.564929+3.343730 
## [29]	train-rmse:79.521997+0.381804	test-rmse:88.436778+3.303684 
## [30]	train-rmse:79.216108+0.381660	test-rmse:88.381375+3.283685 
## [31]	train-rmse:78.908870+0.415771	test-rmse:88.351447+3.301660 
## [32]	train-rmse:78.652557+0.431480	test-rmse:88.336623+3.291697 
## [33]	train-rmse:78.396535+0.429468	test-rmse:88.302460+3.289363 
## [34]	train-rmse:78.110158+0.460592	test-rmse:88.321470+3.302124 
## [35]	train-rmse:77.881937+0.468998	test-rmse:88.301711+3.308152 
## [36]	train-rmse:77.672139+0.483104	test-rmse:88.315302+3.289445 
## [37]	train-rmse:77.456322+0.538548	test-rmse:88.325449+3.286422 
## [38]	train-rmse:77.218331+0.462831	test-rmse:88.324256+3.272457 
## [39]	train-rmse:77.043451+0.465604	test-rmse:88.339674+3.261329 
## [40]	train-rmse:76.830127+0.444705	test-rmse:88.384141+3.258201 
## [41]	train-rmse:76.603450+0.421863	test-rmse:88.380605+3.259009 
## [42]	train-rmse:76.390468+0.431754	test-rmse:88.387536+3.242814 
## [43]	train-rmse:76.179497+0.363290	test-rmse:88.411705+3.232789 
## [44]	train-rmse:75.951012+0.353716	test-rmse:88.415625+3.195239 
## [45]	train-rmse:75.793654+0.347898	test-rmse:88.421261+3.174031 
## [46]	train-rmse:75.590101+0.363877	test-rmse:88.423275+3.176138 
## [47]	train-rmse:75.345567+0.412980	test-rmse:88.424931+3.155728 
## [48]	train-rmse:75.140521+0.427954	test-rmse:88.461465+3.120249 
## [49]	train-rmse:74.991765+0.433069	test-rmse:88.466928+3.133482 
## [50]	train-rmse:74.730895+0.407243	test-rmse:88.471987+3.085795 
## [51]	train-rmse:74.531116+0.379795	test-rmse:88.517015+3.072839 
## [52]	train-rmse:74.372291+0.420693	test-rmse:88.519705+3.073186 
## [53]	train-rmse:74.200429+0.431082	test-rmse:88.581361+3.050697 
## [54]	train-rmse:74.016422+0.411308	test-rmse:88.599655+3.036240 
## [55]	train-rmse:73.808274+0.425908	test-rmse:88.640125+3.003850 
## Stopping. Best iteration:
## [35]	train-rmse:77.881937+0.468998	test-rmse:88.301711+3.308152
## 
## [1]	train-rmse:2010.966479+0.308693	test-rmse:2011.011072+3.230320 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1616.972803+0.253694	test-rmse:1616.965552+3.170456 
## [3]	train-rmse:1300.588403+0.214525	test-rmse:1300.611755+2.994731 
## [4]	train-rmse:1046.647656+0.187522	test-rmse:1046.628919+2.790898 
## [5]	train-rmse:842.867621+0.149921	test-rmse:842.874811+2.682057 
## [6]	train-rmse:679.529816+0.130416	test-rmse:679.570483+2.661353 
## [7]	train-rmse:548.739825+0.122054	test-rmse:548.828119+2.585604 
## [8]	train-rmse:444.237140+0.109031	test-rmse:444.348416+2.514163 
## [9]	train-rmse:360.922031+0.112112	test-rmse:361.085413+2.421754 
## [10]	train-rmse:294.754532+0.118946	test-rmse:295.028204+2.382573 
## [11]	train-rmse:242.495030+0.116983	test-rmse:242.996748+2.223384 
## [12]	train-rmse:201.529071+0.140077	test-rmse:202.336608+2.228819 
## [13]	train-rmse:169.740070+0.161073	test-rmse:170.998151+2.191610 
## [14]	train-rmse:145.378998+0.141794	test-rmse:147.277405+2.131269 
## [15]	train-rmse:127.034899+0.157768	test-rmse:129.584631+2.159657 
## [16]	train-rmse:113.445330+0.222667	test-rmse:116.587089+2.143776 
## [17]	train-rmse:103.558507+0.276838	test-rmse:107.426763+2.199989 
## [18]	train-rmse:96.507288+0.303040	test-rmse:101.083521+2.370382 
## [19]	train-rmse:91.539907+0.325117	test-rmse:96.798899+2.541457 
## [20]	train-rmse:88.070015+0.346946	test-rmse:93.898134+2.721652 
## [21]	train-rmse:85.579089+0.342901	test-rmse:91.973109+2.779972 
## [22]	train-rmse:83.800477+0.350790	test-rmse:90.740460+2.869035 
## [23]	train-rmse:82.484037+0.381763	test-rmse:89.908623+2.902616 
## [24]	train-rmse:81.570034+0.362080	test-rmse:89.381612+2.947612 
## [25]	train-rmse:80.881867+0.386746	test-rmse:88.981548+2.961997 
## [26]	train-rmse:80.329210+0.411740	test-rmse:88.734383+2.988330 
## [27]	train-rmse:79.944430+0.434840	test-rmse:88.591003+3.058410 
## [28]	train-rmse:79.494994+0.476266	test-rmse:88.502770+3.064662 
## [29]	train-rmse:79.123257+0.466944	test-rmse:88.431886+3.084785 
## [30]	train-rmse:78.805248+0.476594	test-rmse:88.395695+3.124507 
## [31]	train-rmse:78.570813+0.497728	test-rmse:88.392965+3.133879 
## [32]	train-rmse:78.315145+0.512832	test-rmse:88.403578+3.141936 
## [33]	train-rmse:78.109440+0.465772	test-rmse:88.387640+3.159795 
## [34]	train-rmse:77.822459+0.411248	test-rmse:88.396070+3.148349 
## [35]	train-rmse:77.563817+0.390269	test-rmse:88.403873+3.165121 
## [36]	train-rmse:77.287662+0.429565	test-rmse:88.448849+3.158289 
## [37]	train-rmse:77.092159+0.482844	test-rmse:88.474696+3.195051 
## [38]	train-rmse:76.856123+0.442134	test-rmse:88.479433+3.166312 
## [39]	train-rmse:76.687517+0.408724	test-rmse:88.469911+3.174442 
## [40]	train-rmse:76.504038+0.417122	test-rmse:88.509467+3.215585 
## [41]	train-rmse:76.296348+0.445843	test-rmse:88.513785+3.194279 
## [42]	train-rmse:76.040048+0.453737	test-rmse:88.552026+3.250372 
## [43]	train-rmse:75.863390+0.453996	test-rmse:88.592614+3.236186 
## [44]	train-rmse:75.655833+0.483326	test-rmse:88.569736+3.254030 
## [45]	train-rmse:75.439830+0.518582	test-rmse:88.599782+3.218930 
## [46]	train-rmse:75.136871+0.473809	test-rmse:88.590313+3.238346 
## [47]	train-rmse:74.974163+0.499463	test-rmse:88.561715+3.209776 
## [48]	train-rmse:74.803317+0.434803	test-rmse:88.575134+3.176625 
## [49]	train-rmse:74.620466+0.408591	test-rmse:88.566422+3.170471 
## [50]	train-rmse:74.424565+0.397568	test-rmse:88.551253+3.186961 
## [51]	train-rmse:74.251349+0.374267	test-rmse:88.522380+3.182156 
## [52]	train-rmse:74.042294+0.406872	test-rmse:88.532957+3.190497 
## [53]	train-rmse:73.876250+0.428231	test-rmse:88.551774+3.197964 
## Stopping. Best iteration:
## [33]	train-rmse:78.109440+0.465772	test-rmse:88.387640+3.159795
## 
## [1]	train-rmse:1985.163306+0.333110	test-rmse:1985.173853+3.640880 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1575.800623+0.265418	test-rmse:1575.797485+3.803520 
## [3]	train-rmse:1251.336413+0.221771	test-rmse:1251.297180+3.703693 
## [4]	train-rmse:994.299786+0.181582	test-rmse:994.274909+3.784414 
## [5]	train-rmse:790.738086+0.169064	test-rmse:790.696655+3.641301 
## [6]	train-rmse:629.735705+0.133721	test-rmse:629.724292+3.620969 
## [7]	train-rmse:502.589508+0.111172	test-rmse:502.637390+3.604224 
## [8]	train-rmse:402.431332+0.096928	test-rmse:402.580325+3.510048 
## [9]	train-rmse:323.789474+0.083927	test-rmse:324.115921+3.374693 
## [10]	train-rmse:262.355627+0.071042	test-rmse:262.910907+3.261688 
## [11]	train-rmse:214.709575+0.071791	test-rmse:215.723531+3.104974 
## [12]	train-rmse:178.138147+0.081825	test-rmse:179.577644+2.991513 
## [13]	train-rmse:150.472832+0.109417	test-rmse:152.499854+2.897125 
## [14]	train-rmse:129.874391+0.141910	test-rmse:132.566689+2.774987 
## [15]	train-rmse:114.841782+0.153499	test-rmse:118.294309+2.632811 
## [16]	train-rmse:104.121830+0.153946	test-rmse:108.321510+2.433602 
## [17]	train-rmse:96.574117+0.199226	test-rmse:101.433736+2.251574 
## [18]	train-rmse:91.397106+0.238191	test-rmse:96.826926+2.103974 
## [19]	train-rmse:87.821832+0.230391	test-rmse:93.850075+1.960810 
## [20]	train-rmse:85.338314+0.212914	test-rmse:91.853245+1.924299 
## [21]	train-rmse:83.590562+0.228711	test-rmse:90.655186+1.859895 
## [22]	train-rmse:82.388982+0.259134	test-rmse:89.839175+1.836819 
## [23]	train-rmse:81.453806+0.263265	test-rmse:89.328331+1.785221 
## [24]	train-rmse:80.815656+0.294947	test-rmse:89.060760+1.785072 
## [25]	train-rmse:80.309209+0.285389	test-rmse:88.808342+1.833016 
## [26]	train-rmse:79.827696+0.229112	test-rmse:88.705254+1.870217 
## [27]	train-rmse:79.459956+0.310502	test-rmse:88.657204+1.904338 
## [28]	train-rmse:79.124238+0.346377	test-rmse:88.585387+1.857434 
## [29]	train-rmse:78.757915+0.411314	test-rmse:88.586153+1.929441 
## [30]	train-rmse:78.473510+0.406888	test-rmse:88.573681+1.952880 
## [31]	train-rmse:78.222141+0.400313	test-rmse:88.575466+1.942906 
## [32]	train-rmse:77.919087+0.407710	test-rmse:88.670149+1.972925 
## [33]	train-rmse:77.741975+0.430071	test-rmse:88.648095+1.965774 
## [34]	train-rmse:77.483144+0.407973	test-rmse:88.649580+2.008194 
## [35]	train-rmse:77.253948+0.467817	test-rmse:88.654560+2.073951 
## [36]	train-rmse:77.006112+0.477044	test-rmse:88.657239+2.098535 
## [37]	train-rmse:76.765565+0.478998	test-rmse:88.688356+2.106537 
## [38]	train-rmse:76.577362+0.482382	test-rmse:88.734763+2.120114 
## [39]	train-rmse:76.371716+0.442673	test-rmse:88.784029+2.098971 
## [40]	train-rmse:76.086875+0.453895	test-rmse:88.804042+2.113740 
## [41]	train-rmse:75.850442+0.448890	test-rmse:88.858719+2.099984 
## [42]	train-rmse:75.648580+0.469209	test-rmse:88.850491+2.063573 
## [43]	train-rmse:75.455251+0.444735	test-rmse:88.837535+2.124620 
## [44]	train-rmse:75.229070+0.464894	test-rmse:88.856427+2.151045 
## [45]	train-rmse:74.996799+0.456438	test-rmse:88.861578+2.161534 
## [46]	train-rmse:74.813928+0.471037	test-rmse:88.847309+2.154346 
## [47]	train-rmse:74.554140+0.498888	test-rmse:88.884897+2.163690 
## [48]	train-rmse:74.329466+0.449506	test-rmse:88.951963+2.148608 
## [49]	train-rmse:74.176890+0.456165	test-rmse:88.997788+2.143192 
## [50]	train-rmse:73.916843+0.399740	test-rmse:89.030716+2.148293 
## Stopping. Best iteration:
## [30]	train-rmse:78.473510+0.406888	test-rmse:88.573681+1.952880
## 
## [1]	train-rmse:1959.363757+0.304848	test-rmse:1959.368176+3.559885 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1535.165698+0.241078	test-rmse:1535.161951+3.466381 
## [3]	train-rmse:1203.366663+0.190142	test-rmse:1203.396484+3.403474 
## [4]	train-rmse:943.955872+0.157099	test-rmse:943.958972+3.254133 
## [5]	train-rmse:741.264880+0.128446	test-rmse:741.267346+3.352320 
## [6]	train-rmse:583.134699+0.115198	test-rmse:583.256604+3.313475 
## [7]	train-rmse:460.007770+0.108558	test-rmse:460.093802+3.436575 
## [8]	train-rmse:364.434998+0.116701	test-rmse:364.593079+3.407196 
## [9]	train-rmse:290.573465+0.127107	test-rmse:290.906503+3.427471 
## [10]	train-rmse:233.895465+0.147418	test-rmse:234.534174+3.443548 
## [11]	train-rmse:190.802055+0.164731	test-rmse:191.902042+3.453387 
## [12]	train-rmse:158.529277+0.207873	test-rmse:160.107794+3.520446 
## [13]	train-rmse:134.740454+0.234177	test-rmse:136.909305+3.665416 
## [14]	train-rmse:117.644619+0.253897	test-rmse:120.444527+3.770208 
## [15]	train-rmse:105.543326+0.276501	test-rmse:109.148651+3.855763 
## [16]	train-rmse:97.176679+0.298018	test-rmse:101.508781+3.970185 
## [17]	train-rmse:91.495810+0.288284	test-rmse:96.489172+4.028208 
## [18]	train-rmse:87.722034+0.283494	test-rmse:93.239073+4.022651 
## [19]	train-rmse:85.052346+0.286300	test-rmse:91.291806+4.041478 
## [20]	train-rmse:83.253025+0.311290	test-rmse:90.038477+4.099916 
## [21]	train-rmse:82.026482+0.332282	test-rmse:89.229628+4.103990 
## [22]	train-rmse:81.172257+0.358559	test-rmse:88.747915+4.120437 
## [23]	train-rmse:80.452415+0.353804	test-rmse:88.484297+4.146659 
## [24]	train-rmse:79.921233+0.378883	test-rmse:88.308587+4.125205 
## [25]	train-rmse:79.469567+0.411598	test-rmse:88.204877+4.154329 
## [26]	train-rmse:79.093606+0.447342	test-rmse:88.195528+4.162056 
## [27]	train-rmse:78.704994+0.454712	test-rmse:88.134051+4.142793 
## [28]	train-rmse:78.437179+0.457245	test-rmse:88.059195+4.142093 
## [29]	train-rmse:78.174691+0.391982	test-rmse:88.069462+4.140781 
## [30]	train-rmse:77.908904+0.429418	test-rmse:88.053699+4.137436 
## [31]	train-rmse:77.698994+0.426897	test-rmse:88.126486+4.126462 
## [32]	train-rmse:77.448767+0.463986	test-rmse:88.131061+4.162162 
## [33]	train-rmse:77.175829+0.469319	test-rmse:88.146487+4.156324 
## [34]	train-rmse:76.978846+0.510995	test-rmse:88.164163+4.200307 
## [35]	train-rmse:76.732696+0.568621	test-rmse:88.189495+4.208168 
## [36]	train-rmse:76.399300+0.567167	test-rmse:88.203166+4.219207 
## [37]	train-rmse:76.211137+0.589013	test-rmse:88.182719+4.217993 
## [38]	train-rmse:75.970072+0.611602	test-rmse:88.145537+4.237000 
## [39]	train-rmse:75.637700+0.581599	test-rmse:88.124177+4.256942 
## [40]	train-rmse:75.379541+0.566684	test-rmse:88.185674+4.283799 
## [41]	train-rmse:75.147616+0.476619	test-rmse:88.153276+4.283582 
## [42]	train-rmse:74.889905+0.486533	test-rmse:88.129272+4.272316 
## [43]	train-rmse:74.692911+0.439694	test-rmse:88.137514+4.275161 
## [44]	train-rmse:74.467744+0.406678	test-rmse:88.167685+4.266795 
## [45]	train-rmse:74.238976+0.394030	test-rmse:88.211681+4.282307 
## [46]	train-rmse:74.080699+0.419755	test-rmse:88.194592+4.310084 
## [47]	train-rmse:73.860787+0.400534	test-rmse:88.240858+4.331217 
## [48]	train-rmse:73.626943+0.403839	test-rmse:88.283456+4.327850 
## [49]	train-rmse:73.397359+0.382068	test-rmse:88.273545+4.320784 
## [50]	train-rmse:73.251127+0.450715	test-rmse:88.288638+4.309622 
## Stopping. Best iteration:
## [30]	train-rmse:77.908904+0.429418	test-rmse:88.053699+4.137436
## 
## [1]	train-rmse:1933.562329+0.377012	test-rmse:1933.570203+4.274304 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1495.068005+0.294208	test-rmse:1495.079114+4.310217 
## [3]	train-rmse:1156.645715+0.236449	test-rmse:1156.656775+4.229633 
## [4]	train-rmse:895.592139+0.168290	test-rmse:895.595874+4.146943 
## [5]	train-rmse:694.391547+0.152371	test-rmse:694.474115+3.938659 
## [6]	train-rmse:539.580695+0.133873	test-rmse:539.689355+3.765127 
## [7]	train-rmse:420.794647+0.108661	test-rmse:420.918613+3.752274 
## [8]	train-rmse:329.989294+0.112610	test-rmse:330.186450+3.632531 
## [9]	train-rmse:260.989194+0.106188	test-rmse:261.390411+3.654670 
## [10]	train-rmse:209.010374+0.115193	test-rmse:209.749368+3.575008 
## [11]	train-rmse:170.384680+0.132522	test-rmse:171.728589+3.501615 
## [12]	train-rmse:142.168837+0.177286	test-rmse:144.214243+3.333622 
## [13]	train-rmse:122.059311+0.227434	test-rmse:124.812341+3.199408 
## [14]	train-rmse:108.018845+0.275626	test-rmse:111.531402+3.064368 
## [15]	train-rmse:98.467517+0.297196	test-rmse:102.802127+2.945497 
## [16]	train-rmse:92.148378+0.287727	test-rmse:97.201594+2.764366 
## [17]	train-rmse:87.941888+0.366377	test-rmse:93.667163+2.726320 
## [18]	train-rmse:85.172437+0.343966	test-rmse:91.554835+2.703861 
## [19]	train-rmse:83.283826+0.358839	test-rmse:90.314000+2.773666 
## [20]	train-rmse:82.035456+0.353466	test-rmse:89.527629+2.817951 
## [21]	train-rmse:81.121469+0.370711	test-rmse:89.006950+2.818051 
## [22]	train-rmse:80.412072+0.401567	test-rmse:88.730923+2.832278 
## [23]	train-rmse:79.848814+0.490754	test-rmse:88.555437+2.810473 
## [24]	train-rmse:79.369434+0.519750	test-rmse:88.416486+2.803327 
## [25]	train-rmse:78.998644+0.452532	test-rmse:88.341951+2.840580 
## [26]	train-rmse:78.664224+0.479406	test-rmse:88.313133+2.851374 
## [27]	train-rmse:78.342944+0.509450	test-rmse:88.350240+2.824657 
## [28]	train-rmse:78.022446+0.482532	test-rmse:88.338863+2.832347 
## [29]	train-rmse:77.834698+0.491749	test-rmse:88.319149+2.833312 
## [30]	train-rmse:77.540663+0.457618	test-rmse:88.320377+2.830672 
## [31]	train-rmse:77.309257+0.498187	test-rmse:88.346689+2.862576 
## [32]	train-rmse:77.002792+0.460494	test-rmse:88.406129+2.848806 
## [33]	train-rmse:76.705028+0.437663	test-rmse:88.409268+2.860357 
## [34]	train-rmse:76.362599+0.430986	test-rmse:88.439208+2.883668 
## [35]	train-rmse:76.097761+0.480981	test-rmse:88.450093+2.887332 
## [36]	train-rmse:75.905344+0.537394	test-rmse:88.449510+2.927280 
## [37]	train-rmse:75.640965+0.513502	test-rmse:88.500074+2.926531 
## [38]	train-rmse:75.449046+0.511657	test-rmse:88.506434+2.919815 
## [39]	train-rmse:75.194502+0.502471	test-rmse:88.564766+2.977811 
## [40]	train-rmse:74.948881+0.542316	test-rmse:88.623620+3.019391 
## [41]	train-rmse:74.718063+0.541257	test-rmse:88.628234+3.001114 
## [42]	train-rmse:74.488776+0.528790	test-rmse:88.630249+3.037215 
## [43]	train-rmse:74.305047+0.464795	test-rmse:88.645741+3.049175 
## [44]	train-rmse:74.130648+0.476859	test-rmse:88.660582+3.078258 
## [45]	train-rmse:73.885050+0.459554	test-rmse:88.703322+3.066306 
## [46]	train-rmse:73.622765+0.468997	test-rmse:88.679886+3.056377 
## Stopping. Best iteration:
## [26]	train-rmse:78.664224+0.479406	test-rmse:88.313133+2.851374
## 
## [1]	train-rmse:1907.764355+0.229407	test-rmse:1907.727149+2.741617 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1455.507410+0.167394	test-rmse:1455.515527+2.701984 
## [3]	train-rmse:1111.175269+0.126176	test-rmse:1111.207312+2.623043 
## [4]	train-rmse:849.160217+0.077611	test-rmse:849.149371+2.594180 
## [5]	train-rmse:650.008478+0.075696	test-rmse:650.110675+2.630969 
## [6]	train-rmse:498.959372+0.074186	test-rmse:499.057169+2.646670 
## [7]	train-rmse:384.762390+0.072185	test-rmse:384.857483+2.495394 
## [8]	train-rmse:298.855237+0.081477	test-rmse:299.274481+2.369424 
## [9]	train-rmse:234.721020+0.107060	test-rmse:235.451087+2.270844 
## [10]	train-rmse:187.421798+0.127243	test-rmse:188.555104+2.117712 
## [11]	train-rmse:153.101810+0.174789	test-rmse:154.871431+1.977103 
## [12]	train-rmse:128.815260+0.166938	test-rmse:131.293214+1.995235 
## [13]	train-rmse:112.063315+0.198701	test-rmse:115.377935+2.074297 
## [14]	train-rmse:100.863035+0.193501	test-rmse:104.897498+2.173800 
## [15]	train-rmse:93.414604+0.276447	test-rmse:98.249630+2.379218 
## [16]	train-rmse:88.603897+0.264825	test-rmse:94.213389+2.562215 
## [17]	train-rmse:85.469616+0.306699	test-rmse:91.772302+2.704203 
## [18]	train-rmse:83.426937+0.311077	test-rmse:90.302556+2.879339 
## [19]	train-rmse:82.059747+0.366563	test-rmse:89.397044+2.991646 
## [20]	train-rmse:81.124316+0.362561	test-rmse:88.937495+3.033959 
## [21]	train-rmse:80.438657+0.396436	test-rmse:88.610473+3.065255 
## [22]	train-rmse:79.877452+0.463893	test-rmse:88.415487+3.080322 
## [23]	train-rmse:79.408510+0.448090	test-rmse:88.356997+3.147942 
## [24]	train-rmse:78.904336+0.361705	test-rmse:88.332531+3.176122 
## [25]	train-rmse:78.593724+0.372333	test-rmse:88.290879+3.189559 
## [26]	train-rmse:78.249270+0.440593	test-rmse:88.292589+3.181132 
## [27]	train-rmse:77.932572+0.427046	test-rmse:88.226216+3.172008 
## [28]	train-rmse:77.692115+0.409050	test-rmse:88.237796+3.167124 
## [29]	train-rmse:77.397537+0.465214	test-rmse:88.262132+3.186501 
## [30]	train-rmse:77.142026+0.398831	test-rmse:88.293411+3.194906 
## [31]	train-rmse:76.904430+0.381710	test-rmse:88.320375+3.165892 
## [32]	train-rmse:76.641469+0.346842	test-rmse:88.316216+3.157122 
## [33]	train-rmse:76.460812+0.331306	test-rmse:88.330087+3.148099 
## [34]	train-rmse:76.256701+0.320749	test-rmse:88.404973+3.103438 
## [35]	train-rmse:75.957594+0.337794	test-rmse:88.429843+3.101235 
## [36]	train-rmse:75.647365+0.374837	test-rmse:88.408520+3.106578 
## [37]	train-rmse:75.331911+0.395057	test-rmse:88.423811+3.029684 
## [38]	train-rmse:75.089187+0.375804	test-rmse:88.438396+2.974960 
## [39]	train-rmse:74.835974+0.426479	test-rmse:88.486849+3.016954 
## [40]	train-rmse:74.633271+0.487512	test-rmse:88.486171+3.009568 
## [41]	train-rmse:74.413178+0.520902	test-rmse:88.488444+2.971664 
## [42]	train-rmse:74.142606+0.513117	test-rmse:88.497690+2.978896 
## [43]	train-rmse:73.952367+0.492280	test-rmse:88.530191+2.943062 
## [44]	train-rmse:73.723632+0.488549	test-rmse:88.538523+2.971462 
## [45]	train-rmse:73.547904+0.466423	test-rmse:88.529037+2.947294 
## [46]	train-rmse:73.301123+0.493137	test-rmse:88.599374+2.950088 
## [47]	train-rmse:73.054656+0.468387	test-rmse:88.654054+2.994092 
## Stopping. Best iteration:
## [27]	train-rmse:77.932572+0.427046	test-rmse:88.226216+3.172008
## 
## [1]	train-rmse:1881.968774+0.302871	test-rmse:1881.972900+3.574268 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1416.483752+0.234216	test-rmse:1416.483997+3.571444 
## [3]	train-rmse:1066.922351+0.190642	test-rmse:1066.922827+3.457566 
## [4]	train-rmse:804.579541+0.137204	test-rmse:804.639520+3.462996 
## [5]	train-rmse:608.014667+0.099994	test-rmse:608.017676+3.428062 
## [6]	train-rmse:461.080658+0.095828	test-rmse:461.128586+3.334412 
## [7]	train-rmse:351.687305+0.090898	test-rmse:351.828103+3.371361 
## [8]	train-rmse:270.775195+0.096800	test-rmse:271.112457+3.326983 
## [9]	train-rmse:211.520209+0.134183	test-rmse:212.306146+3.204522 
## [10]	train-rmse:168.835477+0.168265	test-rmse:170.221530+3.335211 
## [11]	train-rmse:138.699939+0.242095	test-rmse:140.863565+3.202734 
## [12]	train-rmse:118.068991+0.257364	test-rmse:121.008472+3.193860 
## [13]	train-rmse:104.330432+0.309787	test-rmse:108.239546+3.125105 
## [14]	train-rmse:95.478143+0.304563	test-rmse:100.102778+3.121228 
## [15]	train-rmse:89.761254+0.262355	test-rmse:95.304810+3.084111 
## [16]	train-rmse:86.206648+0.275653	test-rmse:92.434569+3.139077 
## [17]	train-rmse:83.865327+0.321896	test-rmse:90.719127+3.173558 
## [18]	train-rmse:82.362887+0.302351	test-rmse:89.724261+3.183625 
## [19]	train-rmse:81.361365+0.272791	test-rmse:89.210376+3.167742 
## [20]	train-rmse:80.568410+0.275885	test-rmse:88.921841+3.124284 
## [21]	train-rmse:80.023238+0.209117	test-rmse:88.754840+3.107026 
## [22]	train-rmse:79.580305+0.268290	test-rmse:88.671783+3.143666 
## [23]	train-rmse:79.192591+0.187993	test-rmse:88.653306+3.150021 
## [24]	train-rmse:78.881590+0.201337	test-rmse:88.579594+3.157297 
## [25]	train-rmse:78.549925+0.284654	test-rmse:88.618865+3.154759 
## [26]	train-rmse:78.259191+0.274476	test-rmse:88.614501+3.113645 
## [27]	train-rmse:78.028979+0.316936	test-rmse:88.589310+3.141518 
## [28]	train-rmse:77.742264+0.237051	test-rmse:88.623984+3.172960 
## [29]	train-rmse:77.496393+0.281091	test-rmse:88.653152+3.152286 
## [30]	train-rmse:77.189431+0.247723	test-rmse:88.623702+3.199065 
## [31]	train-rmse:76.885119+0.288092	test-rmse:88.593340+3.179205 
## [32]	train-rmse:76.639217+0.295569	test-rmse:88.605250+3.179246 
## [33]	train-rmse:76.364896+0.354909	test-rmse:88.608424+3.210980 
## [34]	train-rmse:76.157265+0.318048	test-rmse:88.617821+3.226657 
## [35]	train-rmse:75.874359+0.300191	test-rmse:88.670071+3.169819 
## [36]	train-rmse:75.515469+0.336475	test-rmse:88.771519+3.145115 
## [37]	train-rmse:75.115766+0.306517	test-rmse:88.792026+3.149030 
## [38]	train-rmse:74.875361+0.337697	test-rmse:88.779402+3.146887 
## [39]	train-rmse:74.626926+0.361679	test-rmse:88.845183+3.097175 
## [40]	train-rmse:74.363449+0.349292	test-rmse:88.820621+3.153038 
## [41]	train-rmse:74.085062+0.376514	test-rmse:88.881669+3.124280 
## [42]	train-rmse:73.845593+0.413248	test-rmse:88.951091+3.089803 
## [43]	train-rmse:73.623576+0.411593	test-rmse:89.018275+3.101279 
## [44]	train-rmse:73.358636+0.417381	test-rmse:89.103516+3.072235 
## Stopping. Best iteration:
## [24]	train-rmse:78.881590+0.201337	test-rmse:88.579594+3.157297
## 
## [1]	train-rmse:1856.171411+0.251318	test-rmse:1856.146204+2.781906 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1377.999499+0.181912	test-rmse:1378.006592+2.551200 
## [3]	train-rmse:1023.901459+0.130925	test-rmse:1023.854486+2.305809 
## [4]	train-rmse:761.873230+0.094543	test-rmse:761.898468+2.132695 
## [5]	train-rmse:568.336236+0.087103	test-rmse:568.388745+1.943417 
## [6]	train-rmse:425.827087+0.086616	test-rmse:425.977631+1.912823 
## [7]	train-rmse:321.416101+0.119809	test-rmse:321.705823+1.843491 
## [8]	train-rmse:245.529639+0.168660	test-rmse:246.148714+1.871070 
## [9]	train-rmse:191.111647+0.205812	test-rmse:192.174397+2.080840 
## [10]	train-rmse:152.874203+0.259136	test-rmse:154.540239+2.336238 
## [11]	train-rmse:126.748534+0.332699	test-rmse:129.254525+2.605587 
## [12]	train-rmse:109.419674+0.380923	test-rmse:112.949329+3.002201 
## [13]	train-rmse:98.345503+0.397429	test-rmse:102.851768+3.305618 
## [14]	train-rmse:91.369247+0.420770	test-rmse:96.813145+3.574332 
## [15]	train-rmse:87.090992+0.522537	test-rmse:93.216753+3.766298 
## [16]	train-rmse:84.389513+0.561377	test-rmse:91.152177+3.967438 
## [17]	train-rmse:82.667156+0.519587	test-rmse:90.033794+4.085549 
## [18]	train-rmse:81.597714+0.569415	test-rmse:89.337637+4.159936 
## [19]	train-rmse:80.819553+0.617761	test-rmse:89.021325+4.233445 
## [20]	train-rmse:80.251598+0.676526	test-rmse:88.777821+4.288036 
## [21]	train-rmse:79.799172+0.657990	test-rmse:88.681714+4.311085 
## [22]	train-rmse:79.351097+0.623143	test-rmse:88.632636+4.267026 
## [23]	train-rmse:78.935793+0.624315	test-rmse:88.648987+4.255367 
## [24]	train-rmse:78.555808+0.592018	test-rmse:88.689520+4.276593 
## [25]	train-rmse:78.275054+0.634054	test-rmse:88.607161+4.226141 
## [26]	train-rmse:77.988696+0.560835	test-rmse:88.682584+4.255561 
## [27]	train-rmse:77.654451+0.643152	test-rmse:88.699162+4.274271 
## [28]	train-rmse:77.329947+0.642731	test-rmse:88.729009+4.264544 
## [29]	train-rmse:76.945379+0.562275	test-rmse:88.743368+4.234641 
## [30]	train-rmse:76.625422+0.604059	test-rmse:88.724684+4.267039 
## [31]	train-rmse:76.287283+0.639165	test-rmse:88.742914+4.226476 
## [32]	train-rmse:76.015379+0.605193	test-rmse:88.754353+4.229545 
## [33]	train-rmse:75.750641+0.572163	test-rmse:88.732806+4.196962 
## [34]	train-rmse:75.420348+0.596221	test-rmse:88.804752+4.203625 
## [35]	train-rmse:75.150824+0.595465	test-rmse:88.879147+4.174764 
## [36]	train-rmse:74.935793+0.559431	test-rmse:88.880929+4.166054 
## [37]	train-rmse:74.689166+0.517547	test-rmse:88.849203+4.157470 
## [38]	train-rmse:74.423842+0.481523	test-rmse:88.876115+4.119089 
## [39]	train-rmse:74.145363+0.517264	test-rmse:88.954498+4.171797 
## [40]	train-rmse:73.914064+0.493563	test-rmse:88.981013+4.144360 
## [41]	train-rmse:73.711050+0.507081	test-rmse:89.008304+4.176376 
## [42]	train-rmse:73.456224+0.440329	test-rmse:89.015712+4.161625 
## [43]	train-rmse:73.137612+0.440245	test-rmse:89.082278+4.115153 
## [44]	train-rmse:72.903363+0.480242	test-rmse:89.116264+4.066048 
## [45]	train-rmse:72.730102+0.518621	test-rmse:89.144615+4.052665 
## Stopping. Best iteration:
## [25]	train-rmse:78.275054+0.634054	test-rmse:88.607161+4.226141
## 
## [1]	train-rmse:1830.371850+0.370458	test-rmse:1830.433374+4.327748 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1340.050891+0.273125	test-rmse:1340.048352+4.143246 
## [3]	train-rmse:982.060046+0.211014	test-rmse:982.015112+3.824527 
## [4]	train-rmse:720.897955+0.151919	test-rmse:721.001062+3.800511 
## [5]	train-rmse:530.840057+0.119143	test-rmse:531.015375+3.516281 
## [6]	train-rmse:393.039685+0.123422	test-rmse:393.164651+3.357167 
## [7]	train-rmse:293.717490+0.129453	test-rmse:294.179675+3.201438 
## [8]	train-rmse:222.916205+0.154180	test-rmse:223.976427+3.069815 
## [9]	train-rmse:173.263225+0.195202	test-rmse:174.834665+2.972909 
## [10]	train-rmse:139.294357+0.243242	test-rmse:141.661238+2.993711 
## [11]	train-rmse:116.865808+0.312425	test-rmse:119.986215+3.081639 
## [12]	train-rmse:102.598154+0.323268	test-rmse:106.747741+3.226979 
## [13]	train-rmse:93.710652+0.321996	test-rmse:98.791676+3.295226 
## [14]	train-rmse:88.356450+0.314818	test-rmse:94.184678+3.333642 
## [15]	train-rmse:85.160658+0.312425	test-rmse:91.607004+3.397818 
## [16]	train-rmse:83.093374+0.305859	test-rmse:90.249811+3.433478 
## [17]	train-rmse:81.772367+0.319644	test-rmse:89.539165+3.471753 
## [18]	train-rmse:80.832816+0.327315	test-rmse:89.128877+3.485347 
## [19]	train-rmse:80.142934+0.280273	test-rmse:88.858403+3.540450 
## [20]	train-rmse:79.675141+0.235925	test-rmse:88.783797+3.600594 
## [21]	train-rmse:79.234686+0.267249	test-rmse:88.675794+3.624338 
## [22]	train-rmse:78.872297+0.281106	test-rmse:88.657572+3.684815 
## [23]	train-rmse:78.486030+0.353197	test-rmse:88.604525+3.671348 
## [24]	train-rmse:78.071101+0.397799	test-rmse:88.621435+3.638468 
## [25]	train-rmse:77.762459+0.400625	test-rmse:88.665929+3.651975 
## [26]	train-rmse:77.476073+0.398250	test-rmse:88.668462+3.646618 
## [27]	train-rmse:77.143319+0.409621	test-rmse:88.641685+3.648577 
## [28]	train-rmse:76.788518+0.333352	test-rmse:88.680315+3.661167 
## [29]	train-rmse:76.459305+0.294736	test-rmse:88.691084+3.702913 
## [30]	train-rmse:76.146006+0.286837	test-rmse:88.702561+3.743984 
## [31]	train-rmse:75.895741+0.323510	test-rmse:88.726665+3.775816 
## [32]	train-rmse:75.629930+0.325309	test-rmse:88.717096+3.789293 
## [33]	train-rmse:75.218581+0.400446	test-rmse:88.743497+3.724287 
## [34]	train-rmse:74.964941+0.456757	test-rmse:88.774326+3.730394 
## [35]	train-rmse:74.613586+0.545940	test-rmse:88.814053+3.740747 
## [36]	train-rmse:74.333948+0.488471	test-rmse:88.842848+3.720065 
## [37]	train-rmse:74.081358+0.517248	test-rmse:88.853438+3.734487 
## [38]	train-rmse:73.826613+0.540138	test-rmse:88.873753+3.795251 
## [39]	train-rmse:73.591971+0.585259	test-rmse:88.937186+3.797842 
## [40]	train-rmse:73.349293+0.614138	test-rmse:88.942829+3.777200 
## [41]	train-rmse:73.058924+0.601779	test-rmse:88.939140+3.742560 
## [42]	train-rmse:72.790810+0.538944	test-rmse:88.954354+3.711500 
## [43]	train-rmse:72.524535+0.548892	test-rmse:89.022513+3.710079 
## Stopping. Best iteration:
## [23]	train-rmse:78.486030+0.353197	test-rmse:88.604525+3.671348
## 
## [1]	train-rmse:1804.576416+0.320279	test-rmse:1804.609473+3.682776 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1302.640356+0.234379	test-rmse:1302.656042+3.625170 
## [3]	train-rmse:941.409381+0.169950	test-rmse:941.439264+3.517460 
## [4]	train-rmse:681.686224+0.127234	test-rmse:681.726196+3.486860 
## [5]	train-rmse:495.500537+0.110444	test-rmse:495.576910+3.483811 
## [6]	train-rmse:362.630661+0.111394	test-rmse:362.771152+3.502121 
## [7]	train-rmse:268.524887+0.106454	test-rmse:268.908768+3.410918 
## [8]	train-rmse:202.745960+0.146292	test-rmse:203.584293+3.239358 
## [9]	train-rmse:157.783685+0.160323	test-rmse:159.180028+3.058654 
## [10]	train-rmse:127.917749+0.207565	test-rmse:130.235660+2.951725 
## [11]	train-rmse:108.903974+0.248922	test-rmse:112.139874+2.762067 
## [12]	train-rmse:97.232480+0.346520	test-rmse:101.450075+2.641163 
## [13]	train-rmse:90.296053+0.352491	test-rmse:95.369430+2.466051 
## [14]	train-rmse:86.147132+0.396751	test-rmse:92.020931+2.328945 
## [15]	train-rmse:83.713639+0.445801	test-rmse:90.246872+2.269638 
## [16]	train-rmse:82.211462+0.436268	test-rmse:89.274218+2.320001 
## [17]	train-rmse:81.190368+0.461873	test-rmse:88.775058+2.332176 
## [18]	train-rmse:80.506192+0.496888	test-rmse:88.583710+2.331857 
## [19]	train-rmse:79.924734+0.508324	test-rmse:88.469262+2.419750 
## [20]	train-rmse:79.396197+0.510789	test-rmse:88.413708+2.402530 
## [21]	train-rmse:78.960158+0.459425	test-rmse:88.393480+2.366958 
## [22]	train-rmse:78.564482+0.441044	test-rmse:88.401280+2.364162 
## [23]	train-rmse:78.267427+0.427079	test-rmse:88.366396+2.367619 
## [24]	train-rmse:77.893256+0.449215	test-rmse:88.377609+2.427881 
## [25]	train-rmse:77.585998+0.440450	test-rmse:88.385216+2.412766 
## [26]	train-rmse:77.170950+0.495955	test-rmse:88.413594+2.435808 
## [27]	train-rmse:76.858686+0.561909	test-rmse:88.428303+2.462600 
## [28]	train-rmse:76.494396+0.548751	test-rmse:88.450777+2.516864 
## [29]	train-rmse:76.223784+0.613636	test-rmse:88.442685+2.519818 
## [30]	train-rmse:75.868287+0.589648	test-rmse:88.527042+2.538737 
## [31]	train-rmse:75.573679+0.577093	test-rmse:88.536232+2.523848 
## [32]	train-rmse:75.327896+0.542524	test-rmse:88.593678+2.496969 
## [33]	train-rmse:75.006905+0.584200	test-rmse:88.568934+2.513061 
## [34]	train-rmse:74.685379+0.599557	test-rmse:88.588345+2.531168 
## [35]	train-rmse:74.396342+0.555389	test-rmse:88.604089+2.500140 
## [36]	train-rmse:74.157629+0.607753	test-rmse:88.660909+2.559245 
## [37]	train-rmse:73.906189+0.643893	test-rmse:88.718535+2.543721 
## [38]	train-rmse:73.675858+0.608674	test-rmse:88.771131+2.523979 
## [39]	train-rmse:73.380757+0.527577	test-rmse:88.849058+2.545353 
## [40]	train-rmse:73.104109+0.527693	test-rmse:88.891270+2.519953 
## [41]	train-rmse:72.855080+0.543102	test-rmse:88.895145+2.509300 
## [42]	train-rmse:72.584057+0.529727	test-rmse:88.940971+2.427982 
## [43]	train-rmse:72.310300+0.535488	test-rmse:88.937634+2.405069 
## Stopping. Best iteration:
## [23]	train-rmse:78.267427+0.427079	test-rmse:88.366396+2.367619
## 
## [1]	train-rmse:1778.787256+0.254275	test-rmse:1778.879663+3.547984 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1265.768774+0.180900	test-rmse:1265.761243+3.416815 
## [3]	train-rmse:901.903735+0.123749	test-rmse:901.976581+3.387828 
## [4]	train-rmse:644.153552+0.093463	test-rmse:644.101459+3.173348 
## [5]	train-rmse:462.177219+0.108051	test-rmse:462.203720+2.964032 
## [6]	train-rmse:334.437161+0.119231	test-rmse:334.713602+2.894473 
## [7]	train-rmse:245.589130+0.165788	test-rmse:246.210881+2.760031 
## [8]	train-rmse:184.825795+0.214047	test-rmse:186.044198+2.634934 
## [9]	train-rmse:144.377206+0.314746	test-rmse:146.332913+2.672113 
## [10]	train-rmse:118.467844+0.375421	test-rmse:121.309608+2.869949 
## [11]	train-rmse:102.587334+0.455574	test-rmse:106.303014+3.150814 
## [12]	train-rmse:93.152342+0.478138	test-rmse:97.889147+3.428523 
## [13]	train-rmse:87.695212+0.511017	test-rmse:93.204455+3.704791 
## [14]	train-rmse:84.587628+0.495485	test-rmse:90.776625+3.909885 
## [15]	train-rmse:82.664155+0.475221	test-rmse:89.463907+4.032462 
## [16]	train-rmse:81.451282+0.501856	test-rmse:88.851862+4.096149 
## [17]	train-rmse:80.645815+0.455760	test-rmse:88.508597+4.178367 
## [18]	train-rmse:80.030914+0.480056	test-rmse:88.310150+4.238332 
## [19]	train-rmse:79.489381+0.478219	test-rmse:88.224518+4.253440 
## [20]	train-rmse:79.112637+0.526359	test-rmse:88.152670+4.288154 
## [21]	train-rmse:78.644512+0.560074	test-rmse:88.178738+4.312773 
## [22]	train-rmse:78.290498+0.516425	test-rmse:88.155070+4.340284 
## [23]	train-rmse:77.945165+0.528146	test-rmse:88.209580+4.418488 
## [24]	train-rmse:77.603467+0.520907	test-rmse:88.220850+4.453772 
## [25]	train-rmse:77.251061+0.488001	test-rmse:88.275819+4.521771 
## [26]	train-rmse:76.882851+0.534030	test-rmse:88.296923+4.536751 
## [27]	train-rmse:76.513240+0.548214	test-rmse:88.355818+4.502019 
## [28]	train-rmse:76.174303+0.562078	test-rmse:88.345940+4.507785 
## [29]	train-rmse:75.871706+0.545190	test-rmse:88.334476+4.479623 
## [30]	train-rmse:75.593019+0.599254	test-rmse:88.339678+4.484786 
## [31]	train-rmse:75.279160+0.523713	test-rmse:88.373030+4.488068 
## [32]	train-rmse:74.995094+0.511181	test-rmse:88.422888+4.484357 
## [33]	train-rmse:74.686959+0.534228	test-rmse:88.419530+4.476648 
## [34]	train-rmse:74.391243+0.548262	test-rmse:88.432352+4.470882 
## [35]	train-rmse:74.098279+0.494391	test-rmse:88.460089+4.472510 
## [36]	train-rmse:73.775136+0.514038	test-rmse:88.524156+4.448205 
## [37]	train-rmse:73.443196+0.537754	test-rmse:88.526310+4.439881 
## [38]	train-rmse:73.113226+0.518672	test-rmse:88.454950+4.452703 
## [39]	train-rmse:72.869091+0.583955	test-rmse:88.459145+4.465623 
## [40]	train-rmse:72.673756+0.570745	test-rmse:88.497166+4.479100 
## Stopping. Best iteration:
## [20]	train-rmse:79.112637+0.526359	test-rmse:88.152670+4.288154
## 
## [1]	train-rmse:1752.989758+0.360384	test-rmse:1753.053870+4.282948 
## Multiple eval metrics are present. Will use test_rmse for early stopping.
## Will train until test_rmse hasn't improved in 20 rounds.
## 
## [2]	train-rmse:1229.435327+0.253621	test-rmse:1229.449634+4.215674 
## [3]	train-rmse:863.578247+0.181802	test-rmse:863.596008+3.901314 
## [4]	train-rmse:608.282684+0.137231	test-rmse:608.237878+3.807724 
## [5]	train-rmse:430.871301+0.122034	test-rmse:430.927643+3.651855 
## [6]	train-rmse:308.400824+0.111787	test-rmse:308.624994+3.761617 
## [7]	train-rmse:224.834979+0.147792	test-rmse:225.542265+3.613642 
## [8]	train-rmse:169.029959+0.187371	test-rmse:170.371578+3.490619 
## [9]	train-rmse:133.001929+0.225302	test-rmse:135.179124+3.454330 
## [10]	train-rmse:110.738762+0.262738	test-rmse:113.838846+3.313635 
## [11]	train-rmse:97.576648+0.280197	test-rmse:101.623581+3.277483 
## [12]	train-rmse:90.138657+0.305719	test-rmse:95.044836+3.162852 
## [13]	train-rmse:85.876418+0.239351	test-rmse:91.705812+3.223349 
## [14]	train-rmse:83.461633+0.263131	test-rmse:89.897549+3.192829 
## [15]	train-rmse:82.005439+0.294619	test-rmse:89.134656+3.182807 
## [16]	train-rmse:81.054752+0.279247	test-rmse:88.659316+3.234735 
## [17]	train-rmse:80.377028+0.317327	test-rmse:88.428644+3.296904 
## [18]	train-rmse:79.838070+0.371697	test-rmse:88.324705+3.351766 
## [19]	train-rmse:79.423756+0.395681	test-rmse:88.275580+3.332477 
## [20]	train-rmse:78.859187+0.379412	test-rmse:88.393935+3.230556 
## [21]	train-rmse:78.431869+0.311039	test-rmse:88.439858+3.228725 
## [22]	train-rmse:77.996603+0.351120	test-rmse:88.477309+3.106773 
## [23]	train-rmse:77.536647+0.307037	test-rmse:88.427794+3.125720 
## [24]	train-rmse:77.215131+0.279235	test-rmse:88.440909+3.131503 
## [25]	train-rmse:76.861765+0.259586	test-rmse:88.492988+3.090060 
## [26]	train-rmse:76.557674+0.265927	test-rmse:88.486831+3.062881 
## [27]	train-rmse:76.179245+0.257696	test-rmse:88.556316+3.045232 
## [28]	train-rmse:75.803523+0.252755	test-rmse:88.593929+3.007269 
## [29]	train-rmse:75.473167+0.291458	test-rmse:88.675352+2.949988 
## [30]	train-rmse:75.106651+0.252638	test-rmse:88.694662+2.963544 
## [31]	train-rmse:74.837756+0.305453	test-rmse:88.676745+2.936509 
## [32]	train-rmse:74.576280+0.312642	test-rmse:88.704611+2.915300 
## [33]	train-rmse:74.224732+0.351783	test-rmse:88.778457+2.909996 
## [34]	train-rmse:73.829112+0.370387	test-rmse:88.798130+2.906985 
## [35]	train-rmse:73.550024+0.345648	test-rmse:88.842565+2.905963 
## [36]	train-rmse:73.349217+0.374234	test-rmse:88.834059+2.905294 
## [37]	train-rmse:73.134692+0.443958	test-rmse:88.892769+2.938071 
## [38]	train-rmse:72.803959+0.344804	test-rmse:88.873376+2.884582 
## [39]	train-rmse:72.502420+0.323881	test-rmse:88.938166+2.872012 
## Stopping. Best iteration:
## [19]	train-rmse:79.423756+0.395681	test-rmse:88.275580+3.332477
```

```r
toc()
```

```
## 1332.886 sec elapsed
```

---
# Check out the best

```r
map_df(tune_tree_lr_xgb, ~{
  .x$evaluation_log %>% 
  dplyr::slice(.x$best_iteration)
}) %>% 
  mutate(learning_rate = grd$learn_rate) %>% 
  arrange(test_rmse_mean) %>% 
  select(learning_rate, iter, test_rmse_mean, test_rmse_std)
```

```
##     learning_rate iter test_rmse_mean test_rmse_std
##  1:    0.05180690  141       87.69085      3.177961
##  2:    0.12419655   58       87.76704      2.295048
##  3:    0.13453793   52       87.77186      2.518265
##  4:    0.02078276  324       87.78090      4.838379
##  5:    0.06214828  113       87.79437      2.834557
##  6:    0.07248966  106       87.82489      2.794558
##  7:    0.10351379   75       87.87595      3.396600
##  8:    0.08283103   84       87.91799      3.320636
##  9:    0.11385517   69       87.92624      2.826622
## 10:    0.01044138  668       88.01331      2.397168
## 11:    0.15522069   47       88.01696      2.201978
## 12:    0.21726897   30       88.05370      4.137436
## 13:    0.03112414  213       88.06145      4.896635
## 14:    0.16556207   41       88.14663      2.227841
## 15:    0.17590345   41       88.15149      2.914207
## 16:    0.28965862   20       88.15267      4.288154
## 17:    0.09317241   73       88.17855      4.598866
## 18:    0.04146552  180       88.19150      2.755753
## 19:    0.23795172   27       88.22622      3.172008
## 20:    0.30000000   19       88.27558      3.332477
## 21:    0.18624483   35       88.30171      3.308152
## 22:    0.22761034   26       88.31313      2.851374
## 23:    0.27931724   23       88.36640      2.367619
## 24:    0.14487931   53       88.37876      3.201203
## 25:    0.19658621   33       88.38764      3.159795
## 26:    0.20692759   30       88.57368      1.952880
## 27:    0.24829310   24       88.57959      3.157297
## 28:    0.26897586   23       88.60453      3.671348
## 29:    0.25863448   25       88.60716      4.226141
## 30:    0.00010000 5000     1519.75710      2.612983
##     learning_rate iter test_rmse_mean test_rmse_std
```

---
# Comparing times on the cluster
I ran the same learning rate tuning code as above with 10% on talapas.  I requested the following resources

---
## Set learning rate, tune tree params

```r
tune_depth <- tune_lr %>% 
  finalize_model(select_best(tune_tree_lr, "rmse")) %>% 
  set_args(tree_depth = tune(),
           min_n = tune())

wf_tune_depth <- wf_df %>% 
  update_model(tune_depth)

grd <- grid_max_entropy(tree_depth(), min_n(), size = 30)

tic()
tune_tree_depth <- tune_grid(wf_tune_depth, cv, grid = grd)
toc()
```

```
## 42709.947 sec elapsed
```

---
# autoplot

```r
autoplot(tune_tree_depth)
```

![](w9p2-boosted-trees-2_files/figure-html/autoplot-tree-depth-1.png)

---
# show best

```r
show_best(tune_tree_depth, "rmse")
```

```
## # A tibble: 5 x 8
##   min_n tree_depth .metric .estimator     mean     n   std_err .config
##   <int>      <int> <chr>   <chr>         <dbl> <int>     <dbl> <chr>  
## 1    24          2 rmse    standard   87.84790    10 0.9154182 Model15
## 2    37          2 rmse    standard   87.87870    10 0.9418234 Model07
## 3     3          2 rmse    standard   87.88880    10 0.9319917 Model26
## 4     8          1 rmse    standard   88.26033    10 0.9874354 Model02
## 5    31          1 rmse    standard   88.28066    10 0.9776566 Model28
```

---
# Tune regularization

```r
tune_reg <- tune_depth %>% 
  finalize_model(select_best(tune_tree_depth, "rmse")) %>% 
  set_args(loss_reduction = tune())

wf_tune_reg <- wf_df %>% 
  update_model(tune_reg)

grd <- expand.grid(loss_reduction = seq(0, 100, 5))

tic()
tune_tree_reg <- tune_grid(wf_tune_reg, cv, grid = grd)
toc()
```

```
## 10553.079 sec elapsed
```

---
# autoplot

```r
autoplot(tune_tree_reg)
```

![](w9p2-boosted-trees-2_files/figure-html/autoplot-tune-reg-1.png)

---
# Show best

```r
show_best(tune_tree_reg, "rmse")
```

```
## # A tibble: 5 x 7
##   loss_reduction .metric .estimator     mean     n   std_err .config
##            <dbl> <chr>   <chr>         <dbl> <int>     <dbl> <chr>  
## 1             95 rmse    standard   87.84653    10 0.9151305 Model20
## 2             85 rmse    standard   87.84720    10 0.9152698 Model18
## 3             90 rmse    standard   87.84720    10 0.9152698 Model19
## 4             55 rmse    standard   87.84726    10 0.9152833 Model12
## 5             60 rmse    standard   87.84726    10 0.9152833 Model13
```

---
# Tune randomness

```r
tune_rand <- tune_reg %>%
  finalize_model(select_best(tune_tree_reg, "rmse")) %>% 
  set_args(mtry = tune(),
           sample_size = tune())

wf_tune_rand <- wf_df %>% 
  update_model(tune_rand)

grd <- grid_max_entropy(finalize(mtry(), juice(prep(rec))), 
                        sample_size = sample_prop(), 
                        size = 30)

tic()
tune_tree_rand <- tune_grid(wf_tune_rand, cv, grid = grd)
toc()
```

```
## 78981.883 sec elapsed
```

---
# autoplot

```r
autoplot(tune_tree_rand)
```

![](w9p2-boosted-trees-2_files/figure-html/autoplot-rand-1.png)

---
# Show best

```r
show_best(tune_tree_rand, "rmse")
```

```
## # A tibble: 5 x 8
##    mtry sample_size .metric .estimator     mean     n   std_err .config
##   <int>       <dbl> <chr>   <chr>         <dbl> <int>     <dbl> <chr>  
## 1    12   0.3916880 rmse    standard   87.38401    10 0.8955410 Model02
## 2    24   0.2386458 rmse    standard   87.40194    10 0.8720558 Model07
## 3     9   0.1645754 rmse    standard   87.43756    10 0.8920176 Model04
## 4     6   0.5037975 rmse    standard   87.43936    10 0.9044089 Model13
## 5    22   0.5318504 rmse    standard   87.45761    10 0.9042285 Model28
```

---
# Check learning rate one more time 
* Note how long this takes -- why?

```r
check_lr <- tune_rand %>% 
  finalize_model(select_best(tune_tree_rand, "rmse")) %>% 
  set_args(learn_rate = tune())

wf_final_lr <- wf_df %>% 
  update_model(check_lr)

tic()
final_lr <- tune_grid(wf_final_lr, cv, grid = 30)
toc()
```

```
## 62352.819 sec elapsed
```

---
# autoplot

```r
autoplot(final_lr)
```

![](w9p2-boosted-trees-2_files/figure-html/final-lr-autoplot-1.png)

---
# show best

```r
show_best(final_lr, "rmse")
```

```
## # A tibble: 5 x 7
##    learn_rate .metric .estimator     mean     n   std_err .config
##         <dbl> <chr>   <chr>         <dbl> <int>     <dbl> <chr>  
## 1 0.01040242  rmse    standard   87.38304    10 0.8926279 Model20
## 2 0.01450775  rmse    standard   87.46773    10 0.8870550 Model16
## 3 0.003999757 rmse    standard   87.56493    10 0.9329099 Model03
## 4 0.02809310  rmse    standard   87.74501    10 0.8501355 Model19
## 5 0.002247712 rmse    standard   88.01303    10 0.9856134 Model12
```

---
# Wrapping up

* gradient boosted trees are a really powerful out-of-the-box predictive model

--
* proper tuning can make them hard to beat, particularly for tabular data. But of course, this will not always be the case.

--
* For more info on {xgboost}, see [the documentation](https://xgboost.readthedocs.io/en/latest/)