[major] Training: SmoothL1Loss update beta from 1.0 to 0.3

[ourownstory]

To date we have used the default SmoothL1Loss beta of 1.0. For standardized data in range [0, 1] this means that the loss is always in the MSE region. The update to 0.3 should help with outliers, and initial training to lie closer to the linear L1 loss region, thus stabilizing training.

[codecov]

Codecov Report

Merging #1461 (c0df76b) into main (962d624) will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##             main    #1461   +/-   ##
=======================================
  Coverage   88.32%   88.32%           
=======================================
  Files          38       38           
  Lines        5097     5097           
=======================================
  Hits         4502     4502           
  Misses        595      595           

Files	Coverage Δ
neuralprophet/configure.py	90.18% <100.00%> (ø)

[github-actions]

Model Benchmark

Benchmark	Metric	main	current	diff
AirPassengers	MAE_val	30.12721	31.6338	5.0%	⚠️
AirPassengers	RMSE_val	31.01396	32.6669	5.33%	⚠️
AirPassengers	Loss_val	0.00371	0.01372	269.81%	❌
AirPassengers	MAE	6.27639	6.24137	-0.56%	✅
AirPassengers	RMSE	7.88804	7.82929	-0.74%	✅
AirPassengers	Loss	0.00019	0.00063	228.85%	❌
AirPassengers	time	21.45817	10.71	-50.09%	🎉
EnergyPriceDaily	MAE_val	-	5.5589	-
EnergyPriceDaily	RMSE_val	-	7.1223	-
EnergyPriceDaily	Loss_val	-	0.0283	-
EnergyPriceDaily	MAE	-	6.3717	-
EnergyPriceDaily	RMSE	-	8.5302	-
EnergyPriceDaily	Loss	-	0.0291	-
EnergyPriceDaily	time	-	15.82	-
PeytonManning	MAE_val	0.34778	0.3466	-0.34%	✅
PeytonManning	RMSE_val	0.49928	0.49808	-0.24%	✅
PeytonManning	Loss_val	0.00595	0.01752	194.19%	❌
PeytonManning	MAE	0.35123	0.34735	-1.1%	✅
PeytonManning	RMSE	0.48066	0.48788	1.5%	✅
PeytonManning	Loss	0.0046	0.01457	216.58%	❌
PeytonManning	time	52.14108	21.65	-58.48%	🎉
YosemiteTemps	MAE_val	0.44287	0.64178	44.91%	❌
YosemiteTemps	RMSE_val	0.62875	0.92787	47.57%	❌
YosemiteTemps	Loss_val	7e-05	0.0005	642.64%	❌
YosemiteTemps	MAE	0.80138	1.092	36.26%	❌
YosemiteTemps	RMSE	1.44081	1.89124	31.26%	❌
YosemiteTemps	Loss	0.00027	0.00155	472.33%	❌
YosemiteTemps	time	147.64266	61.2	-58.55%	🎉

Model training plots

Model Training

PeytonManning

YosemiteTemps

AirPassengers

EnergyPriceDaily