filter historic datawith low accuracy or faulty aggregation in compareScenarios2()

[0UmfHxcvx5J7JoaOhFSs5mncnisTJJ6q]

Did I read the intention of

remind2/R/compareScenarios.R

Lines 241 to 257 in 555634c

	# remove regional and global data from WEO 2021 source due to lack of accuracy
	if (any(grepl("IEA WEO 2021", getNames(histData)))) {
	histData.WEO <- histData[,,"IEA WEO 2021", pmatch = T]
	histData.WEO[histData.WEO == 0] <- NA
	histData.WEO[setdiff(getRegions(histData.WEO), "GLO"), ,
	c("IEA WEO 2021 APS GLO", "IEA WEO 2021 Net2050 GLO", "IEA WEO 2021 SDS GLO", "IEA WEO 2021 SPS GLO"),
	pmatch = T
	] <- NA
	histData.WEO["GLO", ,
	c("IEA WEO 2021 APS regional", "IEA WEO 2021 SDS regional", "IEA WEO 2021 SPS regional"),
	pmatch = T
	] <- NA
	histData[,,"IEA WEO 2021", pmatch = T] <- histData.WEO
	}

correctly to remove all data for scenarios IEA WEO 2021 APS GLO, IEA WEO 2021 Net2050 GLO, IEA WEO 2021 SDS GLO, IEA WEO 2021 SPS GLO, except for global (World) data, and all global data for scenarios IEA WEO 2021 APS regional, IEA WEO 2021 SDS regional, IEA WEO 2021 SPS regional, but not the regional?

[fbenke-pik]

Correct, this was an attempt to deal with the same issue brought up in issue #194 for the IEA WEO 2021 data.
It does not have to be adapted to the new cs2 script for now, I have decided to remove Global data together with inaccurate regional data in calcHistorical, so it won't be in new versions of historical.mif.

I am currently talking with @LaviniaBaumstark about a long-term solution that make these workarounds unnecessary altogether.

[fbenke-pik]

Added Christof to list of reviewers, since he was involved in the discussion which led to removing IEA WEO 2021 and should be aware we brought back pre-filtering for IEA ETP data since we need it now for current industry validation .