Kidney Failure Prediction Models: A Comprehensive External Validation Study in Patients with Advanced CKD

Ramspek, C. L.; Evans, M.; Wanner, C.; Drechsler, C.; Chesnaye, N. C.; Szymczak, M.; Krajewska, M.; Torino, C.; Porto, G.; Hayward, S.; Caskey, F.; Dekker, F. W.; Jager, K. J.; van Diepen, M.; Cupisti, A.; Sagliocca, A.; Ferraro, A.; Musiała, A.; Mele, A.; Naticchia, A.; Còsaro, A.; Woodman, A.; Ranghino, A.; Stucchi, A.; Jonsson, A.; Schneider, A.; Pignataro, A.; Schrander, A.; Torp, A.; Mckeever, A.; Szymczak, A.; Blom, A. -L.; de Blasio, A.; Pani, A.; Tsalouichos, A.; Ullah, A.; Mclaren, B.; van Dam, B.; Iwig, B.; Antonio, B.; Di Iorio, B. R.; Rogland, B.; Perras, B.; Alessandra, B.; Harron, C.; Wallquist, C.; Siegert, C.; Barrett, C.; Gaillard, C.; Garofalo, C.; Abaterusso, C.; Beerenhout, C.; O'Toole, C.; Somma, C.; Marx, C.; Summersgill, C.; Blaser, C.; D'Alessandro, C.; Emde, C.; Zullo, C.; Pozzi, C.; Geddes, C.; Verburgh, C.; Bergamo, D.; Ciurlino, D.; Motta, D.; Glowski, D.; Mcglynn, D.; Vargas, D.; Krieter, D.; Russo, D.; Fuchs, D.; Sands, D.; Hoogeveen, E.; Irmler, E.; Dimény, E.; Favaro, E.; Platen, E.; Olczyk, E.; Hoorn, E.; Vigotti, F.; Ansali, F.; Conte, F.; Cianciotta, F.; Giacchino, F.; Cappellaio, F.; Pizzarelli, F.; Sundelin, F.; Uhlin, F.; Greco, G.; Roy, G.; Bigatti, G.; Marinangeli, G.; Cabiddu, G.; Hirst, G.; Fumagalli, G.; Caloro, G.; Piccoli, G.; Capasso, G.; Gambaro, G.; Tognarelli, G.; Bonforte, G.; Conte, G.; Toscano, G.; Del Rosso, G.; Welander, G.; Augustyniak-Bartosik, H.; Boots, H.; Schmidt-Gürtler, H.; King, H.; Mcnally, H.; Schlee, H.; Boom, H.; Naujoks, H.; Masri-Senghor, H.; Murtagh, H.; Rayner, H.; Miśkowiec-Wiśniewska, I.; Schlee, I.; Capizzi, I.; Hernandez, I. B.; Baragetti, I.; Manitius, J.; Turner, J.; Eijgenraam, J. -W.; Kooman, J.; Beige, J.; Pondel, J.; Wilcox, J.; Berdeprado, J.; Röthele, J.; Wong, J.; Rotmans, J.; Banda, J.; Mazur, J.; Hahn, K.; Jędrzejak, K.; Nowańska, K.; Blouin, K.; Neumeier, K.; Jones, K.; Anding-Rost, K.; Gröntoft, K. -C.; Oldrizzi, L.; Haydock, L.; Vogt, L.; Wilkinson, L.; Gesualdo, L.; Schramm, L.; Biancone, L.; Nowak, Ł.; Raasveld, M.; Durlik, M.; Magnano, M.; Vervloet, M.; Ricardi, M.; Carmody, M.; Di Bari, M.; Laudato, M.; Sirico, M. L.; Stendahl, M.; Svensson, M.; Weetman, M.; van Buren, M.; Joinson, M.; Ferraresi, M.; Dutton, M.; Matthews, M.; Provenzano, M.; Hopf, M.; Malaguti, M.; Wuttke, N.; Morgan, N.; Palmieri, N.; Frischmuth, N.; Bleakley, N.; Murrone, P.; Cockwell, P.; Leurs, P.; Roderick, P.; Voskamp, P.; Kashioulis, P.; Ichtiaris, P.; Blankestijn, P.; Kirste, P.; Schulz, P.; Mason, P.; Kalra, P.; Cirillo, P.; Dattolo, P.; Acampora, P.; Sajith, R.; Nigro, R.; Boero, R.; Scarpioni, R.; Sicoli, R.; Malandra, R.; Aign, S.; Cäsar, S.; van Esch, S.; Chapman, S.; Biribauer, S.; Navjee, S.; Crosbie, S.; Brown, S.; Tickle, S.; Manan, S.; Röser, S.; Savoldi, S.; Bertoli, S.; Borrelli, S.; Boorsma, S.; Heidenreich, S.; Melander, S.; Maxia, S.; Maffei, S.; Mangano, S.; Palm, S.; Konings, S.; Mathavakkannan, S.; Schwedler, S.; Delrieux, S.; Renker, S.; Schättel, S.; Dorota, S.; Cicchetti, T.; Nieszporek, T.; Stephan, T.; Schmiedeke, T.; Weinreich, T.; Leimbach, T.; Rappa, T.; Almquist, T.; Stövesand, T.; Bahner, U.; Jensen, U.; Palazzo, V.; de Simone, W.; Seeger, W.; Kuan, Y.; Heleniak, Z.; Aydin, Z.

doi:10.1681/ASN.2020071077

Background: Various prediction models have been developed to predict the risk of kidney failure in patients with CKD. However, guideline-recommended models have yet to be compared head to head, their validation in patients with advanced CKD is lacking, and most do not account for competing risks.Methods: To externally validate 11 existing models of kidney failure, taking the competing risk of death into account, we included patients with advanced CKD from two large cohorts: the European Quality Study (EQUAL), an ongoing European prospective, multicenter cohort study of older patients with advanced CKD, and the Swedish Renal Registry (SRR), an ongoing registry of nephrology-referred patients with CKD in Sweden. The outcome of the models was kidney failure (defined as RRT-treated ESKD). We assessed model performance with discrimination and calibration.Results: The study included 1580 patients from EQUAL and 13,489 patients from SRR. The average c statistic over the 11 validated models was 0.74 in EQUAL and 0.80 in SRR, compared with 0.89 in previous validations. Most models with longer prediction horizons overestimated the risk of kidney failure considerably. The 5-year Kidney Failure Risk Equation (KFRE) overpredicted risk by 10%-18%. The four- and eight-variable 2-year KFRE and the 4-year Grams model showed excellent calibration and good discrimination in both cohorts.Conclusions: Some existing models can accurately predict kidney failure in patients with advanced CKD. KFRE performed well for a shorter time frame (2 years), despite not accounting for competing events. Models predicting over a longer time frame (5 years) overestimated risk because of the competing risk of death. The Grams model, which accounts for the latter, is suitable for longer-term predictions (4 years).