Yeah, mining tailings of rare earths are a real pain indeed. They are in fact toxic forever and indeed a much bigger problem in volume.
Wait, you were talking about that right? Not singling out spent nuclear fuel that remains radiotoxic for around 300 years and has the lowest volume by orders of magnitude, right?