Possible to disable "magic link" login?

Magic link logins make accounts less secure, since the user now only needs to know one factor password (the email address's password). How can we disable access to this kind of login? I want to stay with password/TOTP.