No the worst that could happen. The worst could be that you use a fake Electrum or a corrupted keyboard or worst that steal your coins, but in most cases everything is fine.
Best is to use a Tails OS stick (installed properly with signature checking and all), boot it on a trusted computer, run Electrum (included), enter seed, send all to you hardware wallet.