The higher the fees, the higher the chances that the next BTC transaction you want to do on-chain is considered to be below dust for the mempool.
With L2 infrastructure still being fleshed out and liquidity bolstered, this is a very real scenario for the time being where you will simply not be able to transact.