You probably have to rmmod the drivers that are using the modem before you can "safely" remove it.
But what could happen if you just unplug it after you close your internet connection?
A read-only flash drive with windows software is pretty useless in Linux, isn't it?
What happens when you plug it in?
tail -f /var/log/messages