indeed. Kill switch, immediately.
ANd after running the engine for a while to expel all water, chech the oil. If water has gotten in, it will have become a mayonnaise-like substance. You'll need to replace it asap. Any type of oil (even vegetable cooking oil) is better then keeping on riding with the water/oil mix. Of course replace with genuine motorcycle engine oil at the first opportunity.