Definitely!!! unless you want it to get sucked through the engine and wipe out some bearing be it rod, or main.. Just think $30 for an oil change, or a couple hundred to go through your engine to put new bearings in, and replace anything else that got wrecked. Also just so you know take about a quart of oil and pour it around in your intake valley to make sure none is hanging around on the lifters, or somewhere between the valley and the pan, then change the oil and you will be fine. I know it was probably a good amount that went in the valley, especially in the rear, been there done that three times.
Hope that helps,Dan