Nonrigid materials such as liquids or smoke deform over time. Little is known about the visual perception of nonrigid motion other than that many motion cues associated with rigid motion perception are not reliable for nonrigid motion. Nonrigid motion patterns lack clear borders and their movement can be inconsistent with the motion of their parts. We developed a novel stimulus that creates a nonrigid vortex motion pattern in a random dot distribution and decouples the movement of the vortex from the first-order motion of the dots. We presented three moving vortices that entailed consecutively fewer motion cues, eliminating occlusion, motion borders, and velocity field gradients in the process. Subjects were well able to report the end position and travel path in all cases, showing that nonrigid motion is perceived through an analysis of the temporal evolution of visual motion patterns and does not require borders or speed differences. Adding a coherent global motion did not hamper perception, but adding local noise did, indicating that the visual system uses mid-level features that are on a local scale. We also found that participants judged the movement of the nonrigid motion patterns slower than a rigid control, revealing that speed perception was based on a combination of motion of the parts and movement of the pattern. We propose that the visual system uses the temporal evolution of a motion pattern for the perception of nonrigid motion and suggest a plausible mechanism based on the curl of the motion field.