Classifying an object in a video frame

Claim 3

The method according to claim 1 , wherein, following step (d), step (b) is repeated for a candidate object in the next frame and, in the event that no correspondence is identified between the first object and said candidate object, the second status parameter is changed to one of a plurality of further parameters in accordance with a transition rule associated with said second status parameter.

Claim 4

The method according to claim 1 , wherein the transition rule determines whether the first object has disappeared or merged with another candidate object in the frame.

Claim 5

The method according to claim 1 , further comprising, in step (e), modifying the appearance of said subsequent frames to provide a visual indication of the intra-frame position of said object.

Claim 6

The method according to claim 4 , wherein subsequent frames are modified so as to display each intra-frame position recorded in step (e) so as to provide a trail line indicating movement of said object in said subsequent frames.

Claim 7

The method according to claim 1 , wherein, step (d) comprises changing the first status parameter to the second status parameter when (i) said sequential correspondences are identified and (ii) position characteristics of the object meet a set of predefined criteria.

Claim 8

The method according to claim 6 , wherein step (ii) comprises assigning a motion factor ζ m to the first object based on its position characteristics over a plurality of frames, and classifying said first object as meeting the predefined criteria if the motion factor is above a predetermined threshold T ζ .

Claim 9

The method according to claim 7 , wherein the motion factor ζ m is given by: Ϛ m = ( σ cx 2 σ vx 2 + τ + σ cy 2 σ vy 2 + τ ) / 2 where σ cx 2 and σ cy 2 are the positional variances of the first object in the x and y directions, respectively, σ vx 2 and σ cy 2 are the velocity variances in x and y directions, respectively, and τ is a predetermined constant.

Claim 10

The method according to claim 1 , further comprising providing a first set of data representing appearance features f i o of the first object, and extracting, for the candidate object in the subsequent frame, a second set of data representing appearance features f i b of that object, step (b) comprising combining the first set of appearance data with the second set of appearance data in a cost function C ob thereby to generate a numerical parameter indicating the degree of correspondence between the first object and the or each new candidate region.

Claim 11

The method according to claim 9 , wherein the cost function is given by the following expression: C ob = ∑ i = 1 n ⁢ ( f i o - f i b ) 2 σ i 2 where f i o represents an appearance feature of the first object, f i b represents an appearance feature of the candidate region, σ i 2 is the variance of f i o over a predetermined number of frames and n is the number of appearance features in the first and second data sets.

Claim 12

The method according to claim 9 , wherein the appearance features of the first object and candidate object include features relating to the frame position of the object/candidate object, and features relating to the shape of the object/candidate object.

Claim 13

The method according to claim 11 , wherein in the event of a correspondence being identified in step (b), the appearance features f i o of the first object are updated using the appearance features f i b of the candidate object to which the first object corresponds.

Claim 14

A non-transitory computer-readable storage medium storing a set of instructions to cause a computer to perform steps for selectively tracking an object appearing in a video sequence comprising a plurality of frames, each frame comprising a plurality of pixels, the steps comprising: (a) identifying a first object in a first frame and associating therewith a first status parameter indicative of a non-tracking condition; (b) identifying a plurality of candidate objects in a subsequent frame and determining whether there is a correspondence between any one of the candidate objects and the first object, (c) in the event of correspondence between a candidate object and the first object, repeating step (b) for that candidate object over subsequent frames until a predetermined number of sequential correspondences are identified; (d) changing the first status parameter to a second status parameter when said predetermined number of sequential correspondences are identified; and (e) in response to the change from first to second status parameter, recording the intra-frame position of said object for subsequent frames; wherein correspondence is determined in step (b) by: calculating a first similarity score between each candidate object and the first object using a first cost function, calculating a second similarity score using a second cost function which is different from the first cost function, grouping the calculated similarity scores in accordance with the status parameter of the first object, analysing each group in a predetermined order and selecting the closest match between the candidate objects and the first object.

Claim 15

A non-transitory computer-readable storage medium storing a set of instructions to cause a computer to perform steps for selectively tracking an object appearing in a video sequence comprising a plurality of frames, each frame comprising a plurality of pixels, the steps comprising: (a) identifying a first object in a first frame and associating therewith a first status parameter indicative of a non-tracking condition; (b) identifying a plurality of candidate objects in a subsequent frame and determining whether there is a correspondence between any one of the candidate objects and the first object, (c) in the event of correspondence between a candidate object and the first object, repeating step (b) for that candidate object over subsequent frames until a predetermined number of sequential correspondences are identified; (d) changing the first status parameter to a second status parameter when said predetermined number of sequential correspondences are identified; and (e) in response to the change from first to second status parameter, recording the intra-frame position of said object for subsequent frames; wherein correspondence is determined in step (b) by: calculating a first similarity score between each candidate object and the first object using a first cost function, calculating a second similarity score using a second cost function which is different from the first cost function, grouping the calculated similarity scores in accordance with the status parameter of the first object, analysing each group in a predetermined order and selecting the closest match between the candidate objects and the first object.

Claim 16

A video processing system for selectively tracking an object appearing in a video sequence comprising a plurality of frames, each frame comprising a plurality of pixels, the system being arranged, in use, to: (a) identify a first object in a first frame and associating therewith a first status parameter indicative of a non-tracking condition; (b) identify a plurality of candidate objects in a subsequent frame and determining whether there is a correspondence between any one of the candidate objects and the first object; (c) in the event of correspondence between a candidate object and the first object, repeat step (b) for that candidate object over subsequent frames until a predetermined number of sequential correspondences are identified; (d) change the first status parameter to a second status parameter when said predetermined number of sequential correspondences are identified; (e) in response to the change from first to second status parameter, record the intra-frame position of said object for subsequent frames; and calculate a first similarity score between each candidate object and the first object using a first cost function, calculate a second similarity score using a second cost function which is different from the first cost function, group the calculated similarity scores in accordance with the status parameter of the first object, analyze each group in a predetermined order and select the closest match between the candidate objects and the first object.

Claim 17

A video processing system for selectively tracking an object appearing in a video sequence comprising a plurality of frames, each frame comprising a plurality of pixels, the system being arranged, in use, to: (a) identify a first object in a first frame and associating therewith a first status parameter indicative of a non-tracking condition; (b) identify a plurality of candidate objects in a subsequent frame and determining whether there is a correspondence between any one of the candidate objects and the first object; (c) in the event of correspondence between a candidate object and the first object, repeat step (b) for that candidate object over subsequent frames until a predetermined number of sequential correspondences are identified; (d) change the first status parameter to a second status parameter when said predetermined number of sequential correspondences are identified; (e) in response to the change from first to second status parameter, record the intra-frame position of said object for subsequent frames; and calculate a first similarity score between each candidate object and the first object using a first cost function, calculate a second similarity score using a second cost function which is different from the first cost function, group the calculated similarity scores in accordance with the status parameter of the first object, analyze each group in a predetermined order and select the closest match between the candidate objects and the first object.

Claim 20

The method according to claim 15 , further comprising repeating steps (b) to (d) for a plurality of subsequent frames of the video sequence.

Claim 21

The method according to claim 15 , wherein the transition rule associated with the state causes the status parameter to maintain its current state if there is no correspondence identified in step (c).

Claim 22

The method according claim 15 , wherein the status parameter has a new state and a real state, the transition rule associated with the new state causing the status parameter to be changed to the real state in the event that a correspondence is identified in step (c), the method further comprising the step of recording the position change between the first object and the corresponding candidate region only when the status parameter is in the real state.

Claim 23

The method according to claim 18 , wherein the status parameter is changed to the real state only if a correspondence is identified in a plurality of sequential frames in step (c).

Claim 24

A video processing apparatus comprising: an input for receiving frames of a video sequence; an object queue arranged to store data representing objects identified in one or more frames and, associated with each object, a status parameter representing one of a plurality of predetermined states; a video analysis unit arranged to receive a frame having one or more candidate objects therein, and to determine whether the or each candidate object matches an object in the object queue; and a state transition controller arranged to update the status parameter of each object in the object queue in accordance with a transition rule corresponding to the state of the object's status parameter, said transition rule indicating which of the predetermined states the status parameter should be transited to; wherein the video analysis unit is further arranged to: calculate a first similarity score between each candidate object and the first object using a first cost function, calculate a second similarity score using a second cost function which is different from the first cost function, group the calculated similarity scores in accordance with the status parameter of the first object, analyse each group in a predetermined order and select the closest match between the candidate objects and the first object.

Claim 25

A video processing apparatus comprising: an input for receiving frames of a video sequence; an object queue arranged to store data representing objects identified in one or more frames and, associated with each object, a status parameter representing one of a plurality of predetermined states; a video analysis unit arranged to receive a frame having one or more candidate objects therein, and to determine whether the or each candidate object matches an object in the object queue; and a state transition controller arranged to update the status parameter of each object in the object queue in accordance with a transition rule corresponding to the state of the object's status parameter, said transition rule indicating which of the predetermined states the status parameter should be transited to; wherein the video analysis unit is further arranged to: calculate a first similarity score between each candidate object and the first object using a first cost function, calculate a second similarity score using a second cost function which is different from the first cost function, group the calculated similarity scores in accordance with the status parameter of the first object, analyse each group in a predetermined order and select the closest match between the candidate objects and the first object.

Claim 26

Apparatus according to claim 20 , wherein the status parameter represents one of a new and real state, the state transition controller being arranged to transit the status parameter from the new state to the real state if the video analysis unit determines that a match is made between an object in the object queue and a candidate object in the received frame.

Claim 27

Apparatus according to claim 21 , wherein the video analysis unit is further arranged to record the change in frame position of an object in the object queue and a candidate object to which it is matched in the event that the state transition controller updates the status parameter, associated with said object, to the real state.

Claim 28

Apparatus according to claim 22 , further comprising a display controller arranged to display, on a video display unit, a path line indicative of the change in frame position.