DevaRamanan
EECSDivisionUCBerkeley
USA
Email:ramanan@eecs.berkeley.edu
DavidForsyth
EECSDivisionUCBerkeley&UIUC
USA
Email:daf@cs.berkeley.edu
AndrewZisserman
EngineeringScienceDept
OxfordUniversity
UK
Email:az@robots.ox.ac.uk
DESCRIPTION
Wepresentasystemforautomaticpeopletrackingandactivityrecognition.Thisvideoincludesthecontributionof3papersover2years[1],[2],[3].Weshowresultsonmanysequences,includingclipsfromafeature-lengthfilmandhis-toricalsportsfootage(alltrackedcompletelyautomatically).Weshowresultsthatutilizethetrackertoobtain3Drecon-structionsandactivitydescriptions(alsodoneautomatically).Ourbasicapproachtopeople-trackingistobuildanap-pearancemodelfortheperson(s)inthevideo[1].Sincewedonotknowtheappearanceofapersonapriori,webuildthemodelson-the-fly.Thevideoillustratesourmethodofusingastylized-posedetector(onethatonlyfindspeopleinlateral-walkingconfigurations)[2].Sincepeopledonotalwayswalklaterally,weexpectthedetectortoonlyfireinafewframesinavideosequence(showninred).Oursystembuildsamodeloflimbappearancefromthosesparsestylizeddetections(e.g.,itmightlearnabaseballplayerhasredarmsandwhitelegs).Ouralgorithmthenre-processesthevideo,usingthelearnedappearancemodelstofindpeopleinunrestrictedconfigurations(shownincolor).
Wecanuseourtrackertorecover3Dconfigurationsandactivitylabels.Weassumewehaveamotioncapturelibrarywherethe3Dposeshavebeenlabeledoff-linewithactivitydescriptions.Wethensynthesize3Dmotionsthatlooklikeourtracksbymatchingshortclipsof3Dmotiontoshortclipsofthe2Dtracks[3].Thesynthesizedmotionsareconstructedfromtheoriginalpooloflabeledmotionsandthusarelabeledthemselves.
ACKNOWLEDGMENTS
TheauthorswouldliketothanktheComputerVisionandComputerGraphicsgroupsatUCBerkeleyandtheVisualGeometryGroupatOxfordformanyhelpfuldiscussions.ThisworkwassupportedbyNSFawardno.0098682andbyOfficeofNavalResearchgrantno.N00014-00-1-0890,aspartoftheMURIprogram.D.R.issupportedbyaNSFfellowship.
REFERENCES
[1]D.RamananandD.A.Forsyth.“FindingandTrackingPeoplefromthe
BottomUp”CVPRJune,2003.Madison,WI.
[2]D.RamananandD.A.ForsythandA.Zisserman.“StrikeaPose:Tracking
PeoplebyFindingStylizedPoses”CVPRJune,2005,SanDiego,CA.[3]D.RamananandD.A.Forsyth.“AutomaticAnnotationofEveryday
Movements”NIPSOct.,2003,Vancouver,Canada.
因篇幅问题不能全部显示，请点此查看更多更全内容