{"id":1110,"date":"2021-10-20T12:18:14","date_gmt":"2021-10-20T12:18:14","guid":{"rendered":"http:\/\/vandal.polito.it\/?p=1110"},"modified":"2021-10-20T12:20:16","modified_gmt":"2021-10-20T12:20:16","slug":"vandals-on-the-podium-of-the-epic-kitchens-challenge","status":"publish","type":"post","link":"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/","title":{"rendered":"VANDALs on the podium of the EPIC KITCHENS Challenge"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

EPIC-KITCHENS<\/strong> [1] is the largest-scale egocentric dataset collected by 32 participants in their native kitchen environments, and densely annotated with actions and object interactions (125 verb classes and 331 noun classes).<\/p>

The dataset is aligned with six challenges: action recognition (full and weak supervision), action detection, action anticipation, cross-modal retrieval (from captions), as well as unsupervised domain adaptation for action recognition.<\/p>

The unsupervised domain adaptation challenge<\/strong> tests how models can cope with similar data collected 2 years later on the task of action recognition. The goal is thus to assign a (verb, noun) label to a trimmed segment, following the Unsupervised Domain Adaptation paradigm: a labelled source domain is used for training, and the model needs to adapt to an unlabelled target domain. Videos recorded in 2018 (EPIC-KITCHENS-55) constitute the source domain, while videos recorded two years later (EPIC-KITCHENS-100’s extension) constitute the unlabelled target domain.<\/p>

Our PhD students Mirco Planamente<\/strong> and Chiara Plizzari<\/strong> achieved the 3rd place position<\/strong> [3] in the third edition of the challenge, presented at the Eighth International Workshop on Egocentric Perception Interaction and Computing<\/strong>. They re-purposed the Relative Norm Alignment loss [2], a multi-modal loss recently proposed to deal with the Domain Generalization setting for action recognition, to operate between different backbone architectures in order to enhance their collaboration. Indeed, they achieved top performance on all verb, noun and action category<\/strong>.\u200b<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

[1] Damen, Dima, Hazel Doughty, Giovanni Maria Farinella, Sanja Fidler, Antonino Furnari, Evangelos Kazakos, Davide Moltisanti et al. “Scaling egocentric vision: The epic-kitchens dataset.” In Proceedings of the European Conference on Computer Vision (ECCV)<\/i>, pp. 720-736. 2018.<\/p>

[2] Planamente, Mirco, Chiara Plizzari, Emanuele Alberti, and Barbara Caputo. “Domain Generalization through Audio-Visual Relative Norm Alignment in First Person Action Recognition”, WACV<\/em> 2021.<\/p>

[3] Plizzari, Chiara, Mirco Planamente, Emanuele Alberti, and Barbara Caputo. “PoliTO-IIT Submission to the EPIC-KITCHENS-100 Unsupervised Domain Adaptation Challenge for Action Recognition.” arXiv preprint arXiv:2107.00337<\/i> (2021).<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

EPIC-KITCHENS [1] is the largest-scale egocentric dataset collected by 32 participants in their native kitchen environments, and densely annotated with actions and object interactions (125 verb classes and 331 noun classes). The dataset is aligned with six challenges: action recognition (full and weak supervision), action detection, action anticipation, cross-modal retrieval (from captions), as well as … Continue reading VANDALs on the podium of the EPIC KITCHENS Challenge<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[13,14],"tags":[],"yoast_head":"\nVANDALs on the podium of the EPIC KITCHENS Challenge - VANDAL<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"VANDALs on the podium of the EPIC KITCHENS Challenge - VANDAL\" \/>\n<meta property=\"og:description\" content=\"EPIC-KITCHENS [1] is the largest-scale egocentric dataset collected by 32 participants in their native kitchen environments, and densely annotated with actions and object interactions (125 verb classes and 331 noun classes). The dataset is aligned with six challenges: action recognition (full and weak supervision), action detection, action anticipation, cross-modal retrieval (from captions), as well as … Continue reading VANDALs on the podium of the EPIC KITCHENS Challenge\" \/>\n<meta property=\"og:url\" content=\"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/\" \/>\n<meta property=\"og:site_name\" content=\"VANDAL\" \/>\n<meta property=\"article:published_time\" content=\"2021-10-20T12:18:14+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-10-20T12:20:16+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/vandal.polito.it\/wp-content\/uploads\/2021\/10\/medal-150x150.png\" \/>\n<meta name=\"author\" content=\"deboracaldarola\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"deboracaldarola\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/\"},\"author\":{\"name\":\"deboracaldarola\",\"@id\":\"https:\/\/vandal.polito.it\/#\/schema\/person\/ef9294d95e8f758ff5d7ad9b29eb0bba\"},\"headline\":\"VANDALs on the podium of the EPIC KITCHENS Challenge\",\"datePublished\":\"2021-10-20T12:18:14+00:00\",\"dateModified\":\"2021-10-20T12:20:16+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/\"},\"wordCount\":308,\"publisher\":{\"@id\":\"https:\/\/vandal.polito.it\/#organization\"},\"articleSection\":[\"Divulgative\",\"Research\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/\",\"url\":\"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/\",\"name\":\"VANDALs on the podium of the EPIC KITCHENS Challenge - VANDAL\",\"isPartOf\":{\"@id\":\"https:\/\/vandal.polito.it\/#website\"},\"datePublished\":\"2021-10-20T12:18:14+00:00\",\"dateModified\":\"2021-10-20T12:20:16+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/vandal.polito.it\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"VANDALs on the podium of the EPIC KITCHENS Challenge\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/vandal.polito.it\/#website\",\"url\":\"https:\/\/vandal.polito.it\/\",\"name\":\"Vandal\",\"description\":\"Welcome to the Visual And Multimodal Applied Learning Laboratory @ Politecnico di Torino\",\"publisher\":{\"@id\":\"https:\/\/vandal.polito.it\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/vandal.polito.it\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/vandal.polito.it\/#organization\",\"name\":\"Vandal Lab Polito Politecnico di Torino\",\"url\":\"https:\/\/vandal.polito.it\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vandal.polito.it\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/i0.wp.com\/vandal.polito.it\/wp-content\/uploads\/2020\/12\/cropped-imageedit_2_5067489078-1.png?fit=162%2C167&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/vandal.polito.it\/wp-content\/uploads\/2020\/12\/cropped-imageedit_2_5067489078-1.png?fit=162%2C167&ssl=1\",\"width\":162,\"height\":167,\"caption\":\"Vandal Lab Polito Politecnico di Torino\"},\"image\":{\"@id\":\"https:\/\/vandal.polito.it\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/vandal.polito.it\/#\/schema\/person\/ef9294d95e8f758ff5d7ad9b29eb0bba\",\"name\":\"deboracaldarola\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vandal.polito.it\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/86cfcb71e35546210ffa1034116813b9?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/86cfcb71e35546210ffa1034116813b9?s=96&d=mm&r=g\",\"caption\":\"deboracaldarola\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"VANDALs on the podium of the EPIC KITCHENS Challenge - VANDAL","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/","og_locale":"en_US","og_type":"article","og_title":"VANDALs on the podium of the EPIC KITCHENS Challenge - VANDAL","og_description":"EPIC-KITCHENS [1] is the largest-scale egocentric dataset collected by 32 participants in their native kitchen environments, and densely annotated with actions and object interactions (125 verb classes and 331 noun classes). The dataset is aligned with six challenges: action recognition (full and weak supervision), action detection, action anticipation, cross-modal retrieval (from captions), as well as … Continue reading VANDALs on the podium of the EPIC KITCHENS Challenge","og_url":"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/","og_site_name":"VANDAL","article_published_time":"2021-10-20T12:18:14+00:00","article_modified_time":"2021-10-20T12:20:16+00:00","og_image":[{"url":"http:\/\/vandal.polito.it\/wp-content\/uploads\/2021\/10\/medal-150x150.png"}],"author":"deboracaldarola","twitter_card":"summary_large_image","twitter_misc":{"Written by":"deboracaldarola","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/#article","isPartOf":{"@id":"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/"},"author":{"name":"deboracaldarola","@id":"https:\/\/vandal.polito.it\/#\/schema\/person\/ef9294d95e8f758ff5d7ad9b29eb0bba"},"headline":"VANDALs on the podium of the EPIC KITCHENS Challenge","datePublished":"2021-10-20T12:18:14+00:00","dateModified":"2021-10-20T12:20:16+00:00","mainEntityOfPage":{"@id":"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/"},"wordCount":308,"publisher":{"@id":"https:\/\/vandal.polito.it\/#organization"},"articleSection":["Divulgative","Research"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/","url":"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/","name":"VANDALs on the podium of the EPIC KITCHENS Challenge - VANDAL","isPartOf":{"@id":"https:\/\/vandal.polito.it\/#website"},"datePublished":"2021-10-20T12:18:14+00:00","dateModified":"2021-10-20T12:20:16+00:00","breadcrumb":{"@id":"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/vandal.polito.it\/index.php\/2021\/10\/20\/vandals-on-the-podium-of-the-epic-kitchens-challenge\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/vandal.polito.it\/"},{"@type":"ListItem","position":2,"name":"VANDALs on the podium of the EPIC KITCHENS Challenge"}]},{"@type":"WebSite","@id":"https:\/\/vandal.polito.it\/#website","url":"https:\/\/vandal.polito.it\/","name":"Vandal","description":"Welcome to the Visual And Multimodal Applied Learning Laboratory @ Politecnico di Torino","publisher":{"@id":"https:\/\/vandal.polito.it\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/vandal.polito.it\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/vandal.polito.it\/#organization","name":"Vandal Lab Polito Politecnico di Torino","url":"https:\/\/vandal.polito.it\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vandal.polito.it\/#\/schema\/logo\/image\/","url":"https:\/\/i0.wp.com\/vandal.polito.it\/wp-content\/uploads\/2020\/12\/cropped-imageedit_2_5067489078-1.png?fit=162%2C167&ssl=1","contentUrl":"https:\/\/i0.wp.com\/vandal.polito.it\/wp-content\/uploads\/2020\/12\/cropped-imageedit_2_5067489078-1.png?fit=162%2C167&ssl=1","width":162,"height":167,"caption":"Vandal Lab Polito Politecnico di Torino"},"image":{"@id":"https:\/\/vandal.polito.it\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/vandal.polito.it\/#\/schema\/person\/ef9294d95e8f758ff5d7ad9b29eb0bba","name":"deboracaldarola","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vandal.polito.it\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/86cfcb71e35546210ffa1034116813b9?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/86cfcb71e35546210ffa1034116813b9?s=96&d=mm&r=g","caption":"deboracaldarola"}}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/vandal.polito.it\/index.php\/wp-json\/wp\/v2\/posts\/1110"}],"collection":[{"href":"https:\/\/vandal.polito.it\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/vandal.polito.it\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/vandal.polito.it\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/vandal.polito.it\/index.php\/wp-json\/wp\/v2\/comments?post=1110"}],"version-history":[{"count":14,"href":"https:\/\/vandal.polito.it\/index.php\/wp-json\/wp\/v2\/posts\/1110\/revisions"}],"predecessor-version":[{"id":1131,"href":"https:\/\/vandal.polito.it\/index.php\/wp-json\/wp\/v2\/posts\/1110\/revisions\/1131"}],"wp:attachment":[{"href":"https:\/\/vandal.polito.it\/index.php\/wp-json\/wp\/v2\/media?parent=1110"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/vandal.polito.it\/index.php\/wp-json\/wp\/v2\/categories?post=1110"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/vandal.polito.it\/index.php\/wp-json\/wp\/v2\/tags?post=1110"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}