{"id":403,"date":"2022-04-18T12:26:55","date_gmt":"2022-04-18T03:26:55","guid":{"rendered":"https:\/\/www.sonycsl.co.jp\/kyoto\/?post_type=project&#038;p=403"},"modified":"2022-04-18T12:42:15","modified_gmt":"2022-04-18T03:42:15","slug":"speaking-skill_en","status":"publish","type":"project","link":"https:\/\/www.sonycsl.co.jp\/kyoto\/projects\/speaking-skill_en\/","title":{"rendered":"Speaking Skill Evaluation and Acquisition Support"},"content":{"rendered":"\n<p><strong>Team: Kazuki Kawamura (Student Researcher), Jun Rekimoto<\/strong><\/p>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<p class=\"double\">This project aims to build a system to evaluate how well a user can speak a target language and a process that can be applied to improve the user's speaking skills in the target language. This project originally started from the experience that \"even if a person in Tokyo imitates the Ky\u014d-kotoba (Kyoto dialect), a person in Kyoto would immediately recognize the difference.\"&nbsp; We built a system to replicate this experience using AI to evaluate the speaking skill of the Ky\u014d-kotoba uttered by the user using deep learning techniques. In addition, we have taken this technology a step further and built a system that enables learners to learn speaking interactively by visually presenting the difference and distance between the learner's speech and the speech of a native speaker. We are considering other applications as skill evaluation and skill acquisition assistance by AI in the future.<\/p>\n\n\n\n<p class=\"half\"><strong>Publications:<\/strong><\/p>\n\n\n\n<ul class=\"ref wp-block-list\"><li>1.&nbsp;<a href=\"https:\/\/drive.google.com\/file\/d\/1g9zIUNUvatL_E4WoFiy9em2-U-Vb_pkb\/view\">Visualization of Speech Differences for Dialect Speech Training<\/a>&nbsp;(CHI 2021 workshop)<\/li><li>2.&nbsp;<a href=\"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3474349.3480225\">A Language Acquisition Support System that Presents Differences and Distances from Model Speech<\/a>&nbsp;(UIST 2022 Poster)<\/li><li>3.&nbsp;<a href=\"http:\/\/www.interaction-ipsj.org\/proceedings\/2022\/data\/pdf\/INT22009.pdf\">DDSupport: \u30e2\u30c7\u30eb\u3068\u306a\u308b\u767a\u97f3\u3068\u306e\u5dee\u7570\u30fb\u8ddd\u96e2\u3092\u63d0\u793a\u3059\u308b\u8a00\u8a9e\u5b66\u7fd2\u652f\u63f4\u30b7\u30b9\u30c6\u30e0<\/a>&nbsp;(INTERACTION 2022)<\/li><\/ul>\n\n\n\n<p class=\"half\"><strong>Media Mentions:<\/strong><\/p>\n\n\n\n<ul class=\"ref wp-block-list\"><li><a href=\"https:\/\/www.itmedia.co.jp\/news\/articles\/2201\/20\/news042.html\">\u82f1\u8a9e\u30cd\u30a4\u30c6\u30a3\u30d6\u3068\u306e\u767a\u97f3\u306e\u9055\u3044\u3092\u6df1\u5c64\u5b66\u7fd2\u3067\u53ef\u8996\u5316\u3000\u30bd\u30cb\u30fcCSL\u304c\u958b\u767a<\/a>\uff08ITmedia NEWS\uff09<\/li><\/ul>\n","protected":false},"template":"","class_list":["post-403","project","type-project","status-publish","hentry"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.sonycsl.co.jp\/kyoto\/wp-json\/wp\/v2\/project\/403","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.sonycsl.co.jp\/kyoto\/wp-json\/wp\/v2\/project"}],"about":[{"href":"https:\/\/www.sonycsl.co.jp\/kyoto\/wp-json\/wp\/v2\/types\/project"}],"version-history":[{"count":3,"href":"https:\/\/www.sonycsl.co.jp\/kyoto\/wp-json\/wp\/v2\/project\/403\/revisions"}],"predecessor-version":[{"id":424,"href":"https:\/\/www.sonycsl.co.jp\/kyoto\/wp-json\/wp\/v2\/project\/403\/revisions\/424"}],"wp:attachment":[{"href":"https:\/\/www.sonycsl.co.jp\/kyoto\/wp-json\/wp\/v2\/media?parent=403"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}