{"id":152,"date":"2026-04-20T08:27:56","date_gmt":"2026-04-20T07:27:56","guid":{"rendered":"https:\/\/www.ypod.cymru\/about\/?page_id=152"},"modified":"2026-09-14T13:59:55","modified_gmt":"2026-09-14T12:59:55","slug":"llais-v2","status":"publish","type":"page","link":"https:\/\/www.ypod.cymru\/about\/llais-v2\/","title":{"rendered":"Llais V2: Advancing AI-Driven Lip-Syncing for Welsh Media"},"content":{"rendered":"\n<p>Llais V2 builds directly on the earlier <strong><a href=\"https:\/\/www.ypod.cymru\/about\/llais-welsh-translation-and-lip-sync-for-video-production\/\">Llais project<\/a><\/strong>, which explored the potential of AI-driven lip-syncing as a way of making Welsh-language content more accessible to wider<br>audiences. While the initial phase focused on feasibility and ethical considerations, this second phase shifted towards practical application. The emphasis moved from asking whether the technology could work, to understanding how it might function within real production environments.<\/p>\n\n\n\n<p>This meant developing not just the technology itself, but the surrounding processes that would allow it to be used in a professional context. From the outset, the intention was to create something that could integrate into existing industry workflows rather than sit outside them. At the same time, the project remained grounded in the cultural and linguistic context that inspired it, with a particular focus on supporting the reach of Welsh-language media.<\/p>\n\n\n\n<h3 class=\"has-text-align-center\"><strong><a href=\"https:\/\/ypod.cymru\/about\/downloads\/llais-v2-report.pdf\">Download the Llais V2 Project Report<\/a><\/strong><\/h3>\n\n\n\n<h2>Project Objectives<\/h2>\n\n\n\n<p>The project was guided by a clear set of ambitions. It sought to develop a productionready pipeline for AI-assisted lip-syncing, to test that pipeline using real broadcast<br>material, and to explore whether the approach could form the basis of a viable commercial service.<\/p>\n\n\n\n<p>Alongside the technical goals, there was an ongoing commitment to understanding how such a tool would be received by the industry. This included engaging with stakeholders, identifying potential barriers to adoption, and ensuring that the system was designed in a way that complemented, rather than disrupted, established creative roles.<\/p>\n\n\n\n<p>In practical terms, the work focused primarily on Welsh-to-English localisation, while also considering how the same approach might be extended to other languages and markets in future.<\/p>\n\n\n\n<h3>Objectives<\/h3>\n\n\n\n<p> \u2022 Develop a production-ready AI lip-sync pipeline<br>\u2022 Automate key stages of the localisation process<br>\u2022 Test the system using real broadcast material<br>\u2022 Engage stakeholders to assess industry readiness<br>\u2022 Explore commercial models and pricing structures<br><\/p>\n\n\n\n<h3>Scope<\/h3>\n\n\n\n<p>\u2022 Welsh-to-English localisation (primary focus)<br>\u2022 Integration with existing post-production workflows<br>\u2022 Use of both archive and newly broadcast material<\/p>\n\n\n\n<p>Building on the research and prototype developed in the Llais project, Llais V2 aims to refine and test the viability of the AI-driven lip-syncing process, working closely with industry stakeholders to establish a commercially viable business model.<\/p>\n\n\n\n<p>The project will develop a new production pipeline, incorporating stakeholder feedback to create a market-ready solution. A key focus will be automating several manual elements, while working on real production material to showcase the technology.<\/p>\n\n\n\n<h2>Key Development Areas:<\/h2>\n\n\n\n<ul><li>Client-Facing Portal \u2013 A user-friendly platform to upload full video files, separated audio tracks, scripts, and outtakes.<\/li><li>Automated Transcription &amp; Segmentation \u2013 AI-driven tools to align footage with scripts, applying precise timecodes for segments.<\/li><li>AI Lip-Sync Training \u2013 Further refinement of AI models to match actors\u2019 lip movements.<\/li><li>Final Editing &amp; Quality Control \u2013 A post-processing workflow ensuring high-quality, natural results.<\/li><li>Safeguarding employment by ensuring professional translators, dubbing artists, and writers remain integral to the process.<\/li><li>Building strategic partnerships with broadcasters and content creators to expand Welsh-language media internationally.<\/li><li>Real broadcast content will be used to validate the process, and multiple market segments will be explored to assess demand and pricing structures.<\/li><\/ul>\n\n\n\n<p>Stakeholder feedback has emphasised the importance of ensuring the product is fully developed and industry-ready before wider rollout. Llais V2 will prioritise creating a polished, scalable, and commercially viable AI localisation service for Welsh and international media markets.<\/p>\n\n\n\n<h2>Testing with broadcast content<\/h2>\n\n\n\n<p>Testing the pipeline using real broadcast material was one of the most valuable aspects of the project.  It provided a realistic view of how the<br>technology performs under the kinds of conditions encountered in production.<\/p>\n\n\n\n<h3><strong>Case Study 1:<\/strong> <a href=\"https:\/\/www.ypod.cymru\/about\/llais-v2-rd-llwybrau-celtaidd\/\" data-type=\"page\" data-id=\"176\">Ein Llwybrau Celtaidd \/ Our Celtic Connections<\/a><\/h3>\n\n\n\n<p><strong>Broadcast:<\/strong> S4C \/ TG4 \u2013 May 2026<br><strong>Presenter: <\/strong>Ryland Teifi<br><strong>Production company: <\/strong>Tinopolis<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Llwybrau Celtaidd - Mynydd Du (Audio Test)\" width=\"750\" height=\"422\" src=\"https:\/\/www.youtube.com\/embed\/FkGzAkWi5Fs?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p><br>\u2022 Mixed results depending on footage quality<br>\u2022 High-quality close-up footage performed well<br>\u2022 Challenges:<br>\u2022 Low resolution<br>\u2022 Fast cuts<br>\u2022 Lighting inconsistencies<br><br><strong>Key Learning:<\/strong><br>Scene-specific model training significantly improves output.<br>Examples: https:\/\/www.ypod.cymru\/about\/llais-v2-rd-llwybrau-celtaidd\/<\/p>\n\n\n\n<h3><strong>Case Study 2: <a href=\"https:\/\/www.ypod.cymru\/about\/llais-v2-rd-gwanas-i-gbara\/\" data-type=\"page\" data-id=\"172\">Gwanas i Gbara<\/a><\/strong><\/h3>\n\n\n\n<p><strong>Broadcast: <\/strong>S4C 2010<br><strong>Presenter: <\/strong>Bethan Gwanas<br><strong>Production company: <\/strong>Telesgop<br>Archive (2010) content posed challenges.<br>Languages: English | French | Spanish<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Gwanas i Gbara - Diary - French\" width=\"750\" height=\"422\" src=\"https:\/\/www.youtube.com\/embed\/GhVH4eer3yk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p><strong>Issues:<\/strong><br>\u2022 Low resolution (SD footage)<br>\u2022 Motion interference (hands, shadows)<br>\u2022 Visual artefacts (flickering)<br><br><strong>Key Learning:<\/strong><br>\u2022 Older archive footage may require additional VFX processing<br>\u2022 AI-assisted rotoscoping (e.g. SAM models) shows potential but still requires manual QA<br><\/p>\n\n\n\n<p>Examples: <a href=\"https:\/\/www.ypod.cymru\/about\/llais-v2-rd-gwanas-i-gbara\/\">https:\/\/www.ypod.cymru\/about\/llais-v2-rd-gwanas-i-gbara\/<\/a><\/p>\n\n\n\n<p><\/p>\n\n\n\n<h3>Non broadcast content<\/h3>\n\n\n\n<p>-> <a href=\"https:\/\/www.ypod.cymru\/about\/llais-v2-rd-multilingual\/\" data-type=\"page\" data-id=\"179\">Multilingual test example<\/a> <\/p>\n\n\n\n<p><\/p>\n\n\n\n<h3>Broadcast Content Summary<\/h3>\n\n\n\n<p><strong>Key Challenges<\/strong><br>\u2022 Variability in footage quality<br>\u2022 Handling fast cuts and motion<br>\u2022 Audio alignment complexity<br>\u2022 Integration across different editing platforms<br>\u2022 Ethical and legal considerations<br>\u2022 Archive content limitations<br><br><strong>Key Learnings<\/strong><br>\u2022 Preparation of footage is critical<br>\u2022 Scene-specific training is more effective than general datasets<br>\u2022 AI cannot yet fully replace human oversight<br>\u2022 Industry adoption depends on seamless workflow integration<br>\u2022 Ethical frameworks must evolve alongside technology<\/p>\n\n\n\n<h2>Llais project:  Technical Workflow &amp; Pipeline Development<\/h2>\n\n\n\n<p>The Llais V2 pipeline consists of several modular stages:<br><br><strong>Core Pipeline<\/strong><\/p>\n\n\n\n<ol><li>Ingest &amp; Upload<\/li><li>Media Analysis (transcription, diarisation, segmentation)<\/li><li>Manual Review Interface<\/li><li>Translation &amp; Script Adaptation<\/li><li>Audio Creation (ADR or AI voice)<\/li><li>Audio Alignment<\/li><li>Lip-Sync Processing<\/li><li>Final QA &amp; Delivery<\/li><\/ol>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" width=\"1024\" height=\"581\" src=\"https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/workflow-showcase-1024x581.png\" alt=\"\" class=\"wp-image-182\" srcset=\"https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/workflow-showcase-1024x581.png 1024w, https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/workflow-showcase-300x170.png 300w, https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/workflow-showcase-768x436.png 768w, https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/workflow-showcase-1536x871.png 1536w, https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/workflow-showcase-2048x1162.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2>Commercial potential &amp; future development<\/h2>\n\n\n\n<p>Llais V2 has demonstrated that there is a credible commercial opportunity for AIassisted localisation. The ability to adapt content for different audiences more<br>efficiently has clear value, particularly for smaller language markets seeking to reach global viewers.<\/p>\n\n\n\n<p>In addition to localisation, the technology offers potential benefits within postproduction itself, providing new ways to refine and adapt content without the need for<br>costly reshoots<\/p>\n\n\n\n<p>The next phase of development will focus on working with broadcasters and independent production companies to produce pilot content. These collaborations will be critical in testing the technology in live production environments, refining the commercial model, and demonstrating its value at scale.<\/p>\n\n\n\n<h2 class=\"has-text-align-center\"><strong><a href=\"https:\/\/ypod.cymru\/about\/downloads\/llais-v2-report.pdf\">Download the Llais V2 Project Report<\/a><\/strong><\/h2>\n\n\n\n<h2>Development model screenshots<\/h2>\n\n\n\n<p>A significant portion of the work centred on developing a pipeline that could support the full localisation process from initial ingest through to final output. Rather than<br>treating lip-syncing as a standalone step, the project approached it as part of a broader workflow.<\/p>\n\n\n\n<h2>Dub Tool Model<\/h2>\n\n\n\n<p>Transcribes media, provides a translation model for the transcription to another language for preparation before lipsynch.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" width=\"1024\" height=\"721\" src=\"https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/Screenshot-2026-04-20-at-10.21.34-1024x721.png\" alt=\"\" class=\"wp-image-186\" srcset=\"https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/Screenshot-2026-04-20-at-10.21.34-1024x721.png 1024w, https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/Screenshot-2026-04-20-at-10.21.34-300x211.png 300w, https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/Screenshot-2026-04-20-at-10.21.34-768x541.png 768w, https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/Screenshot-2026-04-20-at-10.21.34-1536x1082.png 1536w, https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/Screenshot-2026-04-20-at-10.21.34.png 1868w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2>Model for translation assistance<\/h2>\n\n\n\n<p>Upload media and transciption &#8211; Compares translation text from AI sources.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" width=\"1024\" height=\"442\" src=\"https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/Screenshot-2026-04-20-at-10.22.01-1024x442.png\" alt=\"\" class=\"wp-image-185\" srcset=\"https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/Screenshot-2026-04-20-at-10.22.01-1024x442.png 1024w, https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/Screenshot-2026-04-20-at-10.22.01-300x130.png 300w, https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/Screenshot-2026-04-20-at-10.22.01-768x332.png 768w, https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/Screenshot-2026-04-20-at-10.22.01-1536x663.png 1536w, https:\/\/www.ypod.cymru\/about\/wp-content\/uploads\/2026\/04\/Screenshot-2026-04-20-at-10.22.01-2048x884.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<h2><strong>Links: <\/strong><\/h2>\n\n\n\n<h3><strong><a href=\"https:\/\/ypod.cymru\/about\/downloads\/llais-v2-report.pdf\">Download the Llais V2 Project Report<\/a><\/strong><\/h3>\n\n\n\n<h3><a href=\"https:\/\/www.ypod.cymru\/about\/llais-welsh-translation-and-lip-sync-for-video-production\/\">Llais prototype &#8211; Welsh translation and lip-sync for video production.<\/a><\/h3>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Llais V2 builds directly on the earlier Llais project, which explored the potential of AI-driven lip-syncing as a way of making Welsh-language content more accessible to wideraudiences. While the initial phase focused on feasibility and ethical considerations, this second phase<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"https:\/\/www.ypod.cymru\/about\/wp-json\/wp\/v2\/pages\/152"}],"collection":[{"href":"https:\/\/www.ypod.cymru\/about\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.ypod.cymru\/about\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.ypod.cymru\/about\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ypod.cymru\/about\/wp-json\/wp\/v2\/comments?post=152"}],"version-history":[{"count":18,"href":"https:\/\/www.ypod.cymru\/about\/wp-json\/wp\/v2\/pages\/152\/revisions"}],"predecessor-version":[{"id":204,"href":"https:\/\/www.ypod.cymru\/about\/wp-json\/wp\/v2\/pages\/152\/revisions\/204"}],"wp:attachment":[{"href":"https:\/\/www.ypod.cymru\/about\/wp-json\/wp\/v2\/media?parent=152"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}