...

UTTER Unified Transcription and Translation
for Extended Reality

news

FSTP Second Call

2024-05-01

Our Horizon Europe project, UTTER, invites project proposals from research organizations and SMEs to develop and/or pilot...

View more

🚀 UTTER YouTube Channel is live!

2023-10-30

You can now explore a range of content, from UTTER User Day to our latest collaborations and contributions in multimodal LLMs...

View more

The FSTP call will be open for submission soon!

2023-07-26

Our Horizon Europe project, UTTER, invites project proposals from research organizations and SMEs to develop and/or pilot...

View more

HE-UTTER First User Day Recordings available,...

2023-07-05

For everyone who couldn't join UTTER's 1st User Day on July 5th: Take a look at the recordings of the event here!

Demo-José...

View more

HE-UTTER FIRST USER DAY

2023-07-03

🌟 Exciting Announcement! 🌟

UTTER USER DAY - JOIN US IN BUILDING THE NEXT GENERATION OF MULTIMODAL EXTENDED REALITY TECHNOLOGIES
View more

UTTER's first in-person meeting

2023-06-19

We held the HE-UTTER's first two-day physical meeting in Amsterdam. It was an outstanding opportunity to come together,...

View more

About UTTER

2022-10-01

In the last almost three years, the pandemic forced us into our homes, where we endured a stream of lockdowns. We had to...

View more

events

2023-07-05

HE-UTTER first User Day

Join us for UTTER User Day, a groundbreaking remote meetup focused on advancing multimodal LLMs and NLP research. Engage with cutting-edge XR technologies, participate in expert discussions, and be part of shaping the future of this dynamic field.
Stay tuned for updates on this exclusive event, where we will also provide valuable insights on an upcoming FSTP call.
Don't miss this opportunity to contribute and collaborate on future XR projects!

Secure your spot today: https://lnkd.in/djBg7Ume

2023-06-19

UTTER First In-Person Meeting

Event: UTTER First In-Person Meeting

Date: 19th-20th June, 2023

Location: Amsterdam

2022-10-24

UTTER Kick-off meeting

Event: UTTER Kick-off Meeting

Date: 24th-27th October, 2022

Location: online

FSTP CALLS

2024-05-01

Second FSTP call

FINANCIAL SUPPORT FOR THIRD PARTIES (FSTP) CALL 2

Funding opportunity for research organization and SMEs – development and application of deep models for extended reality

Our Horizon Europe project, UTTER, invites project proposals from research organizations and SMEs to develop and/or pilot applications of large pretrained language models with a focus on enabling human-human and human-machine interaction. Successful applications will receive up to € 60 000 each, and run for 6 months. The call closes on July 31, 2024

Below is an exhaustive compilation of essential documentation pertaining to the Submission & Evaluation process:

Submissions are only accepted during the submission period through UTTER's proposal management portal https://utter-fstp.science.uva.nl

Questions can be emailed to: utter-fstp@list.uva.nl


 

2023-12-21

Results of UTTER FSTP Open call 1 for recipients of financial support

Project Horizon European Unified Transcription and Translation for Extended Reality, funded from the European Union’s Horizon Europe Research and Innovation program under Grant Agreement No 101070631 and from the UK Research and Innovation (UKRI) under the UK government’s Horizon Europe funding guarantee (GrantNo10039436), launched a FSTP Open Call 1 for recipients of financial support.

The Call closed on 15 October 2023.

A total of 54 proposals were received for this Call among which, 33 proposals were eligible. Eight proposals will receive funding for a total amount of 470.965,72 EUR. 

The evaluation and selection have been completed. All proposers have been informed about the evaluation results.

The Call and the respective call details were published on UTTER's website (https://he-utter.eu/#fstp) on July 26th, 2023 and on the European commission Funding and tender opportunities website (https://ec.europa.eu/info/funding-tenders/opportunities/portal/screen/opportunities/competitive-calls-cs/3722) on July 31st, 2023.

Both the final decisions and the selected projects are formally communicated, on December 20th, 2023 and published on UTTER's website on December 21st, 2023: https://he-utter.eu/#fstp.

The selected projects' details can be accessed via the following link:

FSTP Call- Key Facts

Below are the tentative key facts for the UTTER FSTP funding. For the final version, check each of the calls.



Pilot Project Objectives
Develop and/or pilot applications using XR models in new sectors, with a focus on enabling new types of human-human and human-machine interaction. Examples of welcome project objectives include:
 ●    Improving or demonstrating efficiency of XR model inference;
 ●    Improving or demonstrating efficiency of XR model training;
 ●    Designing interfaces for usability;
 ●    Extending XR models to new languages, domains or modalities;
 ●    Applying XR models to new tasks;
 ●    Building resources for XR models;
 ●    Evaluation of XR models

Budget allocation
€60,000 (maximum amount per pilot project)
Approx. €895,206 to be distributed in total (€424,240 in the second call).

Eligibility
 ●    Only SMEs and research organizations (Section 5.2);
 ●    Horizon Europe eligible countries;
 ●    One organization per project only (i.e. no collaborative multi-party projects);
 ●    Only one proposal per applying institution will be considered;
 ●    Resubmission in the second call is allowed.

Proposals
 ●    Short proposal (approx. 8 pages, incl. formalities);
 ●    Lightweight submission and evaluation procedure.

Evaluation criteria
 ●    Objective fit;
 ●    Technical approach;
 ●    Business, Integration and Dissemination (“BID”) plan;
 ●    Budget adequacy;
 ●    Team.

Project execution
 Consists of the following activities:
 (1) Development;
 (2) Dissemination.

Schedule
 First call
 ●    published: July 2023
 ●    project submission period: August – October 2023
 ●    project start: January 2024
 ●    project duration: 6 – 9 months
 Second call
 ●    published: May 2024
 ●    project submission period: May – July 2024
 ●    project start: January 2025
 ●    project duration: 6 months

Payment Principle
 Lump Sum in two payments:
 1. 50 % after signing the contract;
 2. 50 % after demonstrating and disseminating results.

Contact
 utter-fstp@list.uva.nl

 

Our multilingual customer support assistant empowers a customer service agent to provide support in any language. 

 

The main project objectives are:

 

1. Research: Advancing research in responsible creation and application of multilingual, multimodal pretrained XR models

Advance the state-of-the-art in multimodal,  multilingual  pre-trained models and their application  to downstream tasks. This project will focus on making them customizable, efficient, and ethical.     

   

2. Deployment: Development of new methods and algorithms for adapted, contextualised, and robust dialogue assistant XR models

Leverage multimodal models to deliver tools which provide a new paradigm in quality, robustness, and contextualisation capabilities for dialogue assistant components such as transcription, translation, and summarisation.

 

3. Integration: Development of tools for online meetings and customer support agents

Design and implementation of interfaces to visualise, edit and publish transcripts, minutes, combined with meeting platforms like Zoom to deliver multilingual transcription and translation support.

 

4. Exploitation: Sustainable, maintainable platform and services

Development of a plan for sustainable exploitation and use of the platforms, systems and technologies developed in UTTER.

 

5. Dissemination: Dissemination and communication of project results to stakeholders

- Dissemination and communication of project results to stakeholders and user group. Successful promotion and use of platform in the pilots run under the financial support to third parties call.

    p>This section includes all dissemination and communication activities related to the project needed to reach the goals and promote the results of the UTTER Project and to maximise its impact. The UTTER Consortium will ensure dissemination of its results and communication with its audiences and interested parties in several ways, through multiple dissemination and communication channels. 

     

    Find out more below.

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     


    partners / contact

    Universiteit van Amsterdam

    [ UVA ]

    Netherland

    Maryam Hashemi Shabestari

    Maryam Hashemi Shabestari

    Project manager

    Unbabel

    [ UNB ]

    Portugal

    José Souza

    José Souza

    Researcher

    Instituto de Telecomunicações

    [ IT ]

    Portugal

    André Martins

    André Martins

    Scientific coordinator and Researcher

    Naver Labs Europe

    [ NAV ]

    France

    Laurent Besacier

    Laurent Besacier

    Innovation coordinator and Researcher

    The University of Edinburgh

    [ UEDIN ]

    United Kingdom

    Alexandra Birch

    Alexandra Birch

    Ethics coordinator and Researcher

    This project has received funding from the European Union’s Horizon Europe Research and Innovation programme under Grant Agreement No 101070631 and from the UK Research and Innovation (UKRI) under the UK government's Horizon Europe funding guarantee (Grant No 10039436). Views and opinions expressed are however those of the UTTER consortium only and do not necessarily reflect those of the European Union and UKRI. Neither the European Union nor the UKRI nor the granting authority can be held responsible for them.

    graph - chart

    Start 01/10/2022
    55% 27/05/2024
    End 30/09/2025
    Budget allocation . M€ Budget allocation
    Effort 564 p*m Effort
    Effort 16 persons Full time equivalent

    documents

    UTTER's public deliverables

    UTTER's 1st Ethics Review

    UTTER's Data Management Plan

    Utter's first prototype evaluation report

    Utter's first report on adaptable and context

    Utter's first report on data and resources

    Utter's first report on efficient inference

    Utter's first Report on Uncertainty-Aware, Robust and Explainable Models

    Utter's first report on XR models

    contact us

    By submitting this form, I agree that the information entered may be used for newsletter subscriptions, information requests and statistical analysis that may result. Under no circumstances will these data be transferred to third parties.
    To know and exercise your rights, in particular to withdraw your consent to the use of data collected by this form, please consult our general conditions of use.

    project netboard login