elearning_label_higher_education
Proyectos
Virtual Environments for the Training of Visually Impaired
12 Enero 2003
The project aims at developing an interactive and extensible virtual reality system to allow visually impaired people to study and interact with various virtual objects.
ENORASI will not only introduce techniques for the training of blind people based on their haptic interaction with virtual objects, but will also provide case studies for their training through interaction, manipulation and modification of objects of complex shapes.
An immersive haptic virtual environment (VE) will be created, simulating the real world guiding them through all the phrases of the training procedure. The ENORASI project introduces completely innovative non-visual virtual reality techniques that will help training blind people into feeling, understanding and interacting with complex virtual objects (airplanes, buildings, 3D maps, famous archaeological findings, etc.)
Objectives:
The project's technological objectives include development, testing, and evaluation of new approaches that will serve the project purposes.
These include:
- Development of a high sensitivity virtual reality haptic system for training.
- Development of novel virtual intelligent agents guiding blind humans and consulting them when interacting with the virtual objects, in the way that real guides would.
- Development of a metadata schema for efficient representation of texture.
- Development of realistic 3D rendering systems.
The business oriented objectives for ENORASI include the promotion of powerful solutions for the training of functionally impaired humans and the definition of the commercialisation and exploitation potential of ENORASI.
Work description:
The project will produce five main outcomes:
1. A usability study of innovative virtual reality systems for the training of visually impaired.
2. The ENORASI virtual reality training case studies where complete pilot training scenarios will be implemented and tested for injury-less and strain-less training.
These include:
a) recognising every day objects,
b) recognising complex virtual objects not easily accessible in their real life,
c) interacting with virtual objects and understanding their physical characteristics,
d) facilitating the participation of the visually impaired users in an educational or entertainment environment and
e) navigating into complex VEs based on haptic information and guidance from virtual guides.
3. The ENORASI virtual reality blind training system consisting of a high sensitivity virtual reality haptic system or training (supporting object interaction, manipulation, modification and query) along with novel virtual intelligent agents (implementing the specific training case studies) guiding visually impaired humans and consulting them hen interacting with the virtual objects, in the way that real guides would.
4. An international conference into Virtual Reality Applications in Training of Visually Impaired Humans planned in the 19th month.
5. A white paper providing technology standards and infrastructure guidelines for the setting up of VR based training systems for the visually impaired persons.
Work in the project is organised in the following phases:
a. System specification and user requirements phase,
b. Development of the haptic VR system and integration of internal system prototype,
c. Development of second prototype with improved functions phase,
d. Evaluation and dissemination phase.
Milestones:
M1: System definition
M2: Internal prototype release
M3: International Conference on Haptics in Virtual Environments
M4: Final system release
M5: Final report
The project will result in the ENORASI Training System, and Training Cases together with a White Paper providing technology and infrastructure guidelines.
An immersive haptic virtual environment (VE) will be created, simulating the real world guiding them through all the phrases of the training procedure. The ENORASI project introduces completely innovative non-visual virtual reality techniques that will help training blind people into feeling, understanding and interacting with complex virtual objects (airplanes, buildings, 3D maps, famous archaeological findings, etc.)
Objectives:
The project's technological objectives include development, testing, and evaluation of new approaches that will serve the project purposes.
These include:
- Development of a high sensitivity virtual reality haptic system for training.
- Development of novel virtual intelligent agents guiding blind humans and consulting them when interacting with the virtual objects, in the way that real guides would.
- Development of a metadata schema for efficient representation of texture.
- Development of realistic 3D rendering systems.
The business oriented objectives for ENORASI include the promotion of powerful solutions for the training of functionally impaired humans and the definition of the commercialisation and exploitation potential of ENORASI.
Work description:
The project will produce five main outcomes:
1. A usability study of innovative virtual reality systems for the training of visually impaired.
2. The ENORASI virtual reality training case studies where complete pilot training scenarios will be implemented and tested for injury-less and strain-less training.
These include:
a) recognising every day objects,
b) recognising complex virtual objects not easily accessible in their real life,
c) interacting with virtual objects and understanding their physical characteristics,
d) facilitating the participation of the visually impaired users in an educational or entertainment environment and
e) navigating into complex VEs based on haptic information and guidance from virtual guides.
3. The ENORASI virtual reality blind training system consisting of a high sensitivity virtual reality haptic system or training (supporting object interaction, manipulation, modification and query) along with novel virtual intelligent agents (implementing the specific training case studies) guiding visually impaired humans and consulting them hen interacting with the virtual objects, in the way that real guides would.
4. An international conference into Virtual Reality Applications in Training of Visually Impaired Humans planned in the 19th month.
5. A white paper providing technology standards and infrastructure guidelines for the setting up of VR based training systems for the visually impaired persons.
Work in the project is organised in the following phases:
a. System specification and user requirements phase,
b. Development of the haptic VR system and integration of internal system prototype,
c. Development of second prototype with improved functions phase,
d. Evaluation and dissemination phase.
Milestones:
M1: System definition
M2: Internal prototype release
M3: International Conference on Haptics in Virtual Environments
M4: Final system release
M5: Final report
The project will result in the ENORASI Training System, and Training Cases together with a White Paper providing technology and infrastructure guidelines.
Proyectos
Bluetooth Assistive Listening System
12 Enero 2003
BlueEar will develop an open system for assistive listening devices, based on the new industry radio standard "Bluetooth".
There is no common standard for radio-based assistive listening devices. Bluetooth is a new, global, open specification, for wireless connectivity between computers, printers, cellular phones and other devices. Developed by the Bluetooth Special Interest Group (SIG), the standard will be implemented in thousands of everyday devices, many of which are important for hard of hearing people, such as mobile phones and televisions. The BlueEar project will show that the Bluetooth specification can be enhanced to cover assistive listening systems, so that people who are hard of hearing are not excluded from the revolution in connectivity. It will attempt to persuade the Bluetooth SIG to enhance the specification to cover this important area.
Objectives:
The overall objective of BlueEar is to develop an open system for assistive listening devices, based on the new open industry radio standard "Bluetooth". The technological objectives are:
· to specify the complex needs of an assistive listening system;
· develop an open standard; · develop a prototype application;
· develop a range of prototype products;
· to validate the system functionality of the prototype with users.
Work description:
A prototype standard will be developed based on the Bluetooth system that will enable the provision of the complex facilities and scenarios demanded by an integrated assistive listening system. A prototype will be developed to demonstrate the functionality of the system. This prototype will prove the technical viability of using Bluetooth.
Two sets of workshops will be organised:
· One set of workshops with groups of hard of hearing people, to show the advantages of the system over current systems, and to investigate user needs.
· The second set of workshops with groups of industrial manufacturers to demonstrate the technical viability of using Bluetooth for assistive listening systems, and to build support for the development of a new 'Profile' for Bluetooth to cover assistive listening devices.
The development of a consensus for a new 'Profile' for Bluetooth will be supported. At the same time, a small set of prototype products will be developed using the new 'Profile' standard. These will incorporate the appropriate ergonomic and aesthetic design attributes.
A methodology for validation trials will be developed. Prototype products will be developed and manufactured to validate three different application scenarios (e.g. workplace, theatre, home). The prototype products will be trailed with groups of hard of hearing users in three countries. The results will be evaluated.
Milestones:
BlueEar will create an open specification that will enhance the Bluetooth specification to include assistive listening devices. Prototype products will be developed and manufactured. These will be validated during trials in three countries. BlueEar will have the effect of 'mainstreaming' hard of hearing people. Rather than having to persuade manufacturers to incorporate additional features to provide access to hard of hearing people, mainstream devices will be accessible.
Objectives:
The overall objective of BlueEar is to develop an open system for assistive listening devices, based on the new open industry radio standard "Bluetooth". The technological objectives are:
· to specify the complex needs of an assistive listening system;
· develop an open standard; · develop a prototype application;
· develop a range of prototype products;
· to validate the system functionality of the prototype with users.
Work description:
A prototype standard will be developed based on the Bluetooth system that will enable the provision of the complex facilities and scenarios demanded by an integrated assistive listening system. A prototype will be developed to demonstrate the functionality of the system. This prototype will prove the technical viability of using Bluetooth.
Two sets of workshops will be organised:
· One set of workshops with groups of hard of hearing people, to show the advantages of the system over current systems, and to investigate user needs.
· The second set of workshops with groups of industrial manufacturers to demonstrate the technical viability of using Bluetooth for assistive listening systems, and to build support for the development of a new 'Profile' for Bluetooth to cover assistive listening devices.
The development of a consensus for a new 'Profile' for Bluetooth will be supported. At the same time, a small set of prototype products will be developed using the new 'Profile' standard. These will incorporate the appropriate ergonomic and aesthetic design attributes.
A methodology for validation trials will be developed. Prototype products will be developed and manufactured to validate three different application scenarios (e.g. workplace, theatre, home). The prototype products will be trailed with groups of hard of hearing users in three countries. The results will be evaluated.
Milestones:
BlueEar will create an open specification that will enhance the Bluetooth specification to include assistive listening devices. Prototype products will be developed and manufactured. These will be validated during trials in three countries. BlueEar will have the effect of 'mainstreaming' hard of hearing people. Rather than having to persuade manufacturers to incorporate additional features to provide access to hard of hearing people, mainstream devices will be accessible.
Proyectos
World Wide Augmentative and Alternative Communication
12 Enero 2003
The project will make several Internet services accessible for persons with language and/or cognitive impairments, including symbol users and a part of the elderly population.
An universal coding system will be developed for message encoding which can be used for eMail, eChat or enhancing web-page information. This will be promoted as a public standard. Six national and three symbol languages will be involved. Additional support for handling information and navigation by people with cognitive, motor and/or language disorders will be developed. Software applications will be made with appropriate user interfaces, presenting the message content in multiple ways such as by text, speech or by symbols. For information providers, web-guidelines and an authoring tool will be developed. Educational and rehabilitation centres, organisations for the elderly involved in ICT, several AAC-focused companies, are all involved in the User platform. Representing a wide geographical spread (at least 6 countries) they will ensure optimal user-focused design, qualitative evaluation of the results and a coherent and realistic exploitation planning.
Objectives:
The ultimate goal of the project is to make the electronic highway more accessible for a wide range of persons with language and/or cognitive impairments. In the context of these users the project addresses the development and early implementation of:
- preliminary standards for syntax and semantic text/message encoding,
- tools for text support: i.e. message conversion among symbols and text, with speech output,
- tools for task support i.e. for web navigation and mail box handling,
- guidelines and tools for information presentation on the web for the target group.
In close co-operation with a wide but carefully selected User Base, and with a limited amount of applied research but substantial innovative technology development, existing knowledge and technology from a range of related projects will lead to commercially attractive and close-to-market products.
Standards will be proposed in co-operation with W3C, WAI, ISO, European ICT and Nordic bodies for standardisation in the field of Disabled and Elderly people.
Work description:
In order to achieve the key objectives, the balanced consortium of four industrial, two research partners and two service providers have created a well integrated project workplan. The work has been divided into nine distinct workpackages, each being led by the most appropriate partner. The interrelationship between the various components and workpackages will be carefully managed by the project co-ordinator.
WP1 - User-involvement and Evaluation, the "market square" where user-involvement is assured throughout the lifetime of the project. A platform to maximise the quality of the developments and to perform initial market studies.
WP2 - Universal Concept Sets and Support modules, co-operating with WP3, it focuses on technology development by creating a concept list and software components for language structures.
WP3 - Linguistic structures for eMail and eChat, will set up the language material for symbol-users allowing them by message conversion to read & write messages for eMail and eChat conversations.
WP4 - User Interface: Design and models for evaluation, will address a sound and effective approach in performing and measuring the user-needs during the project, as being performed in WP1.
WP5 - Navigation and data management support, will address the problems encountered by users, such as navigation on the web and information management, e.g. address book maintenance.
WP6 - Developing of Internet Access Applications, will create three AAC-Internet access applications, based on the components developed in WP2, WP3 and WP5.
WP7 - Guidelines and tools for AAC-enabled Web Pages, will develop both guidelines and a web-authoring tool, to be used by Special-Information Providers.
WP8 - Dissemination and Exploitation Planning, dissemination of the project results, contacts with the WWW consortia and/or standardisation bodies, IPR activities and exploitation planning.
WP9 - Management. As with all projects spanning different organisations and member states, well-organised management is needed to deal with financial and organisational matters.
This project will result in a range of interrelated products and services which offer people with language and/or cognitive impairments access to several Internet services such as the Web, eMail and eChat.
Milestones:
M1 - A solid foundation for the project has been laid consisting of the User Requirements, the Technology Specification and the IPR Agreement.
M2 - The project's viability has been optimised, based on a user-based feasibility study, evaluation of the state-of-the-art Internet technologies and a detailed assessment of the market.
M3 - Alpha versions of the software for initial user-centred evaluations, followed by
M4 - Beta versions for full evaluations.
M5 - Project will be completed with final reports, guidelines, implementation plans and software modules.
Objectives:
The ultimate goal of the project is to make the electronic highway more accessible for a wide range of persons with language and/or cognitive impairments. In the context of these users the project addresses the development and early implementation of:
- preliminary standards for syntax and semantic text/message encoding,
- tools for text support: i.e. message conversion among symbols and text, with speech output,
- tools for task support i.e. for web navigation and mail box handling,
- guidelines and tools for information presentation on the web for the target group.
In close co-operation with a wide but carefully selected User Base, and with a limited amount of applied research but substantial innovative technology development, existing knowledge and technology from a range of related projects will lead to commercially attractive and close-to-market products.
Standards will be proposed in co-operation with W3C, WAI, ISO, European ICT and Nordic bodies for standardisation in the field of Disabled and Elderly people.
Work description:
In order to achieve the key objectives, the balanced consortium of four industrial, two research partners and two service providers have created a well integrated project workplan. The work has been divided into nine distinct workpackages, each being led by the most appropriate partner. The interrelationship between the various components and workpackages will be carefully managed by the project co-ordinator.
WP1 - User-involvement and Evaluation, the "market square" where user-involvement is assured throughout the lifetime of the project. A platform to maximise the quality of the developments and to perform initial market studies.
WP2 - Universal Concept Sets and Support modules, co-operating with WP3, it focuses on technology development by creating a concept list and software components for language structures.
WP3 - Linguistic structures for eMail and eChat, will set up the language material for symbol-users allowing them by message conversion to read & write messages for eMail and eChat conversations.
WP4 - User Interface: Design and models for evaluation, will address a sound and effective approach in performing and measuring the user-needs during the project, as being performed in WP1.
WP5 - Navigation and data management support, will address the problems encountered by users, such as navigation on the web and information management, e.g. address book maintenance.
WP6 - Developing of Internet Access Applications, will create three AAC-Internet access applications, based on the components developed in WP2, WP3 and WP5.
WP7 - Guidelines and tools for AAC-enabled Web Pages, will develop both guidelines and a web-authoring tool, to be used by Special-Information Providers.
WP8 - Dissemination and Exploitation Planning, dissemination of the project results, contacts with the WWW consortia and/or standardisation bodies, IPR activities and exploitation planning.
WP9 - Management. As with all projects spanning different organisations and member states, well-organised management is needed to deal with financial and organisational matters.
This project will result in a range of interrelated products and services which offer people with language and/or cognitive impairments access to several Internet services such as the Web, eMail and eChat.
Milestones:
M1 - A solid foundation for the project has been laid consisting of the User Requirements, the Technology Specification and the IPR Agreement.
M2 - The project's viability has been optimised, based on a user-based feasibility study, evaluation of the state-of-the-art Internet technologies and a detailed assessment of the market.
M3 - Alpha versions of the software for initial user-centred evaluations, followed by
M4 - Beta versions for full evaluations.
M5 - Project will be completed with final reports, guidelines, implementation plans and software modules.
Proyectos
Wireless Information Services for Deaf people On the Move
12 Enero 2003
WISDOM is a 3rd Generation (3G mobile) solution to the needs of deaf people for interaction and for visual information.
WISDOM exploits the pervasive nature of the third generation mobile network to offer to deaf people, participation, independence and the means to make their own contribution. Deaf needs for visual interaction at a distance challenge the telecommunications infrastructure in terms of quality of service and content and the specific needs of groups such as the elderly require new interfaces. By trials with Bluetooth enabled systems for video capture, compression, text entry and sign recognition, WISDOM provides solutions for person-to-person live communication and information retrieval in sign language. By involving users and purchasers, network operators and manufacturers, WISDOM ensures a pathway to exploitation and real benefits for the end users. WISDOM advances services for the whole community.
Objectives:
WISDOM will
1. develop a fully portable video communication terminal for deaf people in the third generation mobile networks:
a. video camera and video processing unit with optimal use of the mainstream video coding standards for sign language communication;
b. pocket keyboard - for standardised text interface in calls to legacy text phones and for internet access;
c. screen for video, text and call control;
d. wrist vibrator alert device for incoming calls;
e. 3G communication controller/receiver & software manager for this device. The project will integrate & adapt mainstream units wherever possible;
f. Wireless Bluetooth communication between the physical terminal components;
2. create a 24/7 sign language information video server for deaf people on the move
3. set up sign language remote interpreting and relay centres for fluent conversation between hearing and deaf people wherever the need arises
4. provide information access through sign language recognition of deaf users' signing
5. create a prototype terminal for elderly deaf people.
Work description:
Visual Telecommunications are possible in the third generation mobile networks. Deaf people are ideal users of this development for their sign language communication. WISDOM provides service in sign language in a mobile environment. To achieve this, partners must:
1. specify, implement and validate a mobile video terminal which allows communication in sign language, and text;
2. extend the system of sign language recognition developed by Aachen Technical University to create an interface with the sign language server;
3. set up a sign language server which provides information to deaf users 24 hours, 7 days a week;
4. establish network quality of service for mobile video communication;
5. Integrate recently approved text conversation standards and feed back experience to standardisation bodies;
6. Set up and run sign language remote interpretation and voice call relay services;
7. Carry out lab and field trials;
8. By consultation, ensure a deaf user and purchaser viewpoint for exploitation.
Milestones:
- Initial User Specification for service and device at month 3;
- 3G mobile videophone component validation (month 18) leads to:
- Trials in Sign Recognition: Creation of content in three languages (month 18);
- Deployment of video server for access on network (month 24);
- Wireless LAN with sign language server 12mo leads to: - 3G mobile network;
- Lab Trials (month 12 and 24) lead to: - QOS model Field Trials (month 33);
- Deaf and elderly dissemination & exploitation (month 33) lead to market.
Objectives:
WISDOM will
1. develop a fully portable video communication terminal for deaf people in the third generation mobile networks:
a. video camera and video processing unit with optimal use of the mainstream video coding standards for sign language communication;
b. pocket keyboard - for standardised text interface in calls to legacy text phones and for internet access;
c. screen for video, text and call control;
d. wrist vibrator alert device for incoming calls;
e. 3G communication controller/receiver & software manager for this device. The project will integrate & adapt mainstream units wherever possible;
f. Wireless Bluetooth communication between the physical terminal components;
2. create a 24/7 sign language information video server for deaf people on the move
3. set up sign language remote interpreting and relay centres for fluent conversation between hearing and deaf people wherever the need arises
4. provide information access through sign language recognition of deaf users' signing
5. create a prototype terminal for elderly deaf people.
Work description:
Visual Telecommunications are possible in the third generation mobile networks. Deaf people are ideal users of this development for their sign language communication. WISDOM provides service in sign language in a mobile environment. To achieve this, partners must:
1. specify, implement and validate a mobile video terminal which allows communication in sign language, and text;
2. extend the system of sign language recognition developed by Aachen Technical University to create an interface with the sign language server;
3. set up a sign language server which provides information to deaf users 24 hours, 7 days a week;
4. establish network quality of service for mobile video communication;
5. Integrate recently approved text conversation standards and feed back experience to standardisation bodies;
6. Set up and run sign language remote interpretation and voice call relay services;
7. Carry out lab and field trials;
8. By consultation, ensure a deaf user and purchaser viewpoint for exploitation.
Milestones:
- Initial User Specification for service and device at month 3;
- 3G mobile videophone component validation (month 18) leads to:
- Trials in Sign Recognition: Creation of content in three languages (month 18);
- Deployment of video server for access on network (month 24);
- Wireless LAN with sign language server 12mo leads to: - 3G mobile network;
- Lab Trials (month 12 and 24) lead to: - QOS model Field Trials (month 33);
- Deaf and elderly dissemination & exploitation (month 33) lead to market.
Proyectos
A Multisensory Environment Design for an Interface between Autistic and Typical Expressiveness
12 Enero 2003
The multisensory interactive environment will promote creativity of sensory expression in all users.
MEDIATE addresses Key Action Line I.2.1 by R&D of an ambient intelligent authoring environment, which supports progressive interaction with enacted nonverbal multisensory creations. To reach new levels of interactivity responding to the uniqueness of individuals, the environment will sense and feedback users' behaviour as integrated patterns of image, sound, and vibration. Recognition software will differentiate habitual from distinctive behaviours: stronger and more intense feedback follows distinctive behaviour, while the user maintains control. User creations can be stored and replayed. Developed with the aid of and for the use by autistic individuals, the resultant MEDIATE environment (which will be transportable) will allow such users previously unattained levels of sensory expression: for the benefit and enjoyment of the users and, for others, providing an insight into the sensory world of autism.
Objectives:
The overall objective is to design and build a portable intelligent environment: multisensory in terms of its interface input and response while being activated, controlled, and manipulated by user gestures however limited or unique these might be. People on the Autistic Spectrum (PAS) will be co-designers to create interfaces using sensors that see, hear, and feel the user. Research, development, and implementation of a real-time signature analyser / governor will occur. This software will respond to the unique features of a particular user's behaviour and give control of effects through that behaviour. Protocols to store, retrieve, and re-enact users' interaction histories will allow PAS to experience a sense of agency, will provide data for the interpretation of PAS behaviour (by experts), and will enable entry to their world for significant others (family, teachers).
Work description:
MEDIATE will be produced by the integration of technical skills, theoretical knowledge, and co-constructive design at a trans-European level. The project will proceed through a series of accumulative steps with the end users being integral participants at all times: high functioning autistic individuals from across Europe being co-authors as well as testers of the system. Sensory interfaces for the engagement, manipulation and creative feedback of touch, sound, and sight will be devised at independent locations in parallel during the first stage. The second stage will entail assembly of a full prototype ambient intelligent multisensory interface / environment, bringing representatives of all partners into the same physical location. During both stages an ongoing signature software development will functionalise each step of the evolving interface allowing the experiential usage of the multisensory environment to be captured and replayed to significant others (parents, siblings, teachers, other autistic children) as well as allowing interpretation of these special groups of users (communication impaired children) to be made by psychological experts. The completed hardware and software configuration of MEDIATE will have wide application. From the outset attention will be given to the exploitation of MEDIATE with an emphasis being placed on the robustness and portability of the system's hardware, software, and control components. This will optimise MEDIATE's widest possible clinical, therapeutic, and recreational future use for the benefit of the many and various communication impaired individuals and the organisations that provide for their care and treatment.
Milestones:
Plan for the dissemination and use of MEDIATE (6 months) will frame all future work. Interfaces and data capture for sound, image, and vibration (12 months); controlling signature software (18 months); data gathering protocols and MEDIATE user procedures (18 months) will drive a series of field trials of the portable integrated environment now completed in prototype (24 months); final report, evaluation, and interpretation of results along with appropriate dissemination (30 months) will take MEDIATE into the community. Results: intelligent multisensory 'tent' environment; user sensitive signature software; new knowledge of the sensory worlds of autistic children; released expression from previously uncommunicative children; web site which provides for the possibility of an understanding between autistic and 'typical' expressive creations; plans for future use, development, exploitation, and dissemination.
Objectives:
The overall objective is to design and build a portable intelligent environment: multisensory in terms of its interface input and response while being activated, controlled, and manipulated by user gestures however limited or unique these might be. People on the Autistic Spectrum (PAS) will be co-designers to create interfaces using sensors that see, hear, and feel the user. Research, development, and implementation of a real-time signature analyser / governor will occur. This software will respond to the unique features of a particular user's behaviour and give control of effects through that behaviour. Protocols to store, retrieve, and re-enact users' interaction histories will allow PAS to experience a sense of agency, will provide data for the interpretation of PAS behaviour (by experts), and will enable entry to their world for significant others (family, teachers).
Work description:
MEDIATE will be produced by the integration of technical skills, theoretical knowledge, and co-constructive design at a trans-European level. The project will proceed through a series of accumulative steps with the end users being integral participants at all times: high functioning autistic individuals from across Europe being co-authors as well as testers of the system. Sensory interfaces for the engagement, manipulation and creative feedback of touch, sound, and sight will be devised at independent locations in parallel during the first stage. The second stage will entail assembly of a full prototype ambient intelligent multisensory interface / environment, bringing representatives of all partners into the same physical location. During both stages an ongoing signature software development will functionalise each step of the evolving interface allowing the experiential usage of the multisensory environment to be captured and replayed to significant others (parents, siblings, teachers, other autistic children) as well as allowing interpretation of these special groups of users (communication impaired children) to be made by psychological experts. The completed hardware and software configuration of MEDIATE will have wide application. From the outset attention will be given to the exploitation of MEDIATE with an emphasis being placed on the robustness and portability of the system's hardware, software, and control components. This will optimise MEDIATE's widest possible clinical, therapeutic, and recreational future use for the benefit of the many and various communication impaired individuals and the organisations that provide for their care and treatment.
Milestones:
Plan for the dissemination and use of MEDIATE (6 months) will frame all future work. Interfaces and data capture for sound, image, and vibration (12 months); controlling signature software (18 months); data gathering protocols and MEDIATE user procedures (18 months) will drive a series of field trials of the portable integrated environment now completed in prototype (24 months); final report, evaluation, and interpretation of results along with appropriate dissemination (30 months) will take MEDIATE into the community. Results: intelligent multisensory 'tent' environment; user sensitive signature software; new knowledge of the sensory worlds of autistic children; released expression from previously uncommunicative children; web site which provides for the possibility of an understanding between autistic and 'typical' expressive creations; plans for future use, development, exploitation, and dissemination.
Proyectos
Smart Interactive Tactile Interface Effecting Graphical Display for the Visually Impaired
12 Enero 2003
A state-of-the-art interactive tactile interface peripheral will be developed to improve the access of visually impaired persons to modern computer and internet applications.
The peripheral will display tactile diagrams and multi-line Braille, and touch sensitive feedback will be employed for the presentation of interactive documents. Advances in smart materials and their applications will be exploited to produce an array of multiple actuators. Interface and control systems will be developed to support this new technology, allowing connection to a generic IBM compatible PC clone. Software tools will be created to allow conversion of information to a form suitable for tactile display. The project will be conducted with continued feedback from visually impaired IT users and support organisations.
Objectives:
1.The needs of the visually impaired community with respect to improved access to information technology resources will be researched in detail. The results will be used to design a specification for the development of a new interactive tactile interface;
2. A new interactive tactile interface will be developed using advances in the application of smart materials technology. It will be a large rectangular array of controllable dots which may be raised or lowered under the control of a personal computer (PC) with touch sensitive feedback;
3. Control electronics and driver software will be developed and fully documented, such that it may be easily integrated into applications by third party software developers;
4. To develop software to display information in a tactile form, and demonstrate how the clarity and utility of IT resources have been improved for the visually impaired.
Work description:
The first action of the consortium will be to fully investigate the information technology needs of the visually impaired and the shortcomings of existing technology. Safety, quality, electromagnetic compatibility and cost targets will be set and a full device specification will be drawn up. This document will be used to steer the remaining workpackages towards maximising the benefits brought to end users by the new technology. Research will then be conducted into the best route to the production of an actuator array suitable for use as a tactile display. A full assessment of the suitability of three approaches will first be made, on grounds of their suitability under the specification criteria. An actuator array will then be built. The technology will be based on the novel application of smart materials to produce easily constructible and controllable array of 'dots', with interactive touch sensitive feedback. Development of control systems and driver software will take place. Work will include image and information processing into a form suitable for tactile display. A fully functional and well documented set of software tools will be delivered to enable software control of the tactile interface. System integration of the array, control systems and support software will then be undertaken, and this will include the design and build of a mechanical enclosure. This will result in the delivery of (a) completed prototype (s). Software tools will be used to develop web access and document display software to demonstrate one of a multitude of uses for the new device. Design verification and evaluation will then be undertaken by a group of representative end users. Final stages of the software development and system integration will run concurrently with this work in order that feedback can be incorporated into the software design.
Milestones:
MS1 - Production of device specification;
MS2 - Choice of actuator technology. It is expected that electro-rheological fluid will be chosen to facilitate the production of a matrix of moving dots;
MS3 - Choice of interface method to PC. The choice will be a made on grounds of convenience and cost and performance;
MS4 - First year project assessment;
MS5 - Choice of protocol for communicating between applications and the device. This choice should allow simple but powerful control of the device features.
Objectives:
1.The needs of the visually impaired community with respect to improved access to information technology resources will be researched in detail. The results will be used to design a specification for the development of a new interactive tactile interface;
2. A new interactive tactile interface will be developed using advances in the application of smart materials technology. It will be a large rectangular array of controllable dots which may be raised or lowered under the control of a personal computer (PC) with touch sensitive feedback;
3. Control electronics and driver software will be developed and fully documented, such that it may be easily integrated into applications by third party software developers;
4. To develop software to display information in a tactile form, and demonstrate how the clarity and utility of IT resources have been improved for the visually impaired.
Work description:
The first action of the consortium will be to fully investigate the information technology needs of the visually impaired and the shortcomings of existing technology. Safety, quality, electromagnetic compatibility and cost targets will be set and a full device specification will be drawn up. This document will be used to steer the remaining workpackages towards maximising the benefits brought to end users by the new technology. Research will then be conducted into the best route to the production of an actuator array suitable for use as a tactile display. A full assessment of the suitability of three approaches will first be made, on grounds of their suitability under the specification criteria. An actuator array will then be built. The technology will be based on the novel application of smart materials to produce easily constructible and controllable array of 'dots', with interactive touch sensitive feedback. Development of control systems and driver software will take place. Work will include image and information processing into a form suitable for tactile display. A fully functional and well documented set of software tools will be delivered to enable software control of the tactile interface. System integration of the array, control systems and support software will then be undertaken, and this will include the design and build of a mechanical enclosure. This will result in the delivery of (a) completed prototype (s). Software tools will be used to develop web access and document display software to demonstrate one of a multitude of uses for the new device. Design verification and evaluation will then be undertaken by a group of representative end users. Final stages of the software development and system integration will run concurrently with this work in order that feedback can be incorporated into the software design.
Milestones:
MS1 - Production of device specification;
MS2 - Choice of actuator technology. It is expected that electro-rheological fluid will be chosen to facilitate the production of a matrix of moving dots;
MS3 - Choice of interface method to PC. The choice will be a made on grounds of convenience and cost and performance;
MS4 - First year project assessment;
MS5 - Choice of protocol for communicating between applications and the device. This choice should allow simple but powerful control of the device features.
Proyectos
Computer Graphics Access For Blind People Through A Haptic Virtual Environment
12 Enero 2003
Its aim is to allow blind people to access to the 3D graphic computer world through the sense of touch and with audio help, by means of a new Haptic Virtual Environment (HVE).
Information Society utilities are increasingly being used at working and learning environments. Some of the barriers that impeded to blind people to have access to the computer and its applications are being solved with commercial tools, but there is an inaccessible field yet for them: the 3D computer graphics and their applications. The proposed HVE would allow the user to move his fingers over the virtual object and recognise its geometric features (e.g. corners, edges), as if he was manipulating a real mock-up of the object. This would be achieved with a new two-finger haptic interface specifically developed to touch 3D virtual objects. The new HVE could serve to develop multiple applications in different fields, but the project focuses on: a training system for the recognition of virtual maps of cities, a system for education and reinforcement of the auditory memory and an application for the development of 3D Haptic GUIs through virtual buttons. The access to the 3D graphic computer world would facilitate the integration of blind people in the labour market, where computers are essential tools, and improve their education and training opportunities to live independently.
Work description:
The proposed HVE is based on the integration of:
- a new force feedback haptic interface (HI): capable of replicating independent force vectors at the thumb and the index tip (the simultaneous contact of these fingers with the object would facilitate to the user the recognition of the shape of the objects), with a workspace covering a large part of the user desktop and with a high force feedback fidelity to perceive tiny geometrical details of the objects. A device with such characteristics does not exist in the state-of-the-art. Therefore its development is strategic and would allow fulfilling an existing user need that is found also in other applications.
- a new haptic geometric modeller based on an existing geometric modeller (developed by one of the partners) and 2 additional modules to: provide sound aids and allow the interaction among the user, the new HI and any 3D virtual object.
The HVE could serve to develop multiple applications in different fields, but the project focuses on 3 specific utilities selected for their promising positive impact on the life quality of blind people:
- Training system for the recognition of virtual maps of cities --> to allow the user to move within a virtual map through the sense of touch and with audio help. He could recognise the shape, size and location of their different components (streets, houses, bus, etc.) and get a mental image of the map that would be of great aid during his real walking.
- System for the education and reinforcement of the auditory memory (Master Mind game) --> to allow the user to play the Master Mind game, not only as an entertainment but also with pedagogic purposes. The adaptation of this game, substituting colours by geometric shapes associated to different sounds, would allow the user to interact with virtual objects and share with them information regarding the objects' shape and sound. It would be very useful in training users auditory memory and the shape recognition.
- Application for the development of 3D Haptic GUIs through virtual buttons --> to allow developing GUIs based on haptic exploration of virtual icons-buttons instead of using the mouse (a great obstacle for blind people). In order to execute a command, the user should "touch and push" the corresponding virtual button. The new HVE and its applications would be tested by a great number of people with different vision problems and profiles and a quantitative analysis of the level of user satisfaction would be performed at the end of the project.
Milestones:
M12- prototype 1: mock-up and drawings of the HI, interface sound and utilities to generate virtual maps
M18- prototype 2: first full functionality model of HI, haptic exploration of objects and 3D haptic GUI
M30- final prototype: engineering model of the HI, recognition of virtual maps and virtual game
The main expected result is a new HVE that allows blind people to access to the 3D graphic computer world through the sense of touch and with audio help. In the future, this HVE could also be used to develop multiple applications.
Work description:
The proposed HVE is based on the integration of:
- a new force feedback haptic interface (HI): capable of replicating independent force vectors at the thumb and the index tip (the simultaneous contact of these fingers with the object would facilitate to the user the recognition of the shape of the objects), with a workspace covering a large part of the user desktop and with a high force feedback fidelity to perceive tiny geometrical details of the objects. A device with such characteristics does not exist in the state-of-the-art. Therefore its development is strategic and would allow fulfilling an existing user need that is found also in other applications.
- a new haptic geometric modeller based on an existing geometric modeller (developed by one of the partners) and 2 additional modules to: provide sound aids and allow the interaction among the user, the new HI and any 3D virtual object.
The HVE could serve to develop multiple applications in different fields, but the project focuses on 3 specific utilities selected for their promising positive impact on the life quality of blind people:
- Training system for the recognition of virtual maps of cities --> to allow the user to move within a virtual map through the sense of touch and with audio help. He could recognise the shape, size and location of their different components (streets, houses, bus, etc.) and get a mental image of the map that would be of great aid during his real walking.
- System for the education and reinforcement of the auditory memory (Master Mind game) --> to allow the user to play the Master Mind game, not only as an entertainment but also with pedagogic purposes. The adaptation of this game, substituting colours by geometric shapes associated to different sounds, would allow the user to interact with virtual objects and share with them information regarding the objects' shape and sound. It would be very useful in training users auditory memory and the shape recognition.
- Application for the development of 3D Haptic GUIs through virtual buttons --> to allow developing GUIs based on haptic exploration of virtual icons-buttons instead of using the mouse (a great obstacle for blind people). In order to execute a command, the user should "touch and push" the corresponding virtual button. The new HVE and its applications would be tested by a great number of people with different vision problems and profiles and a quantitative analysis of the level of user satisfaction would be performed at the end of the project.
Milestones:
M12- prototype 1: mock-up and drawings of the HI, interface sound and utilities to generate virtual maps
M18- prototype 2: first full functionality model of HI, haptic exploration of objects and 3D haptic GUI
M30- final prototype: engineering model of the HI, recognition of virtual maps and virtual game
The main expected result is a new HVE that allows blind people to access to the 3D graphic computer world through the sense of touch and with audio help. In the future, this HVE could also be used to develop multiple applications.
Proyectos
Faster Typing for Disabled Persons
12 Enero 2003
It offers a communication support system that will significantly increase typing speed, and is adaptable to users with different languages and with strongly varying needs.
Communication and information exchange is a vital factor in human society. Communication disorders can severely influence the quality of persons' lives. Whereas experienced typists produce some 300 keystrokes per minute, persons with motor impairments achieve only much lower rates. Predictive typing systems for English-speaking areas have proven usefulness and efficiency, but for all other European languages there exist no predictive typing programs that are powerful enough to improve substantially the communication rate and the access to information technology for disabled persons. A large group of non-English-speaking disabled citizens will be supported in living a more independent and self-determined life.
Objectives:
The objective of FASTY is to create an efficient predictive typing program for most European languages. FASTY will assist motor-, speech-, learning- and language-impaired persons to produce texts faster, with less physical/cognitive load, and with better spelling and grammar. FASTY will be configurable for different types of disabilities, different communication settings, and different European languages. It will allow easier access to personal computer-based office systems, to modern forms of information technology communication, and faster use of text-to-speech synthesisers for voice communication. Thus, the FASTY system will contribute to ensuring equal access to the Information Society for all citizens. FASTY is an intelligent system that uses natural language processing, artificial intelligence, self-adaptive user interfaces, and knowledge bases. It will increase significantly the key stroke-saving rate, especially for those European languages which are highly inflected.
Work description:
FASTY will follow a generic approach in order to be multilingual by design. The feasibility and portability of this approach will be demonstrated by implementing algorithms for four European languages: German, Dutch, French, and Swedish. A user panel will ensure the close involvement of end-users in the project. The user needs will be analysed subjectively by intensive interaction with the user panel. Additionally, an objective assessment tool will be developed for user needs investigation. The user panel also plays an important role during verification and validation of the prototype systems. A language-independent prediction software - which will clearly separate the predictor, the dictionary, the grammar description and the user interface - will be specified and implemented. This will ensure a product, which can be ported into most European languages without sacrificing performance. The user interface design, and the features of the predictor program, aim at a wide coverage of users. A user simulation and user ability assessment tool will be built which can be used later as configuration assistance. Self-adapting parameters and flexible configuring ensure a high degree of usability, user-friendliness and accessibility. Innovative and ergonomic user interfaces for various existing input methods (standard keyboard, on-screen-keyboard, scanning) will be developed, together with the predictor, so as to minimise time and effort in the selection process. In addition, a special pressure sensitive switch/keyboard will be developed and used to improve the user interface. Strategies for optimal exploitation of residual functions will be implemented. Dissemination and exploitation play a central role throughout the project. A Technology Implementation Plan will be developed as preparation for the exploitation plan. After successfully finishing the project, the consortium will co-operate to develop a commercial product.
Milestones:
- Dissemination and Use Plan (DUP) and Technology Implementation Plan (TIP)
- A prototype system for accelerating communication speed which can be customised to different European languages. (Dutch, French, German, and Swedish versions will be implemented.) It will be configurable to a wide spectrum of disabilities and communication settings (written output, spoken output, input for personal computer-based office equipment, and for information technology systems)
- User simulator software for laboratory tests of system performance
- Tools for user assessment
- Advanced prototype system improved by the results of a redesign phase.
Objectives:
The objective of FASTY is to create an efficient predictive typing program for most European languages. FASTY will assist motor-, speech-, learning- and language-impaired persons to produce texts faster, with less physical/cognitive load, and with better spelling and grammar. FASTY will be configurable for different types of disabilities, different communication settings, and different European languages. It will allow easier access to personal computer-based office systems, to modern forms of information technology communication, and faster use of text-to-speech synthesisers for voice communication. Thus, the FASTY system will contribute to ensuring equal access to the Information Society for all citizens. FASTY is an intelligent system that uses natural language processing, artificial intelligence, self-adaptive user interfaces, and knowledge bases. It will increase significantly the key stroke-saving rate, especially for those European languages which are highly inflected.
Work description:
FASTY will follow a generic approach in order to be multilingual by design. The feasibility and portability of this approach will be demonstrated by implementing algorithms for four European languages: German, Dutch, French, and Swedish. A user panel will ensure the close involvement of end-users in the project. The user needs will be analysed subjectively by intensive interaction with the user panel. Additionally, an objective assessment tool will be developed for user needs investigation. The user panel also plays an important role during verification and validation of the prototype systems. A language-independent prediction software - which will clearly separate the predictor, the dictionary, the grammar description and the user interface - will be specified and implemented. This will ensure a product, which can be ported into most European languages without sacrificing performance. The user interface design, and the features of the predictor program, aim at a wide coverage of users. A user simulation and user ability assessment tool will be built which can be used later as configuration assistance. Self-adapting parameters and flexible configuring ensure a high degree of usability, user-friendliness and accessibility. Innovative and ergonomic user interfaces for various existing input methods (standard keyboard, on-screen-keyboard, scanning) will be developed, together with the predictor, so as to minimise time and effort in the selection process. In addition, a special pressure sensitive switch/keyboard will be developed and used to improve the user interface. Strategies for optimal exploitation of residual functions will be implemented. Dissemination and exploitation play a central role throughout the project. A Technology Implementation Plan will be developed as preparation for the exploitation plan. After successfully finishing the project, the consortium will co-operate to develop a commercial product.
Milestones:
- Dissemination and Use Plan (DUP) and Technology Implementation Plan (TIP)
- A prototype system for accelerating communication speed which can be customised to different European languages. (Dutch, French, German, and Swedish versions will be implemented.) It will be configurable to a wide spectrum of disabilities and communication settings (written output, spoken output, input for personal computer-based office equipment, and for information technology systems)
- User simulator software for laboratory tests of system performance
- Tools for user assessment
- Advanced prototype system improved by the results of a redesign phase.
Proyectos
Voice for Information Society Universal Access and Learning
11 Enero 2003
The objective of this project is to develop voice based technology in order to improve the access of visually impaired people to the information society.
Information will be offered not only as a graphic interface but using voice. The use of Voice XML technology ensure that the information will reach the user without time losses and totally independent of the graphic interface and the accessing device. Although oriented to visually impaired people, the same development can be use for everybody. Also, any page already designed will be easily adapted to our voice solution, keeping the same structure and richness and in different official languages of the European Union. An e-learning portal oriented to visually impaired people will be designed as a test of the solution.
Objectives:
The goal of this project, VISUAL, is to develop voice based technology in order to improve the access of visually impaired people to the information society. VISUAL in-tends to provide a system for designing web sites entirely accessible to visually impaired people. VISUAL will lead to designs in which interaction will be accomplished as by means of speech as by a keypad, and it would let different classes of impaired people access a Web page not only visually, but also by means of voice.
The main objectives of the project are:
1. To facilitate to visually impaired people both the access to Internet and the design of accessible pages;
2. To provide to the Web developers with a tool which facilitates the creation of accessible pages (both in the accomplishment of the specifications and in the integration of spoken navigation). The authoring tool could be ultimately integrated in any existing well-known Web authoring package or at least be compatible;
3. To integrate speech in the navigation as an alternative form for inter-action. What travels via Web are light text documents which are interpreted by the client;
4. Development of an accessible portal (which can be browsed by means of speech and with contents stored in Voice XML documents).
Work description:
Work is divided into supportive/horizontal and technical/scientific work packages (WP). The Consortium's members have designed the project into 7 workpackages to divide the complexity of the work appropriately. Each workpackage have a verifiable end-point. Technical work is dedicated to the development of VISUAL tool and e-learning portal. After a first analysis and definition of test scenarios, existing data, and documents together with a risk analysis, the work will concentrate on the development of the following modules:
WP1 user requirements of accessibility and web authoring tool;
WP2 plugging for speech recognition and synthesis integration;
WP3 tool development;
WP4 creation of an accessible learning portal;
WP5 evaluation;
WP6 dissemination, standardization and exploitation;
WP7 project management.
A first effort in Work package 3 (Tool Development) will be dedicated to purely technical work and will start before the end of workpackages 1 and 2 (User requirements, and integration of plug-ins). However, the result of those workpackages is necessary in order to complete the objectives. After the initial workpackages, it is expected to have defined what is necessary to ex-press in Voice XML about a page.
It must be described:
1. What kind of help is really important to provide to a visually impaired person in order to improve his Web navigation;
2. What kind of descriptions must be supplied with the page to described properly general description of the page, images, videos, frames, Macromedia Flash animations, backgrounds, and so on;
3. What can be done to help people to introduce data, and to interact with the Web page in a bi-directional mode. Downloaded HTML pages will be in the client side. This pages will be interpreted by the Web browser with the voice plug-in built in it- and read. The user will be able to decide whether it want or not voice help simply by clicking in a box.
Milestones:
- A manual for the Web interpretation, information extraction and requirements for visually impaired people;
- Manual with the requirements of Web design tools for visually impaired people;
- Web design tool using voice;
- A multilingual European e-learning portal using voice;
- Creation of a VISUAL certificate of accessibility;
- Exploitation and dissemination of the results;
- Revision of the project after one year.
Objectives:
The goal of this project, VISUAL, is to develop voice based technology in order to improve the access of visually impaired people to the information society. VISUAL in-tends to provide a system for designing web sites entirely accessible to visually impaired people. VISUAL will lead to designs in which interaction will be accomplished as by means of speech as by a keypad, and it would let different classes of impaired people access a Web page not only visually, but also by means of voice.
The main objectives of the project are:
1. To facilitate to visually impaired people both the access to Internet and the design of accessible pages;
2. To provide to the Web developers with a tool which facilitates the creation of accessible pages (both in the accomplishment of the specifications and in the integration of spoken navigation). The authoring tool could be ultimately integrated in any existing well-known Web authoring package or at least be compatible;
3. To integrate speech in the navigation as an alternative form for inter-action. What travels via Web are light text documents which are interpreted by the client;
4. Development of an accessible portal (which can be browsed by means of speech and with contents stored in Voice XML documents).
Work description:
Work is divided into supportive/horizontal and technical/scientific work packages (WP). The Consortium's members have designed the project into 7 workpackages to divide the complexity of the work appropriately. Each workpackage have a verifiable end-point. Technical work is dedicated to the development of VISUAL tool and e-learning portal. After a first analysis and definition of test scenarios, existing data, and documents together with a risk analysis, the work will concentrate on the development of the following modules:
WP1 user requirements of accessibility and web authoring tool;
WP2 plugging for speech recognition and synthesis integration;
WP3 tool development;
WP4 creation of an accessible learning portal;
WP5 evaluation;
WP6 dissemination, standardization and exploitation;
WP7 project management.
A first effort in Work package 3 (Tool Development) will be dedicated to purely technical work and will start before the end of workpackages 1 and 2 (User requirements, and integration of plug-ins). However, the result of those workpackages is necessary in order to complete the objectives. After the initial workpackages, it is expected to have defined what is necessary to ex-press in Voice XML about a page.
It must be described:
1. What kind of help is really important to provide to a visually impaired person in order to improve his Web navigation;
2. What kind of descriptions must be supplied with the page to described properly general description of the page, images, videos, frames, Macromedia Flash animations, backgrounds, and so on;
3. What can be done to help people to introduce data, and to interact with the Web page in a bi-directional mode. Downloaded HTML pages will be in the client side. This pages will be interpreted by the Web browser with the voice plug-in built in it- and read. The user will be able to decide whether it want or not voice help simply by clicking in a box.
Milestones:
- A manual for the Web interpretation, information extraction and requirements for visually impaired people;
- Manual with the requirements of Web design tools for visually impaired people;
- Web design tool using voice;
- A multilingual European e-learning portal using voice;
- Creation of a VISUAL certificate of accessibility;
- Exploitation and dissemination of the results;
- Revision of the project after one year.
Proyectos
Virtual Signing: Capture, Animation, Storage & Transmission
11 Enero 2003
ViSiCAST will develop and evaluate Virtual Humans generating European deaf sign languages.
ViSiCAST builds on SignAnim, which received two UK Royal Television Society awards for technical innovation in 1998. An English language analysis or speech recognition system drives a virtual human using data captured directly from human signers. SignAnim demonstrated that a virtual human is a valid alternative to video and could run semi-automatically.
ViSiCAST will extend this work in three areas:
(1) In television. Sub-titles help hard-of-hearing people who can read easily. The virtual signer will improve access for those who sign as a first language.
(2) For Web and multi-media. Improved control over signed multi-media generation and delivery will increase the independence of deaf people using the Internet for communication and learning.
(3) In face-to-face transactions. It will improve communication between a deaf customer and a service provider.
Objectives:
ViSiCAST will develop, evaluate and apply realistic Virtual Humans (avatars), generating European deaf sign languages. The project will develop systems for the generation, storage and transmission of Virtual Signing Systems. It will develop user-friendly methods to capture signs where appropriate. It will also develop a machine-readable system to describe sign-language gestures (hand, face and body), which can be used to retrieve stored gestures or to build them from low-level motion components. It will use this descriptive language to develop translation tools from speech and text to sign. By building applications for the signing system in television, multi-media, Web and face-to-face transactions, VisiCAST will improve the position of Europe's deaf citizens, their access to public services and entertainment, and enable them to develop and consume their own multi-media content for communication, leisure and learning.
Work description:
A key result in the first year will be a live signing system for television using a virtual human according to a new standard transmission format, trials of face-to-face communication with deaf subjects and initial web-based tools. In the second year the project will deliver an ambitious prototype text-to-signing tool and an avatar driven from HamNoSys. Key third year results include a face-to-face dialogue system, and a semi-automatic translator from text to signing implemented within a web browser.
A key result in year 1 will be live a signing system for TV using a virtual human according to a new standard transmission format, trials of face-to-face communication with deaf subjects and initial web-based tools.
Year 2 will deliver an ambitious prototype text-to-signing tool and an avatar driven from HamNoSys.
Key year 3 results include a face-to-face dialogue system, a semi-automatic translator from text to signing implemented within a web browser.
ViSiCAST will extend this work in three areas:
(1) In television. Sub-titles help hard-of-hearing people who can read easily. The virtual signer will improve access for those who sign as a first language.
(2) For Web and multi-media. Improved control over signed multi-media generation and delivery will increase the independence of deaf people using the Internet for communication and learning.
(3) In face-to-face transactions. It will improve communication between a deaf customer and a service provider.
Objectives:
ViSiCAST will develop, evaluate and apply realistic Virtual Humans (avatars), generating European deaf sign languages. The project will develop systems for the generation, storage and transmission of Virtual Signing Systems. It will develop user-friendly methods to capture signs where appropriate. It will also develop a machine-readable system to describe sign-language gestures (hand, face and body), which can be used to retrieve stored gestures or to build them from low-level motion components. It will use this descriptive language to develop translation tools from speech and text to sign. By building applications for the signing system in television, multi-media, Web and face-to-face transactions, VisiCAST will improve the position of Europe's deaf citizens, their access to public services and entertainment, and enable them to develop and consume their own multi-media content for communication, leisure and learning.
Work description:
A key result in the first year will be a live signing system for television using a virtual human according to a new standard transmission format, trials of face-to-face communication with deaf subjects and initial web-based tools. In the second year the project will deliver an ambitious prototype text-to-signing tool and an avatar driven from HamNoSys. Key third year results include a face-to-face dialogue system, and a semi-automatic translator from text to signing implemented within a web browser.
A key result in year 1 will be live a signing system for TV using a virtual human according to a new standard transmission format, trials of face-to-face communication with deaf subjects and initial web-based tools.
Year 2 will deliver an ambitious prototype text-to-signing tool and an avatar driven from HamNoSys.
Key year 3 results include a face-to-face dialogue system, a semi-automatic translator from text to signing implemented within a web browser.