Multimedia & Vision Projects

SAFESHORE

Advanced automated human emotion-sensing for business

The Sensing Feeling project will create new technological capability that will significantly enhance the reliability and effectiveness of monitoring retail customer emotional responses to their surrounding environment. By combining current knowledge in retail environmental psychology with advanced techniques in affective computing and computer vision the project aims to develop sensing technology that when deployed into a physical retail setting will enable the retailer to derive a live and continuous feed of a well-defined "customer delight index" of the retail space being sensed. This will be achieved by detection and aggregation of the multi-modal affective (emotional) states of shoppers' interaction behaviours expressed within the retail setting. The aim is to provide retailers with the ability to unobtrusively and automatically derive a reliable measure of the emotional state of shoppers in response to in-store variables like products displayed, merchandising design, layout design, signage, atmospherics, staff dynamics etc. This will equip retailers with a smarter ability to make informed decisions that accelerate the provision of higher quality in-store customer experiences.

  1. Website: http://sensingfeeling.com/
  2. Principal investigator: Dr Yiannis Patras
  3. Consortium: 6 partners from industry and academia
SAFESHORE

Bringing maritime border security to new dimension

The mission of the SafeShore project is to tackle existing problems and gaps in coastal border surveillance by developing a system for detection of Remotely Piloted Aircraft Systems (RPAS) using state-of-the-art, low cost, and low-emission technology. The system will be integrated with existing systems and create a continuous detection line along the border to help border officials in preventing crime such trafficking of human beings and smuggling of drugs.

  1. Website: http://SafeShore.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Consortium: 11 partners from industry and academia
COGNITUS

Covering broadcast and user generated content for interactive UHD services

The COGNITUS project aims to combine the advances in UHD broadcasting technologies with the explosion of UGC in order to create new interactive, immersive modes of production. Running from January 2016 to December 2018, COGNITUS is a joint research project comprising eight European participants, led by BBC R&D. The project is intended to optimise how UHD content is produced and distributed, by capitalising upon the knowledge of professional producers, the ubiquity of UGC and the power of interactive networked social creativity.

  1. Website: http://cognitus-h2020.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Consortium: 7 partners from industry and academia
PROVISION

Creating a 'Visually' Better Tomorrow

PROVISION is a network of leading academic and industrial organisations in Europe comprising of international researchers working on the problems plaguing most video coding technologies of the day. The ultimate goal is to make noteworthy technical advances and further improvements to the existing state-of-the-art techniques of compression video material.

The project shall not only aim to enhance broadcast and on-demand video material, but also produce a new generation of scientists equipped with research and soft skills needed by industry, academia and society by large. In line with the principles laid down by Marie Sk?odowska-Curie actions of the European Commission, PROVISION is a great example of an ensemble of researchers with varied geographical and academic backgrounds all channelling their joint effort towards creating a technologically, or more specifically a 'visually' better tomorrow.

  1. Website: http://www.provision-itn.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Consortium: 11 partners from industry and academia
EcoPix

Eco-Friendly Digital Advertising Display Based on Novel Printable Electrochromic Polymers

ECOPIX aims to improve SME partner competitiveness by developing an innovative digital display technology which provides a more cost-effective and environmentally friendly alternative to traditional paper billboards and existing digital billboards.

ECOPIX will develop the technology to enable addressable electrochromic colour pixels to be printed onto light-weight and flexible plastic sheets, using standard printing methods, to deliver a low-power, light weight, digital colour display, for the high growth "out-of-home" advertising sector.

Electrochromic (EC) materials can switch between any colour and a transparent (or dark) state in a graduated manner via an electron-transfer (red-ox) reaction controlled by the applied voltage.

One of the many advantages of EC materials is that only a small electrical charge is required to select and retain the colour state. Commercial EC applications include smart windows, sunglasses and visors with adjustable light transmission and auto-dimming car rear-view mirrors (mirrors with adjustable reflectivity) and displays.

  1. Website: http://www.ecopix.eu/
  2. Principal investigator: Dr. Qianni Zhang
  3. Start date: 10/07/2014
  4. End date: 09/07/2017
  5. Total project value: € 1,000,000
  6. QMUL funding: 300,000
  7. Duration: 36 months
  8. Funded by: EU FP7
  9. Consortium: 8 partners from industry and academia
THIRA

Enabling Technologies for High Resolution Content Exchange and Delivery

THIRA is a collaborative project led by the BBC and co-funded by the Technology Strategy Board which addresses usage of larger resolution video formats. Recent advances in video capturing and display technologies provide audiences with higher spatial and temporal resolution content. After High Definition (HD), nowadays Ultra High Definition (UHD) aims to further improve users' quality-of-experience at the cost of increased storage capacity and bandwidth. Ultra high definition targets two formats with 16:9 aspect ratio: the first has twice the width of HD while the second has four times the width of HD. To properly handle the data rates associate to UHD content, the H.265/High Efficiency Video Coding (H.265/HEVC) standard will be mainly used. H.265/HEVC is the newly ratified video compression standard developed by both ITU VCEG and ISO/IEC MPEG in a joint partnership called the Joint Collaborative Team on Video Coding (JCT-VC). HEVC results from a joint VCEG and MPEG call for proposals on compression technology able to achieve the same perceived quality of the H.264/AVC standard by halving the required bitrate. The H.265/HEVC standard provides a base for handling ultra high resolution content. Underpinning the capabilities of HEVC are computationally expensive, extremely complex and resource demanding algorithms. Consequently, in its current state, H.265/HEVC is unfeasible for practical applications involving very high definition content. THIRA aims to facilitate storage and transmission of the huge amounts of data contained in very high resolution content using the H.265/HEVC standard.

  1. Website: http://thira.ch.bbc.co.uk/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 01/11/2013
  4. End date: 31/10/2015
  5. Total project value: £ 500,000
  6. QMUL funding: £ 115,000
  7. Duration: 24 months
  8. Funded by: EPSRC, BBC
  9. Consortium: 3 partners from industry and academia
EMC2

Excellence in Media Computing and Communication.

EMC² promotes the entrepreneurial spirit within academia, research centres and individuals with the goal of facilitating start-ups take off and transfer of cutting-edge technology from research labs to the market place. With its associated members, EMC² provides mentoring for start-ups, it provides technical infrastructure to enable quick response to market challenges and opportunities and it coaches web entrepreneurs in the EMC² fields.

  1. Website: http://www.emc-square.org/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 01/01/2010
  4. End date: 30/12/2020
  5. Total project value: € 1,500,000
  6. QMUL funding: 213,000
  7. Duration: 42 months
  8. Funded by: EU FP7
  9. Consortium: 7 partners
LASIE-logo

Large Scale Information Exploitation of Forensic Data

The LASIE project aims to design and implement an open and expandable framework that will significantly increase the efficiency of current investigation practices, by providing an automated initial analysis of the vast amounts of heterogeneous forensic data that analysts have to cope with. The framework will be able to handle forensic data that have been acquired from a variety of different sources including CCTV surveillance content, confiscated desktops and hard disks, mobile devices, Internet, social networks, handwritten and calligraphic documents.

  1. Website: http://www.lasie-project.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 01/05/2014
  4. End date: 30/11/2017
  5. Total project value: £ 8,323,806
  6. QMUL funding: £ 801,200
  7. Duration: 42 months
  8. Funded by: EU FP7
  9. Consortium: 18 partners
Being There

Humans & Robots in Public Spaces

The Being There project brings together five teams of researchers from the Universities of Exeter, Bath, Oxford, Queen Mary University of London (QMUL) and the Bristol Robotics Laboratory (BRL). The research teams are examining how one might preserve privacy, encourage trust in human-robot communication and the implications of using a robot to stand in for the physical presence of a human. The Affective and Human Computing team at QMUL is looking into creating technology to understand the human nonverbal behaviours and emotional expressions in human-robot interaction setting and advancing this technology for public spaces where people will be interacting both with robots and with other people.

  1. Website: http://being-there.org.uk/
  2. Principal investigator: Dr Hatice Gunes
  3. Start date: 01/10/2013
  4. End date: 30/09/2016
  5. Total project value: £ 2,000,000
  6. QMUL funding: £ 200,000
  7. Duration: 36 months
  8. Funded by: EPSRC
  9. Consortium: 6 partners
CONECTA 2020

Cooperation and Networking between Latin America, the Caribbean & Europe to Coordinate Research Opportunities around ICT & Horizon 2020 Challenges via Technology Platforms

CONECTA 2020 is a project funded by the Seventh Framework Programme (FP7) of the European Union, searching the implementation of the Technology Platforms (LATPs) of Uruguay, Costa Rica and Peru, as well as the development of an online community focused on the entailment of organizations dedicated to the use of Information and Communication Technologies (ICT), to foster entrepreneurship and innovation in the European Union and Latin America.

  1. Website: http://www.conecta2020.eu
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 01/03/2014
  4. End date: 28/02/2016
  5. Total project value: £ 799,000
  6. QMUL funding: £ 67,410
  7. Duration: 24 months
  8. Funded by: EU FP7
  9. Consortium: 9 partners
VideoSense

Virtual Centre of Excellence for Ethically-Guided and Privacy-Respecting Video Analytics

VideoSense will integrate leading European research groups to create a long term open integration of critical mass in the twin areas of Ethically-Guided and Privacy Preserving Video Analytics where the advent of new data intelligence technologies against the background of dynamic societal and citizen’s goals, norms, expectations, safety and security needs and thus surveillance requirements have all contributed to a complex interplay of influences which deserve in-depth study and solution seeking in order for the European society, citizen and industry to strike the optimal balance in resolution of the various challenges in this arena.

  1. Website: http://www.videosense.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 01/05/2011
  4. End date: 30/04/2015
  5. Total project value: € 5,282,366
  6. QMUL funding: 638,984
  7. Duration: 48 months
  8. Funded by: EU FP7
  9. Consortium: 8 partners
Reverie

Real and Virtual Engagement in Realistic Immersive Environments

With REVERIE, we believe that the time is ripe to push social networking towards the next logical step in its evolution: to immersive collaborative environments that support realistic inter-personal communication. REVERIE will introduce a new paradigm for how communication happens in social networks by adding to the realism of immersive 3D virtual worlds. It behoves us to consider the impact of this on end users. As with any new technology, understanding how users will apply it, the benefits it brings them and other associated sociological considerations (e.g. legal, ethical) will be key to ensuring its success, and thus investigated in detail within the project.

  1. Website: http://www.reveriefp7.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 01/09/2011
  4. End date: 31/05/2015
  5. Total project value: € 10,000,000
  6. QMUL funding: 1,100,000
  7. Duration: 45 months
  8. Funded by: EU FP7
  9. Consortium: 16 partners from industry and academia
ADVISE

Avanced Video Surveillance archives search Engine for security applications

ADVISE aims to design and develop a unification framework for surveillance-footage archive systems, in an effort to deal with the increasingly critical need to provide automated and smart surveillance solutions. The ADVISE project results will ease the work of law enforcement authorities in their fight against crime and terrorism, through negotiation of all relevant legal, ethical and privacy constraints, and through location based video archive selection and efficient evidence mining of multiple, heterogeneous video archives.

  1. Website: http://www.advise-project.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 01/03/2012
  4. End date: 28/02/2015
  5. Total project value: £ 2,989,762
  6. QMUL funding: £ 443,080
  7. Duration: 36 months
  8. Funded by: EU FP7
  9. Consortium: 10 partners
maptraits

Machine Analysis of Personality Traits in Human-Virtual Character Interactions

MAPTRAITS is a research project designed and developed by Dr Hatice Gunes (Principal Investigator), Dr Oya Celiktutan (Postdoc) and Evangelos Sariyanidi (PhD Student) in the School of Electronic Engineering and Computer Science at Queen Mary University of London. The project has been funded by the Engineering and Physical Sciences Research Council (EPSRC) under their First Grant Scheme in the period of September 2013 - December 2014.

  1. Website: http://maptraits.wordpress.com/
  2. Principal investigator: Dr Hatice Gunes
  3. Start date: 01/09/2013
  4. End date: 31/12/2014
  5. Total project value: £ 2,000,000
  6. QMUL funding: £ 123,000
  7. Duration: 16 months
  8. Funded by: EPSRC
  9. Consortium: 6 partners


AC4MobHCI

Affective Computing for Mobile HCI Workshop

Affective Computing for Mobile HCI workshop aims to bring together researchers and industry people from relevant yet diverse research fields of Affective Computing, Human-Computer Interaction (HCI), and Mobile Computing to discuss the issues and the challenges pertinent in these fields, define future module and course design directions and teaching strategies for making affective computing tangible for university students and companies in mobile and telecommunications industry.

  1. Website: www.ac4mobhci2012.itu.edu.tr/
  2. Principal investigator: Dr Hatice Gunes
  3. Start date: 17/09/2012
  4. End date: 18/09/2012
  5. Total project value: £ 50,000
  6. QMUL funding: £ 25,000
  7. Duration: 1 month
  8. Funded by: British Council
  9. Consortium: 2 partners
CUbRIK

Human-enhanced Time-aware Multimedia Search

The key technical principle of CUBrIK is to create a white-box version of a multimedia content and query processing system, by unbundling its functionality into a set of search processing pipelines, i.e., orchestrations of open source and third-party components instantiating current algorithms for multimedia content analysis, query processing, and relevance feedback evaluation. Examples will be pipelines for extracting metadata from media collections using the software mix that best fits application requirements, for processing multimodal queries, and for analysing users feedback in novel ways. CUBrIK aims at constructing an open platform for multimedia search practitioners, researchers and end-users, where different classes of contributors can meet and advance the state-of-the-art by joining forces.

  1. Website: http://www.cubrikproject.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 01/10/2011
  4. End date: 30/09/2014
  5. Total project value: € 8,900,000
  6. QMUL funding: 430,000
  7. Duration: 36 months
  8. Funded by: EU FP7
  9. Consortium: 15 partners from both industry and academia
3DLife

Bringing the 3D Internet to Life

3DLife aims at stimulating joint research and integrating leading European research groups to create a long-term integration of critical mass for innovation of currently fragmented research addressing media Internet. It will foster the creation of sustainable and long-term relationships between existing national research groups and lay the foundations for a Virtual Centre of Excellence (VCE) in media Internet.

  1. Website: http://cordis.europa.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 01/01/2010
  4. End date: 30/06/2013
  5. Total project value: € 10,000,000
  6. QMUL funding: 1,050,280
  7. Duration: 42 months
  8. Funded by: EU FP7
  9. Consortium: 6 academic partners
MISSA

More Integrated Systems Safety Assessment

The increase of aerospace systems complexity has meant that by using existing methods for systems development, industry has reached a barrier to innovation and a risk to the competitiveness of products. This is characterised by an increasing time to market for new technologies, increasing costs to demonstrate proof of safety, a greater demand for skilled resources and a limitation on design iterations, which means there is less time to optimise designs that are compliant with safety targets. MISSA aims at filling this gap and providing methods and infrastructure that accelerate the convergence toward optimal system architecture that integrate safety constrains.

  1. Website: http://www.missa-fp7.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 01/04/2008
  4. End date: 31/03/2011
  5. Total project value: € 4,000,000
  6. QMUL funding: 391,000
  7. Duration: 36 months
  8. Funded by: EU FP7
  9. Consortium: 2 academic and 11 industrial partners
PetaMedia

Peer-to-Peer Tagged Media

The goal of Petamedia is to bring togheter strong academic groups to build an European network of excellence in order to achieve larger momentum, to integrate available resources, and to further develop complementary expertise. All of this is necessary for pushing new paradigms in enabling efficient and effective access to multimedia content in emerging network structures. The collective research effort that thus comes available will be directed towards integration of existing multimedia content analysis (MCA) and social and peer-to-peer (SP2P) technologies, and towards identification and exploration of potentials and limitations of MCA/SP2P combinations.

  1. Website: http://www.petamedia.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 01/04/2007
  4. End date: 31/10/2011
  5. Total project value: € 3,640,000
  6. QMUL funding: 806,000
  7. Duration: 42 months
  8. Funded by: EU FP7
  9. Consortium: 4 academic partners
Papyrus

Cultural and historical digital libraries dynamically mined from news archives

Past and existing efforts for digital recapturing and preservation of European cultural and scientific heritage have consumed significant effort and resources for the digitisation, characterisation, and classification of content. Digital libraries have thus emerged providing electronic access for many communities of users to available information of their discipline. What has never been targeted, however, is a digital library that draws content from one domain and makes it available to the users of another. Papyrus approaches this need by introducing the concept of a Cross-Discipline Digital Library Engine. The project intends to be a dynamic digital library which will understand user queries in the context of a specific discipline, look for content in a domain alien to that discipline and return the results presented in a way useful and comprehensive to the user.

  1. Website: http://www.ict-papyrus.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 06/03/2008
  4. End date: 21/01/2011
  5. Total project value: € 2,200,000
  6. QMUL funding: 286,000
  7. Duration: 30 months
  8. Funded by: EU FP7
  9. Consortium: 9 academic partners
Rushes

Retrieval of mUltimedia Semantic units for enHanced rEuSability

The overall aim of RUSHES is to design, implement, validate and trial a system for delivery of and access to raw media material (rushes), as well as its reuse in the production of new multimedia assets.

  1. Website: http://cordis.europa.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 01/02/2007
  4. End date: 15/09/2009
  5. Total project value: € 4,550,000
  6. QMUL funding: 391,000
  7. Duration: 30 months
  8. Funded by: EU FP7
  9. Consortium: 3 academic and 6 industrial partners
mesh

An innovative platform for rapid and effective access and delivery of news

Past and existing efforts for digital recapturing and preservation of European cultural and scientific heritage have consumed significant effort and resources for the digitisation, characterisation, and classification of content. Digital libraries have thus emerged providing electronic access for many communities of users to available information of their discipline. What has never been targeted, however, is a digital library that draws content from one domain and makes it available to the users of another. Papyrus approaches this need by introducing the concept of a Cross-Discipline Digital Library Engine. The project intends to be a dynamic digital library which will understand user queries in the context of a specific discipline, look for content in a domain alien to that discipline and return the results presented in a way useful and comprehensive to the user.

  1. Website: http://www.mesh-ip.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 01/03/2006
  4. End date: 28/02/2009
  5. Total project value: € 15,000,000
  6. QMUL funding: 840,000
  7. Duration: 36 months
  8. Funded by: EU FP7
  9. Consortium: 9 academic partners
K-Space

Knowledge Space of semantic inference for automatic annotation and retrieval of multimedia content

K-Space integrates leading European research teams to create a Network of Excellence in semantic inference for semi-automatic annotation and retrieval of multimedia content. The aim is to narrow the gap between content descriptors that can be computed automatically by current machines and algorithms, and the richness and subjectivity of semantics in high-level human interpretations of audiovisual media: The Semantic Gap.

  1. Website: http://cordis.europa.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 01/01/2006
  4. End date: 31/12/2008
  5. Total project value: € 5,500,000
  6. QMUL funding: 710,000
  7. Duration: 36 months
  8. Funded by: EU FP7
  9. Consortium: 13 academic and 1 industrial partners
aceMedia

Integrating knowledge, semantics and content for user-centred intelligent media services

aceMedia focuses on generating value and benefits to end users, content providers, network operators, and multimedia equipment manufacturers, by introducing, developing and implementing a system based on an innovative concept of knowledge assisted, adaptive multimedia content management, addressing user needs.

  1. Website: http://cordis.europa.eu/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 2004
  4. End date: 2007
  5. Total project value: € 16,000,000
  6. QMUL funding: 509,102
  7. Duration: 36 months
  8. Funded by: EU FP7
  9. Consortium: 5 academic and 10 industrial partners
busman

Bringing User Satisfaction to Media Access Networks

BUSMAN's overall aim is to design, implement, validate, and trial a secure and efficient system for both delivery of and access to multimedia content, and for creation of and querying large and distributed multimedia databases. Management and delivery across mobile, fixed and distributed networks are considered in order to facilitate cross-media content access.

  1. Website: http://mmv.eecs.qmul.ac.uk
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 2002
  4. End date: 2004
  5. Total project value: € 3,874,000
  6. QMUL funding: 423,000
  7. Duration: 24 months
  8. Funded by: EU FP7
  9. Consortium: 5 academic and 10 industrial partners
COST292

Semantic Multimodal Analysis of Digital Media

The main objective of COST 292 is to push forward the frontiers of current research on semantic analysis, inference and conceptualisation for high-level annotation and retrieval of digital audiovisual content.

  1. Website: http://mmv.eecs.qmul.ac.uk/
  2. Principal investigator: Prof. Ebroul Izquierdo
  3. Start date: 2004
  4. End date: 2008
  5. Duration: 48 months
  6. Funded by: European Science Foundation
  7. Consortium: 4 academic and 4 industrial partners