Keynote Speech I

The Internet of Things – A New Frontier of Multimedia Research

Kien A. Hua
Department of Computer Science, University of Central Florida

ABSTRACT The Internet of things (IoT) with 34 billion connected devices by 2020 will generate more ‘big data’ than ever. While Cloud Computing has been a viable solution for processing and analyzing very large volumes of data, dealing with billions of live data sources continuously feeding from all “corners” of the Internet would make it a serious bottleneck for IoT analytics in the cloud. In particular, on-demand video streaming already takes up 70% of Internet traffic. Non-stop streaming of IoT data will add substantially more stress on the Internet if IoT applications are not deployed responsibly. In this presentation, we discuss potential solutions for this emerging challenge as video streaming and IoT streaming coalesce. We re-examine conventional wisdom in network design and consider a new concept called traffic deduplication. We present a Deduplication Overlay Network (DON) that shows congestion can surprisingly be turned into advantage. Another great IoT challenge is due to ‘thing’ heterogeneity (i.e., the diversity of cameras and sensors) and a new computation model is needed for heterogeneous data stream processing. We discuss this capability in an IoT architecture based on a Boolean abstraction. A Boolean query-processing framework is also presented as a potential standard approach for applications to share IoT infrastructure. These features are part of ThingStore, an online ecosystem for development and deployment of IoT applications. While an IoT environment fusing human and machine intelligence opens up a host of new opportunities, the human teams may be overwhelmed trying to keep up with massive amount of real-time information. This calls for new communication and collaboration tools to enable the human teams to deal with information overload in real-time decision making. Tabletop, a virtual multimedia conferencing system, is one such environment to support teamwork in an IoT-enabled human-cyber workplace. The team members can not only share and discuss multimedia information, but also co-operate on IoT devices as they collaborate. A short video will be presented to demonstrate this Tabletop system.

BIOSKETCH Dr. Kien A. Hua is a Pegasus Professor and Director of the Data Systems Lab at the University of Central Florida. He was the Associate Dean for Research of the College of Engineering and Computer Science at UCF. Prior to joining the university, he was a Lead Architect at IBM Mid-Hudson Laboratory, where he led a team of senior engineers to develop a highly parallel computer system, the precursor to the highly successful commercial parallel computer known as SP2. More recently, Prof. Hua was serving as a domain expert on spaceport technology at NASA, and a data analytics expert to advise the U.S. Air Force on the Air Force Strategy 2030 Initiative.

Prof. Hua received his B.S. in Computer Science, and M.S. and Ph.D. in Electrical Engineering, all from the University of Illinois at Urbana-Champaign, USA. His diverse expertise includes image/video computing, network and wireless communications, Internet of Things, machine learning, medical imaging, mobile computing, sensor networks, and intelligent transportation systems. He has published widely with 14 papers recognized as best/top papers at conferences and a journal. Many of his research have had significant impact. His paper on Chaining technique began the peer-to-peer data sharing and video streaming revolution. His Skyscraper Broadcasting, Patching, and Zigzag techniques have each been heavily cited in the literature, and have inspired many commercial systems in use today.

Prof. Hua has served as a Conference Chair, an Associate Chair, and a Technical Program Committee Member of numerous international conferences, and on the editorial boards of several professional journals. More recently, he served as a General Co-Chair for the 2014 ACM Multimedia conference and the 2018 IEEE International Conference on Cloud Engineering (IC2E). Prof. Hua is a Fellow of IEEE.

Keynote Speech II

Breaking The Glass Wall Between Users And Computers

Max Mühlhäuser
Telecooperation, Technische Universität Darmstadt

ABSTRACT The introduction of IBM’s “Computer Terminal” 3270 and later of the VT100 by Digital Equipment in the 1970es triggered the wide-spread use of display-centric human computer interaction. The touch screens used in billions of smartphones and tablets worldwide bear witness of the latest and most ubiquitous phase of this era – will this be the last globally resounding success of computer displays? The main reason why this era will sooner or later be superseded is the fact that displays erect a glass wall between users and the information (as well as apps) they are coping with – may it be multimedia content or other data of all sorts.

But how can that glass wall be broken? Which are the promising technologies for the“era after the glass wall era” and what is their state of the affairs? Which interaction concepts, metaphors, and concrete user interface elements do these alternative technologies suggest?Which parts are still missing — or must be further advanced before we can finally say good-bye to the glass wall? Are there additional challenges beyond those pertaining toHuman Computer Interaction that must be addressed? After revisiting the main stages of the “glass wall era”, the talk will attempt to answer these questions.

BIOSKETCH Prof. Dr. Max Mühlhäuser is head of Telecooperation Lab at Technische Universität Darmstadt. He is the spokesperson of the Research Training Group (Doctoral School) on “Privacy and Trust for Mobile Users” and acts as a deputy spokesperson of the National Collaborative Research Center on Multi-Mechanisms Adaptation for the Future Internet. Further, he serves as a PI in the Center for Research in Security and Privacy (CRISP) and runs numerous projects funded by national agencies, the EU, and industry. He served as Dean of the Informatics Department twice.

Together with about 35 team members, he conducts research in four domains of computer science as follows. (1) Computer Networks and Distributed Systems – e.g., edge computing; software defined and big networks. (2) Human Computer Interaction – e.g., novel interaction concepts for 3D-printed personalized devices; immersive and on-body-interaction; novel augmented and mobile-interaction technology; electronic tables and walls. (3) Cybersecurity, Privacy and Trust – e.g., assessment measures for IT security and QoS settings based on computational trust; privacy for mobile and for smart meter networks; damage/attack resilience for critical infrastructures. (4) Proactive Intelligent Environments – e.g., for augmented humans and teams, business processes, and cyberphysical systems.

Following his PhD in Karlsruhe in 1986, Prof. Mühlhäuser was the founder and head of an industrial research center. He worked as either professor or visiting professor at universities in Germany, the US, Canada, Australia, France, and Austria. He published more than 500 articles, books, and book chapters. He was appointed Adjunct Professor at QUT Brisbane in 2012 and is a member of acatech, the German National Academy of Science and Engineering, since 2015.

Keynote Speech III

The ‘u’ in Multimedia stands for humans

Dick Bulterman,
Vrije Universiteit Amsterdam and Fellow, CWI Amsterdam

ABSTRACT During the past half-decade, the study of multimedia has slowly transformed from creating, storing, transporting and rendering multiple media objects to analyzing the content of (mostly) visual objects. In this process, intelligence has migrated to machines and the human creator/compiler/manipulator and viewer of media content has become largely irrelevant. Although media content often contains encapsulated human emotion, it is now studied as if it contained only inanimate objects. It is time to bring the human back in the multimedia loop.

This talk will present an overview of the role of the human in creating, storing, selecting and consuming media. In each of these areas, we look at what human intelligence can add to the process of creating and consuming engaging experiences. We also consider the role of machines that can learn to adapt some of these tasks.

Taking examples from several aspects of media processing, the talk will provide a forward-looking overview of where we’ve come from and where we are likely to be going in the creation and consumption of media experiences in the next decade.

BIOSKETCH Dick Bulterman is a member of the faculty of the department of computer science at the Vrije Universiteit (VU) in Amsterdam, The Netherlands. He is also a Fellow at Centrum Wiskunde en Informatica (CWI), also in Amsterdam, where he has worked on multimedia systems, languages and user interfaces for more than thirty years. Prof. Bulterman was President and CEO of the FX Palo Alto Laboratory (FXPAL) in California from 2013-2016 and CEO of Oratrix Development from 1998-2002.

Bulterman’s main research interests include the development of declarative multimedia languages (leading to the development of W3C’s SMIL standard for temporal control of XML content) and the development of user agents that can flexibly and interactively control the content of media presentation in a distributed context (leading to the GRiNS and Ambulant multimedia engines). He has contributed to a dozen European and national research projects, has provided fundamental contributions to hypermedia languages and has studied user behavior in creating and experiencing media content.

In addition to his work at the VU and CWI, Bulterman is chair of ACM SIGWEB. He received the ACM SIGMM Lifetime Achievement Award in 2013. He was a long-time editorial board member of ACM Transactions on Multimedia, Multimedia Systems and Multimedia Tools and Applications. He has been an organizer of conferences for major ACM and IEEE conferences in the area of multimedia and multimedia systems. He received his PhD from Brown University in Providence, RI, initially specializing in computer graphics architectures.