← Dedication Back to Book Chapter 2 →

Chapter 1: Introduction

1.1 What is HCI?

1.1.1 Defining Human-Computer Interaction

According to Preece et al. (2015) , Human-Computer Interaction (HCI) is a multifaceted discipline dedicated to studying and designing technologies that enable seamless and productive interactions between humans and computers . From a practical perspective, this means designing interfaces and systems that align with human needs, behaviors, and cognitive processes to enhance efficiency, effectiveness, and overall user experience.

1.1.2 Distinguishing HCI Research from UI/UX Design

UI/UX design and HCI research both aim to improve human-computer interaction but differ in their core focus. UI/UX design is primarily practical, creating effective interfaces that deliver good user experiences for specific users and contexts. Designers are evaluated on consumer satisfaction and business metrics rather than scientific rigor. Unlike researchers, they aren't bound by requirements for statistical significance, detailed methodology documentation, or replicable results — their success is measured by how well their solutions work for target users in real-world applications.

HCI research, while often involving interface design, aims to generate new scientific knowledge about human-computer interaction through rigorous investigation and evaluation. Novelty is typically considered essential — either through innovative designs, methodological approaches, theoretical frameworks, or empirical insights that challenge existing assumptions and expand our understanding of how humans interact with technology.

Unlike commercial products, HCI research prototypes — whether systems or interaction techniques — aren't required to be practical for mass deployment. Some published techniques may function effectively in theory or provide valuable insights, despite having significant limitations in real-world applications. This approach is not only acceptable but valued in HCI research, where knowledge generation is the primary objective. In contrast, such impracticality would typically be considered a failure in UI/UX design. This flexibility enables researchers to explore more experimental approaches, provided they advance our understanding of human-computer interaction.

This is not to say that practical considerations are unimportant in HCI research. Rather, the value of research is often judged based on the quality of its argument and the overall contribution of the insights derived from the investigation, particularly when these insights are generalizable despite technical or practical limitations of the prototypes used. For example, a Wizard of Oz study of an intelligent interface may help us understand the desirable ways in which humans want to interact with computers in futuristic scenarios. Such research can be tremendously valuable even if the system itself isn't practical to implement at the time of study. The insights gained can guide future development when technology catches up to the conceptual vision. This distinction between research and practical design becomes clearer when we examine concrete examples.

For instance, when designing a mobile app menu, a UI/UX designer would focus on creating an effective solution. They may iteratively test their proposed solutions with users until a desirable solution is reached. The resulting menu design may or may not be innovative - it could just follow traditional design principles or simply combine different features from existing approaches to create a practical implementation that meets user needs. As long as the customer likes the menu, the job is well done.

An HCI researcher approaching the same menu system faces a different challenge. Rather than simply applying established principles to create a practical solution, they must generate new knowledge about menu design. This requires developing innovative approaches that extend beyond existing paradigms. The researcher will create novel designs and conduct rigorous studies to demonstrate not only the advantages of these new designs but also the underlying principles that explain their effectiveness. Furthermore, they must employ methodologically sound research practices to ensure their findings are reliable, valid, and reproducible. The ultimate goal is to contribute validated knowledge to the field that can guide and inform future design work, advancing our collective understanding of human-computer interaction.

1.1.3 The Scope of HCI: From Narrow to Broad

As a research discipline, HCI is best defined as a problem-solving field focused on addressing empirical, conceptual, and constructive challenges in human-computer interaction ( MacKenzie, 2013 ) (we will explore these different types of contributions in detail in Chapter 2 ). Rather than being confined to a single domain like computer science or psychology, HCI research is unified by its focus on solving important problems while producing new knowledge.

The field has evolved significantly over time - from its technical origins in the 1980s through several distinct waves of development, each expanding the scope and focus of HCI research. This evolution has transformed HCI from a narrow discipline concerned with interface optimization to a broad field addressing the complex relationships between humans and technology in various contexts. We'll explore these developmental waves in greater detail in the following section.

The scope of HCI can be viewed along a spectrum from narrow to broad. At its narrowest, HCI focuses on specific interaction techniques and interface elements. In its broadest sense, it encompasses the entire ecosystem of human relationships with technology, including social, cultural, ethical, and even philosophical dimensions of these relationships. This evolution reflects a shift from viewing computers as tools to understanding them as mediators of human experience and social relationships.

This interdisciplinary nature is both a strength and a challenge. It allows HCI to address complex problems from multiple perspectives but can also make it difficult to define clear boundaries for the field. The diagram ( see Figure 1.1 ) illustrates how HCI sits at the intersection of multiple disciplines, drawing from and contributing to each.

For instance, an HCI project could involve the intersection of psychology and computer science, where researchers study the cognitive processes involved in decision-making while using a digital interface. Another project may focus on the intersection of sociology and design, where researchers examine how cultural and social norms influence the use and adoption of new technologies. This interdisciplinary approach enables deeper investigation across domains while ensuring solutions are grounded in diverse perspectives, ultimately leading to more human-centered technological innovations.

However, this interdisciplinary nature also presents significant challenges. Researchers must develop competence across multiple domains, which requires substantial time and effort. Communication barriers can arise when collaborators from different disciplines use different terminology, methodologies, and evaluation standards. Additionally, publishing interdisciplinary work can be challenging, as reviewers from different backgrounds may have conflicting expectations about what constitutes a valuable contribution.

For newcomers to HCI, this shifting focus, expanding scope, and interdisciplinary nature creates a significant challenge. The field's flexibility — spanning from narrow technical interfaces to broader societal implications — can make it difficult to grasp what exactly constitutes HCI research. When it seems to encompass "anything and everything," newcomers often struggle to find solid footing. This ambiguity makes it crucial to study the fundamentals thoroughly, such as understanding HCI as a problem-solving discipline ( Oulasvirta & Hornbæk, 2016 ). Rather than being overwhelmed by its breadth, focus first on comprehending core frameworks that define the field's boundaries and contributions. This foundation will help you navigate the seemingly endless possibilities and gradually develop the discernment needed to identify meaningful research directions amid the field's continuous evolution from narrow to broader concerns.


Figure 1.1: Adapted from
Mackay & Fayard, 1997

1.1.4 Summary: The Essence of HCI

To summarize, while the definition of Human-Computer Interaction may seem straightforward, truly understanding the field requires grasping the fundamental distinction between creating practical solutions and conducting research. HCI research goes beyond implementing functional interfaces—it demands generating new knowledge through rigorous investigation and validation. This distinction is crucial for newcomers who might otherwise conflate UI/UX design practices with HCI research requirements.

The unique position of HCI research lies in its problem-solving approach ( Oulasvirta & Hornbæk, 2016 ). While the field encompasses a seemingly broad range of topics and areas, this diversity is unified by a common purpose. Rather than being confused or overwhelmed by this apparent breadth, newcomers should focus on developing a solid understanding of what constitutes HCI research and contributions (which we'll explore more deeply in Chapter 2 ). Only with this foundation can one effectively navigate the complex landscape of HCI research. Without it, researchers may struggle to identify meaningful problems, apply appropriate methodologies, or make significant contributions to the field.

1.2 HCI's Significance Through Time

In the previous section, we established what HCI research is, and discussed HCI's distinction from UI/UX design, its expanding scope from narrow to broad concerns, and its interdisciplinary nature that spans multiple domains. We also briefly touched on how the field's focus has changed over time. Let's now dive deeper into this historical evolution (see Figure 1.2 ). By examining how HCI has developed through different waves and paradigms, we can better appreciate why the field has such a broad scope today and how its fundamental concerns have shifted. This historical perspective helps newcomers recognize that HCI isn't just about solving today's interaction problems, but about understanding the ongoing relationship between humans and technology that continues to evolve.

Figure 1.2: Co-evolution of humans and our tools

The history of HCI research can be traced back to the mid-20th century when early computers were developed. During this time, the focus was on developing and improving the technical aspects of computing, with little attention paid to how people would interact with these machines. It was not until the 1970s that the importance of understanding human-computer interaction began to be recognized. The introduction of the Graphical User Interface (GUI) in the 1970s serves as a landmark example. It democratized computer usage by transitioning from the traditional text-based command line interface to a visually intuitive system, bolstered by the integration of the mouse. This evolution transformed the personal computer from a complex tool into an indispensable component of everyday life. Researchers such as Stuart Card, Thomas Moran, and Allen Newell, working at the Xerox Palo Alto Research Center (PARC), began to develop methods for studying user behavior and cognitive processes when interacting with computers. Their work culminated in the publication of "The Psychology of Human-Computer Interaction" in 1983 ( Card et al., 1983 ), which remains a seminal work in the field.

The 1980s and 1990s saw a significant expansion of HCI research, with the development of new methodologies and the establishment of academic programs dedicated to the field. Researchers such as Donald Norman, Ben Shneiderman, and Jakob Nielsen made significant contributions to the field during this time. One of the most influential works in HCI research during this period was Norman's "The Design of Everyday Things" ( Norman, 1988 ). In this book, Norman introduced the concept of "affordances," which refers to the properties of an object that suggest how it should be used. This concept has since become a cornerstone of user-centered design, emphasizing the importance of designing products with the user in mind. Another significant contribution to the field during this time was "Designing the User Interface" ( Shneiderman, 1987 ), which introduced the concept of "direct manipulation" as a means of improving user interaction with digital interfaces. Direct manipulation involves allowing users to directly manipulate on-screen objects to achieve their goals, rather than relying on complex commands or programming.

As we move along in time, the advent of the mobile interaction paradigm in the 1990s revolutionized information accessibility, enabling seamless connectivity irrespective of time or place. The emergence of touch-screen smartphones in the 2000s further accelerated this trend, democratizing access to computing capabilities and making them more intuitive and user-friendly. This period also saw the rise of social media platforms, which generated unprecedented amounts of "big data" on user behavior and interaction patterns, opening new avenues for HCI research.

The field continued to evolve in response to emerging societal concerns. As technology became more pervasive, HCI researchers began examining not just how people use technology, but how technology affects society at large. This broader perspective led to the development of new subfields within HCI research, such as "value-sensitive design," ( Friedman et al., 2013 ) which focuses on creating technologies that align with human values and promote ethical practices. Similarly, as AI systems have become more prevalent, HCI researchers have turned their attention to both the opportunities and challenges these systems present. While AI-powered interfaces can enhance user experiences through personalization, they also raise important questions about privacy, security, and ethical decision-making that HCI researchers must address.

These historical developments reveal a fundamental pattern: HCI is an evolving field driven by technological breakthroughs, with each major advance in technical capabilities triggering new paradigms of human-computer interaction. The progression from command-line interfaces to GUIs, mobile computing, touch interfaces, and social media platforms all followed significant hardware and software innovations. Today, we are very likely to stand at another inflection point as wearable computing matures and AI capabilities become increasingly sophisticated, where concepts like Heads-Up Computing ( Zhao et al., 2023 ) start to emerge.

For students entering the field, this historical perspective offers several important lessons about HCI's evolving relationship with technology:

  1. Anticipating Technological Trends : Forward-looking research must anticipate emerging technologies to remain relevant as capabilities advance. This requires researchers to stay informed about developments across multiple domains — from hardware innovations to software paradigms, from AI advancements to new sensing technologies. Rather than merely responding to existing technologies, successful HCI researchers often position their work ahead of the curve, envisioning how people might interact with technologies that are still emerging. This proactive stance allows research to shape technological development rather than simply reacting to it, creating opportunities to influence how new capabilities are implemented with human needs in mind.
  1. Finding the Intersection : Revolutionary interfaces typically emerge at the intersection of new technical capabilities and human-centered design principles. The most impactful innovations in HCI history—from the GUI to touchscreens to voice interfaces—succeeded not merely because they were technically possible, but because they aligned with human cognitive abilities, physical capabilities, and social contexts. This intersection requires researchers to develop both technical expertise and deep understanding of human factors. By identifying where emerging technical capabilities can address fundamental human needs or overcome persistent interaction barriers, researchers can discover opportunities for transformative interfaces that might otherwise be overlooked.
  1. Balancing Technology's Dual Nature : Understanding technology's potential to be both constructive and destructive is critical as it becomes deeply woven into the fabric of modern life. This aspect of HCI research is frequently neglected but increasingly crucial. Technologies that enhance productivity can also enable surveillance; systems that connect people can also isolate them; interfaces that simplify tasks can also reduce agency. The history of HCI reveals that technological advances often bring unintended consequences that weren't initially apparent. As technologies become more pervasive and powerful, HCI researchers have a responsibility to consider not just whether an interface is usable or efficient, but how it might reshape social dynamics, affect psychological well-being, influence power structures, or impact marginalized communities. This requires expanding research methodologies to include ethical frameworks, participatory approaches, and longer-term impact assessments. By acknowledging technology's dual nature, researchers can work to amplify its benefits while mitigating potential harms, ensuring that technological progress serves human flourishing rather than undermining it.

This historical understanding highlights the significant responsibility HCI researchers bear in shaping not just individual interactions, but the very nature of how society engages with technology. The field's most important lesson may be the need to balance technological advancement with human-centered outcomes. By positioning research at the forefront of technological evolution while remaining grounded in human needs, behaviors, and values, HCI researchers can navigate the complexities of emerging technologies to create solutions that enhance lives, empower individuals, and contribute to the betterment of society. This balance defines HCI's critical role in our technological future.

Suggested Reading: " A Brief History of Human Computer Interaction Technology "

1.3 The HCI research process

Having established what HCI research is and explored its historical evolution, let's now examine the actual process of conducting HCI research. For newcomers to the field, understanding this process is essential because it differs significantly from other types of work you may have previously encountered. Most undergraduate studies involve problems with predetermined solutions or focus primarily on developing functional implementations that work correctly.

In contrast, the HCI research process is inherently more open-ended and unpredictable, which can be particularly challenging for those accustomed to more structured problem-solving environments. By developing a comprehensive understanding of what this process entails, you'll be better equipped to navigate its complexities and avoid common pitfalls that frequently discourage beginners. This section aims to demystify the HCI research journey, establishing realistic expectations and providing a framework that will help you approach your research with confidence and resilience.

To illustrate what working on an HCI research problem is like, consider this analogy: it resembles exploring an uncharted territory (see Figure 1.3 below), where your goal is to discover a new optimal path through previously unexplored land. Unlike following established routes with clear directions, research requires you to forge your own way through unknown terrain, making discoveries and overcoming obstacles as you progress.

Figure 1.3: Exploring an HCI research problem as venturing from known land into uncharted territory, discovering new paths through unknown challenges.

This unknown land exhibits the following characteristics:

Given such characteristics, it's no wonder many students face a hard time when starting their HCI research journey. The unknown boundaries, potential dead-ends, progressive nature of exploration, and need for careful prioritization can make the research process feel overwhelming and frustrating, especially for those new to the field.

While these challenges are inherent to the research process, there are strategies that can help navigate this complex terrain more effectively. By approaching the exploration process strategically, researchers can reduce frustration and increase their chances of success. Let's examine some key approaches that can minimize the difficulties in this journey:

These strategies represent just the beginning of what you'll need to navigate the complex terrain of HCI research. Throughout this book, we'll elaborate on these concepts and introduce additional approaches to help you become a more effective researcher. It's worth noting that many of these ideas may not fully resonate with you now — their true value often becomes apparent only after you've experienced the challenges of research firsthand. As you progress through your first few projects, you may find yourself returning to this section with new insights and appreciation.

Remember that research is inherently iterative and often messy. Even experienced researchers face setbacks and moments of uncertainty. The difference is that they've developed strategies to navigate these challenges more effectively. By approaching your research with patience, flexibility, and strategic thinking, you'll gradually build the skills needed to explore unknown territories with greater confidence.

As we transition to the next section, we'll discuss another crucial aspect of becoming an effective HCI researcher: developing the appropriate mindset, especially when transitioning from other disciplines. Whether you're coming from engineering, design, or another field entirely, understanding how to adapt your thinking to the unique demands of HCI research will be essential for your success.

1.4 Mindset and Transitions into HCI research

Transitioning into HCI research often requires a shift in mindset, especially for individuals accustomed to engineering or design roles. HCI encompasses a broader scope than implementation-driven approaches and includes a diverse range of methodologies and practices. This includes user-centered design principles, interdisciplinary collaboration, and other essential elements in the design and evaluation of interactive systems.

It is important to note that an important component of HCI research is scientific practices, which involve producing scientifically validated new knowledge. While not all HCI research follows strict scientific methods and can involve creativity, having a strong scientific mindset and practice greatly facilitates the research process. Therefore, whether you come from an engineering or design background, the most significant hurdle when transitioning into HCI research is learning the scientific method and adopting scientific practices. By embracing these principles, researchers can contribute to the advancement of knowledge in the field.

  1. Non-research Science/Engineering Jobs:

Transitioning from an engineering mindset to a HCI research one can be a challenging process due to the distinct differences in the nature of these fields. A few key aspects to this transition include:

However, doing research in Human-Computer Interaction (HCI) needs a different approach. It's not just about whether something works or not. It's also about understanding why things work or don't work. So, in HCI research, we need to think more deeply about the reasons behind everything. This deeper thinking can help us see problems in a new way and provide more generalizable findings. Below are some additional differences between engineers and HCI researchers:

Denser Theory Interaction Engineers use theory as a problem-solving tool, while HCI research employs it continuously, informing question framing, result interpretation, and conclusions. For instance, engineers use ergonomics to design comfort, while HCI researchers use it to study user-computer interaction.
Wider Task Scope Engineers focus on efficient solutions within defined tasks, measured by specific metrics. Conversely, HCI researchers consider the solution's context, user impact, and future improvements. For example, engineers optimize code in software development, while HCI researchers also consider user experience and accessibility.
Divergent Data Usage Engineers use data to validate solutions, while HCI researchers use it to generate insights about user behavior and preferences. For example, engineers use user testing data for website navigation, while HCI researchers use it to understand user navigation preference.

To facilitate a smoother transition, students from Engineering background are encouraged to learn scientific practices by reading books such as " The Craft of Research " ( Booth et al., 2009 ) or " How to think Straight about Psychology " ( Stanovich, 1992 ). These resources can provide valuable insights into developing the scientific mindset required for HCI research. Transitioning into HCI research also requires engineers to learn the different stages of research, particularly understanding that the early stages are highly uncertain and demand flexibility and adaptability. Once they grasp these principles, engineers can more successfully transition into becoming HCI researchers.

  1. Designers Without a Research Background:

While the path from an engineering background to HCI research is often steep, one might assume that individuals with a design background may find it easier, given their inherent creativity and understanding of user interfaces. However, in reality, this transition can be equally, if not more challenging, for designers. Why?

Designers are accustomed to relying heavily on their intuition and creativity to produce work. However, they may overlook the necessity within HCI research to explain the 'why' behind their choices and validate their ideas with data and evidence — a fundamental aspect of the scientific approach. This can sometimes make it more difficult for designers than engineers to adopt the scientific method.

The key for designers aiming to successfully transition into HCI researchers is to fully embrace the scientific method and effectively integrate it with their existing design practices. By doing so, they can strike a balance between their creative design process and the empirical, evidence-based approach required in HCI research.

Suggested Reading: " The Craft of Research "  " How to think Straight about Psychology "

  1. Researchers From Other Disciplines:

Researchers from fields like psychology or sociology may have a foundation in various research methodologies but be less familiar with specific technologies or HCI design principles. Transitioning into HCI research requires learning about these technologies, as well as understanding how to apply their existing research skills within the context of HCI. A cognitive psychologist with expertise in studying human memory may need to learn about the design of graphical user interfaces or the use of virtual reality for memory training. This could involve collaborating with computer scientists, learning to program in Unity, or becoming familiar with tools like Figma or Sketch for interface design.

Suggested Reading: " Translational Resources: Reducing the Gap Between Academic Research and HCI Practice "

In all cases, embracing the interdisciplinary nature of HCI research and being open to learning new concepts and methods are essential for a successful transition. Whether through workshops, courses, or mentorship, the journey into great research is characterized by a relentless pursuit of knowledge and a voracious appetite for learning.

1.5 Scope and Objectives

Now that we have provided essential background information for newcomers to the field, let's clarify the specific role this book will play in your HCI research journey.

This book aims to equip newcomers to HCI research with a deeper understanding of the research cycle and process. It offers practical guidance and hands-on approaches to kickstart research projects:

While our book covers some topics similar to existing textbooks on HCI, it stands out in its focus on providing a practical, hands-on guide to HCI research. Instead of focusing on theory, our emphasis lies in offering actionable insights to facilitate the initiation and execution of research projects effectively.

Caution: The recent trend towards producing incremental research for publication has become increasingly noticeable, with flagship conferences experiencing a surge in submissions each year. This influx has made it challenging to secure enough qualified reviewers to handle the growing volume of papers. Moreover, the contributions of many publications appear to be diminishing [ref], with content that often just meets the minimum criteria for a paper.

However, this book serves as a hands-on guide that does not endorse the push for incremental publications. It advocates for the value of publishing impactful work over incremental contributions. Indeed, one piece of impactful research can outweigh the significance of ten incremental papers. While mastering best practices in research is critical, it's equally crucial to learn how to identify and tackle important problems.

Although it's acceptable for junior researchers (e.g., PhD students) to begin with less challenging problems as a form of practice, there is an expectation for them to evolve. As they gain experience, they should aspire to address more impactful issues, which may be more complex, but have the potential to make a significant difference in the field.

Background information on HCI research is crucial. We’ve prepared a list of resources for you that we recommend you spend 1 week going through. It includes relevant books, papers, online courses and others...

Preparation List :

Tip: If you feel a lack of motivation to run through the list, we encourage you to be patient. In fact, after this week, you will feel readier to put all that theory to good use!

Sample list of questions you may be asked.

References

Preece, J., Sharp, H., & Rogers, Y. (2015).Interaction design: Beyond human-computer interaction(4th ed.). Hoboken, NJ: John Wiley & Sons.

MacKenzie, I. S. (2013). Human–computer interaction: An empirical research perspective. Waltham, MA: Morgan Kaufmann.

Oulasvirta, A., & Hornbæk, K. (2016, May). HCI research as problem-solving. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 4956-4967).

Mackay, W. E., & Fayard, A. L. (1997, August). HCI, natural science and design: a framework for triangulation across disciplines. In Proceedings of the 2nd conference on Designing interactive systems: processes, practices, methods, and techniques (pp. 223-234).

Zhao, S., Tan, F., & Fennedy, K. (2023). Heads-up computing moving beyond the device-centered paradigm. Communications of the ACM, 66(9), 56-63.

Card, S. K., Moran, T. P., & Newell, A. (1983). The psychology of human-computer interaction. Hillsdale, NJ: Lawrence Erlbaum Associates.

Norman, D. A. (1988). The design of everyday things. New York, NY: Basic Books.

Shneiderman, B. (1987). Designing the user interface: Strategies for effective human-computer interaction. Reading, MA: Addison-Wesley.

Friedman, B., Kahn Jr, P. H., Borning, A., & Huldtgren, A. (2013). Value sensitive design and information systems. In Early engagement and new technologies: Opening up the laboratory (pp. 55-95). Dordrecht: Springer Netherlands.

Myers, B. A. (1998). A brief history of human-computer interaction technology. Interactions, 5(2), 44–54.

Booth, W. C., Colomb, G. G., & Williams, J. M. (2009). The craft of research. University of Chicago press.

Stanovich, K. E. (1992). How to think straight about psychology. HarperCollins Publishers.

Colusso, L., Bennett, C. L., Hsieh, G., & Munson, S. A. (2017, June). Translational resources: Reducing the gap between academic research and HCI practice. In Proceedings of the 2017 conference on designing interactive systems (pp. 957-968).

← Dedication Back to Book Chapter 2 →