0 \vgtccategoryResearch \vgtcinsertpkg
Fixation and Creativity in Data Visualization Design: Experiences and Perspectives of Practitioners
Abstract
Data visualization design often requires creativity, and research is needed to understand its nature and means for promoting it. The current visualization literature on creativity is not well developed, especially with respect to the experiences of professional data visualization designers. We conducted semi-structured interviews with 15 data visualization practitioners, focusing on a specific aspect of creativity known as design fixation. Fixation occurs when designers adhere blindly or prematurely to a set of ideas that limit creative outcomes. We present practitioners’ experiences and perspectives from their own design practice, specifically focusing on their views of (i) the nature of fixation, (ii) factors encouraging fixation, and (iii) factors discouraging fixation. We identify opportunities for future research related to chart recommendations, inspiration, and perspective shifts in data visualization design.
Human-centered computingVisualization;
Introduction
Data visualization designers often need to produce solutions that are both novel and useful. This combination of attributes forms the standard definition of creativity [45], and is commonly used to define creativity in design [14, 46]. Design creativity has been studied in numerous design disciplines, including interaction design [19], instructional design [10], product design [51], industrial design [15], and architecture [24]. Researchers in these fields have investigated many aspects of creativity, including, among others, the role of constraints [39], the nature of a ‘good’ idea [24], where creativity is located [20], the influence of environmental information [11], and numerous cognitive aspects relating to creativity [32, 21, 8, 3].
Although the visualization community has not studied creativity in the same breadth or depth as other design disciplines, there have been some initial contributions. With respect to the visualization design process, Vande Moere and Purchase argue for a view that includes both creative and engineering aspects [37]. In proposing the Design Activity Framework, McKenna et al. [35] acknowledge the role of creativity in the visualization design process, and argue that previous design process models have lacked this emphasis. Regarding the promotion of creativity, Goodwin et al. [25] have investigated several techniques, such as analogical reasoning and constraint removal. Kerzner et al. [30] have proposed a framework for “creative visualization-opportunities workshops” inspired by creative problem solving workshops. Mendez et al. [36] investigated the role of top-down and bottom-up approaches to visualization construction, arguing that bottom-up approaches can promote creativity. Others have developed techniques that may promote creativity, such as using cards [26], sketching and ideation activities [6], and worksheets [44, 34]. While these studies provide valuable contributions to promoting creativity in data visualization, there are still many topics that need to be explored, especially relating to the nature of creativity and factors that may hinder or promote it.
One factor influencing creativity that has been studied across multiple disciplines is design fixation. Fixation occurs when designers adhere blindly or prematurely to a set of ideas—concepts, features, representations, solutions—that limit creativity in the design process [29]. Studies across design disciplines have shown that fixation exists and impacts design cognition in significant ways, yet it is not well understood for data visualization. One of the only papers to explicitly discuss fixation in data visualization is from Eggermont et al. [17], in which they present a functional co-occurrence visualization tool with the aim of avoiding design fixation. However, their short poster abstract does not appear to have been extended.
In this paper we present findings from semi-structured interviews with 15 data visualization practitioners, in which we asked them about their experiences and perspectives on fixation, including what might encourage or discourage it. We identify opportunities for future research related to chart recommendations, inspiration, and perspective shifts in data visualization design.
1 Design Fixation
Fixation has been studied extensively by psychologists, often in reference to problem solving and insight [47, 4, 16]. Inspired by this work, Jansson and Smith[29] defined design fixation as ‘blind adherence to a set of ideas or concepts limiting the outputs of conceptual design’. They performed a series of experiments in which participants were given a design problem, and one group was shown an existing solution (fixation group) while the other was not (control group). Results showed that the fixation group generated solutions with less variation than the control group, indicating the existence of fixation in the design process.
Since this early work, there have been studies on design fixation across a wide variety of disciplines, including engineering design [33, 49, 48], architecture [23], industrial design [9], product design [28], and service design [38]. Researchers have employed various methods to study design fixation, including think aloud protocols of sketching activity [22], showing partial photographs to designers [9], and using physical and non-physical environments to investigate effects on fixation during prototyping [52].
Though there have been many empirical lab- and classroom-based investigations of design fixation, there has not been as much research using qualitative approaches focused on real-world design settings. Crilly [13, 12] has advocated for more methodological pluralism in the study of fixation, including qualitative approaches and observational field studies with practitioners. Although a focus on practitioner perspectives in general is growing in the visualization literature (e.g., [41, 42, 2, 27, 36, 50, 1, 40, 5]), it has not historically been a strong area of focus. Our work provides a practice-led, qualitative approach to understanding fixation in a data visualization context.
2 Method
We interviewed 15 data visualization practitioners about their experiences and perspectives on fixation. Recruiting was done via social media, the DataVis Society’s Slack workspace, the InfoVis email list, and our personal networks. We also contacted more than 200 individuals and more than 30 agencies. This discussion on fixation happened at the end of a larger interview aimed at understanding participants’ design process (see [40] for more detail). Participants were given the option to continue and discuss their views on creativity, to which 15 of the original 20 participants agreed. The discussion of fixation took approximately 15 minutes. Table 1 provides self-reported characteristics of the participants.
Interviews were semi-structured and conducted remotely via videoconferencing. Participants were first asked if they could describe a project in which they were creatively stuck and then made a breakthrough. The interviewer then introduced the concept of fixation. In line with Crilly et al. [13], this included a high-level description of Jansson and Smith’s [29] experiments with the bike rack problem (see Section 1), which served as an example of design fixation and its effects. Participants were asked about their thoughts on what might encourage fixation and what might discourage fixation in the context of data visualization design.
Transcripts were analyzed using a hybrid thematic analysis approach [18], incorporating both data-driven inductive coding and a top-down a priori approach. Our top-down approach was guided by previous literature on design fixation [13]. We specifically looked for data on (1) descriptions of fixation in participants’ own words; (2) factors that may encourage or lead to fixation; and (3) factors that may discourage or help overcome fixation. The three researchers went through several rounds of bottom-up coding independently with these high-level categories in mind. We met regularly to discuss the codes, eventually coming into alignment on the final codes.
ID | Job Title | Exp. (yrs) | Highest Degree | G |
---|---|---|---|---|
P1 | DataVis Designer | 5-7 | B | M |
P2 | DataVis Designer | 5-7 | B | F |
P3 | DataVis Designer | 8-10 | B | M |
P4 | Sr. DataVis Dev | 10 | D | F |
P5 | Data Communicator | 2-4 | M | M |
P6 | DataVis Designer | 10 | M | M |
P7 | DataVis Designer | 5-7 | M | F |
P8 | DataVis/UX Designer | 2-4 | M | F |
P9 | Graphics Editor | 8-10 | B | F |
P10 | Sr. UX Design Lead | 8-10 | D | M |
P11 | DataVis/UX Designer | 10 | M | M |
P12 | Data Architect | 10 | M | M |
P13 | Sr. UX/DataVis Designer | 5-7 | M | F |
P14 | DataVis Designer | 5-7 | M | F |
P15 | DataVis Journalist/Designer | 5-7 | M | M |
3 Findings
3.1 Nature of Fixation
All participants reported experiencing fixation in their professional work and were able to describe a project they had worked on in which fixation was an issue. Many participants described fixation as being a common issue in their own practice. In describing fixation, participants made references to getting ‘stuck’, ‘hitting a wall’, having difficulty ‘letting go’, having a ‘blockage’, and hitting a ‘dead end’. Some participants described the feeling of being fixated. P10, describing an instance of fixation, stated “I certainly felt like I was throwing myself at a brick wall over and over and over again until I had some notion of how to get over that wall.” P1 described the feeling of fixation as needing to “get my head out of that focused, that super-focused state, where I can’t consider other things.” P7 described the attachment people feel towards their design ideas, noting the solution as “you have to kill your darlings.”
Some participants described fixation as getting stuck on an initial idea. For example, when asked if they experience fixation, P6 replied “No question about it—and I’ve experienced in two different ways. One is I come up with an idea like immediately during the phone call with the client, and then I’m sort of fixated on that initial idea and can’t veer away from it or just sort of tend not to. And I’ve also had the experience […] where maybe the client says, ‘Oh, we were thinking of doing X, Y, Z’—and now I’m stuck with their idea.”
Other participants interpreted fixation more broadly. P14 described fixation as not being able to find a better solution than one they currently have: “I have cases where I never find a good solution. I find that I’m never totally happy with it and I just stick with the least bad version.” P15 described an instance of fixation as being about “the story and the structure of the story I wanted to tell”, going on to describe the effect of re-framing the problem “finally I found an angle […] the framing, that was really the angle I needed to build a story. And that was kind of a breakthrough. Before that I was really a bit lost until I found that angle.”
3.2 Factors Encouraging Fixation
Chart Recommendations Multiple participants noted the existence of chart recommendations from software as promoting premature adherence to a design idea. For instance, P15 noted “a lot of the people making visualizations are constrained by the chart types they have in their software […] by the all the chart types that Excel can offer, for example, and they don’t know how to break out of this constraint of the software they’re using.” Similarly, P7 stated “ I think if you invest in a charting tool and it shows a visualization type, then you have like these borders to other visualization types because you need to completely start your visualization from scratch when you choose another visualization type.” P13 noted that “[…] like excel, these are the 10 types of charts that you can use. I think those can sometimes be bad because then people feel limited to them and you don’t think about the 20 types of targets that excel doesn’t do. And so anything that’s sort of like limits your possibility of tools in general.[People say] Oh, I have to use Tableau I have to use, I can only design within this framework.”
Missing the Big Picture. Participants mentioned being too focused on details and not the ‘big picture’. P12 described being “so deeply involved in the details, and the pieces and parts that you—for whatever reason—have a hard time sitting back and looking at the whole thing in a more relaxed way. That will get people stuck.” P11 described a strategy he uses to avoid getting stuck in the details: “Sometimes I’ve just taken the biggest marker I have and done designs with that. I mean the overly huge one that doesn’t let you do any details, because if you are kind of stuck in the details, then you need to kind of somehow dig yourself out of it.” P14 mentioned getting stuck on details while programming: “in the programming phase […] that’s where it usually gets stuck on the details.”
Effort and Attachment Participants described the amount of effort required for creativity in design as potentially encouraging fixation. P14 described this as being due to emotional investment in their work “I’d have definitely have a lot more emotional difficulty to letting go of something that you’ve worked out for a while and are fixated on.” P6 described experiencing the phenomenon of sunk cost, where “You get invested in this thing you’ve invested time in and you just don’t want to let go of it.” Related to the issue of chart recommendations above, P13 emphasized the ease of selecting from predetermined chart types “Here are your suggested chart types okay, I can point and click and like, change it. And that’s super easy.”
Existing Practices and Habits. Some participants described the role of prior experience and existing practices or habits in influencing fixation in design. P4 described the influence of reusable components in adopting ideas too early “We’ve got some reusable components, and that makes you kind of go to those first. Like, let’s go to our library and see—so certainly I think that’s something that, you know, I’ve experienced and our team has experienced.” P13 mentioned the role of having solved similar problems previously as leading to fixation: “Because you think you’ve solved this problem before, you think it’s the same problem. P4 described experiencing fixation as a result of relying on prior success, “ Everything we do is sort of building on what we’ve already done. You know, we would make one app and it goes out there, it’s popular, so they’re like, hey, make another, make one like that for this other survey because you’ve already got your original thing. It is very easy to get stuck on.” P1 described the role of rigid ‘best practices’ in influencing the adoption of ideas as “A lot of people get stuck on best practices and that being the stop of it, like this is the best practice […] I think best practices can hold people back if they see it as like they have to do this.”
Precedent. Many participants described the role of existing visualizations in encouraging fixation. Participants were aware of their own propensity to be influenced by prior visualization designs and described strategies they had developed. P15 described their strategy as “I don’t want to look too closely at their [other visualization designers] stuff because I don’t want to get stuck just building that.” P6 noted that looking at existing visualizations can encourage fixation: “Yeah. You might get fixated on this cool thing on D3 and it’s just not the best idea.” P3 described a similar strategy as “ I made a conscious decision when I started a new project not to look at other people’s work to get some inspiration. So right now, I’m not looking so much on a site anymore when I do projects because I did notice that you tend to come up with similar solutions.”
Client Influence. Some participants described fixation arising from client influences, largely due to clients changing their mind, sharing their own ideas about the design, and brand guidelines that need to be applied. P6 described clients’ early ideas as encouraging fixation, and a strategy of avoiding visual content from clients to prevent fixation: “Oh, we were thinking of doing X, Y, Z, and now I’m stuck with their idea. And actually actively try to avoid that when clients have a visual content, I usually try to encourage them to not share it and let’s not talk about that.” P4 mentioned the role of client expectations as “something that we hear a lot is like, well our clients are used to looking at it this way, and so that’s certainly something that enforces that kind of fixation.” P6 also shared their experience of clients promoting adherence to an idea they’ve seen somewhere else: “What might lead to it [fixation] in datavis specifically is—8 times out of 10—is charts, it’s like, ‘oh, I think we should do a bar chart. I was thinking we should do a pie chart’ […] or they saw this really cool thing in the New York times or wherever else and they say, ‘Oh, I saw this wonderful thing over here. Can we do that with this data?”
3.3 Factors Discouraging Fixation
Incubation. Participants discussed how putting the problem aside for a while could help overcome fixation. P7 puts it as “Taking a break, looking at other stuff. Even sometimes just taking, if I can, a couple days away, not thinking about it. And then somewhere in my subconscious something will click. And I will be able to like, oh, this was the problem. Let’s try it this way instead.”. P2 highlighted the importance of diverting the mind from the problem and says the “only thing I do when I know that I’ve gone down a path that’s ineffective, or that I’m too fixated, is I just take a break—and that could be like I step away and do something for a few hours, or do a completely different project for weeks and come back with a fresh perspective.” Some participants talked about unconscious moments of insight, even in states of sleep, as P9 describes: “I dunno, sometimes with things where I’m sleeping in the middle of the night, wake up and like, oh, I know exactly how to redo this.”
Experimenting and Creative Exercises. Participants shared various strategies they employ to avoid or overcome fixation and promote creativity. Some participants described experimenting with different visual encodings as a creative exercise to overcome being fixated on one encoding. For instance, P3 described “these kind of ‘what if’ questions, like what if I would show it as line instead of circles or whatever. Because I think one of the characteristics of data visualization is that, especially because of this very iterative approach and exploratory approach at the small scale, you can try things and then you see things happen again. And sometimes, or often, these could be things that you didn’t expect and these kinds of things can generate new ideas that you could try out.” Similarly, P1 described their strategy as “pick two encoding and mash them together to see what sort of thing you can create from that.”
Participants described other creative exercises, such as P4’s “Coming up with 10 solutions to something […] eventually you start coming up with stuff that’s weirder and that might lead off into something.” P6 described sketching as a way to keep early ideas flexible and avoid fixation, stating that “I try not to do it [look at existing visualizations] until after I got my initial sketches out.” P3 described a training exercise of asking people to create intentionally bad designs, reflecting that “it’s very interesting to see that once people start doing this exercise, they sometimes cannot stop working on it because they have so many ideas, and sometimes people are laughing at themselves because they come up with nice ideas. And so this is really one of the most fun exercises because people come up with the most crazy ideas.”. P9 described an exercise of trying to do the opposite of an existing visualization for a similar problem that they were working on “what if I showed the opposite of this? So instead of being like ‘what are the most words that the candidates used?’ I’d be like, ‘what words didn’t they use?’” P11 described a way to avoid early attachment to ideas as “flipping the brief”—referring to a strategy for challenging the initial client request and adjust the framing of the problem.
Inspiration. Participants highlighted various ways they get inspired for their design work. One method was to look for inspiration in existing visualizations. P12 described a situation where a client wanted an ‘ugly’ dashboard to become ‘visually appealing’. P12 was not sure what to do, so “went into a sort of hysterical, ‘inspire me’ mode” and stumbled across a waffle chart. P12 then described the result: “so that [the waffle chart], combined with a better color palette than they had before, turned into pretty compelling results that they liked—and that got me out of the woods.” However, this is one of the trickiest strategies to follow with respect to fixation, as some participants indicated becoming fixated as a result of looking at existing work. Participants acknowledged this and discussed strategies for looking at existing work that was not too similar to the current problem they were working on. As P9 said “I wouldn’t look at any of their [a direct competitor] stuff because then I would feel like I was going to create something like what they were doing.” P3 noted that they will “still look at other people’s work, not related to a specific project that I’m working on.” P4 described a strategy of looking broadly at existing visualizations “I’ll go to a few different sites like Flowing Data or Xenographics that just have lots of examples of different visualizations, different chart types, and just browse that for half an hour. And that can help me kind of jog out of being stuck on something.”
Some participants, especially P2 and P9, went beyond data visualization examples to look for inspiration in art and nature. P9 described “going to the art museum and seeing a renaissance painting, or like this 1970s weird something. I went to this conspiracy UFO exhibit, but it’s just like …it [the solution] can be a shape—it could just be like a weird shape. I see. And I’m like, ‘oh like that’s a connection I can make’.” P2 described getting inspiration as “a lot of the inspiration is just kind of like the world around me—nature, other people’s art. Especially, I like taking inspiration from art—not other people’s datavis–but other people’s art.” P2 described a project where they were trying to create a visual encoding using a flower metaphor, but were getting stuck on the idea: “I just couldn’t lay it out in a pleasing way. And then, I was in Tokyo at the time, and I stepped out and took a walk. And it was April, so there was a bunch of cherry blossoms and, as I was staring out at the cherry blossom, I’m like: ‘Oh yeah, flowers grow on trees’. And so if I just organize them as tree branches, it would look much more aesthetically pleasing—and then it just unblocked me immediately.”
External Input. Many participants described the value of external input in overcoming fixation. P7 noted “having a co-worker discussing this with me, and basically the question that they ask always gets me out of it [fixation].” P6 spoke about seeking informal input from their spouse whenever being stuck creatively. P5 includes feedback as a part of their process and says, “in my process, what helps me avoid it [fixation] is getting others’ input—that’s input from users, input from coworkers—getting a sense of what other people are thinking and how they respond to something helps prevent me from getting locked into the idea that my idea is the only solution.”
Changing Perspective. Some practitioners advocated for deliberately thinking in a different way or changing their literal or mental perspective. P6 described their strategy of trying to think from a beginners’ perspective: “try to remember what it was like to not know anything, and try to walk into every client engagement as though you don’t know anything about what they’re doing or about even almost data visualization..” Some participants described a literal change of perspective, such as P12 suggesting to “Take an image and look at it upside down to get a sense of it from a compositional perspective outside of the details of what it’s actually a picture of […] one of the things you need to do is cock your head or go away and come back or look at it from across the room.” P2 speculated about the value of a technique that’s often used in art education, where “one of the things that you would do is flip your artwork upside down. You really give yourself a different perspective.”
4 Discussion
Fixation was universally experienced by our participants. This is consistent with research on fixation in other design disciplines. Most participants could recognize fixation when it was described and could easily provide a personal example. Many, although not all, were aware of their own encounters with fixation and had developed conscious strategies to avoid or overcome it. Some participants could describe ways that they had overcome fixation, although they were not always deliberate strategies that had been developed. For instance, participants described serendipitous insights from nature, art galleries, existing data visualizations, and even dreams. These are consistent with prior research on fixation and creativity. Researchers have studied the role of both conscious and unconscious incubation, noting that the mind may still be making associations when people are attending to other things, including while sleeping [7, 43, 53].
Although fixation has been studied in other design disciplines, its nature and effects in data visualization are not known. Visualization practitioners need to engage in creative work that is not the same as the work that engineers or interaction designers may engage in. For instance, they need to deal with issues relating to data, visual encodings, human perception and cognition, and client and stakeholder needs—a unique set of issues not faced by designers in other disciplines [50, 42]. It is known in general that looking at existing solutions can lead to fixation [29]. However, we do not know exactly what that means for data visualization. What about visualizations based on partially or entirely different data types? Or visualizations that are static vs. interactive? What about the role of visualization grammars vs. chart templates? The answers to such questions cannot be easily transferred from other design disciplines, and necessitate their own studies within a visualization context. Our work does not attempt to answer these questions, but rather provides an initial exploration into this space, drawing connections to literature in other fields while also offering preliminary insights from a practice-led data visualization perspective.
Our findings surface questions about how to avoid or overcome fixation for data visualization designers. For instance, the role of chart templates and suggestions in software tools is a challenging topic. Participants noted that templates can be too easy to select and can promote adherence to a solution too early. P15 noted that templates can lead to fixation, while “the grammar of graphics gives you a lot of flexibility and a lot of different ways of expressing your data […] it’s definitely a framework that allows for creativity.” This is a topic that spans more than one of our factors that encourage fixation—at least chart recommendations, effort and attachment, and existing practices and habits. Building visualizations from the bottom up generally requires more effort and does not support reliance on reusable templates or other easily chosen solutions. Mendez et al. [36] confirmed this idea in an empirical study with visualization designers, finding that bottom-up visualization construction requires more thoughtful engagement with the problem and more creativity in the output. However, generating visualizations this way requires both conceptual and technical expertise—a requirement that not all practitioners have. There is not an simple answer to this issue, and we do not claim to provide one here. However, we believe that approaching this topic through the lens of fixation adds a valuable perspective that has not been addressed in the extant literature.
Another topic for future investigation is how to provide inspiration to designers without encouraging fixation. Some participants have developed their own strategies of looking only at visualization examples that are not too similar to the context in which they are currently working. Here there may be an opportunity to develop an inspiration tool or catalog based on certain characteristics of the design situation. For instance, designers could identify characteristics of their design problem, such as data types, complexity, user tasks, and so on, and the tool could present only existing solutions that do not match the characteristics too closely. Perhaps a strategy analogous to Cheng et al. [9], where they presented only partial photographs to designers, could be employed to mitigate fixation. Partial visualizations, or visualizations with only partial datasets, could be presented as a strategy to provide inspiration but still require effortful engagement with the ideas. Some of our participants noted looking at art or nature for inspiration. Similarly, an inspiration tool could suggest visual metaphors from nature or paintings with certain color palettes or shapes based on input from the designer. Experimenting with creative exercises like sketching, playing with visual variables, and consciously trying to create bad designs also helped participants overcome fixation. Tools that promote serendipitous mashups of visual variables or provide intentionally ‘bad’ outcomes could aid in this regard. Strategies from the literature on creativity support tools, such as promoting failure in design [31], are likely fruitful for exploration. Although our work does not provide such solutions, our findings surface these topics as potential areas of future research.
5 Summary
Our findings indicate that design fixation is prevalent among data visualization practitioners and significantly impacts creativity. We provide initial contributions to the topic of design fixation, including introducing a new theoretical construct to the visualization literature, and partially characterizing it based on an empirical qualitative investigation with professional data visualization practitioners. This work may be valuable for practitioners, helping them develop awareness of fixation in their own practice and collecting some solutions for overcoming it. Our work opens new questions for the research community, including how to support creativity in efficient, flexible ways without encouraging fixation; how to provide useful examples for inspiration without promoting adherence to them; how to encourage designers to ‘step back’ and see the big picture of what they’re working on; and how to support perspective shifts to overcome fixation and encourage creativity.
References
- [1] S. Alspaugh, N. Zokaei, A. Liu, C. Jin, and M. A. Hearst. Futzing and moseying: Interviews with professional data analysts on exploration practices. IEEE TVCG, 25(1):22–31, Jan 2019. doi: 10 . 1109/TVCG . 2018 . 2865040
- [2] A. Bigelow, S. Drucker, D. Fisher, and M. Meyer. Reflections on how designers design with data. In ACM AVI, pp. 17–24. Como, Italy, 2014.
- [3] N. Bonnardel. Towards understanding and supporting creativity in design: analogies in a constrained cognitive environment. Knowledge-Based Systems, 13(7-8):505–513, 2000.
- [4] E. M. Bowden, M. Jung-Beeman, J. Fleck, and J. Kounios. New approaches to demystifying insight. Trends in cognitive sciences, 9(7):322–328, 2005.
- [5] M. Brehmer and R. Kosara. From jam session to recital: Synchronous communication and collaboration around data in organizations. IEEE TVCG (Proc. IEEE VIS ’21), 2021.
- [6] N. Bressa, K. Wannamaker, H. Korsgaard, W. Willett, and J. Vermeulen. Sketching and ideation activities for situated visualization design. In ACM DIS, p. 173–185. ACM, Jun 2019.
- [7] D. J. Cai, S. A. Mednick, E. M. Harrison, J. C. Kanady, and S. C. Mednick. Rem, not incubation, improves creativity by priming associative networks. PNAS, 106(25):10130–10134, 2009.
- [8] H. Casakin and S. Kreitler. The cognitive profile of creativity in design. Thinking Skills and Creativity, 6(3):159–168, 2011.
- [9] P. Cheng, R. Mugge, and J. P. L. Schoormans. A new strategy to reduce design fixation: Presenting partial photographs to designers. Des. Stud., 35(4):374–391.
- [10] G. Clinton and B. Hokanson. Creativity in the training and practice of instructional designers: the design/creativity loops model. Educational Technology Research and Development, 60(1):111–130, Feb 2012.
- [11] D. Collado-Ruiz and H. Ostad-Ahmad-Ghorabi. Influence of environmental information on creativity. Des. Stud., 31(5):479–498, 2010.
- [12] N. Crilly. Methodological diversity and theoretical integration: Research in design fixation as an example of fixation in research design? Des. Stud., 65:78–106.
- [13] N. Crilly. Fixation and creativity in concept development: The attitudes and practices of expert designers. Des. Stud., 38:54–91, May 2015.
- [14] N. Crilly. Creativity and fixation in the real world: A literature review of case study research. Des. Stud., p. S0142694X1930047X, Aug 2019.
- [15] K. Dorst and N. Cross. Creativity in the design process: co-evolution of problem–solution. Des. Stud., 22(5):425–437, Sep 2001.
- [16] K. Duncker and L. S. Lees. On problem-solving. Psychological monographs, 58(5):i, 1945.
- [17] M. Eggermont, S. Knudsen, R. Pusch, and S. Carpendale. Biomole: Visualizing functional co-occurrence. In IEEE VIS posters, p. 2, 2019.
- [18] J. Fereday and E. Muir-Cochrane. Demonstrating rigor using thematic analysis: A hybrid approach of inductive and deductive coding and theme development. International journal of qualitative methods, 5(1):80–92, 2006.
- [19] J. Frich, L. MacDonald Vermeulen, C. Remy, M. M. Biskjaer, and P. Dalsgaard. Mapping the landscape of creativity support tools in hci. In ACM CHI, p. 1–18. ACM, May 2019.
- [20] J. S. Gero. Future directions for design creativity research. In Design creativity 2010, pp. 15–22. Springer, 2011.
- [21] J. S. Gero. Studying visual and spatial reasoning for design creativity. Springer, 2015.
- [22] G. Goldschmidt. The dialectics of sketching. Creativity Research Journal, 4(2):123–143.
- [23] G. Goldschmidt and M. Smolkov. Variances in the impact of visual stimuli on design problem solving performance. Des. Stud., 27(5):549–569.
- [24] G. Goldschmidt and D. Tatsa. How good are good ideas? correlates of design creativity. Des. Stud., 26(6):593–611, 2005.
- [25] S. Goodwin, J. Dykes, S. Jones, I. Dillingham, G. Dove, A. Duffy, A. Kachkaev, A. Slingsby, and J. Wood. Creative user-centered visualization design for energy analysts and modelers. IEEE TVCG, 19(12):2516–2525, Dec 2013.
- [26] S. He and E. Adar. VizItCards: A card-based toolkit for infovis design education. IEEE TVCG, 23(1):561–570, 2016.
- [27] J. Hoffswell, W. Li, and Z. Liu. Techniques for flexible responsive visualization design. In ACM CHI, p. 1–13. ACM, Apr 2020.
- [28] D. Hwang, B. Choi, S. Bae, and W. Park. Mitigating design fixation: A visualization tool for enhancing situation awareness. Journal of Mechanical Design, 143(61402).
- [29] D. G. Jansson and S. M. Smith. Design fixation. Des. Stud., 12(1), 1991.
- [30] E. Kerzner, S. Goodwin, J. Dykes, S. Jones, and M. Meyer. A framework for creative visualization-opportunities workshops. IEEE TVCG, 25(1):748–758, Jan 2019.
- [31] J. Kim, A. Bagla, and M. S. Bernstein. Designing creativity support tools for failure. In ACM C&C, pp. 157–160, 2015.
- [32] M. Kim, Y. Kim, H. Lee, and J. Park. An underlying cognitive aspect of design creativity: Limited commitment mode control strategy. Des. Stud., 28(6):585–604, 2007.
- [33] J. S. Linsey, I. Tseng, K. Fu, J. Cagan, K. L. Wood, and C. Schunn. A study of design fixation, its mitigation and perception in engineering design faculty. Journal of Mechanical Design, 132(41003).
- [34] S. McKenna, A. Lex, and M. Meyer. Worksheets for guiding novices through the visualization design process. In Proceedings of the 2nd Pedagogy of Data Visualization Workshop, 2017.
- [35] S. McKenna, D. Mazur, J. Agutter, and M. Meyer. Design activity framework for visualization design. IEEE TVCG, 20(12):2191–2200, 2014.
- [36] G. G. Mendez, U. Hinrichs, and M. A. Nacenta. Bottom-up vs. top-down: Trade-offs in efficiency, understanding, freedom and creativity with infovis tools. In ACM CHI, p. 841–852. ACM, May 2017.
- [37] A. V. Moere and H. Purchase. On the role of design in information visualization. Information Visualization, 10(4):356–371, Oct 2011.
- [38] D. P. Moreno, L. T. Blessing, M. C. Yang, A. A. Hernández, and K. L. Wood. Overcoming design fixation: Design by analogy studies and nonintuitive findings. AI EDAM, 30(2):185–199.
- [39] B. Onarheim. Creativity from constraints in engineering design: lessons learned at coloplast. Journal of Engineering Design, 23(4):323–336, 2012.
- [40] P. Parsons. Understanding data visualization design practice. IEEE TVCG (Proc. IEEE VIS ’21), 2021.
- [41] P. Parsons, C. M. Gray, A. Baigelenov, and I. Carr. Design judgment in data visualization practice. In IEEE VIS short papers, 2020.
- [42] P. Parsons and P. Shukla. Data visualization practitioners’ perspectives on chartjunk. In IEEE VIS, short papers, 2020.
- [43] S. M. Ritter and A. Dijksterhuis. Creativity—the unconscious foundations of the incubation period. Frontiers in human neuroscience, 8:215, 2014.
- [44] J. C. Roberts, C. Headleand, and P. D. Ritsos. Sketching designs using the five design-sheet methodology. IEEE TVCG, 22(1):10, 2016.
- [45] M. A. Runco and G. J. Jaeger. The standard definition of creativity. Creativity research journal, 24(1):92–96, 2012.
- [46] P. Sarkar and A. Chakrabarti. Assessing design creativity. Des. Stud., 32(4):348–383, 2011.
- [47] S. M. Smith and S. E. Blankenship. Incubation and the persistence of fixation in problem solving. The American Journal of Psychology, 104(1):61–87.
- [48] C. Toh, S. Miller, and G. Kremer. Mitigating design fixation effects in engineering design through product dissection activities. In J. S. Gero, ed., Design Computing and Cognition ’12, pp. 95–113. Springer Netherlands.
- [49] V. Viswanathan, O. Atilola, N. Esposito, and J. Linsey. A study on the role of physical models in the mitigation of design fixation. Journal of Engineering Design, 25(1):25–43.
- [50] J. Walny, C. Frisson, M. West, D. Kosminsky, S. Knudsen, S. Carpendale, and W. Willett. Data changes everything: Challenges and opportunities in data visualization design handoff. IEEE TVCG, 26(1):12–22.
- [51] S. Yilmaz and C. M. Seifert. Creativity through design heuristics: A case study of expert product design. Des. Stud., 32(4):384–415, 2011.
- [52] R. J. Youmans. The effects of physical prototyping and group work on the reduction of design fixation. Des. Stud., 32(2):115–138.
- [53] C.-B. Zhong, A. Dijksterhuis, and A. D. Galinsky. The merits of unconscious thought in creativity. Psychological science, 19(9):912–918, 2008.