Lam Van Luong, Diana Giraldo Mendez, James Giles, Huong Mai Nguyen, Tam Thi Le, Kees Swaans Human-Centered Design in Action: Bridging Gaps in Climate Information Services INFO NOTE 1 Usability Testing and Assessment of the Agro-Climatic Bulletin in Vietnam 1Human-Centered Design in Action Key Messages � Human-Centered Design is a problem- solving approach that prioritizes users, their needs, and their context by involving them throughout the design process, and it is increasingly used to create effective climate information services. � Usability testing, as part of the Human- Centered Design process, helps understand how farmers interact with climate information services and identify valuable and intuitive insights that other methods might overlook. � Usability testing and assessment of the Agro- Climatic Bulletins show that the bulletin can be easily accessed and navigated as it is shared in an image-based format on a messaging platform familiar to farmers. � Key recommendations to enhance usability of the Agro-Climatic Bulletins include: improve accessibility, simplify navigation, enhance design with visuals, increase frequency of updates, use simpler language, provide more localized content, and prioritise key information. � As Human-Centered Design is iterative, the cycle does not end with implementing recommendations for improvement; it continues with testing, feedback, and refinement to ensure the ACBs align with user needs. Introduction The Agro-Climatic Bulletin (ACB) is a climate information service initiated by the Alliance of Bioversity International and CIAT and the Department of Crop Production in the Mekong River Delta of Vietnam. Based on the “Local Technical Agroclimatic Committees” (LTAC) approach (Giraldo-Mendez et al., 2021), the ACB is developed through a co-design process with input from provincial Technical Working Groups (TWGs), including agricultural and extension experts, as well as hydrometeorological staff. The ACB provides district-localized advisories based on seasonal, monthly and 10-day climate and weather forecasts (Swaans et al., 2023). As of June 2024, the ACB has reached over 270,000 farmers across 70 districts and 547 communes through multiple channels, including loudspeakers, posters, and the Zalo messaging app (CIAT, 2024). In 2023, the ACB approach was recognized by Vietnam’s Ministry of Agriculture and Rural Development as a “technical advance” and subsequently scaled to all 13 provinces of the Mekong River Delta of Vietnam. Human-Centred Design (HCD) is a creative and iterative problem-solving approach that prioritizes the needs, experiences, and contexts of users throughout the design process of a product or service (CIAT, 2023; IDEO, 2015). To enhance the ACB’s content and delivery, the HCD approach has been applied in the framework of the CGIAR initiative Asian Mega-Deltas to reduce risks in key https://alliancebioversityciat.org/stories/notifications-timely-climate-alerts-boost-farmers-resilience-across-vietnams-mekong-river https://alliancebioversityciat.org/stories/notifications-timely-climate-alerts-boost-farmers-resilience-across-vietnams-mekong-river 2 Info Note 1 - Usability Testing and Assessment of the Agro-Climatic Bulletin in Vietnam Human-Centered Design and Usability Usability refers to the ease with which users can interact with a system, product, or service to achieve their goals effectively, efficiently, and satisfactorily (Nielsen, 1994). It is defined by five quality elements: learnability, efficiency, memorability, errors and satisfaction (Nielsen, 1994). In other words, a service with high usability is easy to learn, allows users to complete tasks efficiently, is easy to remember after a break, minimizes errors or makes them easy to fix, and provides the users with a satisfying overall experience. In the agriculture sector, usability is an important factor which impacts farmers’ effective use and adoption of digital tools (Budiastuti et al., 2023; Sebald et al., 2024). Human-centered design (HCD) is defined as an iterative process with five phases, namely Scope (identifying research challenges), Explore (gathering user insights), Create (designing prototypes), Validate (testing prototypes with users and stakeholders), and Scale (iterating designs through continuous evaluation during scaling) (Figure 1). Specifically, usability testing is used in the Validation phase of the HCD process, in which a prototype of a product or service is tested with real users to identify any usability issues before final implementation. This helps ensure solutions align with user needs and real-world contexts (Harte et al., 2017; ISO, 2019). Figure 1. Design cycle of the HCD approach implemented in the Alliance of Bioversity International and CIAT. Source: Alliance Inclusive Design and User Research Team (Ortiz-Crespo & Zapata, 2023). Scan to learn about Human- Centered Design approach value chains in the Mekong River Delta in Vietnam since 2023 (Giraldo et al., 2024). The application of this approach involves direct engagement with farmers as end users, using tools such as user personas, journey mapping, and usability testing to refine and improve the ACB. This info note is part of a series, highlighting key results and lessons learned from applying the HCD to the ACBs. Each info note focuses on a specific tool of the process: • Info Note 1: Presents findings from usability testing, revealing how farmers interacted with the bulletins and highlighting areas for improvement. • Info Note 2: Develops user personas, providing a deeper understanding of the diverse farmer profiles and their unique needs. • Info Note 3: Delves into user journey mapping, showing how farmers engage with the ACBs at different touchpoints and uncovering opportunities for enhancing service delivery. https://cgspace.cgiar.org/items/8154d141-6277-40b5-b276-57049794106f https://cgspace.cgiar.org/items/8154d141-6277-40b5-b276-57049794106f https://cgspace.cgiar.org/items/8154d141-6277-40b5-b276-57049794106f 3Human-Centered Design in Action The HCD study of ACBs in Vietnam was conducted during the rice winter-spring season of 2023-2024 in the Mekong River Delta. We targeted farmers receiving 10-day ACBs throughout the season via Zalo (Whatsapp-like message app) group chats managed by local government officials. The bulletin took the form of a set of images with each image providing district-localized weather forecasts for the next 10 days and advisories based on these (Figure 2). To assess the usability of the ACBs, we used two approaches: an expert assessment and a usability test with the actual farmer users. This dual approach ensures that the product is not only designed to be functional, accessible, and useful for the users based on their responses, but also complies with common practices for user-friendly interface design Researchers from the Alliance of Bioversity International and CIAT in Vietnam, who were trained in HCD, conducted the expert usability evaluation of the ACBs. The purpose of this assessment was to evaluate the ACBs against key usability principles proposed by Jakob Nielsen (Harley, 2018; Nielsen, 2024) to identify design issues and improve user- friendliness. Photo: CIAT/Lam Luong Figure 2. The Agro-Climatic Bulletin as shown on a phone screen (left) and a close-up of the cover page (right). Usability testing and assessment The usability test was conducted with 25 rice farmers (12 men, 13 women) in Soc Trang and Hau Giang provinces in the Mekong River Delta of Vietnam from February to May 2024. The two provinces were selected to represent different ecological zones: Soc Trang, a coastal area, faces greater climate-related challenges such as drought and saltwater intrusion, while Hau Giang, located inland in the freshwater zone, is less affected (Figure 3). The participants, all current ACB users, were purposefully selected to ensure diversity in age and gender. Hau Giang Soc Trang Figure 3. Map of the Mekong River Delta in Vietnam, highlighting the study provinces. 4 Info Note 1 - Usability Testing and Assessment of the Agro-Climatic Bulletin in Vietnam Photo: CIAT/Lam Luong The usability test aims to evaluate the user experience of accessing and interacting with the ACB on the Zalo messaging app. More specifically, it consisted of three parts (Luong et al., 2024), as follows: • First, farmers were instructed to access the ACB on their phones while verbalizing their thought processes, enabling researchers to assess how easily they could locate and open the bulletin. • Secondly, farmers were tasked with finding specific types of information within the bulletin to evaluate how easy the navigation was. • Finally, individual interviews were conducted to collect detailed feedback from farmers about their experiences with the ACB, including accessibility, design and readability, content comprehension and usefulness. The usability test was conducted by two Vietnamese interviewers (Figure 4), who played complementary roles to ensure the collection of both qualitative and observational data. One interviewer took the lead in giving instructions, guiding the users through tasks, and engaging in direct interaction. The second interviewer focused on observing the user’s behaviour, paying close attention to verbal feedback, non-verbal cues, and how users interacted with the ACBs during the session. After each testing session, the interviewers debriefed, comparing notes, sharing observations, and collaboratively identifying key usability issues. Additionally, a non-Vietnamese HCD expert was involved in designing the tests and analyzing the findings. This helps counterbalance potential cultural biases and ensure a more comprehensive interpretation of the results. Figure 4. A usability testing section conducted by 2 interviewers (left) and a close-up of a user interacting with the bulletin on his phone (right). 5Human-Centered Design in Action Usability heuristics Usability assessment Visibility of System Status  Users may not be aware when a ‘new’ bulletin is released as the notification appears on their phone together with many other notifications from Zalo. Match Between the System and the Real World  Technical language, such as meteorological terms and abbreviations, scientific names of pesticide chemicals, are not familiar to farmers. User Control and Freedom  The ACBs, presented as a set of images in a messaging app, allow farmers to swipe easily between images. This intuitive navigation reduces the likelihood of making mistakes since there are no complex menus or processes. Consistency and Standards  Internal inconsistency in terms of fonts, colour usage and layout style among different pages of one bulletin.  External inconsistency (compared with the industry or common practices) in terms of colours usage. For example, red colour is often associated with high-priority or alarming information, but in the bulletin, it is sometimes used for non-alarming updates. Error Prevention  The ACBs, shared as image sets, use straightforward interface that does not require complex input from farmer. This helps prevent errors such as incorrect data entry, which are common in interactive systems. Recognition Rather than Recall  The lack of a memorable brand name and logo requires farmers to rely on their memory to locate the group chat for sharing the ACBs, rather than recognition. Flexibility and Efficiency of Use  The ACBs, presented as a set of images, are simple and easy to use for both beginner and experienced users.  Due to the image format and sometime the inclusion of many images to cover more than one crop, the bulletins lack flexibility in how users can interact with or customize the content to suit their specific needs. Aesthetic and Minimalist Design  Text-heavy sections and minimal use of visual aids can overwhelm users and make the bulletin less engaging. Help Users Recognize, Diagnose, and Recover from Errors  No major issue due to the simple format of the bulletin. Note: As the ACB is sent via Zalo messaging app, which is not owned by the service provider, supporting users in recognizing and diagnosing issues is limited due to the need for app feature modifications beyond the provider’s control. Help and Documentation  The ACBs use image sets, providing a simple form of visual documentation that reduces the need for explanations and allows farmers to quickly grasp key information.  The ACBs lack interactive elements, such as pop-ups or tooltips, that could provide in-context help or detailed explanations for complex topics.  The hotline for additional support is only mentioned in the final image of the bulletin, which may be overlooked or hard to locate when needed.  In some Zalo groups where ACBs are shared, the comment feature is blocked to simplify management. This limits farmers’ ability to quickly ask questions or seek clarifications. Findings from expert usability assessment Table 1 presents the Alliance HCD-experts’ assessment of the ACBs, based on key usability heuristics (Harley, 2018; Nielsen, 2024), highlighting several strengths and weaknesses. Table 1. Expert usability review of the ACB 6 Info Note 1 - Usability Testing and Assessment of the Agro-Climatic Bulletin in Vietnam Findings from usability testing Interviews with farmers and observation of their interactions with the ACBs on their phones revealed the following usability and user experience-related issues: Accessibility: Most farmers could quickly find the ACBs in group chats on the Zalo messaging app, as the platform was familiar to them. However, 8 out of 25 farmers reported difficulty locating the group chat where the ACBs were shared. Farmers often forgot the location of the bulletin, with a 37-year- old female farmer saying, “I don’t remember… I just saw it this morning”, and a 36-year-old male farmer stating, “It just disappeared automatically; I don’t know why I don’t see it anymore”. Observations revealed that farmers received the bulletin through diverse sources — some directly from extension officials via Zalo, others from a Zalo group chat of their cooperative, and/or in other group chats for sharing local information (e.g., salinity updates). This overlap between communication channels likely contributed to the confusion. Moreover, as Zalo is used for various communication purposes, the bulletin often gets lost among other messages. The 10-day sharing interval during rice cropping seasons aggravates the issue, as more frequent messages overshadow the bulletin updates. Navigation: The ACB, presented as a set of 4 - 15 images, made it easy for farmers to locate the content they needed. While some read the bulletin sequentially from start to finish, others skipped directly to images featuring pests and diseases or the image with detailed weather forecasts for each day. Most farmers reported paying most attention to pest and disease information. Observations revealed that farmers often skimmed through the bulletin quickly rather than reading it in detail, prioritizing information they deemed immediately useful. Design and readability: 11 out of 25 farmers reported design and readability issues that hindered their engagement with the ACB: • Font size and Text density: Small fonts and dense text made the bulletin difficult to read, particularly for elderly users. One 50-year-old female farmer noted, “The font is too small... sometimes when I look at it for a while, my eyes get tired.” • Visual design and Presentation: Farmers preferred more visual aids, such as photos or diagrams, to simplify key messages. For example, one 36-year-old male farmer said, “If salinity levels are high, just draw a diagram showing high or low levels instead of writing so much text.” • Colour and Emphasis: Participants suggested using bold text or colours to draw attention to critical information like weather alerts. As a 56-year-old female farmer explained, “Create emphasis by making key points bold or highlighted to draw attention. If everything is written the same, people often don’t pay attention.” Frequency of updating: 9 out of 25 farmers expressed a need for more frequent updates, favouring weekly or even daily intervals to enhance relevance and accuracy. As one 28-year-old male farmer explained, “Ten days is too long; weekly updates would be better”. Shorter intervals were considered more actionable and precise, especially Photo: CIAT/Lam Luong Figure 5. A farmer explains how she accesses and reads the bulletin on her phone. 7Human-Centered Design in Action for addressing weather and pest management needs, as expressed by a 41-year-old female farmer: “Daily updates are more accurate and make it easier to prevent pests and diseases”. Content usefulness: 12 out of 25 farmers commented on the usefulness of the ACBs, highlighting areas for improvement. Some noted that district-wide or provincial forecasts were broad. A 49-year-old male farmer explained, “The bulletin says it will rain in Long Phu district, but it rains in Tan Hung and not in Chau Khanh commune”. The 10-day forecasts were also seen as less precise and actionable compared to daily or weekly updates. Another 38-year-old female farmer shared, “Daily forecasts are easier to understand and apply”. Additionally, advice on fertilizers and pesticides was considered too general, “Fertilizer advice is vague; it doesn’t specify the amounts needed” , said a 55-year-old male farmer Content comprehension: 11 out of 25 farmers reported difficulties understanding parts of the bulletin, primarily due to the use of technical terms Figure 6. An interview to gather a farmer’s feedback on his experience with the ACBs. Photo: CIAT/Lam Luong that were unfamiliar to them. For example, 51-year- old female farmer said, “We don’t understand millimeters. It would be better if you explained it a bit more clearly. Here, we just say whether it’s heavy rain, light rain, or a lot or a little rain”. Other usability issues: The length of the bulletin was an additional concern. A 40-year-old male farmer said “The bulletin covers things like salinity forecasts, the growth stages of rice, pests and diseases, and extreme weather warnings. Even if you provide a lot of information, people might not read it all. Just include the key points, and that should be enough.” . Interviews with the farmers also showed that they often used their phones in the early morning before going to the field, at noon when they came back home from the field, or in the evening before going to bed. This may raise a potential issue such as farmers feeling fatigued and having reduced mental energy, which makes it harder for them to process complex or dense information. 8 Info Note 1 - Usability Testing and Assessment of the Agro-Climatic Bulletin in Vietnam Recommendations Based on findings from the Alliance’s HCD expert assessment and usability testing with farmers in the Mekong River Delta, several recommendations were proposed to enhance the usability and address some user experience issues with the ACBs in Vietnam. Table 2. Possible solutions for enhancing the ACB’s usability Usability issue Recommendations Accessibility • Pin the latest bulletin in Zalo group chats. • Instruct farmer to pin the ACB Zalo group chat to the top of their screen to easier tracking. • Set a reminder of when the next bulletin will be issued. • Increase the visual brand identity and concise, memorable name of the group chat for sharing the ACBs. • An official announcement on the use of the Zalo groups at commune/village level in consultation with TWGs can be considered for raising awareness about ACBs. Navigation • Place the most important content, such as weather alerts, pest and disease alerts at the top of the bulletin. • Provide summary page at the top of the bulletin and/or brief highlight text for quick access to key points. Design and readability • Increase font size to improve readability. • Replace dense text with icons, graphs, and images, short sentences. • Use visuals to convey complex data, such as salinity levels or rainfall forecasts, with charts and infographics. • Highlight critical information, such as weather alerts or pest warnings, using bold colours and larger text. • Use effective colour coding for sections to visually differentiate topics (e.g., blue for weather, green for pests). • Use sufficient spacing between sections to reduce cognitive overload. • Automating aspects of ACB development can reduce inconsistencies in color codes, language, fonts, and text length. • Content might get cut off if the layout isn’t responsive, especially when viewed on smaller screens or in different orientations. It’s important to test for a safe area and leave adequate margins around the content. • Establish clear content priorities: the most important and urgent information stand out and should come first, followed by important updates, and finally general advice or links to further resources. Update frequency • Guide farmers to available sources of shorter-term weather forecast information. • Send short updates (hazard warnings and advisories for critical issues such as extreme weather events, pests and diseases outbreaks). Content comprehension • Replace technical terms (e.g., millimetres of rainfall) with relatable terms (e.g., heavy or light rain). • Avoid abbreviations and provide definitions or explanations in simple language. Content usefulness • Engage commune agricultural officers to get more commune-specific issues to provide commune-specific advisories during special periods such as pests and diseases outbreak, extreme events specific to certain areas. • Localized and tailored advisories could be organized in the form of Q&A sections, videos, or a special bulletin issue focusing on certain topics. 9Human-Centered Design in Action HCD is an iterative process that emphasizes gradual improvement through cycles of testing, feedback, and refinement rather than aiming for a perfect solution upfront. Usability testing helps identify areas for improvement, and based on these findings, feasible solutions are prioritized considering available resources and potential impact. Selected solutions are implemented and tested in real-world conditions to gather feedback and evaluate their effectiveness. If necessary, further adjustments are made, followed by retesting. This continuous loop of testing, improving, and refining ensures the product evolves to become more user- friendly and effective. Since the HCD study, many of the recommendations have been implemented in a pilot involving an improved version of the 10-day ACB in three target provinces during the summer-autumn rice season of 2024. Main change was to no longer post the full ACB on Zalo groups, but to use ‘risk, impact and practice cards’ instead. This allows for short and concise information on risks, impacts and advisories based on newly designed templates for each, using standardized colours. It also allows for more consistency in bulletins and the sharing of extra information and videos (e-training materials) on certain practices through links; in addition, the ACB was branded with a new logo for both the group chat and the ACBs to enhance visual recognition of the service. Integrating further lessons in consultation with the Department of Crop Production and TWGs, the Alliance plans to scale the improved 10-day ACB across all provinces of the Mekong River Delta, Vietnam, in 2025. Discussion Bulletin length • Reduce unnecessary details, such as the number of rice hectares planted in each district. • Offer two versions of the bulletin: one brief version to share directly via Zalo group chat, and a longer version (via link and QR code). • Explore the need for separate ACBs tailored to different crops and farming systems, and evaluate how the ACBs can be shortened to better address the diverse needs and characteristics of farmers. Help and documentation • Provide a quick-start guide or video explaining how to access the bulletin, introducing its key contents and structure, and guiding users on how to read and interpret key sections or terms. • Provide training sessions for local agricultural staff, farmer champions, or cooperatives on how to read and use the ACBs, enabling them to assist other farmers. Other recommendations • Automate the bulletin delivery system to send updates early in the morning, at noon, or in the evening, increasing the likelihood of farmers accessing the bulletin. Usability issues are often addressed by HCD experts. However, for the ACBs as well as other climate information services using the LTAC approach, the TWGs including of governmental officials and other local stakeholders play a crucial role in the service design. Hence, addressing usability of a climate information service like the ACBs requires not only HCD expertise, but also a broader view at the development process of the services. In the short term, usability enhancements and changes should be discussed and implemented collaboratively with them. In the long term, automation may provide the potential to address certain usability issues, reduce human subjectivity, and minimize errors in designing, but it will always require a participatory approach and local involvement to ensure human centered and localized services. The findings from the usability test of the Agro- Climatic Bulletins (ACBs) offer key insights for other climate information services using the LTAC approach, particularly those in bulletin format. While usability testing is often used for systems like apps or websites, this study shows that it can be effectively applied to straightforward systems like digital bulletins. Applying HCD, the usability test conducted in this study revealed intuitive insights into farmers’ interactions with the ACBs — insights that would be hard to capture otherwise. These findings emphasize the importance of making climate information services accessible, useful, and easy to use for their intended users. Conclusion https://alliancebioversityciat.org/tools-innovations/local-technical-agroclimatic-committees-ltac https://alliancebioversityciat.org/tools-innovations/local-technical-agroclimatic-committees-ltac https://alliancebioversityciat.org/tools-innovations/local-technical-agroclimatic-committees-ltac 10 Info Note 1 - Usability Testing and Assessment of the Agro-Climatic Bulletin in Vietnam Budiastuti, E., Ritchi, H., & Deliana, Y. (2023). Usability Analysis of Digital-Based Agricultural Product Marketing Platform at Farmers Level in Region V, Bogor Regency. Scientific Journal of Informatics, 10(3), 297–312. https://doi.org/10.15294/SJI. V10I3.44605 CIAT. (2023). Human-Centered Design: An approach to capacity building. https://alliancebioversityciat.org/stories/ human-centered-design-approach-capacity-building-and- co-design-inclusive-tools-agriculture CIAT. (2024). Notifications of timely climate alerts boost farmers’ resilience across Vietnam’s Mekong River. https:// alliancebioversityciat.org/stories/notifications-timely- climate-alerts-boost-farmers-resilience-across-vietnams- mekong-river Giraldo-Mendez, D., Navarro Racines, C. E., Martínez Barón, D., Loboguerrero Rodriguez, A. M., Gumucio, T., Martínez, J. D., Guzmán Lopez, H., & Ramírez Villegas, J. A. (2021). Local Technical Agroclimatic Committees (MTA): A detailed guide on its implementation step by step - Second Edition. CGIAR Research Program on Climate Change, Agriculture and Food Security. https://hdl.handle.net/10568/114943 Giraldo, D.; Zapata, E.; Ortiz, B.; Simiyu, M.; Muller, A. (2024) Applying human-centered design principles to climate services in Nairobi, Kenya: Workshop Report. 19 p. https:// hdl.handle.net/10568/159991 Harley, A. (2018, February 25). UX Expert Reviews. https:// www.nngroup.com/articles/ux-expert-reviews/ Harte, R., Quinlan, L. R., Glynn, L., Rodríguez-Molinero, A., Baker, P. M. A., Scharf, T., & Ólaighin, G. (2017). Human- centered design study: Enhancing the usability of a mobile phone app in an integrated falls risk detection system for use by older adult users. JMIR MHealth and UHealth, 5(5). https://doi.org/10.2196/mhealth.7046 IDEO. (2015). The field guide to human-centered design. https://www.designkit.org/resources/1.html ISO. (2019). Ergonomics of human-system interaction- Human-centred design for interactive systems. Luong, V. L., Giraldo, D., Giles, J., Müller, A., Swaans, K., & Ramirez-Villegas, J. (2024). Climate information services in the Mekong River Delta, Vietnam: A human-centered design approach. Interview guide for validate phase. https://hdl. handle.net/10568/159726 Nielsen, J. (1994). Usability Engineering. Morgan Kaufmann Nielsen, J. (2024). 10 Usability Heuristics for User Interface Design. https://www.nngroup.com/articles/ten-usability- heuristics/ Swaans, C., Barlis, A., & Le, T. T. (2023). Over 130,000 farmers in the Mekong Delta, Vietnam, have used timely weather forecasts and advisories to improve farm decisions, leading to higher yields and profits. Reporting 2022 evidence, study 4702. Rome (Italy): Bioversity International; Cali (Colombia): CIAT. 3 p. https://hdl.handle.net/10568/132401 This info note was conducted as part of the CGIAR research initiative on Asian Mega-Deltas (AMD), with a specific focus on de-risking delta-oriented value chains. The info note builds on findings from research on the application of Human-centered design to understand farmers’ use of the Agro-Climatic Bulletin in the Mekong River Delta, Vietnam. Suggested citation Luong, V.L., Giraldo, D., Giles, J., Nguyen, M.H., Le, T.T., Swaans, K. (2024). Human-Centered Design in Action: Bridging Gaps in Climate Information Services. Info Note 1 - Usability Testing and Assessment of the Agro-Climatic Bulletin in Vietnam. Hanoi (Vietnam). The International Center for Tropical Agriculture (CIAT). 10p. Contributing agencies The Alliance of Bioversity International and CIAT Royal Melbourne Institute of Technology (RMIT) Vietnam, School of Communication and Design We would like to thank all funders who support this research through their contributions to the CGIAR Trust Fund: www.cgiar.org/funders To learn more about this Initiative, please visit: https://www.cgiar.org/initiative/asian-mega-deltas/ Copyright © 2024 CIAT. Some rights reserved. This work is licensed under a Creative Commons Attribution Noncommercial 4.0 International Licence (CC BY-NC 4.0). https://creativecommons.org/ licenses/by-nc/4.0/ For more information, please contact: Tam Thi Le t.t.le@cgiar.org Alliance of Bioversity International and CIAT Kees Swaans c.swaans@cgiar.org Alliance of Bioversity International and CIAT References Ortiz-Crespo, B., & Zapata, E. (2023). Human centered design workshop. CGIAR Digital Innovation a hands-on training. Montpellier. 27-28 September 2023. 49 sl. https:// hdl.handle.net/10568/134721 Sebald, C., Treiber, M., Eryilmaz, E., & Bernhardt, H. (2024). Usability Testing of Novel IoT-Infused Digital Services on Farm Equipment Reveals Farmer’s Requirements towards Future Human–Machine Interface Design Guidelines. AgriEngineering 2024, Vol. 6, Pages 1660-1673, 6(2), 1660– 1673. https://doi.org/10.3390/AGRIENGINEERING6020095 Acknowledgement https://doi.org/10.15294/SJI.V10I3.44605 https://doi.org/10.15294/SJI.V10I3.44605 https://alliancebioversityciat.org/stories/notifications-timely-climate-alerts-boost-farmers-resilience-across-vietnams-mekong-river https://alliancebioversityciat.org/stories/human-centered-design-approach-capacity-building-and-co-design-inclusive-tools-agriculture https://alliancebioversityciat.org/stories/human-centered-design-approach-capacity-building-and-co-design-inclusive-tools-agriculture https://alliancebioversityciat.org/stories/human-centered-design-approach-capacity-building-and-co-design-inclusive-tools-agriculture https://alliancebioversityciat.org/stories/human-centered-design-approach-capacity-building-and-co-design-inclusive-tools-agriculture https://alliancebioversityciat.org/stories/human-centered-design-approach-capacity-building-and-co-design-inclusive-tools-agriculture https://alliancebioversityciat.org/stories/human-centered-design-approach-capacity-building-and-co-design-inclusive-tools-agriculture https://alliancebioversityciat.org/stories/notifications-timely-climate-alerts-boost-farmers-resilience-across-vietnams-mekong-river https://alliancebioversityciat.org/stories/notifications-timely-climate-alerts-boost-farmers-resilience-across-vietnams-mekong-river https://alliancebioversityciat.org/stories/notifications-timely-climate-alerts-boost-farmers-resilience-across-vietnams-mekong-river https://alliancebioversityciat.org/stories/notifications-timely-climate-alerts-boost-farmers-resilience-across-vietnams-mekong-river https://hdl.handle.net/10568/114943 https://hdl.handle.net/10568/159991 https://hdl.handle.net/10568/159991 https://www.nngroup.com/articles/ux-expert-reviews/ https://www.nngroup.com/articles/ux-expert-reviews/ https://doi.org/10.2196/mhealth.7046 https://www.designkit.org/resources/1.html https://designthinking.ideo.com/faq/whats-the-difference-between-human-centered-design-and-design-thinking https://hdl.handle.net/10568/159726 https://hdl.handle.net/10568/159726 https://hdl.handle.net/10568/159726 https://www.nngroup.com/articles/ten-usability-heuristics/ https://www.nngroup.com/articles/ten-usability-heuristics/ https://hdl.handle.net/10568/132401 http:// www.cgiar.org/funders https://www.cgiar.org/initiative/asian-mega-deltas/ https://creativecommons.org/licenses/by-nc/4.0/ https://creativecommons.org/licenses/by-nc/4.0/ https://hdl.handle.net/10568/134721 https://hdl.handle.net/10568/134721 https://doi.org/10.3390/AGRIENGINEERING6020095