{"id":1896,"date":"2021-07-04T22:05:42","date_gmt":"2021-07-04T20:05:42","guid":{"rendered":"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/?p=1896"},"modified":"2021-07-05T09:24:44","modified_gmt":"2021-07-05T07:24:44","slug":"a9-p8-preparation-of-a-summative-evaluation","status":"publish","type":"post","link":"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/2021\/07\/04\/a9-p8-preparation-of-a-summative-evaluation\/","title":{"rendered":"[A#9, P8] Preparation of a summative evaluation"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">I. Assignments<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">(1) Improve your high-fidelity prototype<\/h3>\n\n\n\n<p>Gruppe 4 hatte nicht ihr Google Form, also ihr Feedback, im letzten Blogbeitrag verlinkt bzw. ihr Feedback im Blogpost beschrieben. Wir konnten Gruppe 4 leider nicht \u00fcber Mattermost erreichen, weshalb wir leider nicht ihr Feedback einarbeiten konnten.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">(2) Preparation for a summative evaluation<\/h3>\n\n\n\n<p><strong>1. Please recall your experience and takeaways from your first testing session (<a href=\"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/2021\/05\/31\/a6-p8-paper-prototyping-and-usability-testing\/\">#Assignment 6<\/a>)<\/strong><\/p>\n\n\n\n<p>Wir m\u00f6chten uns st\u00e4rker an unser Skript als in Assignment 6 halten, da unsere Interviews alle sehr verschieden geworden sind(zumindestens der Sprechteil des Moderators)<\/p>\n\n\n\n<p><strong>2. Prepare all documents (script, consent form, \u2026) you will need during the test session:<\/strong><\/p>\n\n\n\n<p>a. F\u00fcr die Verwendung und Auswertung der gesammelten Daten, brauchen Wir eine Eigenst\u00e4ndigkeitserkl\u00e4rung. Wir haben eine <a href=\"https:\/\/www.datenschutzexperte.de\/fileadmin\/user_upload\/PDFs\/einverstaendniserklaerung_dsgvo_datenschutzexperte.pdf\">Online Format<\/a> als Vorlage  genommen. <\/p>\n\n\n\n<p>b. Ein Skript f\u00fcr die Einf\u00fchrung durch den Moderator. Das Meiste konnten wir von unserem alten Skript \u00fcbernehmen, da es gut funktioniert hatte. Wir m\u00fcssen aber die Aufgaben erneut formulieren, da die Aufgabe konkret mit einem bestimmten Ziel ausformuliert werden soll.<\/p>\n\n\n\n<p>c. Ein Consent Format f\u00fcr TeilnehmerInnen.<\/p>\n\n\n\n<div class=\"wp-block-file\"><a href=\"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/files\/2021\/07\/Einverst\u00e4ndniserkl\u00e4rung.pdf\">Einverst\u00e4ndniserkl\u00e4rung_Social Play<\/a><a href=\"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/files\/2021\/07\/Einverst\u00e4ndniserkl\u00e4rung.pdf\" class=\"wp-block-file__button\" download>Herunterladen<\/a><\/div>\n\n\n\n<div class=\"wp-block-file\"><a href=\"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/files\/2021\/07\/Script-Social-Play.pdf\">Script-Social-Play<\/a><a href=\"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/files\/2021\/07\/Script-Social-Play.pdf\" class=\"wp-block-file__button\" download>Herunterladen<\/a><\/div>\n\n\n\n<div class=\"wp-block-file\"><a href=\"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/files\/2021\/07\/Consent-Form-Social-Play.pdf\">Consent-Form-Social-Play<\/a><a href=\"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/files\/2021\/07\/Consent-Form-Social-Play.pdf\" class=\"wp-block-file__button\" download>Herunterladen<\/a><\/div>\n\n\n\n<p><strong>3. This time, you will measure the effectiveness using the task completion rate.<\/strong><\/p>\n\n\n\n<p>We just take the provided Observation Coding Form from HCC Group.<\/p>\n\n\n\n<div class=\"wp-block-file\"><a href=\"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/files\/2021\/06\/HCC_Short_ObservationCodingForm.pdf\">HCC_Short_ObservationCodingForm<\/a><a href=\"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/files\/2021\/06\/HCC_Short_ObservationCodingForm.pdf\" class=\"wp-block-file__button\" download>Herunterladen<\/a><\/div>\n\n\n\n<p>4<strong>.This time, you will also measure the satisfaction of users, by using a post-task or post-test questionnaire.<\/strong><\/p>\n\n\n\n<p>We plan to take UEQ for measuring the satisfaction of users. Here are our considerations:<\/p>\n\n\n\n<p>(1) We prefer a post-test questionnaire, since the full process from create account task to log out task is a complete user journey on our web application, which cannot be seperately measured. Lack of any single task will make the user journey incomplete and will make the satisfaction evaluation unreliable. The usage of social play is based on a smoothly enjoyable gaming evening, which consists of several tasks to be completed through our web application. But the usage process will be interrupted by task-level satisfaction assessment. And since all task satisfaction level together account for the general usage of social game, we decided to use post-test satisfaction questionnaire.<\/p>\n\n\n\n<p>(2) Between different standardized measurements we prefer SUS, UEQ and AttrakDiff2 in terms of their reliability and widely usage.  We first don\u2018t want to choose questionnaire with too many questions, since we are afraid that those questionnaires will cause implatiency of participants. Compared to SUS, UEQ and AttrakDiff2 measures satisfaction on a more well-round level with different dimenstions. But AttrakDiff2 has a strong focus on hedonistic quality, which is not our main purpose, we therefore choose UEQ for our satisfaction measurement. <\/p>\n\n\n\n<p>The questionnaire can be reached by scanning the QR Code:<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/files\/2021\/07\/UEQ_Social-Play-1024x1024.png\" alt=\"\" class=\"wp-image-1906\" width=\"256\" height=\"256\" srcset=\"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/files\/2021\/07\/UEQ_Social-Play-1024x1024.png 1024w, https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/files\/2021\/07\/UEQ_Social-Play-300x300.png 300w, https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/files\/2021\/07\/UEQ_Social-Play-150x150.png 150w, https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/files\/2021\/07\/UEQ_Social-Play-768x768.png 768w, https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/files\/2021\/07\/UEQ_Social-Play.png 1127w\" sizes=\"auto, (max-width: 256px) 85vw, 256px\" \/><figcaption>We made a google form questionnaire used the standard questionnaire provided by<a href=\"https:\/\/www.ueq-online.org\/\"> UEQ<\/a>. The QR code is then self-made using the onling platform <a href=\"https:\/\/www.qrcode-monkey.com\/\">QR-Code Monkey.<\/a> <\/figcaption><\/figure>\n\n\n\n<p>5. <strong>Document preparation.<\/strong><\/p>\n\n\n\n<p>We document the preparation as by using the assignment questions. <\/p>\n\n\n\n<!--nextpage-->\n\n\n\n<h2 class=\"wp-block-heading\">II. Reflection<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">Wer hat welchen Beitrag geleistet?<\/h3>\n\n\n\n<p>Ina took care of subtask 1 and created detailed task description (script) as well as the formulation of declaration of agreement. Brendan prepared the necessary documents (what documents we need and the templates). Xin Yu was responsible for the satisfation questionnaire as well as blogpost writing.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Was habt ihr gelernt?<\/h3>\n\n\n\n<p>First of all, we learned how to exctly formulate a task for user to complete. For example, in our Assignment 6 LoFi Testing, we somehow formulated the tasks as &#8222;please make yourself familiar with the design&#8220; &#8222;get to know the function create an account&#8220; etc. Those formulations are with no explicitely formulated task goals which will cause confusion of the users.<\/p>\n\n\n\n<p>Otherwise we also learned how to measure user satisfaction and got to know a variety of standardized questionnaires. By doing the assignment, we did some research regarding how to choose the suitable questionnaire and was able to apply the method for choosing our own tool. <\/p>\n\n\n\n<p><strong>Was lief gut?<\/strong><\/p>\n\n\n\n<p>It ran generally good, since this assignment can be compared to Assignment 6 so that we already had some positive\/negative experience from previous usability testing and kind of knew where we should pay attention to for the new assignment. <\/p>\n\n\n\n<p><strong>Was m\u00f6chtet ihr verbessern?<\/strong><\/p>\n\n\n\n<p>The cross team communication could be improved, since as we wrote in task 1, we were unable to contact group 4 in mattermost (tbh, I only had negative experience with mattermost, the notification alert seems never worked), and they didn&#8217;t post their answer to assignment 8 in the blogpost, so that we were even unable to check their blogpost to view the heuristic evaluation result from them. <\/p>\n","protected":false},"excerpt":{"rendered":"<p>I. Assignments (1) Improve your high-fidelity prototype Gruppe 4 hatte nicht ihr Google Form, also ihr Feedback, im letzten Blogbeitrag verlinkt bzw. ihr Feedback im Blogpost beschrieben. Wir konnten Gruppe 4 leider nicht \u00fcber Mattermost erreichen, weshalb wir leider nicht ihr Feedback einarbeiten konnten. (2) Preparation for a summative evaluation 1. Please recall your experience &hellip; <a href=\"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/2021\/07\/04\/a9-p8-preparation-of-a-summative-evaluation\/\" class=\"more-link\"><span class=\"screen-reader-text\">\u201e[A#9, P8] Preparation of a summative evaluation\u201c<\/span> weiterlesen<\/a><\/p>\n","protected":false},"author":6151,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[384608,397246,416539],"tags":[],"class_list":["post-1896","post","type-post","status-publish","format-standard","hentry","category-projekt-8","category-week-11","category-assignment-9"],"_links":{"self":[{"href":"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/wp-json\/wp\/v2\/posts\/1896","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/wp-json\/wp\/v2\/users\/6151"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/wp-json\/wp\/v2\/comments?post=1896"}],"version-history":[{"count":4,"href":"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/wp-json\/wp\/v2\/posts\/1896\/revisions"}],"predecessor-version":[{"id":1914,"href":"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/wp-json\/wp\/v2\/posts\/1896\/revisions\/1914"}],"wp:attachment":[{"href":"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/wp-json\/wp\/v2\/media?parent=1896"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/wp-json\/wp\/v2\/categories?post=1896"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.fu-berlin.de\/hci1-sose2021\/wp-json\/wp\/v2\/tags?post=1896"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}