What we learned from testing MoodleNet’s value proposition

woman-looking-up

We’ve recently finished testing MoodleNet’s value proposition with two cohorts of users, in both English and Spanish. During each three-week testing period, we sent one survey per week. In this post, we’d like to share some of the insights we’ve gleaned.

It’s important to note the following:

  1. We built the smallest possible version of MoodleNet in an attempt to answer the question, “Do educators want to join communities to curate collections of resources?”
  2. During the testing process, we didn’t discuss future functionality in the user interface or in the emails we sent users. We did, however, discuss the roadmap in a tool called Changemap which we’re using to collect and discuss feedback and feature requests.
  3. One of the key features of MoodleNet will be federation (i.e. the ability to have separate instances of MoodleNet that can communicate with one another). This will change the user experience and utility of MoodleNet in significant ways.

The survey data we’ve collected suggests that MoodleNet is indeed something that can sustainably empower communities of educators to share and learn from each other to improve the quality of education.

What follows are three things that we’ve learned from the testing process.

1. We’ve validated the value proposition

This slideshow requires JavaScript.

A couple of days after giving each cohort of testers access to MoodleNet, we asked them, “Do you see yourself using something like MoodleNet to curate collections of resources?”. The functionality, especially during that first week for the initial cohort was extremely basic, and the experience sometimes buggy.

Despite this, by the time the second cohort filled in their first survey, it was clear that almost two-thirds of testers agreed that, yes, MoodleNet would be something that they would use.

2. The best tagline for MoodleNet: ‘Share. Curate. Discuss’

This slideshow requires JavaScript.

During the testing period we learned that creating taglines that are translatable and impactful in different languages is no easy feat. In fact, many companies and brands simply use English taglines, such as Nike’s ‘Just Do It’. We’ve decided to go ahead and use ‘Share. Curate. Discuss’ for the moment as the tagline for MoodleNet (including on the Spanish version of MoodleNet).

3. Testers are clear on what they want to see next

Through free text boxes in surveys, and from the information coming in via Changemap, it’s clear that users want to be able to:

  1. Search for specific keywords and topics of interest.
  2. Easily find out when something has changed within a community they’ve joined, or a collection they’re following.
  3. Sort lists of communities and collections by more than ‘most recent’ (e.g. by number of collections or discussion threads)
  4. Tag communities, collections, and profiles, to make it easier to find related content.
  5. Upload resources to MoodleNet instead of just adding via URL.
  6. Indicate ‘resource type’ (e.g. ‘course’, ‘presentation’ or ‘plugin’)
  7. Send resources they discover on MoodleNet to their Moodle Core instance
  8. Add copyright information to resources and collections
  9. Easily rediscover useful resources they’ve discovered in collections they’re not following
  10. Access MoodleNet on their mobile devices

Happily, we’ve already got MoodleNet working on mobile devices, although we’re still having some issues with Safari on both iOS and MacOS. We’re also launching ‘timeline views’ for communities and collections this week which will allow users to see what’s changed since they’ve been away.

As for the rest of the suggestions, we’re working on them! The most user-friendly way to see progress is via Changemap at: https://changemap.co/moodle/moodlenet

Conclusion

When developing software products, it’s easy to come up with a plan and start working on it without validating what you’re doing with users. We’ve still got a way to go before MoodleNet is exactly what community participants want from it, but we feel that in this initial testing period we’ve got a mandate to keep on iterating.

A big thank you to our two cohorts of testers, who have provided invaluable feedback. They still have access to MoodleNet beyond the testing period. We’ll be inviting more people to join at next month’s UK & Ireland MoodleMoot in Manchester, so why not join us there?

The second round of MoodleNet initial testing starts next week!

This slideshow requires JavaScript.

We’ve learned a lot from the first testing round of MoodleNet, which ends this week. Our focus has been on testing the value proposition, “Do educators want to join communities to curate collections of resources?” It’s early days, but it would appear that yes, they do!

The wealth of feedback we’ve received during the first testing period really has been invaluable. Our enthusiastic bunch of 100 testers have shown us what they prefer, through their use of MoodleNet, responses to surveys, and suggestions via Changemap. Happily, we’re not ‘wiping’ or ‘resetting’ the HQ instance, so we’re encouraging the 100 testers to use MoodleNet beyond this initial period.

As demonstrated in a previous update, over the last three weeks we’ve added a lot of functionality to MoodleNet, made many improvements to the user interface, and fixed a number of bugs. We’re looking forward to seeing how 150 additional testers respond to MoodleNet when they get started next week.

It’s now two months until our planned beta launch at the UK & Ireland MoodleMoot, so the team has some very important functionality to work on. Soon, MoodleNet will be:

    • Mobile — access MoodleNet on-the-go
    • Searchable — find communities, collections, and people across all of MoodleNet’s federated instances
    • Connected — import resources you discover on MoodleNet into courses in Moodle Core
    • Federated — join any instance of MoodleNet and interact with communities, collections, and other users across all instances

The MoodleNet team would like to thank the Moodle community for the encouragement and feedback we’ve received so far. We’re dedicated to creating an easy-to-use environment where educators can share, curate, and discuss!

MoodleNet testing: Day 13 update

Update: Check out this overview video showing the changes we’ve made!

MoodleNet screenshot - Day 13

Yesterday, we made our first major update to the version of MoodleNet currently undergoing initial testing. Not only did this update alter the look and feel of the interface, but it also added some useful new functionality and fixed some bugs reported by users via Changemap.

Functionality added

  • Gravatars to represent users
  • Community overviews
  • List of members in communities
  • Collections display number of resources they contain
  • Collections indicate number of followers

UI tweaks

  • Button styles and positions improved (e.g. for ‘Create a community’)
  • Increased character limit in text fields
  • Moved language selector to menu and removed flags
  • Added full-width images in communities
  • Sidebar has a darker colour

Bug fixes

  • Improved metadata import when adding resources
  • Users can only add resources & edit collections in communities they’ve joined
  • ‘All collections’ page fixed
  • Switching languages and then back to British English no longer causes an error
  • Word wrapping on community descriptions

Next week, we’re aiming to add collection-level discussions, featured collections, and basic user profiles.


For those interested in our product management processes, we’ve also switched to Moodle Tracker (Jira) for stories and epics while sticking with GitLab for issues. Check out bit.ly/MN-epics 

Evolving the MoodleNet UI

We’re a week into the initial testing of MoodleNet and are already getting some fantastic feedback from testers!

MoodleNet current (early Feb 2019)

While there’s a long way still to go before we can open registrations, things are really starting to come together in terms of the user interface (UI) for MoodleNet.

The above screenshot was taken today. Even in this very initial version, the feedback we have had from testers has been mostly positive. Our anonymous survey to ask for their first impressions included responses such as “nice interface”, “attractive” and “clean and clear”.

MoodleNet staging version

Our designer and front end developer, Ivan Minutillo, isn’t content to rest on his laurels, however. The above screenshot is taken from our staging server and shows an iteration of the UI that we will make available to users over the next few days.

As you can see, there are many improvements, including:

  • Image width
  • Placement of ‘Create a community’ button
  • ‘Overview’ tab in communities
  • Indication of community members
  • Dark sidebar
  • Use of gravatars

MoodleNet - future mockup

Ivan hasn’t stopped there, either, though! Although the above mockup isn’t coded yet, this is the direction we are currently thinking of heading with MoodleNet. As you can see, the sidebar now includes ‘MoodleNet’ at the top, there is search functionality (which we will be doing across federated instances) and the whole experience feels much more refined.

Whether or not you’re part of the initial testing process, we’d love your feedback on this! Do you like what you see? 

What are we hoping to get out of testing MoodleNet?

Test pattern

Last week, we put out a call for initial testers of MoodleNet in English and Spanish. We’ve been delighted with the response, and have now closed the sign-up process until the next round.

When developing a new product or service, it’s important to test, test, and test again – which is exactly what we’ve done with MoodleNet so far. The concept of a resource-centric social network came out of talking to a wide range of experts and educators. That led to a design sprint that included user testing of the resulting prototype. We tested the sign-up process to MoodleNet, solicited feedback on our code of conduct, tested out community calls and office hours, how we work as a team, done some internal testing, and will be very soon running a privacy and security testing programme.

The most important test so far, however, starts next week. That’s the time when we’ll be putting MoodleNet in front of users for the first time. We’re testing the value proposition: “Do educators want to join communities to curate collections of resources?” This doesn’t mention federation. There’s no mention of mobile devices, fancy user interfaces, or machine learning. We’ve tried to create a very simple approach to test this basic value proposition.

It may turn out that users agree with this value proposition. They may think that, yes, joining communities to curate collections of resources is something they want to do. Alternatively, they may indicate that they prefer a different approach. Either way, this test is of vital importance; it makes no sense to continue along this particular path without a mandate from real-world users!

For those interested, but who aren’t part of the initial testing, here’s how it will proceed:

  • Successful applicants will have their email address whitelisted and be invited to sign up to a Moodle HQ-run instance of MoodleNet
  • Feedback from users during the testing process will be collected in two ways: via Changemap and through weekly surveys
  • New features will be rolled out during the testing process, as detailed on this milestone

If you missed the sign-up process this time around, or weren’t available for the first testing period, then don’t worry! You will have an opportunity to put your name forward again in a few weeks’ time.

Reflecting on feedback from testers about the user sign-up process

User testing

Last week, the MoodleNet team were in Barcelona at Moodle Spain HQ. Much of the work week involved the kind of discussion and implementation that can be difficult to write about, as it mainly involved hooking up the backend and front-end code.

Kayleigh and Sam from Outlandish joined us in the office on Thursday and Friday, which meant that we had an opportunity to reflect on the results of some testing they did with users about the sign-up process for MoodleNet. Their findings are below (or click here).

Based on user feedback, which is always different from what you expect, we’ve decided to take a different approach to the sign-up process. It became clear that there are users who want to get straight in and start using platforms straight away. These are the kind of users who will complete their profile later.

On the other hand, there are users that want to complete their profiles straight away, so that they have a full ‘presence’ on the platform and others can find out more about them.

Our proposed workflow, which will have a knock-on effect on other elements of the user interface, is below (or click here).

What are your thoughts on this? Note that we’re planning to implement a (skippable) user tour for first-time users of MoodleNet. We’ll also be writing a post soon that explains ‘Emoji ID’ and why it’s more than just a cute thing to have on your profile!


Image by José Alejandro Cuffia used under the terms of an open license

Testing MoodleNet sign-ups

Update: sign-ups for this are now closed, and Outlandish will be in touch with those who registered their interest!

Usability testing

Over the next couple of weeks we’re going to be doing some online user testing of MoodleNet’s sign-up process. It will be run by Outlandish, with whome we’ve been working on front-end development and UX.

We’re aiming is to remove any barriers to adoption for the beta testing in January. So we need feedback on everything from “that button should be on the left” to “what on earth is that emoji ID thing?!”

It’s not remunerated, but you’d be front of the queue for a MoodleNet beta account (of which there’ll only be 100, initially) next year!

If that sounds like the kind of thing in which you’d be interested, here’s what to do:

  1. Introduce yourself here
  2. Check your availability for the following dates (GMT): Weds 14th (PM), Mon 19th (PM), Tues 20th November
  3. Fill in this form

Thanks in advance! We’re looking forward to making MoodleNet as awesome as possible!


Privacy notice: if you volunteer for testing, your details will be added to a spreadsheet, stored on Moodle HQ’s Google Drive. We’ll keep your information until the end of the testing process and share your details with Outlandish, who are overseeing the testing process. Before testing, you’ll be required to give your consent to ensure GDPR compliance.