Skip to 0 minutes and 1 second Let’s talk about a few ways you can do that on incremental features. Okay, here’s a mockup of the enable quiz might look like. One really interesting test, and it’s just one tool, is to do a fake feature test. So, let’s say this is their normal menu for aadding and administering quizzes and they add this little tab here, Skills Audit, and they see if anybody clicks on it. This is on a SAS product where they control the software. They probably only, they have a lot of users, they only roll this out to a subset of them, and they just see who clicks on it. And if they click on it, they come to a tab that says coming soon or
Skip to 0 minutes and 39 seconds sign up for updates here, if you want them. And this is a good way to gauge interest under these particular circumstances. So if a lot of people click on it what can you conclude? Well, you can’t conclude that they’re going to love it and use it. But you can conclude that they would take note of it and check it out. And that’s good. That’s a positive initial signal that there’s some interest. And the thing that I wouldn’t do is over conclude about this. You also don’t want to run the, you don’t need a huge amount of statistical significance here. You just want a notion of whether people will click on it.
Skip to 1 minute and 11 seconds So this fake feature test is a good thing to do. Don’t over conclude it and don’t run it too much or too long. You just want to get a relatively small sample to see if the people are going to click through on it and take note.
Skip to 1 minute and 23 seconds Another thing to do, a great tool for new features, is to concierge them. Just like we talked about with the whole new product, we take this incremental thing we’re thinking about adding to an existing product, and we do kind of a hand carried version of it. I know it seems like a lot of work but if you think about it, all software can do at the moment anyway, is automate and standardize things that we already know how to do. That is machine intelligence, and softwares learning how to be its own creator to a small degree and that’s certainly coming. But right now, mainly, we standardize and automate and structure things that we already know how to do.
Skip to 2 minutes and 0 seconds So if you think about it, the idea that we don’t really know how to do this and we don’t exactly know how customers do it, but we’re going to build software for it, it’s pretty crazy when you think about it. So I think it makes a lot of sense to hand create this experience. It’s not going to feel like real work. You’re going to wonder whether you should do it, you should do it. So another great tool for the enable quiz team is to concierge the skills audit. So find a customer that wants to do this. How would you do that? Well, maybe you ask them a series of non-leading questions at increasing levels of specificity.
Skip to 2 minutes and 30 seconds So for example, hey, tell me about what’s on your A list management-wise to the functional manager that takes care of a bunch of engineers. And what have you done in the last few months that really helped you do a better job as a manager? What would you do if time and money weren’t an issue? Now if they start saying things like, I’d get everybody on an e-learning platform and kind of help them tailor their own programs. So they could advance their skill sets and move their career arc in the way that they want. Then that’s a good signal that they might care about what we have.
Skip to 3 minutes and 3 seconds And if they don’t say anything about it, then we don’t want to concierge with these people, we might want to concierge with anybody. If this problem doesn’t exist, we don’t want to pursue it. So, it’s a good thing to find out early because that allows us to pivot and focus somewhere else on something that does matter to them. And so a good way to find a customer to participate or customers, just ask them a series of non leading questions, something you should do. Anyway, if you remember we move from persona to problems scenario. Who is this person? What do they care about? And then, enable quiz maybe just does this whole thing by hand.
Skip to 3 minutes and 37 seconds So, we find out what kind of jobs they want these developers to be able to do. Which ones are important. They design assessments to test for that with their quizzes, they do those. Maybe this is or isn’t on the actual platform. That’s less important, because we’re not on a scaling mission with this. We’re not trying to build the 1.0, the skills audit. We’re on a learning mission to learn if and what this thing would be, to be valuable to the customer. They would take this forward to a professional ed program, yes, they don’t sell the professional ed but if that’s not the outcome that this thing can drive to then we think that they’re probably not going to care.
Skip to 4 minutes and 14 seconds Hey, it’s great they have these skills but what has to be, we think probably our hypothesis is that it has to be actionable. so we find the professional ed program, even though we know that’s not in our area. And we help them run a pilot to go out and up skill the employees. And so, this seems like a ton of work, but again, I think, personally, it’s crazy to try and standardize and automate something with software that you don’t understand really well. So, concierge testing is one of the most powerful vehicles you can use to increment your features on the margin. It may not be a right fit your particular product, maybe the fake feature test is, maybe something else.
Skip to 4 minutes and 47 seconds But this is a great way to apply the methods that you have been learning about in the course on the margin as you develop new features.
The importance of good enough: Seedling features
© Copyright Rector and Visitors of the University of Virginia