Michael Royzen has developed seven apps for iOS, including his latest launch, SmartLens.
Michael Royzen has developed seven apps for iOS, including his latest launch, SmartLens.

Prolific App Developer Michael Royzen Plans for a Future in College and AI Innovation

On June 10 Michael Royzen, 18, will don his cap and gown and graduate from The Bush School in Seattle, Washington. Like many of his classmates, the soon-to-be high school grad has been busy finishing up projects and finals, celebrating, and preparing for the big day. He admits, however, that he has been slightly distracted by the recent launch of his seventh app for iOS, Apple’s mobile operating system. SmartLens, designed to turn your phone into a search box, is Royzen’s most sophisticated app yet, and is fittingly launching at a time when the teen software developer is considering future prospects and the shape of his life after high school. That will definitely involve entrepreneurship, but not before he first heads to college.

KWHS caught up with Royzen to discuss his latest fascination with artificial intelligence (human intelligence exhibited by machines) and find out what’s in store for a kid who has caught the eye of media outlets like GeekWire (he was the featured ‘Geek of the Week’ in February 2017) and companies like Apple and Microsoft.

An edited version of our interview appears below.

Knowledge@Wharton High School: How does your SmartLens app operate?

Michael Royzen: I think of it as a Shazam [an app that identifies the music and other media playing around you] for the visual world. It’s a way for you to quickly understand the world around you. You can point your phone at anything and the app will quickly identify it. The app segments the world into three categories: products, general objects, like flora and fauna, and businesses. As soon as it recognizes something, it then determines what you want to do next. Let’s say you point your phone at a product, like something in a package or a book, it will identify the product and then let you buy it. That doesn’t make sense for flora and fauna. If you point your phone at a dog, it will identify the dog and then show you a Wikipedia description, something relevant for the object that it recognizes. My goal is to not only tell users what they’re looking at, but to also take that second step and bridge the gap between what they see and what they want to do by showing them relevant information based on the type of object they recognize.

Another important thing to me was to have the app be able to work offline. You can put your phone in airplane mode or can go off the grid and SmartLens will still be able to recognize more than 17,000 objects — animals, flora, fauna — totally offline. You can go into the forest and it will still work. That is the first of its kind. No other visual search solution can do that as of now.

It was my goal from the beginning to have the app work offline. I love nature, to hike and to explore the outdoors. The world around us is incredibly beautiful, and it also raises a lot of questions. One day it hit me that there wasn’t a solution that could tell you what you’re looking at, whether it’s nature, a product or anything you encounter. My idea was to have an app that could give you that information whether you were on or off the grid. I built the whole app on the technical side from that foundation. The way the app works is even if you do have an Internet connection, the app always runs a neural network on the device. So, no matter what, when you open the app it will run a neural network on the device using the GPU (graphics processing unit) and it will give a primary result. Based on that result, it will do multiple different things. It will either run other neural networks on the device to give you a more specific answer or it will invoke other neural networks working in the cloud to recognize products and other things. The reason why I have so many neural networks running on the device is because it’s much better for the user. You get a result much quicker than if you have to send the request to a server somewhere in the cloud and then wait for it to come back.

KWHS: An artificial neural network (often shortened to neural network) has been described as a “strange new breed of artificial intelligence.” What exactly are neural networks and how do they work?

Royzen: Ultimately, what the neural network portion of SmartLens does is a task known as image classification, where it sees an image and it assigns a label for what that image is. My app has other stuff on top of that, like the Wikipedia information and Amazon products. But that isn’t related to the machine-learning portion. The machine-learning portion takes that initial image and determines what it is. That is fundamentally the heart of the app.

The most intuitive way to think about image classification is, say you take an image of your cat and you compare it to an image of a cat from Google Images. If you simply write an algorithm that would take all the pixels from the photo you took of your cat and compare it to a professional picture of the same breed of cat and you compare how many pixels match [to identify it], maybe that would work and maybe it wouldn’t. What if the lighting was very different between those photos or the conditions weren’t the same or the cat has slight variations that confuse its direct equivalent? Neural networks stem out as a solution to that problem. Instead of trying to classify images by a direct equivalent to something we know is the real thing you’re trying to identify, neural networks embody an empirical presentation of what that object is. Neural networks essentially embody real-world examples. There are many, many different kinds of neural networks each designed to solve specific tasks.

As far as the way the app works, you start with your input image. As soon as the user takes the photo, you convert it to a matrix of pixel values. You can think about having several different matrices, one for each color that segments the picture into three color channels of red, green or blue. The neural network is trained to recognize a certain number of objects. For each thing it can recognize, it learns features. It could be a dog’s ear, its face, tail or a specific shape. You take the feature matrix, which is much smaller than your input-image matrix, and you simply multiply all of those matrices together, the input and the feature, to determine if an input image contains a particular feature. Every single input image and every single feature and every object that the neural network can recognize are multiplied together, so it’s a massive computational undertaking. That’s how the neural network narrows down what it identifies, by multiplying the features together for every single object. And depending on the type of architecture you use – I have my own proprietary architecture that I designed for SmartLens – you continue these steps and feature convolutions.

The last step is to give an output. There is something called a fully connected layer, where it connects all of the neurons from the previous steps to all the types of objects that the neural network can recognize; all the trained categories. If SmartLens can recognize 17,000 objects offline, then that very last step would be connected to each one of those possibilities. The fully connected layer generates a probability distribution, and eventually, the category with the largest value is the object that the neural network is most confident in saying that is what the photo is identifying.

KWHS: You have now developed seven apps, everything from a game to a recipe reader to one that tells people when they need to leave for their commute. SmartLens is quite different. Have you evolved toward artificial intelligence and machine learning? If so, why?

Royzen: Yes, I have. My interest in AI stems from the fact that there are so many things that can be done. In the 70s, we saw the personal computer revolution. In the late 90s, we saw the internet revolution. Starting now and in the next five to 10 years, we’re going to see another artificial intelligence revolution. I predict that as devices get more and more powerful, they will get more intelligent. Your devices will be able to communicate with you. All sorts of really incredible stuff is possible from this form of artificial intelligence. I find the pursuit of a general AI that can pass the Turing Test fascinating. The Turing Test is basically a test for when a human interacts with a machine. If the human can’t tell that they’re interacting with a machine, then the machine is considered a true form of AI. It’s the benchmark that several people are going for. We’re not super close to that, but I find the pursuit of that inspiring. Humans are essentially mortal. At some point we’re going to die and possibly go extinct. But we can create a new life form that can continue existing for perpetuity if we do the right things. In the shorter term, there are all sorts of incredible benefits that can come about from having a truly intelligent assistant for people to use.

You hear all these dystopian stories about the things that can go wrong [with AI and robots taking over]. That’s very possible. I completely agree with Elon Musk’s determination about AI. [Elon Musk is a well-known entrepreneur who co-founded Tesla and founded SpaceX]. We should not be scared of researching it, but we should try to figure out an ethical framework for how to deal with an intelligent AI now, rather than later when it could be too late. I find all of that inspiring. I feel like that’s my calling. I want to make something cool that people can enjoy and benefit from.

KWHS: How do you move on from one project to the next without clinging to your last success?

Royzen: My previous apps were simpler ideas and simpler to make. My goal was to push myself with every new app. When I came up with the idea for SmartLens and began to get into AI, I realized that it was so much cooler than what I had done in the past. That alone was enough to move on. I try not to gloat mentally or otherwise about what I’ve done in the past. The future strategy part of my brain turns on. In the present, I try not to care what I’ve done in the past. I focus on what I’m doing now and what my plans are for the future. If you’re too inclined to gloat without moving forward, that’s an opportunity for people to catch up to you. It’s a loss for you because you’re not moving forward as much as you could have.

KWHS: You are graduating from high school in a few days. Where do you go from here? Will you take a job at a top software developer or go to college?

Royzen: Ultimately, I see SmartLens as a stepping stone rather than a final destination. It became really important to me when I started working on SmartLens more than a year ago to go to college and enter a program where I can do some intensive computer science research. I’ll be going to the University of Texas at Austin this fall into the Turing Scholars program, which is a research-oriented honors program where students have to engage in research and can gradually write a thesis that they have to defend in front of a panel.

I’ve thought a lot about my path in the past year. Initially, I wasn’t as keen on going to college until I got into AI. I realized that the state-of-the-art in AI research is moving so quickly that the only way to allow me to get there and to have the opportunity to push it forward is to first get my feet in academia. Last summer, I interned at Microsoft Research, where I worked on some AI tools. The corporate research landscape is also very interesting, but it’s to a degree different. It’s still more applied than results-oriented compared to academia research in AI. I see my path as first going into academia to understand all of the theoretical aspects, and then to dip my feet in the corporate research landscape once again to understand the applied landscape, and then go off and start my own company.

KWHS: Do you consider yourself an entrepreneur?

Royzen: Yes, I see starting my own company as the end goal. I do want to go off on my own. That will only happen once my co-founders and I have some idea that we feel can be game changing. The pursuit of that idea is my biggest driving force to go to college. And also to find a specific solution to that idea. Sergey [Brin] and Larry [Page], the founders of Google, came up with the idea for PageRank, Google’s initial algorithm that assigned different relevances to web pages from a user search, while they were doing state-of-the-art research at Stanford University. That’s the path that I want to stay on until I have the chance to break off. If an idea and a solution happen earlier, then I will go ahead and pursue it.

KWHS: You have made great strides in software development for someone your age. What are some of your personal success strategies?

Royzen: It’s initially hard to be confident in your wildest ideas because you don’t have a roadmap. You have a cool idea and you want to work on it, but you don’t know if you can get it done or how you can get it done. I have been really inspired by Elon Musk in this area. I do my best to let my ideas flow and not worry too much about the technical side. It can always be figured out. To get to that point, I have had to get comfortable trusting my gut intuition and I have had to persevere. Once you get those two aspects down, then you can start to not be afraid of your wildest ideas.

My previous experience building apps helped me get up to that point. I began to trust my intuition enough to pursue this idea of making the most accurate digital search app in the world, which is a crazy idea. When I came up with the idea, I sat down at my computer and I simply began to research. I had a gut instinct and I trusted that with enough perseverance I could get it done. There were several pitfalls while working on the project. There were also several pivotal decisions that I made, some of which I didn’t know the impact of at the time, that resulted in the project turning out the way it did. It’s really about trusting your intuition and continuing to try and try again when it doesn’t work. I tried no fewer than 150 different neural network architectures and training techniques before I finally came upon something that worked the way I wanted it to. You’ve just got to keep trying.

Running three to five miles every single day at the same time helps me keep that self-discipline. It helps me persevere and push through those difficult technical moments. It’s hard. I can’t say enough about how difficult those moments are when you’re in that pit where you need to solve a specific problem to get to where you want to be, but it’s not a clear deal. Entrepreneurship is a story of high highs and low lows. I’ve come to enjoy the process in general. Pushing myself to the limit, trying different ideas, persevering when it doesn’t work the way I want it to.

KWHS: Do you believe that your age helps or hinders your success?

Royzen: I’ve been co-president of a club called TeenTech that is part of a larger worldwide network that hosts events to help bring kids into technology and encourages them to create solutions to various issues using technology. I consider being young to be an advantage. When you’re a high schooler in tech and doing something cool, people are more likely to pay attention to you than if you’re older. In addition to putting on events through TeenTech, I’ve been helping other high school students see that. Their age is an advantage, not a disadvantage.

KWHS: What has been your greatest lesson through all of this?

Royzen: When I was working on SmartLens, there were periods of time where that was all I did. I put everything else on the back burner. I consider SmartLens to be my first software startup. It requires everything. I thought I understood that after doing six other apps, but it turns out I was way off. That was the one thing that I really got wrong. How difficult it would be physically and mentally at the same time as school, college applications and all of it. There were days for several months where I would get home from school, work on SmartLens for six or seven hours until it was time to go to bed and then wake up early and do my homework. On the weekends, all I would do is work on SmartLens. I had no idea it would be that hard. But it turns out that level of commitment was what it would take to get the app done. I overestimated myself, which is a common thing that younger entrepreneurs need to understand. You need to find your own limits and not be overly optimistic in what you can achieve in a certain period of time.

KWHS: Are you continuing to improve SmartLens?

Royzen: There’s a point where every project reaches maturity. SmartLens is getting there quickly. I’m working on several small updates. Over the summer, my goal is to continue adding features and improving the app. I have a decent number of competitors from companies like Google who have a lot more money and resources than I do. I want to retain my lead over them. I need to continue to improve my technology and make it better.

Conversation Starters

Michael Royzen says, "It’s initially hard to be confident in your wildest ideas because you don’t have a roadmap." What does he mean by this? Do you agree or disagree? What does he offer as a solution?

What do you think of the SmartLens app idea? Would you use it? Have you used it or something similar? Offer your impressions and feedback in the comment section of this article.

Michael says, "We should try to figure out an ethical framework for how to deal with an intelligent AI," which is something that one of his role models, Elon Musk, has talked about. Do you agree that this is an important consideration given the pace of development in the field of artificial intelligence? What should be included in this type of "ethical framework?"

4 thoughts on “Prolific App Developer Michael Royzen Plans for a Future in College and AI Innovation

  1. These days, high school students – like myself – face a massive conundrum in the form of managing time in an adequate manner so as to devote enough of it to doing all the things we aspire to. Everyday, a hundred ideas cross my mind, asking me to give them a little thought, but eventually, end up getting diffused into the vacuum of academic commitments. I have taken part and won multiple business plan competitions in the last 2 years, with the hope of converting some of the ideas into something real, but the unwritten and lackadaisical laws of academics eventually take over, and suppress me into a corner in my room with an Economics and Math book in my hand – literally, the gospel for all the ideas that I had – only dreaming of ever being able to pull it off.

    SmartLens is a commendably advanced solution for anyone and everyone to make effective use of, but the train of though that approaches my mind upon reading about it, is the amount of effort that patrons like Michael nuance into managing time and other commitments in such an efficient manner.

    This is why I affirm that mainstream entrepreneurial quotes and experiences do not apply to students. When still a student, it takes an insight to drive a concept into your mind, a little push for the fruition of an idea, a little effort to stand up, raise your mindly sword and say ‘I will do this!’, but it takes a world of perseverance and grit to declare the battle between books and brains open, and conquer each of the fields with enough nuance and commitment, and Michael is a pure testament to that.

    1. Hi Saumya! Thank you for your thoughtful comment and kudos to your accomplishments.

      I agree that we hold immense responsibility as high school students in fulfilling both our academic commitments and our overarching goals in life. Diligent students often get bogged down in heaps of homework, and each day, the cycle repeats monotonously. It engulfs hours of our lives and deprives us of the freedom to truly sit down and think about the things that captivate us. I have experienced some similar “idea rushes”, but because high school drowns things out immediately, I have never come to grips with any of them.

      I remember back in middle school, time was plentiful for me. I had the will to pursue whatever I wanted, and that passion led to programming on a website called Scratch. Scratch is a coding version of Youtube: users publish their finished projects and the Scratch community can comment, like, favorite, and remix them. You can choose to follow a user if you enjoy their content, much like subscribing to a channel on Youtube. I would spend summers accumulating followers and making all kinds of games and music-related projects. I would participate in competitions where a group of 15 people would work on making a virtual OS system. My work on Scratch got me interested in coding, and the support I received from the Scratch community was invaluable. There was always motivation for me to improve on the next project. Among my most successful ones included a piano cover with 40,000 views and a puzzle game with 60,000 views. These creations converged to an app idea I wanted to make. But not long after, 8th grade summer finished, and the transition to high school pushed everything off course. Coding went under the radar, tucked snugly under Google Drive.

      As of this writing, I had just reopened my Scratch account for the first time in three years. Even amidst SAT studying, volunteer work, camps, and other commitments, I still find bits of this summer to explore my curiosity. Time shouldn’t become an obstacle for anything that is worthwhile. Royzen epitomizes pure and prolific dedication to all amazing things unknown. He inspires young people to work such that they will achieve breakthroughs on how execute their inconceivable ideas. His accomplishments as a young and prospering entrepreneur compel me to dig out some of those thoughts I hold in the back of my mind. I have gone into my old Scratch projects and refurbished them from a fresh perspective. I am revisiting my idea of fusing a unique musical experience with gaming.

      The image of an entrepreneur is seldom associated with high schoolers, though in fact, we are still capable of so much. Given our more malleable minds, we can be our own agents of creative change. We live in a generation of new technologies that our parents are not as integrated into. New windows of opportunity are available for us, like SmartLens utilizing AI. Who knows what we will do in the next few decades? We are uncertain as to how the world will change, but it’s up to us to embrace such changes.

      1. I enjoyed reading your comments, Stephen! I wish you luck with your Scratch revival. While feeding our minds and our college apps, we also have to feed our souls. Given your perspective, you may also like to read this KWHS article/video: https://whr.tn/1WV4a82. I am a true believer in high school entrepreneurship after interviewing so many innovative teens. Many times, they are not looking for all the ways an idea might fail but instead going after the “what if.” It’s inspiring!

  2. First of all, congratulations to Michael launching SmartLens after all the hard work, and wish you luck in college! I want to say that SmartLens would be so helpful to millions of people in daily life, because, sometimes we just need to know what we’re seeing. My mom loves growing flowers, and when from time to time we go take a walk in the neighborhood, she notices flowers in others’ gardens. Naturally, she wonders what those flowers’ names are so that she could go find them in the market. However, it is usually a hard job to tell the names since they all look alike in my eyes. SmartLens can be a great help to this problem, especially with its offline neural network, we will never have to worry about passing through those flowers without knowing what they are, and growing them in our own yard. SmartLens has made AI more friendly and accessible by functioning as a go-to-Wikipedia!

    I like programming as well. I recently started to learn how to create video games, and I realized what an important role AI takes part in that process. Just a few days ago I made a simple game where the player plays against the computer in a simple tic-tac-toe game. After finishing the easy part like setting up the board or telling the program to receive the input commands from the player, the more complicated and, as I see it, the most important part of the game, is to tell the computer how to play the game. Although it was just a few lines of codes that controls the computer to make maneuvers, it was the first artificial intelligence I have ever made! When I finished the game and played against the computer, I still can’t help thinking how magical it is that people can instruct computers to make decisions on its own.

    Alongside with my interest in coding, I also have an interest in UI designing. Once, I came across a PowerPoint made by an engineer, its content was very solid, but the way it’s designed made it hard to convey messages clearly. I couldn’t help noticing how much it could have been improved. Many people in fact share the same problem because they are not familiar with audience-friendly design principals. Then it occurred to me that maybe I can use the power of AI to solve this problem for them, for instance, creating an AI program that checks people’s slides and give suggestions accordingly, like Microsoft’s Word auto-correction function! I still have a long way to go, since I am far from building that program because of its complexity, but Michael’s work inspires me that as long as I put my heart into what I believe to be valuable, it’s only a matter of time and persistence before I achieve the goal.

    The recent development on AI has made great impact on our society. I agree with Michael that an AI revolution is coming soon, and sooner or later we will meet the question regarding the necessity to create an ethical framework for artificial intelligence. I don’t believe that AI revolution should be stopped, because we see from history that revolution always substitutes some obsolete tools with better ones to advance our society, and bring forth more opportunities for new generations. For instance, the internet revolution in the 90s made enormous knowledge accessible to people anywhere through just a computer screen, and also empowers businesses, small or big. Internet essentially led to many successful companies and great entrepreneurs. I believe it is the same thing for the AI revolution. Some repetitive jobs will be replaced by AI, but this also means more time saved for people who can focus more on what they don’t have enough time to do before. Technology is constantly moving forward, so when the age of AI finally arrives, all we should do is to be well prepared and embrace it.

Join the Conversation