Seeing the World Through AI: My Experience with the Meta Frames.


By Robyn Wallen

As someone with visual impairment, navigating the world can be challenging.  However, recently, a new piece of technology has brought more independence into my life: Meta Frames. They are smart glasses developed through a partnership between Meta and Ray-Ban. They have quickly become an indispensable tool for a lot of us who are blind and visually impaired people.

A big benefit is they look like everyday sunglasses, so you don’t have to feel self-conscious.  So much assistive technology is big, bulky, and draws too much attention. Many sighted people are these glasses so we will not stand out in a crowd.

The frames have a 12-megapixel camera, open-ear speakers, and a microphone. They allow you to capture photos and videos hands-free, listen to music and podcasts, and even make calls, all while staying connected to your surroundings.

The feature that truly sets these glasses apart for me is the integration with Meta AI. By simply saying, “Hey Meta,” I can access a virtual assistant that can provide information, answer questions, read to me, and even describe my surroundings. Imagine needing to know the expiry date on a milk carton in the supermarket – I can just ask Meta! This feature has been incredibly empowering, allowing me to perform tasks I couldn’t always do before.

The Live AI feature is another game-changer. It can describe the scene around me, identify objects, and even read text. Which has been invaluable in unfamiliar environments or when trying to read small print. It’s like having a personal assistant whispering helpful information in my ear.

The Meta Frames start at around $299, with prices varying depending on the frame style and lens options. You can even have prescription lenses added if your prescription is not too strong. This might seem high but compared to other assistive technology glasses designed for the visually impaired, like the Envision Glasses, which can cost upwards of $3,500, they are a significantly more affordable option.  (NOTE: These are the prices at the time this article was written)

There are many places you can buy them, including Amazon, Best Buy, Target, Lens Crafters, and Sunglass Hut.  If you decide to purchase them, they are fairly easy to set up.  You do not need a Meta or Facebook account, but you will need to download the Meta View App to your phone. They come with a charging case so you will then need to charge your case before you take the next steps to set up your glasses.  Most people have had success using VoiceOver to do this, but you can also ask a friend to help.  I am going to put the basic steps below.

Setting up your Meta Frames.

  1. Unbox and Charge: Start by unboxing your Meta Frames and charging the case fully. The glasses magnetically snap into the case for charging. The USB-C charging port is on the back of the case. Make sure your glasses are in the case while you charge them.  (NOTE-you will have to provide your own charging cord it does not come with one).
  2. Download the App: Download the Meta View app (iOS or Android) on your smartphone. This app is crucial for setting up and controlling your glasses.
  3. Pair with Your Phone: Open the Meta View app and follow the instructions to pair your glasses via Bluetooth. This involves putting the glasses on and pressing a button on the back of the case. This button is a little hard to feel but is in the center of the back toward the bottom.
  4. Connect to Wi-Fi: The app will guide you through connecting your glasses to your home’s Wi-Fi network. This allows for firmware updates and better Meta AI performance.
  5. Personalize Settings: Once connected, explore the app to customize settings like touch controls, voice activation, and privacy options. You can also connect your glasses to certain apps like Instagram, Messenger, Snapchat, Facebook, Amazon Music, and others.  Once you have activated AI, you can also connect to the Be My Eyes app, where you can call a volunteer for help.  (Be My Eyes is a free app)
  6. Start Exploring: You’re all set! Put on your glasses and start experimenting with taking photos, and videos, listening to audio, and using Meta AI.

Tips for a Smooth Setup:

  • Ensure Bluetooth and Wi-Fi are enabled on your phone.
  • Keep your phone nearby during the initial setup process.
  • Grant the Meta View app necessary permissions.

 

Here are some basic commands you can use with your glasses, and you will learn more as you go along.

  • “Hey Meta, take a photo.”
  • “Hey Meta, play my favorite playlist.”
  • “Hey Meta, call my mom.”
  • “Hey Meta, what’s the weather like today?”
  • “Hey Meta, read this sign.”
  • Hey, Meta what is in front of me.”
  • Hey, Meta read me the appetizers, entrees, or desserts on this menu.”
  • Hey, Meta, what is the address on this envelope.”

As you work with your glasses, you will learn that you can ask different questions to get different answers.  So, if you don’t get the answer you want the first time, rephrase the question.  Caution: The “Look and Tell Me” feature is Ai, which is a fairly new technology.  It will sometimes have hallucinations, so be sure to ask more than once if the answer sounds off.  I am sure this will get better as time goes on.  One of the awesome things about AI is that it learns from you, so the more you use your glasses, the better your answers get.

 

If you are interested in using your glasses with the Be My Eyes App, you will need to download that free app as well. You will need to have both apps open and go to the Accessibility tab in the settings of the Meta View app to permit Meta to connect with Be My Eyes. You will also have to have a free Be My Eyes account. Once you are set up just say, “Hey, Meta call Be My Eyes and a volunteer will answer to help you.

 

While the Meta Frames aren’t specifically designed as assistive technology, their features have proven incredibly beneficial for me as a visually impaired person. They have enhanced my independence, improved my access to information, and, quite simply, made life easier.  If you are looking for more affordable technology, they are a great option.  They won’t be perfect but simply another tool in your toolbox.