This is fantastic! I've been wanting this, I'll try it very soon. If I'm understanding this correctly, it's an extension that monitors the FB account just to read the messages, right? Is there no API integration with FB messenger (or WhatsApp/Instagram/something easier than running a browser all the time)?
I did research into messenger bots quite awhile ago but stopped for some reason.
It might of been that I couldn't trigger it with Hey Meta, but that's before I learnt how to force a friend/groupchat sync. (so might be different now)
It would definitely be better as it's quite a pain for daily use or out and about and more of a tech demo in its current state.
Hah, this is great. So many amazing use cases are being hidden behind walls.
I love my Meta Ray Bans but frankly Llama is not best in class and it also isn't plugged into the rest of my data, phone, etc. I know they won't, but I wish Facebook would let us choose which AI model we wanted.
Frustratingly they of course work as bluetooth input, so if you manually trigger a conversation with ChatGPT you can chat away with it via your Ray Bans of course.
I use ChatGPT voice mode all the time and when I did have my glasses (lost or stolen now) I called it all the time, reducing the friction for calling would be a great quality of life feature
I also have no idea they don't have location tracking like find my iPhone/airpods, seems trivial to add
The Meta Raybans are a fantastic device hobbled by a weak LLM and supported by a bad actor - Meta [1]. Frankly I feel dirty for running any Meta software on my phone. I can talk to ChatGPT or Claude using the glasses but unfortunately I can’t show them what I’m looking at which is what the OP has built.
This is fantastic! I've been wanting this, I'll try it very soon. If I'm understanding this correctly, it's an extension that monitors the FB account just to read the messages, right? Is there no API integration with FB messenger (or WhatsApp/Instagram/something easier than running a browser all the time)?
I did research into messenger bots quite awhile ago but stopped for some reason. It might of been that I couldn't trigger it with Hey Meta, but that's before I learnt how to force a friend/groupchat sync. (so might be different now)
It would definitely be better as it's quite a pain for daily use or out and about and more of a tech demo in its current state.
Hah, this is great. So many amazing use cases are being hidden behind walls.
I love my Meta Ray Bans but frankly Llama is not best in class and it also isn't plugged into the rest of my data, phone, etc. I know they won't, but I wish Facebook would let us choose which AI model we wanted.
Frustratingly they of course work as bluetooth input, so if you manually trigger a conversation with ChatGPT you can chat away with it via your Ray Bans of course.
I use ChatGPT voice mode all the time and when I did have my glasses (lost or stolen now) I called it all the time, reducing the friction for calling would be a great quality of life feature
I also have no idea they don't have location tracking like find my iPhone/airpods, seems trivial to add
Nice work!
The Meta Raybans are a fantastic device hobbled by a weak LLM and supported by a bad actor - Meta [1]. Frankly I feel dirty for running any Meta software on my phone. I can talk to ChatGPT or Claude using the glasses but unfortunately I can’t show them what I’m looking at which is what the OP has built.
[1] https://arstechnica.com/security/2025/06/meta-and-yandex-are...
How do you talk to Claude? Maybe you meant Gemini?
P.S. I'm working on Android app to talk to any LLM ( iOS one is already out: Roxy Voice: https://apps.apple.com/app/apple-store/id6737482921?pt=12710... ) using an OpenAI-compatible completions endpoint.
I really wish Reality Labs would open up their API but with meta ai and llama I doubt that'll happen.
For open source glasses there's a few potential options, I think omi.me has an open smart glasses project.
I'm surprised no one has found a way to properly jailbreak them, it's a bit out of my wheelhouse but would be fun to try one day.