About Lotion

Inspiration

We came up with this idea when one of our teammates was studying for statistics before the beginning of the Hackathon. He realized that he was spending ages navigating through uncountable amounts of hopelessly long notes he had taken for his first exam.

What it does

• ✨ Note Classification: Automatically classifies and stores your handwritten or typed notes
• 🚀 AR Note Annotations: Overlays relevant notes based on scanned information
• 🔧 Note Querying: Returns relevant notes based on text input questions or statements
• 📈 Interactive Interface: Ease of access to all taken notes

How we built it

Using React Native, we created a fully functioning note taking app. In the Flask backend, we used Google's Cloud Vision API to process handwritten notes into processable text to be read using the ChatGPT API. A combination of Firebase for authentication and MongoDB for document storing/querying was used. We tied it all together into an AR feature using ExpoGo's Camera tools.

Challenges we ran into

One of our major bottlenecks was connecting our backend and frontend. This was a result of poor communication, perhaps because we didn't sleep. We worked around this by creating a quick api documentation and having a meeting to discuss what endpoints the frontend needed.

Accomplishments

We are proud of interlinking so many moving parts into one working product. It was satisfying seeing every endpoint, react component, and api call come together as we finished our AR feature.

What's next for Lotion AI/AR

If we get positive impact, we would push out a more mature version; we hope students could actually use this product.