Experiments/3D

<<Back to Experiments

This project aims to prepare Open Food Facts for the advent of 3D and virtual/augmented reality.

Inspiration

3D models of food in a dystopian future

• Screenshot 1, Screenshot 2, Screenshot 3

Google launches the tango phone - allows for 3D scanning

• https://techcrunch.com/2016/11/01/google-finally-launches-tango/?sr_share=facebook

3 models of food

• a Supermarket to store everything: https://sketchfab.com/models/ca06a9061e2a4beb9b30aae5392fca26
• Collection of cosmetics: https://sketchfab.com/teolemon/collections/open-beauty-facts
• Collection of food: https://sketchfab.com/teolemon/collections/packaged-food

3D scanner we could buy

• https://www.artec3d.com/3d-scanner/artec-eva

Cool demo we could hide in the OFF app

• With just spinning, you could make a Pepper's ghost: https://www.youtube.com/watch?v=zkgy-WcflWE (but that's silly)

It works much better with cylinders like cans than with more complex shapes, because it's still just four images. @aleksejrs

Photogrammetry

• Making 3D models out of photos is https://en.wikipedia.org/wiki/Photogrammetry
• The only open source program for that I've seen was abandoned and so had annoyingly incomplete UI and crashed often. Not a very popular activity. http://insight3d.sourceforge.net/ (edited)
• There was also a page about doing it using many different programs (IIRC, that included one used for making panoramas with Hugin), but that was complex (also, the most difficult part was removing the incorrect dots). An example was making a 3D model of a part of the earth surface from ISS photos.

Augmented Reality

• https://twitter.com/i/web/status/855753253312761856 (Aurelien is on the Slack - Demo)
• https://openfoodfacts.slack.com/files/niwra/F31561NP2/hololens_read_the_ingredients.mp4 (Read the Ingredients for Windows and Hololens, niwra is on the Slack)

Mixed reality

Apple Vision Pro

• Cooking in augmented reality: https://youtu.be/8xI10SFgzQ8?t=222 / https://twitter.com/JustMeDevin
• Vodka pasta in augmented reality: https://youtu.be/Lj5wZfxvF8I?t=320
• Apps iOS sur Apple Vision Pro - Toutes les apps iOS compatibles, nouvelles et existantes, peuvent être rendues disponibles sur visionOS. Vos apps compatibles seront publiées dans l'App Store pour Apple Vision Pro, sauf si vous modifiez leur disponibilité. Modifier la disponibilite
• Barcode scanning is only available to Pro developer for Pro apps

Generating usable data

Microsoft Tech

Microsoft just made big 3D creation announcements making it easy to create 3D models from a phone or from MS Paint and share them to their platform https://www.youtube.com/watch?v=8M_-lSYqACo

Storing the data

We need to be able to differentiate 3D ready photos, photos that can be transformed on the fly, and unusable photos.

Visualising data in 3D

• http://demo.rickyh.co.uk/can-spin/
• Source image

Get in touch

Slack channel #3D