Experiments/3D: Difference between revisions

VisualWikitext

Latest revision as of 14:05, 27 August 2024

<<Back to Experiments

This project aims to prepare Open Food Facts for the advent of 3D and virtual/augmented reality.

Inspiration

Cool demo we could hide in the OFF app

With just spinning, you could make a Pepper's ghost: https://www.youtube.com/watch?v=zkgy-WcflWE (but that's silly)

It works much better with cylinders like cans than with more complex shapes, because it's still just four images. @aleksejrs

Photogrammetry

Making 3D models out of photos is https://en.wikipedia.org/wiki/Photogrammetry
The only open source program for that I've seen was abandoned and so had annoyingly incomplete UI and crashed often. Not a very popular activity. http://insight3d.sourceforge.net/ (edited)
There was also a page about doing it using many different programs (IIRC, that included one used for making panoramas with Hugin), but that was complex (also, the most difficult part was removing the incorrect dots). An example was making a 3D model of a part of the earth surface from ISS photos.

Augmented Reality

https://twitter.com/i/web/status/855753253312761856 (Aurelien is on the Slack - Demo)
https://openfoodfacts.slack.com/files/niwra/F31561NP2/hololens_read_the_ingredients.mp4 (Read the Ingredients for Windows and Hololens, niwra is on the Slack)

Virtual Reality

Mixed reality

Apple Vision Pro

Cooking in augmented reality: https://youtu.be/8xI10SFgzQ8?t=222 / https://twitter.com/JustMeDevin
Vodka pasta in augmented reality: https://youtu.be/Lj5wZfxvF8I?t=320
Apps iOS sur Apple Vision Pro - Toutes les apps iOS compatibles, nouvelles et existantes, peuvent être rendues disponibles sur visionOS. Vos apps compatibles seront publiées dans l'App Store pour Apple Vision Pro, sauf si vous modifiez leur disponibilité. Modifier la disponibilite
Barcode scanning is only available to Pro developer for Pro apps
Apps in the Food & Drink category: https://vision.directory/categories/food-and-drink

Generating usable data

Getting flat photos of products we can map on preexisting standard models

Using photos from Daniel's machine

Straightening existing photos to maps them onto models

Microsoft Tech

Microsoft just made big 3D creation announcements making it easy to create 3D models from a phone or from MS Paint and share them to their platform https://www.youtube.com/watch?v=8M_-lSYqACo

Storing the data

We need to be able to differentiate 3D ready photos, photos that can be transformed on the fly, and unusable photos.

Visualising data in 3D

Get in touch

Slack channel

#3D

@@ Line 32: / Line 32: @@
 === Virtual Reality ===
+=== Mixed reality ===
+==== Apple Vision Pro ====
+* Cooking in augmented reality: https://youtu.be/8xI10SFgzQ8?t=222 /  https://twitter.com/JustMeDevin
+* Vodka pasta in augmented reality: https://youtu.be/Lj5wZfxvF8I?t=320
+* Apps iOS sur Apple Vision Pro - Toutes les apps iOS compatibles, nouvelles et existantes, peuvent être rendues disponibles sur visionOS. Vos apps compatibles seront publiées dans l'App Store pour Apple Vision Pro, sauf si vous modifiez leur disponibilité. Modifier la disponibilite
+* Barcode scanning is only available to Pro developer for Pro apps
+* Apps in the Food & Drink category: https://vision.directory/categories/food-and-drink
 ==Generating usable data==
@@ Line 48: / Line 55: @@
 * http://demo.rickyh.co.uk/can-spin/
 * [https://github.com/rickyH/can-spin/blob/master/js/threejs/models/textures/gamma_ray.png Source image]
+== Get in touch ==
+{{Box
+ | 1     =  Slack channel
+ | 2     =  [https://openfoodfacts.slack.com/messages/C2NRJJFCL/ #3D]
+}}
 [[Category:Experiments]]
 [[Category:Developer]]