Infrastructure Planning: Difference between revisions
Raphael0202 (talk | contribs) (Add robotoff requirements) |
Raphael0202 (talk | contribs) |
||
Line 19: | Line 19: | ||
*** Models are memory hungry, at least 32 GB of RAM is needed. | *** Models are memory hungry, at least 32 GB of RAM is needed. | ||
*** GPU servers deliver the best performances for prediction, but are rather expensive. Given the current load, CPU servers are enough. | *** GPU servers deliver the best performances for prediction, but are rather expensive. Given the current load, CPU servers are enough. | ||
*** Disk: speed is only important when loading model from disk, which only occurs at startup. SSDs are fine. 500 GB of space should be ok. | |||
* New producer platform | * New producer platform | ||
** New server | ** New server |
Revision as of 09:45, 5 September 2019
Current infrastructure
Details on https://en.wiki.openfoodfacts.org/Infrastructure#Current_infrastructure
- off1: frontend + backend for the web site and API
- off2: mongodb + off1 backup
- dev: dev server, robotoff, remote backup
Hardware needs 2019
Production
- Frontend + backend for the web site and API
- off1
- MongoDB
- off2
- Robotoff
- New server
- Models are memory hungry, at least 32 GB of RAM is needed.
- GPU servers deliver the best performances for prediction, but are rather expensive. Given the current load, CPU servers are enough.
- Disk: speed is only important when loading model from disk, which only occurs at startup. SSDs are fine. 500 GB of space should be ok.
- New server
- New producer platform
- New server
- Little web traffic, lots of image data (sometimes in huge PDFs or png)
- mid-level cpu and ram, at least 2x4 Tb disks
- New server
- New content platform (wiki, blog) ??
- New server for different kind of tools (example: Zammad, MediaWiki, Wordpress, Nextcloud?)
- Little web traffic, not much disk needed (except for videos if needed?)
- mid-level cpu and ram, 2x500 Gb SSD disks probably ok
- New server for different kind of tools (example: Zammad, MediaWiki, Wordpress, Nextcloud?)
Backup
- New backup server or cloud storage
Dev
- OFF + producer platform dev
- New server
- mid level cpu and ram, at least 2x8 Tb disks
- New server