Great piece, Janelle. One other piece of AI infrastructure I find fascinating (which you touch a bit on wrt optimizing models) is how to deploy AI on specific hardware configurations (on edge devices, on prem, etc) where users may not have easy access to powerful compute. Interesting to see how ppl are able to carefully choose models for different deployment options and optimize those models for that hardware. Thanks so much for sharing your work!
Great piece, Janelle. One other piece of AI infrastructure I find fascinating (which you touch a bit on wrt optimizing models) is how to deploy AI on specific hardware configurations (on edge devices, on prem, etc) where users may not have easy access to powerful compute. Interesting to see how ppl are able to carefully choose models for different deployment options and optimize those models for that hardware. Thanks so much for sharing your work!
excellent work. thank you for sharing.