Most of that stuff, like the Intel NCS2 I use is for 'edge computing'. In my case I run YOLO to do object detection on the cameras outside my house. So, robotics, vision, maybe some speech recognition.
For my NCS2 the object detection is really fast, but the Raspberry Pi feeding it images and then drawing rectangles on the pictures is slow. So I'm going to test an upgrade to a Pi 5 with the same NCS2.
Edit: here's an example from a stock photo.
View attachment 5554613
Plus a text file so I can parse it and see if anything "interesting" happened, like a bear wandering by.