Yes, there are AI tools that can help describe gameplay by interpreting what's happening on-screen. However, achieving the level of specificity you're asking for—accurately describing player actions and game events without unnecessary information—would require a combination of tools:
Object Detection & Scene Understanding: Tools like OpenCV with YOLO (You Only Look Once) or TensorFlow can detect objects and actions happening in the game, such as identifying characters, enemies, or specific objects in a scene.
Action Recognition Models: Pre-trained AI models, such as those from the Action Recognition space, can be used to understand player movement or in-game actions (like shooting, jumping, etc.).
Text Generation for Narration: Once the gameplay actions are identified, models like GPT-4 can generate concise descriptions of what's happening based on the detected actions.