Prompt: Is there a single tool, online or offline that can do that?
Summarized Response: There isn't a single tool that transcribes gameplay into detailed action-based descriptions. Some options, like GameSight AI or OpenAI Codex combined with visual recognition tools, can partially meet this need but would require custom integration. Replay analysis tools focus more on performance than narration. A full solution would likely require combining multiple tools.
Expanded response in comments.
Currently, there isn't a single AI tool that automatically transcribes gameplay into detailed action-based descriptions (like a narrator describing what the player and game elements are doing) in one step. Most tools focus on specific aspects, such as screen capture, object detection, or basic transcription of voice, but not detailed action narration.
Some options may partially meet your needs:
GameSight AI (Custom Integration): This tool is designed for esports and gaming analytics. It can recognize key in-game events but would still need custom integration with a language model to generate text.
OpenAI Codex/GPT-4 with Custom Vision Models: Though not a pre-built tool, using GPT-4 combined with a visual recognition tool like OpenCV, YOLO, or others could theoretically create a system for generating game-based descriptions. This setup would be offline but require some technical expertise to implement.
Replay Analysis Tools (e.g., AimLab, Highlights AI): These focus more on performance analysis for players (aim, kills, etc.) rather than detailed descriptions, but they could be extended for basic action detection.
At this time, no single off-the-shelf tool provides the exact gameplay-to-text description functionality. You'd likely need a custom solution involving multiple tools or models.