I am interested in a solution that would perform automated monitoring of user activities performed on Windows, Mac and Linux environments, and create hyper-detailed log of all actions and activities that the user has performed, as well as developing an accurate and highly-detailed storyline of the user activities.
This includes:
– All interactions with the operating system, including what windows/features the user interacts with, and how.
– All interactions with applications, including what buttons the user presses, fields that the user interacts with, including the values within those fields.
– All keyboard interactions, including keys/combinations of keys pressed, characters/words/commands typed, buttons clicked, as well as applications/views/fields where those key presses entered.
– All mouse interactions, including starting/ending points, select, click (right and/or left button), drag actions, as well as which element/field/button/link within which application/view/window was clicked, selected, or dragged, and to where.
The solution should include a desktop application that would perform screen recording/screen capture/mouse tracking/keyboard event capture/OS and Application activity capture, and leverage one or more AI models to accomplish the task of analyzing all of the actions/activities for the outcome. Validation testing can leverage tensordock with access to high-performance GPU resources.
I am looking for several providers to develop a solution and the provider that delivers the most accurate solution will be selected for subsequent work.
