No internet connection
  1. Home
  2. General

Mouse movement? Simultaneous keys?

By @rcdc2021-03-07 04:03:35.224Z

Can mouse / cursor position input be mirrored to the target computer through the Tinypilot?
Also can simultaneous key combos e.g. shift + something be sent easily?

Also wondering what the device & drivers are displayed as on the target computer.

I have a device called USBtoUSB made by Hagstrom electronics, which I was hoping would allow me to do something just like what the Tinypilot does - it takes Serial COM messages from a Sender computer and converts them to USB keyboard data (it just shows as USB keyboard on the target comp) for the target computer. It is a physical device connected physically between the two computers, one of them I can remote into and the other is the non-networked, headless computer etc.

However this device would have required me to write the code in C# or Vb /.net and didn't come with anything other than very very limited example .exes that only allow you to send one string of ASCII characters at a time by hitting Enter, and did not seem to send special keys like Alt/Ctrl etc at all.
As for the mouse position part of it, the programs provided with it involved clicking on different buttons in a GUI window to make the mouse jump to a numerical offset position on the target computer as well and it was nigh on unusable for anything that required time efficiency or requiring moving mouse to various different not-predetermind positions.

I wanted to try to see if it was possible to write in C# or Vb a program that would do a more realtime mirroring of my sender computer keystrokes (all types of keys) and mouse movements but it seems very difficult.

It looks like the Tinypilot would work as a solution for me instead. I actually already have my HDMI capture part sorted via a capture box into the networked/sender computer, which I also remote into and view the HDMI signal from target computer via OBS.

The keystrokes and maybe mouse data is the only thing left to try to get working, via the tinypilot hopefully.

Solved in post #2, click to view
  • 1 replies
  1. Michael Lynch @michael2021-03-08 22:42:58.481Z

    Can mouse / cursor position input be mirrored to the target computer through the Tinypilot?

    Yep, TinyPilot supports mouse forwarding.

    Also can simultaneous key combos e.g. shift + something be sent easily?

    Yes, TinyPilot supports sending keys with modifiers like shift, alt, etc.

    I wanted to try to see if it was possible to write in C# or Vb a program that would do a more realtime mirroring of my sender computer keystrokes (all types of keys) and mouse movements but it seems very difficult.

    It sounds like TinyPilot should do what you need already. If you do want to script it, TinyPilot doesn't expose an API, but it's open source, so you can peek in the code to see how the mouse and keyboard interaction works. Most of the logic is in the hid directory.

    For example, here's a simple script I wrote to jiggle the mouse cursor every 3 seconds.

    ReplySolution