Audio streaming
Hello, I installed the tinypilot and so far it's been great.
I use it to remote control a work laptop at the office from home.
I was wondering if there is a way to stream the audio/microphone so that I would be able to also take calls from the work laptop.
Thank you!
Michael Lynch @michael2021-05-14 19:23:49.179ZIt's theoretically possible, but it's not something I'm likely to add in the short term. It would be a significant amount of work to add that, and it's not a critical feature for many users. I'm also not sure if we'd ever be able to get performance to a level where it's usable for voice calls. If there's a 200ms delay on audio, that would make it hard to have a conversation.
That said, they just came out with an improved version of the HDMI capture chip that TinyPilot uses, and it captures audio, so I'm planning to explore the audio capture side of this.
- D@derekhansell
I'm a bit confused - Am I correct that currently TinyPilot does not pass audio from the host connected to the KVM back to the remote computer?
Michael Lynch @michael2021-07-19 21:28:22.439ZThat's correct. Audio does not forward in either direction.
- T@test513607a
@michael , Great to hear you are exploring audio.
is there a temporary fixes through hardware, or any other way if possible to transmit the audio meanwhile even lagging or lossy also , - for timebeing
That would be really helpfulI have the two laptops side by side(one connected to tinypilot, and the laptop receiving signal), so anything you can suggest.
- Michael Lynch @michael2021-09-15 18:39:29.435Z
Audio is still not on the short-term roadmap, unfortunately.
If you're interested in experimenting, it might be possible to get your TinyPilot to impersonate a USB speaker and then have the target computer select it as an audio output. You'd need to tinker with TinyPilot's USB gadget configuration and then find a way to stream the audio through the web browser, so it would be a substantial amount of work.
- RBob Alexander @raetron
One way audio like you describe above would be very useful for my work of testing audio/video devices.
I am very interested in implementing this over HDMI and not USB. Would a HDMI capture device that supports audio be easier to implement?
I have one of the USB HDMI video capture devices that does support audio capture.
Thanks!- Michael Lynch @michael2021-09-29 19:08:37.763Z
@raetron - That would also be possible, but you'd need to handle splitting out the audio and video. TinyPilot uses MJPEG to stream the video, and that's a video-only format (no audio). You'd need to split out the audio, pipe it from the TinyPilot back to the client browser, and then create a separate element in the browser window that plays audio from the target computer.
- RBob Alexander @raetron
Or when h.264 is implemented it might be even easier.
- In reply tomichael⬆:
This is one of the few things preventing a purchase for me. I'm really interested in audio support, both capture (speaker out) as much as audio in (microphone) . You mention an improved HDMI capture chip which would possibly allow capture. I assume this would be in a future hardware refresh, or is this new HDMI chip in the TinyPilot Voyager 2?
Thank you!
- Michael Lynch @michael2022-02-15 18:09:55.075Z
@mikeff - This would be a future hardware improvement. The Voyager 2 hardware doesn't support audio capture.
Keep in mind that the latency is still ~100ms. I don't think it would be usable for things like voice conversations.
- VIn reply tofrancescot⬆:VVV @vvv
One way audio via HDMI interface output would be plenty, I suppose exploring USB passthrough for audio the other way would be nice, but latency would also eventually become an issue as it relates to actual conferencing. But just getting audio remotely would be nice, for non server usage.
- CCharles Hague @cghague2023-02-06 17:20:22.415Z