No internet connection
  1. Home
  2. General

Audio streaming

By Francesco @francescot
    2021-05-14 01:51:52.350Z

    Hello, I installed the tinypilot and so far it's been great.
    I use it to remote control a work laptop at the office from home.
    I was wondering if there is a way to stream the audio/microphone so that I would be able to also take calls from the work laptop.
    Thank you!

    • 10 replies
    1. It's theoretically possible, but it's not something I'm likely to add in the short term. It would be a significant amount of work to add that, and it's not a critical feature for many users. I'm also not sure if we'd ever be able to get performance to a level where it's usable for voice calls. If there's a 200ms delay on audio, that would make it hard to have a conversation.

      That said, they just came out with an improved version of the HDMI capture chip that TinyPilot uses, and it captures audio, so I'm planning to explore the audio capture side of this.

      1. D@derekhansell
          2021-07-19 20:32:37.898Z

          I'm a bit confused - Am I correct that currently TinyPilot does not pass audio from the host connected to the KVM back to the remote computer?

          1. That's correct. Audio does not forward in either direction.

            1. T@test513607a
                2021-09-15 12:39:48.557Z2021-09-15 14:17:40.703Z

                @michael , Great to hear you are exploring audio.
                is there a temporary fixes through hardware, or any other way if possible to transmit the audio meanwhile even lagging or lossy also , - for timebeing
                That would be really helpful

                I have the two laptops side by side(one connected to tinypilot, and the laptop receiving signal), so anything you can suggest.

                1. Audio is still not on the short-term roadmap, unfortunately.

                  If you're interested in experimenting, it might be possible to get your TinyPilot to impersonate a USB speaker and then have the target computer select it as an audio output. You'd need to tinker with TinyPilot's USB gadget configuration and then find a way to stream the audio through the web browser, so it would be a substantial amount of work.

                  1. RBob Alexander @raetron
                      2021-09-24 04:07:09.267Z

                      One way audio like you describe above would be very useful for my work of testing audio/video devices.
                      I am very interested in implementing this over HDMI and not USB. Would a HDMI capture device that supports audio be easier to implement?
                      I have one of the USB HDMI video capture devices that does support audio capture.
                      Thanks!

                      1. @raetron - That would also be possible, but you'd need to handle splitting out the audio and video. TinyPilot uses MJPEG to stream the video, and that's a video-only format (no audio). You'd need to split out the audio, pipe it from the TinyPilot back to the client browser, and then create a separate element in the browser window that plays audio from the target computer.

                        1. RBob Alexander @raetron
                            2021-10-05 19:55:38.820Z

                            Or when h.264 is implemented it might be even easier.

                2. In reply tomichael:
                  M@mikeff
                    2022-02-14 20:07:12.311Z

                    This is one of the few things preventing a purchase for me. I'm really interested in audio support, both capture (speaker out) as much as audio in (microphone) . You mention an improved HDMI capture chip which would possibly allow capture. I assume this would be in a future hardware refresh, or is this new HDMI chip in the TinyPilot Voyager 2?

                    Thank you!

                    1. @mikeff - This would be a future hardware improvement. The Voyager 2 hardware doesn't support audio capture.

                      Keep in mind that the latency is still ~100ms. I don't think it would be usable for things like voice conversations.