On: The current state of OpenTelemetry

[hinkley]

Please, please, to anyone following this thread:

Implement a human readable protocol, then use standardized streaming compression on the wire to get your message size down. Something LZ family because there are tools everywhere that speak them. And consider turning off transport encoding for local development.

Being able to scan data saves so much time on triage. And using zgrep and friends on production data is almost as easy. You will spend tons of effort trying to make something 10% more efficient than zlib or for certain zstd, and the cost is externalized onto your team.

[arccy → hinkley]

human readable == inefficient parse and processing

[hinkley → arccy]

It’s IPC. I think are vastly overestimating the local processing overhead.

[arccy → hinkley]

there's overhead every time you turn a number from native into a human readable decimal representation, and telemetry is mostly numbers.