Skip to content

SourcesAvroV1

John Koenig edited this page Jan 18, 2018 · 6 revisions

Header Contents

| version - 4 bytes, big-endian   |   control - 4 bytes, big-endian  |
|                      id - 8 bytes, big-endian                      |
|                   shard_by - 8 bytes, big-endian                   |

where:

  • version :: version of the payload. 1 in this case.
  • control :: flags governing how the avro_blob is to be published. See Control Flags.
  • id :: client assigned unsigned, 64-bit id for the payload. Sent in reply on successful publication when control contains the SYNC flag.
  • shard_by :: unsigned, 64-bit value used by some sinks to serialize payloads within upstream shard (buckets).

Control Flags

  • SYNC :: 0x00000001 - when specified the avro source will ACK publication into Cernan's internal queues by sending the payload's corresponding id back to the client.

Clone this wiki locally