Module pipeline

Source
Expand description

Data pipeline for processing market data events and sending them to storage

This module handles the flow of market data from the collection system to the storage system with FlatBuffers serialization and compression.

Why don’t we archittect it like original pipeline? Because we want to more performant. not for scalability.

Structs§

DataPipeline
Data pipeline that processes market data events and stores them
PipelineConfig
Configuration for the data pipeline
PipelineStats
Statistics for pipeline processing