Data Ingestion

API Ingestion

The ingestion of data via the API is done by the API microservice. The API microservice is responsible for receiving data from external sources and sending it to a Pulsar topic for further processing.

Batch File Ingestion

The ingestion of data via batch files is done by the Ingester microservice. The Ingestor microservice is responsible for processing batch files and extracting data from them.