Skip to main content

Overview

Welcome to the comprehensive guide on data ingestion via the Walr platform API, an efficient and scalable method to seamlessly incorporate substantial volumes of data. This guide aims to provide you with a clear understanding of the process, allowing you to harness the full potential of our platform for handling your data needs.

Ingesting data through our API offers an unparalleled advantage, enabling you to effortlessly funnel vast amounts of information into the Walr platform. One of the primary advantages lies in the absence of limitations; you have the flexibility to transmit data in any volume, whether it's a comprehensive dataset or incremental batches as they become available.

Crucially, our system operates asynchronously, ensuring the seamless flow of data processing. This asynchronous processing mechanism streamlines your workflow, allowing for a continuous stream of data without disruptions or bottlenecks.

Throughout this documentation, we will delve into the intricacies of leveraging our API for data ingestion, providing step-by-step guidance and best practices to optimize your experience. By the end of this guide, you'll be adept at efficiently harnessing the power of our API to seamlessly integrate your data into the Walr platform.

The process of data ingestion within the Walr platform is divided into two essential phases: meta data creation and the processing of case data. Each phase serves a crucial role in seamlessly incorporating your information into our system.

Meta Data Creation​

Before uploading data into the Walr platform, the creation of a dataset through meta data is imperative. Our ingestion API relies on Triple-S, an internationally recognized standard for survey interchange. To gain a comprehensive understanding of this standard and its integration within our system, refer to the dedicated section titled Triple-S Specification.

Case Data Processing​

Once a dataset has been successfully generated using the meta data endpoints, the subsequent step involves streaming data into it via the case data endpoints. This process involves uploading data in CSV format, which undergoes rigorous validation upon submission. Upon successful validation, the data is primed for processing, initiating the seamless transfer of all information into the Walr data warehouse.