Overview
This Knowledge Base article explains an ingestion issue where the hotel_id field appears as null or missing during processing. Our investigation confirmed that the issue is related to the formatting of the source file, not to missing data in the records themselves.
Problem Description
During ingestion, the workflow may fail and display error messages indicating that the hotel_id field is null or missing. In many cases, customers are unable to find any records in the source data where hotel_id is actually null, which can make the issue difficult to identify.
When the error rate exceeds the defined threshold, the ingestion workflow is automatically aborted and marked as Failed.
Root Cause
The root cause of this issue is source file formatting that does not meet ingestion requirements.
The ingestion process expects:
Each record to be contained on a single line.
During investigation, it was found that some source files contained records spanning multiple lines. When records are multi-line, the ingestion system cannot parse them correctly, causing required fields such as hotel_id to be interpreted as null. This results in a high error rate and workflow failure.
Files that follow the one-record-per-line format ingest successfully without issues.
Resolution
To resolve this issue, please ensure that:
Each record in the source file is fully contained on a single line.
No record spans multiple lines.
After correcting the file formatting, rerun the ingestion workflow. With the correct format in place, the workflow should complete successfully.
Recommendations
Validate source file formatting prior to ingestion.
Ensure data-generating systems follow the one-record-per-line requirement.
Contact Support if ingestion issues persist after formatting corrections.