Pipeline Failure Due to Missing File – File Successfully Exported from Amperity

Overview

A downstream data pipeline may fail with a missing file error even though the corresponding Amperity workflow has completed successfully.
In most cases, this issue is caused by pickup timing or path mismatches in the downstream system rather than a failure in Amperity.


Common Error Message

A downstream system may report an error similar to:
Pipeline failure: missing file at expected inbound path



How to Identify the Issue

Step 1: Confirm the Downstream Error

  • Review the downstream pipeline logs
  • Confirm the failure is due to a missing file
  • Note:
    Expected pickup directory
    Pipeline execution time

    Step 2: Verify Workflow Completion in Amperity
  • Log in to the Amperity tenant
  • Navigate to:
    Workflows
  • Locate the workflow for the impacted run date
  • Confirm:
    Workflow status is Completed
    No task failures are reported

    Step 3: Validate File Export from Amperity
  • Open workflow task details
  • Locate the export task
  • Confirm:
    Export completed successfully
    File was written to the configured outbound directory
    Export timestamp aligns with expectations


    Resolution Steps

    Step 4: Align Downstream Pickup Timing
  • Ensure the downstream pipeline does not run before file delivery
  • Add buffer time between:
  • Amperity export completion
  • Downstream pickup execution

    Step 5: Confirm Pickup Path Configuration
  • Verify the downstream system is monitoring the correct directory
  • Confirm:
    Directory path is exact
    Case sensitivity matches
    No additional subfolders are assumed 

    Step 6: Re-run the Downstream Pipeline
  • Re-run the downstream job
  • Confirm the file is detected
  • Validate successful pipeline completion


    When to Contact Support

    Contact support only if:
  • The Amperity workflow failed or did not run
  • The export task did not complete
  • The file is not present in the configured outbound directory
  • Multiple consecutive exports are missing


    Final Outcome

    Once:
  • Workflow success is confirmed
  • Export delivery is verified

  • Downstream timing and paths are aligned

    The pipeline will:

  • Detect the exported file
  • Process data successfully
  • Complete without missing file errors