When a query is sent to an egestion destination (such as Salesforce Sales Cloud), Amperity processes the data within a workflow and streams the query results through a temporary storage location. Customers often want to know how they can access the underlying output file (for example, a .parquet file) generated during the workflow run.
Example :
Within the workflow details, you may observe output entries similar to:
This refers to a temporary intermediate file created while streaming data from the query to the destination system. It represents the immediate result of the query before it is delivered.
Important: These temporary .parquet files are not accessible to customers. They exist only during processing and are not stored in a location intended for external access.
Can I Retrieve the Temporary File?
No. The temporary output file generated during orchestration is internal to the Amperity processing pipeline and is not exposed to users.
How to Access Results of a Previously Run Query ?
If you need access to the results of a query from a past workflow run and cannot re-run it due to potential data changes, you have the following option:
Send Query Results to an Accessible Storage Location
You can create a secondary orchestration that sends the output of the same query to a storage destination that you control, such as:
- S3 bucket
- Azure Blob Storage
- Google Cloud Storage
- SFTP location
Once configured, the query results will be delivered as a file that you can download and review.