NextGen Knowledge Center

Source Map Variables

KeyDescription
originalFilenameThe name of the file that was read in.
fileDirectoryThe absolute path of the directory in which the file resides.
fileSizeThe size of the file in bytes.
fileLastModifiedThe last modified date of the file, as an epoch time in milliseconds.
pollIdA unique nanosecond timestamp that uniquely identifies the current polling window. If your File Reader polls 5 files, the messages for each file will have the same pollId.
pollSequenceIdAn integer that starts at 1 and increments for every subsequent file in the current polling window. If your File Reader polls 5 files, the message(s) for the first file will have a pollSequenceId of 1, the message(s) for the second file will have a pollSequenceId of 2, and so on.
pollComplete

This is only present for the last file in the current polling window. The value of this entry is always equal to true. Use this to determine programmatically whether you are currently working with the last file in a poll.

Note that if you have Batch Processing enabled, you will want to look at both the pollComplete and batchComplete variables to determine whether the current message is truly the "last" one. If both are true, then you know that you are on the last file in the polling window, and also on the last message in that file.

Variables only applicable to the Amazon S3 mode

KeyDescription
s3BucketNameThe name of the S3 bucket that the file belongs to.
s3ETagThe hex encoded 128-bit MD5 hash of the file contents as computed by Amazon S3.
s3KeyThe key under which the file is stored in S3.
s3OwnerThe owner of the S3 object, if present.
s3StorageClassThe storage class used for this file in S3 (e.g. STANDARD, STANDARD_IA).
s3MetadataA MessageHeaders object representing the map of metadata/headers for the S3 object.