Profile data output

[mahesh-panchal]

The pipeline generates a lot of output, but much of it is not needed.
Profile both the files written in the working directory ( and replace with local modules )
and results directory to write out only the files that are needed.