-
Notifications
You must be signed in to change notification settings - Fork 82
Closed
Labels
acceptedAccepted for implementationAccepted for implementationquestionFurther information is requestedFurther information is requested
Description
I need to read files from multiple folders, but so far I didn't find in cobrix an option to achieve this. So is there a way to read multiple folders without creating multiple rdd's or datasets? If not, then this should be an enhancement request.
Example :
source_folders = ["example1/folder_1/","example2/folder_2/"]
spark.read.format("cobol").load(source_folders)
Parquet and other popular formats have support for multiple sources
Metadata
Metadata
Assignees
Labels
acceptedAccepted for implementationAccepted for implementationquestionFurther information is requestedFurther information is requested