TALEND SCENRIOS: FILE SPLIT

Split one file into multiple files using a column value in Talend

Source File: Download Source File for this

Source Code: Download

Job Design:


1. Read the file and identify the unique departments using tUniqRow and store them in tHashOutput

2. Iterate through Uniq departments using tFlowToIterate component

3. Use the global variable created in tFlowToIterate in FixedFlowInput_1


4. Make an Inner join with source data on DeptName in tMap



5. Use the same global variable in tFileOutputDelimited to create a separate file for that department







2 comments:

  1. Pavan KApril 14, 2021 at 7:30 PM

    Hi,

    good scenario, instead of using buffer components. better to use directly like..src->tunique->flowtoiterate->tmap(src as lookup)->out

    ReplyDelete
  2. JeetuApril 18, 2021 at 12:45 AM

    Hi,

    Please checkout the below design, it worked for me.

    tFileInputDelimited_1 -> Main -> tUniqRow_2 -> Uniques -> tFlowToIterate_1 -> Iterate -> tFileInputDelimited_2 -> Main -> tFilterRow_1 -> tFileOutputDelimited_2

    Best Regards,
    Jitendra

    ReplyDelete

Subscribe to: Posts (Atom)