MVSFORUMS.com

Sqlcode · Intermediate Joined: 15 Dec 2006 Posts: 157 Topics: 38

Team,
I have an input file with about 150 million records and I need to the dataset in to 24 different dataset based on date.

When I try to run the job, all i get is SPACE Abend. Now going by previous post and DFSORT manual, I believe if we use DFSORT commands in specific sequence(DFSORT Flow diagram), we may get better result in terms of performance.

I even tried using FILSZ parameter (EXEC PGM=SORT,'PARM=E150M' but i didnt work either.

FYI, I am using condition in below mentioned manner.

OPTION COPY
OUTFIL INCLUDE (CONDITION checking),FNAMES=DD1

Is there way we can handle 150 million records using DFSORT?

CraigG · Posted: Mon Jun 30, 2008 10:10 am Post subject:

Which file is getting the space abend?

kolusu · Posted: Mon Jun 30, 2008 10:36 am Post subject:

rajen,

Your space abends have got nothing to do with DFSORT. It is your output files that are running out of space. You need to talk to your storage folks to allocate more DASD for your jobs.
_________________
Kolusu
www.linkedin.com/in/kolusu

Frank Yaeger · Posted: Mon Jun 30, 2008 10:52 am Post subject:

DFSORT has no problem copying 150 million records.

As Kolusu says, you need enough space for the records in each output data set. That has nothing to do with DFSORT.

You are doing a COPY, so FILSZ isn't needed and has no effect.

You might be able to get better performance by using an INCLUDE statement to just include the records you need for OUTFIL processing. INCLUDE will eliminate unneeded records before OUTFIL processing starts, so it could help performance.
_________________
Frank Yaeger - DFSORT Development Team (IBM)
Specialties: JOINKEYS, FINDREP, WHEN=GROUP, ICETOOL, Symbols, Migration
DFSORT is on the Web at:
www.ibm.com/storage/dfsort

Sqlcode · Intermediate Joined: 15 Dec 2006 Posts: 157 Topics: 38

I have increased space allocated for output datasets and resubmitted job.

Meanwhile, below is the error message which I am getting with space abend.

ICE751I 2 EF-K10929 CB-K90000 F0-Q84357 DA-K26318
ICE185A 0 AN S322 ABEND WAS ISSUED BY DFSORT, ANOTHER PROGRAM OR AN EXIT (PHASE C 3)

Is this really output dataset space issue?

Frank,
I am including only those records which I need for OUTFIL processing. 150 ml. is count for OUTFIL processing records. Smile

Regarding FILSZ...
If I am not mistaken and If I have understood previous post correctly,
FILSZ would help SORT to estimate SORT Workspace needed for processing.

Is it only applicable when we are doing actual sort on records? Would that be useful while using sort for copy purpose?

CraigG · Posted: Mon Jun 30, 2008 11:25 am Post subject:

Sqlcode · Intermediate Joined: 15 Dec 2006 Posts: 157 Topics: 38

Craig,

My apologies for posting wrong message. It was previous one.
I am getting below mentioned error message and I guess as correctly suggested by Kolusu/Frank I need to speak to Storage Team for space allocation.

XXXXX999 JOB CANCELLED DUE TO EXCESSIVE TAPE UNIT REQUIREMENTS

Frank Yaeger · Posted: Mon Jun 30, 2008 4:17 pm Post subject:

The S322 ABEND would be a timeout ... you'd need to increase the time allowed for the job.