MVSFORUMS.com

rkarthik22 · Beginner Joined: 27 Sep 2008 Posts: 24 Topics: 9

Hi,

I am having a input file of having 141.5 million records.

Type : FB
LRECL: 3300
SORT FIELDS=(2126,11,CH,A)
SUM FIELDS=NONE

Sort key is in position 2126.

It almost took 23 hours to sort and dedup the file

Here is the statistics:

Frank Yaeger · Posted: Mon Nov 23, 2009 12:31 pm Post subject:

Which SORT product are you using (DFSORT, Syncsort, CA-Sort)?

Do you happen to have the complete JES log from the run including the sort product's messages? If so, post it.
_________________
Frank Yaeger - DFSORT Development Team (IBM)
Specialties: JOINKEYS, FINDREP, WHEN=GROUP, ICETOOL, Symbols, Migration
DFSORT is on the Web at:
www.ibm.com/storage/dfsort

Dibakar · Posted: Mon Nov 23, 2009 2:18 pm Post subject:

kolusu · Posted: Mon Nov 23, 2009 2:22 pm Post subject:

Dibakar · Posted: Mon Nov 23, 2009 3:36 pm Post subject:

Kolusu,

I assumed that rkarthik22 had some other steps in the job that required debugging and 23 hrs included that. All based on misintrepreting dedup.

rkarthik22 · Beginner Joined: 27 Sep 2008 Posts: 24 Topics: 9

I think Frank/Kolusu will not reply me because we are using SYNCSORT here Sad

here is the jes2 msg:

Brian Wood · Posted: Tue Nov 24, 2009 9:12 am Post subject:

rkarthik22:

Please email me a copy of the complete job listing (JCL, JES LOG, SYSOUT containing SyncSort message output) to review.
_________________
Brian Wood
SyncSort Mainframe Product Services
201-930-8260
zos_tech@syncsort.com

papadi · Supermod Joined: 20 Oct 2009 Posts: 594 Topics: 1

Knowing that you have Syncsort, is there any good reason you did not include this in the Subject?

As there are people from both IBM and Syncsort participating, it would be more productive to mention the product in the subject and not waste people's time. . .
_________________
All the best,

di

rkarthik22 · Beginner Joined: 27 Sep 2008 Posts: 24 Topics: 9

kolusu · Posted: Wed Nov 25, 2009 12:16 pm Post subject: Re:

jctgf · Beginner Joined: 05 Nov 2006 Posts: 89 Topics: 36

i think the real problem is the number of bytes to be sorted.
have you tried to increase a few parameters like mincore and so on.
if the position of your sort key really counts, why don't you try repositioning it at the beginning of the record?
your sysin would be:
inrec fields=(2126,11,1,3000)
sort fields=(1,11,a),format=bi,noequals
outrec fields=(12,3000)
sum fields=none
regards

ps.: "noequals" may be the default situation in your installation. if so, no need to declare.

Terry_Heinze · Posted: Sun Feb 28, 2010 11:38 pm Post subject:

Did you notice that this thread is 3 months old?
_________________
....Terry