View previous topic :: View next topic |
Author |
Message |
dohellwithmf Beginner
Joined: 12 Jul 2007 Posts: 55 Topics: 23
|
Posted: Tue May 13, 2008 6:44 am Post subject: optimising the space/volume |
|
|
Hi All,
I am merging two file in Ezt based on 2 keys. One file has 137 Million of records and LRECL=2200 another file has 50000 records with LRECL=10000. We have to retain every record from file1 so the out put file has a record length > 12000. The job is abending again and again with SB37. We have to optimize the space allocation. I have tried all the combinations of SPACE and VOL parameters. I am also passing parameters in order to get dynamic allocation of DASD:
PARM='DYNALLOC=(SYSDA,1000),HIPRMAX=OPTIMAL,VSCORE=16M,VSCORET=64M'
But this is also not working. Is there any other ways to optimize the allocation? I heard about some parameter to be coded with SPACE/VOL for dynamic allocation but I never used that. Can anybody help on this????
TIA, Mayank |
|
Back to top |
|
|
Nic Clouston Advanced
Joined: 01 Feb 2007 Posts: 1075 Topics: 7 Location: At Home
|
Posted: Tue May 13, 2008 7:03 am Post subject: |
|
|
You do not show what you have tried for your SPACE=
Do you know how much space you need? From the figures given you seem to need over 355,000 cyl. What space do the current datasets use? You don't say how you are merging the files - is each of the 137m records going to be 12200 bytes long? what about the 50000 records - do they become 12200 bytes long or are they appended to the first file?
If there is a parameter for dynamic allocation of SPACE/VOl it will be documented in the JCL manual but I do not think that is so - you are getting your terminology mixed up I think.
For such a large allocation it may be that you need to talk to your storage guys - or use tape/cart _________________ Utility and Program control cards are NOT, repeat NOT, JCL. |
|
Back to top |
|
|
dohellwithmf Beginner
Joined: 12 Jul 2007 Posts: 55 Topics: 23
|
Posted: Tue May 13, 2008 7:10 am Post subject: |
|
|
I have tried with:
UNIT=SYSDA,SPACE=(CYL,(1000,800),RLSE)
Yes you are right 137m records going to be 12200 bytes long. The records are getting merged from two files after matching on some KEY. Means 50K records are getting appending to the 1st file. If KEY don't match in two files then we are appending Space to the 1st file. |
|
Back to top |
|
|
Nic Clouston Advanced
Joined: 01 Feb 2007 Posts: 1075 Topics: 7 Location: At Home
|
Posted: Tue May 13, 2008 7:29 am Post subject: |
|
|
That space allocation only gives you 15*800 (12000)+1000 = 13000 cylinders and you are needing 355000 cyls _________________ Utility and Program control cards are NOT, repeat NOT, JCL. |
|
Back to top |
|
|
dohellwithmf Beginner
Joined: 12 Jul 2007 Posts: 55 Topics: 23
|
Posted: Tue May 13, 2008 8:12 am Post subject: |
|
|
how did u calculate 355000 cyls? shouldn't it be like:
Integer(27,998/12200) is 2
2 multiplied by lrecl(12200) gives you 24400 which is the optimum blksize.
This will allow 2 records per block, or 4 records per track, or 60 records per cylinder (cylinders are 15 tracks).
Since the volume of records you have is 137m, number of cyls = 137,000000/60 = 2283334 cyls?
please correct me if i am wrong.... |
|
Back to top |
|
|
Nic Clouston Advanced
Joined: 01 Feb 2007 Posts: 1075 Topics: 7 Location: At Home
|
Posted: Tue May 13, 2008 8:24 am Post subject: |
|
|
Yes, that figure of yours is correct - and is 6 times GREATER than my figure so your allocation is even further off. _________________ Utility and Program control cards are NOT, repeat NOT, JCL. |
|
Back to top |
|
|
Terry_Heinze Supermod
Joined: 31 May 2004 Posts: 391 Topics: 4 Location: Richfield, MN, USA
|
Posted: Tue May 13, 2008 10:17 am Post subject: |
|
|
See the unit-count subparameter of the UNIT parameter in the JCL manual. _________________ ....Terry |
|
Back to top |
|
|
dohellwithmf Beginner
Joined: 12 Jul 2007 Posts: 55 Topics: 23
|
Posted: Thu May 15, 2008 7:24 am Post subject: |
|
|
Hey Nic,
Can you pls solve my curiosity concerned with the information below associated with the file:
Data Set Name . . . . : WCCT.SIT3.WCCSYNC.ATTCONV.PER.NDM.FILE2
General Data Current Allocation
Management class . . : DEVLG Allocated cylinders : 801
Storage class . . . : DEV1000 Allocated extents . : 3
Volume serial . . . : 9SD#ET +
Device type . . . . : 3390
Data class . . . . . : DCCOM Current Utilization
Organization . . . : PS Used cylinders . . : 801
Record format . . . : FB Used extents . . . : 3
Record length . . . : 4561
Block size . . . . : 31927
1st extent cylinders: 200
Secondary cylinders : 400
Data set name type : EXTENDED SMS Compressible : YES
Creation date . . . : 2008/05/15 Referenced date . . : 2008/05/15
Expiration date . . : ***None***
To display multiple volumes press Enter or enter Cancel to Exit.
The file mentioned here has 1964538 records. The number of cyls doesn't match with the calculated number as per:
http://www.mvsforums.com/helpboards/viewtopic.php?t=28&highlight=3390n |
|
Back to top |
|
|
Nic Clouston Advanced
Joined: 01 Feb 2007 Posts: 1075 Topics: 7 Location: At Home
|
Posted: Thu May 15, 2008 7:47 am Post subject: |
|
|
1 - the dataset may be compressed
2 - it is across multiple volumes
3 - I believe the allocation is for the displayed volume only
4 - press F1 for help which will explain these things for you
5 - your blocksize is for a tape/cart so you are only getting one block per cylinder instead of 2 so you are only getting 7 records per track instead of 12 _________________ Utility and Program control cards are NOT, repeat NOT, JCL. |
|
Back to top |
|
|
|
|