| View previous topic :: View next topic |
| Author |
Message |
nishantrk
Beginner
Joined: 24 Mar 2006
Posts: 32
Topics: 16
|
 Posted: Sat Mar 27, 2010 9:43 pm Post subject: syncsort partial records copy vs full record |
 |
|
Is there any performance difference if am copying the full record or a portion of the record.
My requirement is to extract a particular record types from a huge master file ,then read the record in cobol programs,but i need only few fields of the records .
My peers here suggest to copy the full record as sort will be faster in that case and let the cobol program read the full records .
But i feel that since of the 28793 record , only a 100 byte is relevant to cobol program, should be copy only the 100??
Can anyone please throw some light how exaclty syncsort works...and help me with this problem?? |
|
| Back to top |
|
 |
papadi
Supermod
Joined: 20 Oct 2009
Posts: 594
Topics: 1
|
| Posted: Sat Mar 27, 2010 10:16 pm Post subject: |
|
|
How many records will be selected from the input file?
| Quote: | | My peers here suggest to copy the full record as sort will be faster in that case |
Suggest they explain why they believe this. . .The process will use more space for the output and most likely run longer if the full-size records are written when only 100 bytes would be needed.
| Quote: | | Can anyone please throw some light how exaclty syncsort works... |
Unless there is something i misunderstand, this has nothing to do with Syncsort. It is simply a matter of whether writing 28,793 byte records takes more resources than writing the same number of 100 byte records.
_________________
All the best,
di |
|
| Back to top |
|
|
nishantrk
Beginner
Joined: 24 Mar 2006
Posts: 32
Topics: 16
|
| Posted: Sun Mar 28, 2010 4:22 pm Post subject: |
|
|
| Quote: | | Suggest they explain why they believe this. . .The process will use more space for the output and most likely run longer if the full-size records are written when only 100 bytes would be needed. |
Actually it would better ,if i can justify that copying partial records is better than actually copying the full records with some documentation ,as its me who is suggesting this change in there design..
Can you help here...I tried google search.. couldn't find anything relevant there |
|
| Back to top |
|
|
papadi
Supermod
Joined: 20 Oct 2009
Posts: 594
Topics: 1
|
| Posted: Sun Mar 28, 2010 5:04 pm Post subject: |
|
|
Run a simple experiment. . .
Write 10 million 28793-byte records (287,930,000,000 total bytes) and 10 million 100-bytes records (1,000,000,000). A billion bytes is more than just a few, but nothing to compare against 287 billion.
Compare the space used and the time it takes. . . This will be more dramatic than just showing the calculations 
It may be difficult to find what you are looking for via a search because it is something most people would realize intuitively.
_________________
All the best,
di |
|
| Back to top |
|
|
|
|
|
FAQ
Search
Quick Manuals
Register
Profile
Log in to check your private messages
Log in
