Idea Details

TSS add optional parameter to suppress useless control characters (ASA)

Last activity 06-13-2019 10:13 AM
markus.grzeskiewicz1.1's profile image
07-05-2016 07:53 AM

It's 2016 -- we've been to the moon, we're thinking about autonomous car driving but TSS tools still generating ASA formatted reports.

 

This is totally useless as probably no one will still send endless output of tssaudit, tssutil, "cleanup" (AT6#RPT) etc. to a real printer (for which ASA has been made for).

 

Besides being useless it...

 

- requires needless cpu cycles whilegenerating and processing the data
     * just in case someone is head shaking: we're not talking about a

       ridiculous amount of a few hundred or thousand pages; we're talking

       about 10-50 GB of data (tssutil)

 

- requires additional logic while processing data -- and this in turn

     -- thanks IBM -- differs among the point of access (SORT, REXX, C/C++).

 

 

So please let's finally be in 2016 and add an optional parameter which will suppress the useless ASA control characters(having it optional will give 100 percent compatibility and it's only a few lines of code that need to be changed).

 

Thanks a lot!

 

Here's two examples: As you can see there's annoying form feeds, overstrikes (very useful in datasets/files) etc.

 

#-------------------------------------------------------------8<-------------------------------------------------------------

 

1CA-TOP SECRET SECURITY VERSION 15.0         SECURITY REPORT/EXTRACT UTILITY

-              INCOMING CONTROL STATEMENTS :

- EVENT(ALL) DATE(-01)

1CA-TOP SECRET SECURITY VERSION 15.0  SECURITY ACTIVITY/INCIDENTS REPORT # 01 05.07.16  0:30:12  PA


DATE     TIME   SYSI ACCESSOR JOBNAME  FFM VC PROGRAM  R-ACCESS A-ACCESS SRC/DRC SEC RESOURCE (TYPE & NAME)       JOBID

-------- -------- ---- -------- -------- ----- -------- -------- -------- ------- --- ---------------------------- -------

+

+

  1. 004.07.16 05:11:42 XXXX YYYY     YYYYZZZZ B F    USAP    READ     READ       OK+A  OPN D PPP111 DATA.SET            J003441

[...]

#-------------------------------------------------------------8<-------------------------------------------------------------

 

#-------------------------------------------------------------8<-------------------------------------------------------------

1CA-TOP SECRET SECURITY VERSION 15.0                        AUDIT UTILITY                          05.07.16   00:30:12

+                                                       

+ _____________

 

 

0 INCOMING PARAMETER ===>       CHANGES DATE(-01) 1CA-TOP SECRET SECURITY VERSION 15.0                        AUDIT UTILITY                         05.07.16   00:30:12

+                                                       

+ _____________

-                                         ----- LISTING OF CHANGES TO SECURITY FILE -----

-CHANGER    DATE    TIME   SYSID TYPE                      COMMAND/IMAGE

=======================================================================================

 

0XXXXXXXX 04.07.16 09:30:09 YYYY  CMND TSS REMOVE(TTTTTTT) SUSPEND TARGET(*) [...]

 

1CA-TOP SECRET SECURITY VERSION 15.0                        AUDIT UTILITY                         05.07.16   00:30:12

+                                                        

+ _____________

-                                          ----- LISTNG OF CHANGES TO SECURITY FILE -----

 

 

 

0

 

-                                                
ALL CHANGES WITHIN SCOPE LISTED

0

                                                     TSS COMMAND CHANGES = 32467
                                                     PASSWORD CHANGES = 00001                                                        
                                                     PHRASE CHANGES = 00000

                                                     DYNAMIC UPDATES = 00000 #
-------------------------------------------------------------8<-------------------------------------------------------------


Comments

09-19-2016 10:32 AM

Agreed, FBA is another annoyance.  We use IEBPTPCH to convert all our reports to FB.

09-19-2016 04:58 AM

Good news,

we just received and applied a new APAR. It introduces a "NOASACC" that suppresses the control characters. Good to notice anyhow, that the dataset will be nevertheless generated FBA (even FB was specified). Perhaps something to discuss!?

09-01-2016 10:22 AM

I'd like to see this in all #acf2 reports as well.  We have specialized COBOL formatter programs and multiple sort steps that strip out control characters and header information.  Nobody is printing reports anymore.  Just give me the data so I can get it into another format.

08-29-2016 10:05 AM

08-24-2016 01:01 AM

Hello Don,

 

thanks for the comment. Of course it's quite easy to process the data with something like sort. _But_ it's an additional process which takes resouces -- and even if we presume sort is quick and we ignore the CPU and memory usage totally, it takes time. Not sure what kind of systems others have, but our TSS audits sometimes reach 50 GB a day (no, this no misconfig) in a plex.

 

So why wasting resouces and especially time for totally useless things? A simple parameter NOASA as mentioned before would solve the problem and _any_ user processing the data can rely on clean data and does not ignore, remove etc. the data by itself.

 

It's (more than) fairly easy to implement, it's completely compatible and everybody can be sure by 100% that the input is totally clean. Not everybody should invent the wheel by itself again...

08-23-2016 02:31 PM

P.S.  That should be ANSI, not ASCII.

08-23-2016 02:30 PM

Hi -

 

ASA (ASCII) control characters are an annoyance, but you should be able to ignore them fairly easily.  You can also use SORT to do the initial selection and then delete the 1st position on output.  Let me know if you want more details.

 

If you're using native REXX (which doesn't really support RECORD FORMAT I/O) you have to cheat by concatenating something in front of the record.

 

- Don

08-16-2016 06:37 AM

Hi,

 

the problem is _not_ the heading etc. (which we can easily suppress) but the old fashioned printer output itself:

 

https://en.wikipedia.org/wiki/ASA_carriage_control_characters

 

As described above, this is totally useless in electronic data that is not printed. If you want to process this kind of data, you need to implement some logic to skip it. In REXX you have to care abou the offset, in Unix -- C, Java etc. you have to take special care as the control sequences are interpreted as what they are (form feeds etc.) and it costs looots of cycles if you have to process 20 GB.

 

Even with NOTITLE NOECHO NOLEGEND it's still in ASA.

 

For those who want to keep it, fine, but for those who need to process large amounts of data and want to rely on ASA free data source, a simple switch like

 

NOASA

 

would solve the problem.

08-11-2016 02:06 PM

NOTITLE---suppresses all TSSUTIL report titles and the legend which

           normally appears at the bottom of the TSSUTIL report.  This

           option is mutually exclusive with ONETITLE.

 

ONETITLE--allows the title preceding the echo of the input parameters

           and one copy of the title preceding the main body of the

           report, but suppresses all titles and pagination of the

           TSSUTIL main report.  This option is mutually exclusive with

           NOTITLE.

08-11-2016 01:47 PM

For those who, like Don, might not have known much about NOTITLE/ONETITLE, you can find more information about them in the documentation about TSSUTIL report selection criteria. Quick summary:

NOTITLE

     Suppresses title lines and pagination in the TSSUTIL report and suppresses the legend that follows the report.

ONETITLE

     Prints one title block at the beginning of the TSSUTIL report and suppresses all later pagination/title blocks.

08-11-2016 01:30 PM

John -

 

I did NOT know about the NOTITLE and ONETITLE options in TSSUTIL.  Not well publicized.   However, it doesn't appear that any of the other utilities, nor the canned EARL reports support this.

 

Thanks for pointing this out.

 

- Don

07-22-2016 02:25 PM

Have you looked at the NOTITLE option?

 

John P. Baker

07-14-2016 01:22 PM

While you're at it, how about something like PAGESIZE=0 or HEADING=[YES|first|no] to suppress page breaks and additional headings within the report as it does take extra work to strip off these headings.

 

- Don