DX Unified Infrastructure Management

 View Only
  • 1.  Capture date with regular expression at file.log with logmon probe

    Posted 12 days ago

    Hi Everyone !

    I have a request of monitoring, where we need to monitoring the date of the day on a file...

    This data comes from a file that i read with logmon probe:

    Example:

    Listado de /DATALAKE/LANDINGS/BODEGA_DE_DATOS
    Found 35 items
    -rw-r--r--   3 nififlow supergroup      38893 2024-07-04 00:03 /DATALAKE/LANDINGS/BODEGA_DE_DATOS/ACTIVIDAD_ECONOMICA.csv
    -rw-r--r--   3 nififlow supergroup      12234 2024-07-04 00:03 /DATALAKE/LANDINGS/BODEGA_DE_DATOS/APL_DIMEN.csv
    -rw-r--r--   3 nififlow supergroup  218719671 2024-07-03 00:16 /DATALAKE/LANDINGS/BODEGA_DE_DATOS/APL_TRADUCCION_INSTAN_DIMEN.csv
    -rw-r--r--   3 nififlow supergroup        580 2024-07-04 00:03 /DATALAKE/LANDINGS/BODEGA_DE_DATOS/CARACT_COMERCIO_ELECT.csv

    If today is 2024-07-04 and a line of the file indicate 2024-07-03 i need generate the alarm that the indicate the route (/DATALAKE/LANDINGS/BODEGA_DE_DATOS/APL_TRADUCCION_INSTAN_DIMEN.csv) wasn't updated...
     
    That is possible doing this with logmon probe or do you have another idea... ?



  • 2.  RE: Capture date with regular expression at file.log with logmon probe

    Posted 8 days ago

    You can try the monitoring of the "file age" with the dirscan probe, tab "age of file".

    Via a schedule you can define when to check/run so you can decide on when you decide a file is too old.

    The alarm will give you the file name + how old in minutes.




  • 3.  RE: Capture date with regular expression at file.log with logmon probe

    Posted 7 days ago

    Hi Luc, i can't to use dirscan because the files is only possible obtaing with a command... "hdfs dfs -ls /DATALAKE/LANDINGS", this is files from Hadoop Distributed File System (HDFS). They isn't conventional linux command "ls -lah".

    So I managed to do this configuration through logmon, generating a file from a shell script that exports the data of the command performed to a file.log. I read this file and generate the alarm when it matches the search pattern




  • 4.  RE: Capture date with regular expression at file.log with logmon probe

    Broadcom Employee
    Posted 6 days ago

    Hi Miller,

    I don't see a way to compare parsed value with current date (dynamic value). We may have to use a script.

    Rgds,

    Rajesh B