Kimm Fathy

The best definition of AutoSys is

AutoSys Workload Automation is a multi-platform automated job control system.

How application Dev teams perform AutoSys job monitoring, manage enterprise workloads and scheduling using AutoSys software?

I.e. from anywhere at any time, with a custom dashboard using CA Workload Automation. Check out this video.

Following were the high level benefits.

Undoubtedly Yes !

As per the survey conducted by TechValidate

“68% of surveyed customers prefer Workload Automation over BMC Control-M for visualizing workloads”.

CA Workload Automation AE main components are as follows:

Remote Agent, Event Server, Event Processor are the build blockings.

Majority of the server configurations will be configured by autosys administrator.

There are two ways to create an AutoSys job definition.

Using AutoSys GUI(AutoSys Graphical User Interface):

Through gui or graphical user interface, job attributes can be set to describe where, when, and how a job should run.

Using Job Information Language (JIL) via command-line interface :

JIL command is a specification language whichs has its own commands to describe how a job should run.

In other words its a kind of schema which has its own data types and a defined structure/syntax.

Also environment variable passed as profile in JIL script.

Jobs in AutoSys classified into following job type.

Command job:

The name itself suggests, i.e Command jobs execute commands.

An command job is a single command or executable, windows batch file, or unix script/powershell script/shell script (scripting language).

File Watcher job:

The AutoSys file watcher job will watch for the arrival of particular file.

Box (box jobs):

AutoSys box jobs are containers that consists other jobs .

The box job in AutoSys used to control and organize process flow.

An impressive feature of this type of job is, boxes can include another boxes.

This tool keeps track of the AutoSys status of every job.

The job status used to determine when to start other jobs that are dependent on the job.

The following were the list of job status and their AutoSys change status behaviours.

STARTING : An event initiated to the start job procedure with the remote agent.

RUNNING :Means the job is in running mode. In case if the job is a box job, this value means that the jobs within the AutoSys box started.

INACTIVE : Means the job is inactive. The job has been never executed or its status was intentionally marked to turnoff its previous completion status.

ACTIVATED : The top-level box that this job resided now in RUNNING state, but note that job itself has not started yet.

SUCCESS : The job completed successfully, by default the Exit Code ‘0’ considered as success. In case of box job, success status means that all the jobs inside the box has completed successfully.

FAILURE : The job failed, which means the Exit Code-is greater than zero.

TERMINATED : The job terminated while in the running state. A job terminated when user sends a KILL job event.

RESTART : The job was unable to start due to application or hardware problems and scheduled to restart.

QUE_WAIT : The job ready to run, but there are not enough machine resources available.

ON HOLD : The job is ON HOLD and will not run until it receives job OFF HOLD event.

ON ICE : The job will be ON ICE ( AutoSys jobs on ice) until it receives OFF ICE event. In other words, ICE job can be ON/OFF.

Its one of the standard AutoSys interview questions.

Here are the details of AutoSys condition which covers ON ICE to OFF ICE vs ON HOLD to OFF HOLD.

File Transfer jobs allows transferring of,

binary, ASCII, EBCDIC files between an agent computer/remote location or FTP server.

File transfer jobs defined as following:

FTP:

Lets you transfer files using File Transfer Protocol(FTP).

SFTP:

We can securely transfer binary or ASCII files using the Secure File Transfer Protocol (SFTP).

Also SFTP protocol supports wildcard transfers,

so you can upload multiple files to a remote FTP server or download multiple files to the agent machine.

SCP:

Securely transfer binary files using the Secure Copy Protocol (SCP).

Note that SCP protocol doesn’t support wildcard transfers.

JIL stands for Job Information Language.

JIL file/scripts used to built an job definition via command-line interface.

JIL scripts contain one or more subcommands/attribute statements.

The following are the jil command syntax for subcommand and attribute.

sub_command:object_name

sub_command -> Defines a JIL sub command.

object_name -> Defines the name of the object (i,e job / machine) to act on.

attribute_keyword:value

attribute_keyword -> Defines a valid JIL attribute.

value -> Defines the setting to apply a attribute.

1. Sample JIL command example for an command job “helloJob.jil”

insert_job:helloJobmachine :unix machine nameowner :usernamecommand :echo “Hello this a welcome command job”

note: insert job denotes the job name2. To add the command job “helloJob.jil” in database(db)

Run the following autosys unix commands through command prompt.

jil < echoJob.jil

If you want to read JIL tag and the corresponding job associated with it,

load the information via datastage, then you can grep the JIL script.

grep “hello_job:echo” *.jil | cut -d ‘ ‘ -f2

By using above command syntax solution, you can get the job names.

I.e. via filter options available in Sequential file/script and load using datastage job.

Lets go through update job syntax and each attribute/parameter in detail.

update_job: BOX_Nstart_times: “18:00”

Here start_times aceepts numeric type of time format.

Save into a jil file and run it using jil executable script command jil < filename.jil

Example:

insert_job: HelloWorld

job_type: c

box_name: box1

command: Datasource/scripts/Autosys/oraclesqlquery/storedprocedure.sh

machine: localhost

owner: [email protected]

permission: gx,ge,wx,we,mx,me

date_conditions: 1

days_of_week: all

start_times: 0,30]

strong>term_run_time: 180

alarm_if_fail: 1

Let’s go through each attribute of jil commands from above example

insert_job:

Its a JIL keyword which used as Name to identify a job.

job_type:

It defines type of a job and in this case C refers to a Command Job.

command:

This attribute can be any command, UNIX shell script, executable, or batch file.

machine:The client machine on which the command should run.

owner:

It will be the userID on which the command will be running. For above scenario, I gave autosys admin as owner.

permission:First letter (g,w,m) combination refers to group user and last letter (x,e) refers to the rights for edit (e) and execute(x).

date_conditions:The AutoSys date_conditions which enables the run calendar for the respective job.

days_of_week:

Days on which the job should run.

start_times:

autosys start times, This specifies start time of job that it should trigger/run.

term_run_time:‘

term_run_time result in a job status being set to Terminated after specified time.

As per example above, it will set the job status to terminated after running 180 minutes.

alarm_if_fail :

If the value is 1, then you will receive an failure alert and If the value is 0, then you will not receive any alert.

max run alarm in AutoSys is an classic example for this.

Whenever job runs than the specified time, an max run alarm alert will trigger.

Note:AutoSys start_mins leveraged, if a job needs to trigger every minute/minutes.

The following syntax will start the job for every 10 mins.

start_mins: 00,10,20,30,40,50

Following cheat sheet consists list of Autosys basic commands used in unix or any other operating system.

Out of above, let me go through some important commands that are frequently used.

autocal_asc used to define AutoSys calendars.

Calendars are very helpful incase of job/box specific events, processed based on a date in a calendar

eg: holiday batch job or batch jobs processing based on the date etc).

AutoSys condition parameter “date_conditions” related to calendar concepts.`For a job to run ‘standalone’,

the ‘Date/Time conditions’ attribute in the ‘Schedule’ section must reflect ‘true’.

If the date_conditions field is not set to ‘1’ (true),

AutoSys review ignore ‘Days’ or ‘Time’ attributes and rely on dependencies for job scheduling software.

If the ‘Date/Time conditions are ‘true’,

the job or job box will also reference ‘Run days’, or ‘Run calendar’ and/or ‘Exclude Calendar’;

and, ‘Times of day’ or ‘Minutes past hour’.

These job attributes will covered in more details in other sections of autosys documentation.

Cron is a job scheduler in unix based operating systems.

Used to schedule a job (either command or the scripts )that runs at fixed intervals, schedule.

Cron controlled by a crontab file,

a config file that defines shell commands to run cyclically on a specified schedule.

cron2jil command is used to convert from CRON to JIL.

The sendevent AutoSys command is a component that sends events,

to start or stop jobs, stop the AutoSys scheduler, put a job on hold,

set a AutoSys global variable, cancel a scheduled jobs event and so on.

Basically this command will send event in AutoSys scheduling tool.

Following are sample sendevent commands, generally denoted by using sendevent e job name.

To start a job:

sendevent -E STARTJOB -J

To force start a job : sendevent -E FORCE_STARTJOB -J

AutoSys ON ICE:

sendevent -E ON_ICE -J

Put job OFF ICE :

sendevent -E OFF_ICE -J

AutoSys kill job:

sendevent -E KILLJOB -J

Event logs verified to check the output, errors.

We can call an AutoSys job via unix executable script, following is an example.

JobName : SchedulerCommand

Custom Script Name: callJob.ksh

Server: AutoSys Server

In shell script “callJob.ksh”, use the below sendevent command to pass the event type and job name.

sendevent -E FORCE_STARTJOB -J SchedulerCommand

Now save the unix script and invoke it using command ./callJob.ksh from AutoSys server.

that’s it, the job ‘SchedulerCommand’ will be successfully force started.

autorep command generates reports about jobs, machines, and autosys global variables defined in database.

It pulls data from the database to formulate the reports.

autorep command used to achieve the following.

If you want to check the job definition history changes, then you can acieve it using autorep command below

autorep -j “mention the job name”

Also by using wildcards(%) with autorep command, you can export the AutoSys JIL’s.

autorep -j % -q > /temp/filename.jil

For an instance, jobs could be dependent on a arrival file and if the file not yet arrived in an expected time frame.

Then the job fails and then alarm notification alert the respective groups or owners to take appropriate action.

Exception Handling is one of the key attribute in the software life cycle.

w.r.t AutoSys, its best practice to have exception handling on failed operator which have exit path for only “retry” scenario.

Else having retry without ever exiting the process results in endless loops.

Error/Err files or log files can found by using following commands.

Scheduler Server and Application Server logs:

(default) /opt/CA/WorkloadAutomationAE/autouser.ACE/out

AutoSys WCC logs:

(default) /opt/CA/WorkloadCC/log

AutoSys agent logs:

(default) /opt/CA/WorkloadAutomationAE/SystemAgent/WA_AGENT/log

In general, a zero Exit Code- indicates success; while a non zero Exit Code- indicates an error. Following are exit or error codes which are frequently seen.

Exit Code-1:Missing System Agent configuration parameter “oscomponent.cmdprefix.force=true”

and/or the Windows machine definition missing the “opsys: windows” (JIL) attribute.

Exit Code-2:

This error is coming from the first line in the job script where the shell was being sourced.

The first line read ‘#!/usr/bin/ksh’.

However, this was an invalid location for setting the shell interpreter which are typically located in /bin and not /usr/bin.

Exit Code-13:

Due to a permission error on the std_out_file.

Exit Code-15:

The job terminated.

Exit Code-101:

CHANGE_STATUS performed on the job. for eg: The job changed to FAILURE or TERMINATED status.

Exit Code-121:

Cannot open std_in_file. File does not exist or it is inaccessible.

Exit Code-122:

Cannot open std_out_file. File does not exist or it is inaccessible.

Exit Code-123:

Cannot open std_err_file. File does not exist or it is inaccessible.

Exit Code-127:

Directory that holds the executable is not in the command search PATH.

Exit Code-256:

Unable to execute the command.

Exit Code-512:

Incorrect command options.

Exit Code-655/-655 SYSTEM_ERROR:

STARTJOB failures because auto_remote will not start.

-656 NO_EXIT_CODE:

exit_code field in database initialized to this.

-657 PROCESS_MIA: Set by a chase-generated FAILURE event.

for eg: chase cannot find the process.

Oracle job scheduler defined to run Oracle E-Business Suite workload.

It is illustrated in the following ways.

CA Workload Automation Reviews from subject matter experts posted in itcentralstation.com.

In this tutorial, I tried to cover as vast i can when compared to other AutoSys tutorials.

Hope you liked AutoSys user guide topics covered in this post , please feel free to share above autosys reference manual.

How to apply · Select the 'Register for JP Online' button · Confirm your eligibility and enter your personal details · Receive an email from the Department of

The Doberman puppy should be fed an age-appropriate diet approved by the dog's breeder or veterinarian Treats can be an important aid in training,

World War I From December 31, 1893, Russia had a defensive alliance with France In 1904 France and Great Britain put an end to their overseas rivalries

Top 10 RV Campgrounds in Fresno, California According to Google · Millerton Lake State Recreation Area · Island Park Campground · Lakes RV & Golf