Control-M for Airflow jobs stuck on execution

Knowledge Article

Article Number

000414577

Old Article Number

Article Type

Solutions to a Product Problem

Title

Control-M for Airflow jobs stuck on execution

Summary

Product

Control-M for Airflow

Component

Control-M for Airflow

Applies to

Control-M for Airflow 9.0.21 using json file

Problem

Airflow jobs remain on execution but finish on Airflow side. The issue presents on jobs using configuration json and when json file contains multiple lines like this:

{

"dag_id": "my_simple_dag",

"schedule_interval": "@daily",

"default_args": {

"owner": "airflow",

"start_date": "XXXX-XX-XX"

"tasks": [

{

"task_id": "task1",

"operator": "BashOperator",

"bash_command": "echo 'Hello, World!'",

"depends_on_past": false

}

]

}

Such error is visible in the airflow log :

AFL_DLL_TRACK_EVENT_.log

0606 10:43:41:749 AFL_DLL_TRACK_EVENT: [be_remoting.cpp:633] Raw Response: <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 java.lang.NullPointerException</title>
</head>
<body><h2>HTTP ERROR 500 java.lang.NullPointerException</h2>
<table>

Cause

new line character in the JSON configuration file .

Solution

Alternate solution :

Use a single line json configuration file, without new line character, for example:

{ "dag_id": "my_simple_dag", "schedule_interval": "@daily", "default_args": { "owner": "airflow", "start_date": "XXXX-XX-XX" }, "tasks": [ { "task_id": "task1", "operator": "BashOperator", "bash_command": "echo 'Hello, World!'", "depends_on_past": false } ]}

Attachment(s):