Can't start airflow 3 on Ubuntu 22.04 in WSL 2

[klonuo]

Apache Airflow version

3.0.0

If "Other Airflow 2 version" selected, which one?

No response

What happened?

I'm on Windows 11 with WSL 2, and using virtualenv with pip to install airflow:

pip install -U "apache-airflow[celery]==3.0.0" --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-3.0.0/constraints-3.12.txt"

I can run airflow 2.10.5 without issues, while when I try current 3.0 I can't start the server ("child process died"):

I suspect problem with the new fastapi backend.

I tried using gevent: _AIRFLOW_PATCH_GEVENT=True, but it's the same result.

Any ideas how to approach to solve this?

What you think should happen instead?

No response

How to reproduce

run $ airflow api-server

Operating System

Ubuntu 22.04.5 LTS

Versions of Apache Airflow Providers

No response

Deployment

Virtualenv installation

Deployment details

No response

Anything else?

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[boring-cyborg[bot]]

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

[potiuk]

Converted to a discussion - WSL2 is not a "target" platform for us, but if someone who uses it and would like to investigate and share their experiences, this discussion might be helpful

[potiuk]

I think the way you can approach it @klonuo is to look at more logs - system logs, airflow logs - any other logs you can find. Somewhere somethign is likely writing what and why happened - but without seeing the reason, it's next to impossible to guess what's going on.

It might be as simple as not having enough resources (memory, CPU, disk, etc. allocated for your VM or as complex as some missing permissions. But without you deeging deeper, it's quite impossible to guess what is wrong in your case

[retsilla]

I have also faced this issue trying to get Airflow 3.0 running on a Raspberry Pi 4 with two API server workers (this setup did previously work fine on Airflow 2).

The issue seems to be related to newer versions of uvicorn (>=0.30.0) running on slower machines not allowing enough time for the child processes to start. Relevant discussions: encode/uvicorn#2450 and encode/uvicorn#2506.

Two solutions that worked for me:

1. Set AIRFLOW__API__WORKERS=1, this prevents uvicorn launching child processes avoiding the timeout issue.
2. Downgrade to uvicorn==0.29.0 which uses the older and quicker method for launching child processes meaning you can use more than 1 worker.