Skip to content

Add exit logic to ETL to ensure container stops after completion#44

Closed
JacobLanter wants to merge 1 commit into
developfrom
pr/etl_exit_fix
Closed

Add exit logic to ETL to ensure container stops after completion#44
JacobLanter wants to merge 1 commit into
developfrom
pr/etl_exit_fix

Conversation

@JacobLanter

Copy link
Copy Markdown
Collaborator

I think this should resolve our ETL service not closing after running sometimes. I looked into changing our cron creation command to do a force recreate for our ETL service; however, this will make it recreate immediately, which could interrupt a longer pull of data, which wouldnt break anything since on the next update, it would continue where it left off; however would not be ideal.

…inished

Signed-off-by: Jacob Lanter <jalant02@louisville.edu>
@JacobLanter

Copy link
Copy Markdown
Collaborator Author

Tested this to see if exit handling was the issue, but it didn’t fully resolve the container behavior. After increasing the update interval from 1 min to 5 min, things have been running much more consistently, so it seems more like a timing/start-stop issue with compose up when the interval is too short.

Going to clean up and delete this branch for now, but this is still worth revisiting if we want more near-real-time updates.

@JacobLanter JacobLanter deleted the pr/etl_exit_fix branch April 20, 2026 13:14
@Jalen-Hatcher

Copy link
Copy Markdown
Collaborator

Tested this to see if exit handling was the issue, but it didn’t fully resolve the container behavior. After increasing the update interval from 1 min to 5 min, things have been running much more consistently, so it seems more like a timing/start-stop issue with compose up when the interval is too short.

Going to clean up and delete this branch for now, but this is still worth revisiting if we want more near-real-time updates.

I'm wondering if there's a suitable way to check if we're composing up from another process or if Docker just gets overworked having to compose up multiple times.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants