Skip to content
Open
Changes from all commits
Commits
Show all changes
73 commits
Select commit Hold shift + click to select a range
9a2562e
Exposes the /dwh, /config and /next APIs
ndegwamartin Aug 6, 2025
5a96344
Adds prefix to snapshot ids for /dwh
ndegwamartin Aug 7, 2025
446cfef
Formats files with mvn clean package
ndegwamartin Aug 7, 2025
634575f
Refactors listDwhSnapshot to reuse existing code
ndegwamartin Aug 7, 2025
7f9bdd0
Adds delete snapshot functionality to /dwh endpoint
ndegwamartin Aug 7, 2025
37fde9f
Adds unit tests
ndegwamartin Aug 8, 2025
e37321a
Merge branch 'master' into expose-apis
ndegwamartin Aug 13, 2025
0a2a7b5
Addresses PR Feedback
ndegwamartin Aug 15, 2025
cac1332
Merge branch 'expose-apis' of github.com:ndegwamartin/fhir-data-pipes…
ndegwamartin Aug 15, 2025
f3e7767
Merge branch 'master' into expose-apis
ndegwamartin Aug 15, 2025
084f859
Implements CLI for the pipeline controller
ndegwamartin Aug 15, 2025
f12b4a6
Merge branch 'master' into controller-cli
ndegwamartin Aug 19, 2025
fc1899d
Merge branch 'master' into controller-cli
ndegwamartin Aug 20, 2025
6d7b0de
Merge remote-tracking branch 'martin/master' into controller-cli
ndegwamartin Aug 22, 2025
2c000a6
Format controller-cli main.py
ndegwamartin Aug 22, 2025
bf0aa80
Refactors to use setup tools | Wrapper for cli tooling
ndegwamartin Aug 23, 2025
303f396
Refactors CLI implementation
ndegwamartin Aug 25, 2025
c716e33
Adds dev and user documentation
ndegwamartin Aug 25, 2025
d21b0e4
Adds tests for the Controller CLI
ndegwamartin Aug 25, 2025
f8f2c8a
Trigger CI
ndegwamartin Aug 26, 2025
e61f55b
Refactors to use HTTP request mocking
ndegwamartin Sep 3, 2025
216b16d
Merge remote-tracking branch 'origin/master' into controller-cli
ndegwamartin Sep 4, 2025
b1720d7
Address PR feedback
ndegwamartin Sep 4, 2025
37b81c6
Removes error file
ndegwamartin Sep 4, 2025
cd78a83
Refactors e2e tests scripts to utilize controller-cli to trigger runs
ndegwamartin Sep 4, 2025
6d56abc
Refactors e2e pipeline run check to use controller CLI
ndegwamartin Sep 4, 2025
5837d81
Address PR Feedback II
ndegwamartin Sep 4, 2025
15586fc
Runs PyLint in Controller CLI and formats
ndegwamartin Sep 4, 2025
5fd678a
Refactors e2e controller CLI install logic to Dockerfile
ndegwamartin Sep 8, 2025
f85b30c
Adresses PR Feedback | Cleans up docs
ndegwamartin Sep 8, 2025
3b0c5df
Combines CLI install commands to same Dockerfile layer
ndegwamartin Sep 8, 2025
daa4fc9
Reconfigures the cloud build Build E2E Image step to support Controll…
ndegwamartin Sep 8, 2025
44a3504
Reverts changes to e2e tests running
ndegwamartin Sep 9, 2025
11f188a
Troubleshooting : Enables LOG printing for controller e2e tests
ndegwamartin Sep 10, 2025
093bb63
Reverts e2e test changes
ndegwamartin Sep 11, 2025
f15e1ba
Reverts cloudbuild logs configuration
ndegwamartin Sep 12, 2025
c840287
Adds Controller CLI script install configuration to main Dockerfile
ndegwamartin Sep 13, 2025
1478dd4
Merge branch 'master' into controller-cli
ndegwamartin Sep 13, 2025
3d0025f
Merge branch 'master' into controller-cli-e2e
ndegwamartin Sep 16, 2025
a298001
Migrates end to end script to controller CLI
ndegwamartin Sep 16, 2025
381bf3f
Updates controller CLI install in e2e Docker configuration
ndegwamartin Sep 16, 2025
eaf4779
Disables extra logs for Run E2E Tests for Dockerized Controller and S…
ndegwamartin Sep 16, 2025
c0b0f5e
Revert "Updates controller CLI install in e2e Docker configuration"
ndegwamartin Sep 17, 2025
e7a8c28
Merge branch 'master' into controller-cli-e2e
ndegwamartin Sep 17, 2025
0717bf4
Merge branch 'master' into controller-cli-e2e
ndegwamartin Sep 17, 2025
5895bf6
Merge branch 'master' into controller-cli-e2e
ndegwamartin Sep 23, 2025
b953985
Merge branch 'master' into controller-cli-e2e
ndegwamartin Oct 6, 2025
e91535a
Merge branch 'master' into controller-cli-e2e
ndegwamartin Oct 21, 2025
ff04807
Merge branch 'master' into controller-cli-e2e
ndegwamartin Oct 22, 2025
a4b0168
Merge branch 'master' into controller-cli-e2e
ndegwamartin Oct 22, 2025
6ff2303
Adds query parameters to requests url for POST
ndegwamartin Oct 22, 2025
2f76df3
Addresses PR Feedback
ndegwamartin Oct 22, 2025
cc3968c
Adds missing parameters to to POST requests
ndegwamartin Oct 23, 2025
dfd45c1
Merge branch 'master' into controller-cli-e2e
ndegwamartin Oct 30, 2025
42b2a78
Add quotes around bash script command environment variables
ndegwamartin Oct 30, 2025
8e072df
Merge branch 'controller-cli-e2e' of github.com:ndegwamartin/fhir-dat…
ndegwamartin Oct 30, 2025
0b3119a
Enhances the pipeline status check to be more robust
ndegwamartin Oct 30, 2025
633d3b8
Refactors run api method to return valid Json
ndegwamartin Oct 30, 2025
5de111e
Troubleshooting tag
ndegwamartin Oct 31, 2025
142123b
Troubleshooting tag
ndegwamartin Oct 31, 2025
0e39a85
Adds debug logs for Troubleshooting
ndegwamartin Nov 1, 2025
182c5a6
Merge branch 'master' into controller-cli-e2e
ndegwamartin Nov 3, 2025
ccae8e8
Revert "Refactors run api method to return valid Json"
ndegwamartin Nov 3, 2025
8a518dd
Refactors run api method to return valid Json
ndegwamartin Oct 30, 2025
4f17c84
Revert "Refactors run api method to return valid Json"
ndegwamartin Nov 4, 2025
982a0f8
Traces any errors caused by Write Resources to File
ndegwamartin Nov 4, 2025
832db15
Enables Cloud Build Controller logs
ndegwamartin Nov 4, 2025
5d93f4a
Merge branch 'master' into controller-cli-e2e
ndegwamartin Nov 5, 2025
a2f8a68
Fixes e2e tests CI build 💚
ndegwamartin Nov 10, 2025
8888c55
Refactors e2e tests await pipeline status logic for POSIX compliance
ndegwamartin Nov 10, 2025
c628b3b
Resets code to master version
ndegwamartin Nov 25, 2025
3593390
Refactors e2e tests await pipeline status logic for POSIX compliance
ndegwamartin Nov 25, 2025
28de569
Merge branch 'master' into posix-e2e
ndegwamartin Nov 25, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 5 additions & 3 deletions e2e-tests/controller-spark/controller_spark_sql_validation.sh
Original file line number Diff line number Diff line change
Expand Up @@ -192,10 +192,12 @@ function run_pipeline() {
}

function wait_for_completion() {
local runtime="25 minute"
local end_time=$(date -ud "$runtime" +%s)
local runtime_minutes=25
local runtime_seconds=$((runtime_minutes * 60))
local start_time=$(date +%s)
local end_time=$((start_time + runtime_seconds))

while [[ $(date -u +%s) -le ${end_time} ]]
while [[ $(date +%s) -le ${end_time} ]]
do
# Here we extract only the JSON part of the output from controller 'status'
# command as there could be some logging info printed before the JSON output.
Expand Down
Loading