Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
50 commits
Select commit Hold shift + click to select a range
c150f35
test SAS url & adding restore steps from infra file to not download f…
naomitodd May 15, 2026
e943228
fix NAMESPACE variable
naomitodd May 15, 2026
eea8d02
test updating sas step
naomitodd May 15, 2026
9da34bc
typo
naomitodd May 15, 2026
3f0c5d1
update sas url for download
naomitodd May 15, 2026
9f08546
fix typo
naomitodd May 15, 2026
9410924
check url/sas token created
naomitodd May 15, 2026
543b650
tweak to try and stop timeouts
naomitodd May 15, 2026
3d94a47
try encoding sas url
naomitodd May 15, 2026
a8f90c1
use txt file
naomitodd May 15, 2026
9fa80a9
update writing txt file
naomitodd May 15, 2026
bda33bc
hide url and fix missing .gz
naomitodd May 15, 2026
2d65117
fix typo
naomitodd May 15, 2026
992e7df
update file compression check
naomitodd May 15, 2026
6f00549
fix filename
naomitodd May 15, 2026
3044c29
add keepalive settings to command as not sure they were applied previ…
naomitodd May 15, 2026
a2a673b
Revert "add keepalive settings to command as not sure they were appli…
naomitodd May 15, 2026
a4fdeb2
increase timeouts
naomitodd May 15, 2026
204708d
update all timeouts
naomitodd May 15, 2026
75a168f
set shorter retention period for atrtifact
naomitodd May 15, 2026
b0ee84a
try one last time to pass SAS url directly between steps
naomitodd May 15, 2026
4c9777d
forgot to remove artifact download
naomitodd May 15, 2026
75cf63f
update ouput name
naomitodd May 15, 2026
e2fa77e
test github artifacts
naomitodd May 15, 2026
154cae0
try pg restore
naomitodd May 15, 2026
3f6cefe
revert to psql
naomitodd May 15, 2026
c92a854
cleanup & try out pg_restore for better speed/compression
naomitodd May 18, 2026
5e10bb7
match pipeline postgres version to deployed version
naomitodd May 18, 2026
eceaad5
Revert "match pipeline postgres version to deployed version"
naomitodd May 18, 2026
e624144
Revert "cleanup & try out pg_restore for better speed/compression"
naomitodd May 18, 2026
c7dd37e
cleanup & try out pg_restore for better speed/compression
naomitodd May 18, 2026
3d5659d
match pipeline postgres version to deployed version
naomitodd May 18, 2026
0d1555e
test out refreshing views separately
naomitodd May 18, 2026
bff43ff
update passing sql to konduit
naomitodd May 18, 2026
94b4b05
cleanup konduit output
naomitodd May 18, 2026
757321e
update analyze arguements
naomitodd May 18, 2026
5ff1244
update refresh views step
naomitodd May 18, 2026
1273dde
revert refresh steps
naomitodd May 18, 2026
761d6ef
reduce jobs to try and avoid dropped connections
naomitodd May 18, 2026
d72c5e8
try more jobs?
naomitodd May 18, 2026
b3db0ce
add rety and split up sections of restore - works without but possibl…
naomitodd May 18, 2026
274a30e
missing file changes
naomitodd May 18, 2026
d92e6da
update action versions
naomitodd May 18, 2026
112c686
fix typo
naomitodd May 18, 2026
0f4f38c
Revert "fix typo"
naomitodd May 18, 2026
cfaa1f0
Reapply "fix typo"
naomitodd May 18, 2026
07ec3e3
Revert "fix typo"
naomitodd May 18, 2026
5477ac1
Revert "update action versions"
naomitodd May 18, 2026
ad6226c
update all sync database actions to most recent versions
naomitodd May 18, 2026
8d8fcbf
Add retry to backup
naomitodd May 19, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/data-pipeline.yml
Original file line number Diff line number Diff line change
Expand Up @@ -625,7 +625,7 @@ jobs:
set +e
"$GITHUB_WORKSPACE/konduit.sh" \
-n "${{ env.AKS_NAMESPACE }}" \
-t 7200 \
-t 28800 \
-x \
-i "$GITHUB_WORKSPACE/SAPData/Sql/run_all.sql" \
"${{ env.KONDUIT_APP_NAME }}" -- psql 2>&1 | tee "$log_file"
Expand Down Expand Up @@ -668,7 +668,7 @@ jobs:
set +e
"$GITHUB_WORKSPACE/konduit.sh" \
-n "${{ env.AKS_NAMESPACE }}" \
-t 7200 \
-t 28800 \
-x \
"${{ env.KONDUIT_APP_NAME }}" -- \
pg_dump --format=plain --no-owner --no-privileges 2> konduit_pg_dump.log | gzip -c > "${LOCAL_FILE}"
Expand Down
Loading
Loading