Respeitar o scheme do endpoint na conexão DuckLake (s3_use_ssl) - #73
Open
maia-andre wants to merge 1 commit into
Open
Respeitar o scheme do endpoint na conexão DuckLake (s3_use_ssl)#73maia-andre wants to merge 1 commit into
s3_use_ssl)#73maia-andre wants to merge 1 commit into
Conversation
`_nova_conexao` descartava o scheme da URL configurada e nunca definia `s3_use_ssl`, cujo default no DuckDB é ligado. Endpoints http (MinIO local, storage on-premises) falhavam com "SSL connection failed" em qualquer comando que lesse parquets. Agora o scheme é honrado: http desliga o SSL; https mantém o comportamento atual.
maia-andre
force-pushed
the
fix/ducklake-endpoint-http
branch
from
August 31, 2026 23:38
da47dde to
23a7467
Compare
1 task
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Resolve #72
O que muda com esse PR
_nova_conexao(utils/ducklake.py) passa a definirs3_use_ssla partir do scheme do endpoint configurado, em vez de deixar o default do DuckDB (SSL sempre ligado) valer para qualquer endpoint:https://…(produção)http://…(MinIO local, on-prem)SSL connection failedIsso destrava o desenvolvimento local com MinIO (#35) e abre caminho para testes de integração na CI com um S3 real como service container (#68).
Antes (main atual, MinIO local em
http://localhost:9000):Depois (este PR, mesma máquina, mesmos dados — pipeline NCM):
O lake no MinIO (bucket
colibri-prodpopulado pelocolibri pipeline run ncm; a segunda imagem mostra exatamente o parquet que a URL do erro tentava alcançar):Como testar
docker run --rm -p 127.0.0.1:9000:9000 -p 127.0.0.1:9001:9001 -e MINIO_ROOT_USER=... -e MINIO_ROOT_PASSWORD=... minio/minio server /data --console-address ":9001", criar o bucketcolibri-prod..segredos.ymlparaendpoint: http://localhost:9000com as credenciais do passo 1.colibri pipeline run ncm.colibri lake query "SELECT COUNT(*) FROM lake.main_intermediate.int_ncm"— sem este PR, falha comSSL connection failed; com ele, retorna as linhas.https(produção), nada muda:s3_use_ssl = trueé exatamente o default que já valia.Checklist antes de mesclar na main
ruff format .