Skip to content

Releases: DataKitchen/dataops-testgen

3.7.8

Choose a tag to compare

@aarthy-dk aarthy-dk released this 01 May 21:57

Bug Fixes

  • charts: Fixing a variety of small issues with the app charts (18af230)
  • handle none data type in profiling ddf (c16cb92)
  • data-catalog: joining profiling results did not include table_name (e9cd3be)

Miscellaneous

  • cli: add run id to profiling and test execution outputs (656d541)

Docker Image

datakitchen/dataops-testgen:v3.7.8

PyPI Package

dataops-testgen==3.7.8

3.7.6

Choose a tag to compare

@rboni-dk rboni-dk released this 02 Apr 22:43

Bug Fixes

  • ODBC driver was missing (54ae6b6)
  • Fix the custom test validation (eb4ce5d)

Docker Image

datakitchen/dataops-testgen:v3.7.6

PyPI Package

dataops-testgen==3.7.6

3.7.3

Choose a tag to compare

@rboni-dk rboni-dk released this 31 Mar 20:49

Bug Fixes

  • Connection "http_path" was missing (f19741a)
  • profiling: replace null characters before copy command (2f52a15)

Docker Image

datakitchen/dataops-testgen:v3.7.3

PyPI Package

dataops-testgen==3.7.3

3.7.1

Choose a tag to compare

@aarthy-dk aarthy-dk released this 25 Mar 05:42

Features

  • flavors: Adding support to Databricks (e08e964)
  • scoring: keep history of score results for each score definition (8455400)
  • scoring: display score card history as line charts (20072a4)
  • data-catalog: add autocomplete for tags (dd5d58f)
  • data-catalog: add tree filters (e506fa7)
  • data-catalog: add data preview dialog (c913595)
  • data-catalog: add multi-edit mode (1f03c7f)
  • update user roles (d26a111)
  • roles: apply permissions to results disposition (0334101)
  • roles: apply permissions to data catalog (0b763c9)
  • telemetry: Sending event when user logs in (498778f)

Bug Fixes

  • scoring: add missing filter to scoring view (0d53ef8)
  • scoring: issues and inconsistencies storing history (6d68465)
  • data-catalog: shows tags inherited from table group (fbdfb74)
  • data-catalog: add new http-path to data preview query (4ea4aa8)
  • roles: apply permissions to empty state actions (db60ef6)
  • roles: apply permissions to canceling runs (6516a9c)
  • roles: apply missing permissions to connections, table groups & scores (f5ae33c)
  • scores: bugs in saving to db (0e24a16)
  • data catalog: bugs in tree (412d547)
  • bugs in routing (d589ae4)
  • Upgrade PyArrow at the base image (bf85763)
  • connections: hide Test Connection button for non-admins (b79b7ba)
  • project in query param not sticking on refresh (019bfe6)

Refactors

  • consolidate user session service, remove auth service (8f80b5c)
  • imports in test results (b892972)
  • project-settings: improve edit form (8d288d2)
  • sidebar: improve layout, add App Logs button (888424d)
  • cleanup dead code (ee2d850)

Miscellaneous

  • db: function decorator to manage database sessions (504f162)
  • scoring: add views and table for score recalc (0d68ee9)
  • scoring: implement score recalculation (0a26d6e)
  • ui: add line chart component (66ac23a)

Docker Image

datakitchen/dataops-testgen:v3.7.1

PyPI Package

dataops-testgen==3.7.1

testgen-0.1.1

Choose a tag to compare

@github-actions github-actions released this 07 Mar 02:18
c8dd8dc

A Helm chart for Kubernetes

3.1.2

Choose a tag to compare

@aarthy-dk aarthy-dk released this 06 Mar 17:41

Bug Fixes

  • scores: key error on empty state (b3b4f35)
  • ui: bug in run timestamp displays (0edf526)
  • runs: old profiling runs incorrectly marked as error (d01f27e)
  • runs: update Running runs to Canceled on startup (4e54943)

Refactors

  • runs: simplify code to update run status (a467372)

Docker Image

datakitchen/dataops-testgen:v3.1.2

PyPI Package

dataops-testgen==3.1.2

3.1.0

Choose a tag to compare

@aarthy-dk aarthy-dk released this 28 Feb 07:05

Features

  • Adding Helm charts (caae9e6)
  • helm-charts: support extra volume and mounts, update secret (0b1f403)

Bug Fixes

  • docker: empty version env var in image (09d571e)
  • scores: hide empty scorecards and make breakdown filter conditional (82efe24)

Docker Image

datakitchen/dataops-testgen:v3.1.0

PyPI Package

dataops-testgen==3.1.0

testgen-services-0.1.0

Choose a tag to compare

@github-actions github-actions released this 28 Feb 05:16
d4d1ce1

A Helm chart for Kubernetes

testgen-0.1.0

Choose a tag to compare

@github-actions github-actions released this 28 Feb 05:16
d4d1ce1

A Helm chart for Kubernetes

3.0.0

Choose a tag to compare

@aarthy-dk aarthy-dk released this 19 Feb 16:49

Features

  • scoring: display scoring for each table group in the overview page (fa05577)
  • ui: add sections to nav bar (09c80a5)
  • scoring: refresh data characteristics during test execution (acbe3e7)
  • scoring: add new score dashboard (fe5e36a)
  • scoring: add details page for score cards (c36ce70)
  • ui: display scores in Data Catalog, Profiling Runs & Test Runs (1ab9794)
  • test-suites: add "exclude from scoring" checkbox to add/edit dialog (2ddffcb)
  • components: improvements to button, checkbox and paginator (7f080fd)
  • score-issues: add pagination, multi-selection and issue reports in score drilldown (e178d13)
  • quality-dashboard: add profiling and testing scores to cards (3cc7ef8)
  • scores: support refreshing scores for runs and table groups (cd81a82)
  • scores: add score refresh buttons in hygiene issues and test results pages (ad79073)
  • data-catalog: consolidate, rename & improve tags (12eb738)
  • scoring: add support for custom score cards (92a6813)
  • scoring: refresh score cards results (4db34fb)
  • scoring: register a scorecard on table group creation (1b8c372)
  • ui: add component for column profiling results (afec021)
  • scoring: add column profiling to issues (938afa5)
  • project-dashboard: add sort by lowest score (1faa4a9)
  • cdes: add checkbox to table group for flagging cdes (a688763)
  • profiling: display bar for alpha case distribution (2b1d3b3)
  • Copy or Move test definitions TG-826 (0ba7fee)
  • sidebar: display project name above nav menu (3bf9612)
  • score-issues: add filters (6cf5e4d)
  • data-catalog: support drag to resize tree (aca99fa)

Bug Fixes

  • security: Switch the base image to Alpine to fix vulnerabilities (f95d10a)
  • functions: Eliminating the need of a trailing space on function calls (66d5408)
  • overview: minor fixes and styling improvements (491e6ed)
  • sql: special characters in pattern match test (3a15652)
  • overview: set default value for pandas null (00d267a)
  • overview: apply sort on first render (65d1766)
  • build: Pinning the matplotlib version (752b62f)
  • ui: use mutation observer to sync height (cc2a904)
  • test suites: add missing elements (320ac51)
  • ui: update highlight for client-side Selects (714d614)
  • test suites: dynamically display empty state (83f3136)
  • scoring: fixes + query and styling updates (8ddc483)
  • scoring: query fixes and styling updates (5a58672)
  • table groups: prevent unintentional edit to Explicit Table List (8de1510)
  • sql: bugs in data characteristics refresh and score dashboard queries (c3d6c4f)
  • sql: broken score details (da2d04a)
  • ui: make score cards compatible with dark mode (65e7fd5)
  • ui: display fixes for scoring, test suites and dashboard pages (32a8d4a)
  • project: handle project code in score queries (e05f974)
  • quality-dashboard: bugs in search (adce378)
  • profiling-results: broken function reference and missing filters (96449b4)
  • scoring: add missing labels and other suggestions (f61145a)
  • scoring: remove dq_dimension as a explorer filter (272cfc1)
  • scoring: rearrange the breadcrumbs in score explorer (987d43f)
  • scoring: minor css and text updates (008e197)
  • scoring: issues binding to query params (7a45396)
  • scoring: aggregate issues count for impact calc (d2d7a61)
  • broken link and incorrect date display on dashboard (4c363fd)
  • scoring: bug in latest_profile_record_ct (aa878d3)
  • router: exclude none query params when navigating (66d6ea3)
  • sql: bugs in upgrade script and test score calc (c48c2e9)
  • score-explorer: error on saving empty filter + responsive css (5c235c0)
  • sql: updates to impact calc (0fbc403)
  • data-chars: skip record count retrieval if no tables (5439b35)
  • scoring: reduce number of reruns in the explorer (03c8832)
  • scoring: update record count subquery (7723412)
  • scoring: load related objects for score definition (529b784)
  • scoring: send empty score card when no filters applied (e3313d0)
  • scoring: block saving of empty score cards (1ac2ab0)
  • scoring: initial display of empty card (9bae26e)
  • scoring: render initial state of score details in the explorer (02c808a)
  • upgrade: grant executor role rights to new scoring tables (c4d75ef)
  • test-execution: separate prevalence calc to prevent errors from affecting run (b458201)
  • column-profiling: align summary and percent bars (223fbba)
  • data-catalog: bug in editing tags (f0c02a5)
  • data-catalog: tweaks to column distribution, tooltips for tags (fe1ec09)
  • test-definitions: dropped tables and columns not displayed in filters (d9f8984)
  • test-validation: table tests for dropped tables not deactivated (4e1536c)
  • copy-tests: update to profiling and manual date fields (4a666f6)

Refactors

  • convert overview page to vanjs component (d0669a1)
  • ui: rename data hierarchy to data catalog (4a7e2b0)
  • forms: downgrade pydantic version for pypi release (1b968f5)
  • test suites: move page logic to vanjs (1c98c0e)
  • ui: support logo plugin (9c85f6b)
  • ui: rename "overview" and "score dashboard" pages (5cbcade)
  • scoring: split score details into components (e88dd94)
  • scores: make score displays consistent (6167060)
  • scoring: move queries to sqlalchemy model methods (0f48fb9)
  • scoring: enable cde score in score cards (0994dba)
  • components: add border property to Card (5e8ba8c)
  • data-catalog: make characteristics, distribution and issues cards reusable (5de4ac6)
  • data-catalog: make queries reusable and consistent (69ddd3e)
  • ui: replace column profiling with new component (ac46ffa)
  • remove dead code (f65acbc)
  • navigation: queue the navigation when receiving linkclicked event (36cb4d3)
  • tooltip-icon: add Icon component and use withTooltip (25a91d3)

Miscellaneous

  • functions: Code review feedback (93b2038)
  • add default ports to add connection form (6f68fa8)
  • ui: add empty state vanjs component (1b2d04e)
  • ui: add caption and metric reusable component (bc9e9dd)
  • ui: make some vanjs components more customizable (7060365)
  • Code review feedback (ed26f8d)
  • connections: change default max query chars (9e2a609)
  • pin scipy version (75aca92)
  • ui: update wording in score details page (2217061)
  • scores: add empty state message for score dashboard (43774ae)
  • scores: update styles and text (c709643)
  • linting: adress linting suggestions (e1d8b2f)
  • scoring: add new data_product column (bdf3ab2)
  • ui: remove cache clear when switching between scoring pages (b4386fc)
  • scoring: cache score card breakdown items (78d889f)
  • scoring: clear score list cache on delete and create (bab63a1)
  • scoring: display loading spinners (f025c0a)
  • components: support tooltips in input and attribute (45d8819)
  • scoring: uncomment score type dropdown in breakdown table (1c872ea)

Docker Image

datakitchen/dataops-testgen:v3.0.0

PyPI Package

dataops-testgen==3.0.0