Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FSTORE-1630][4.1] Model Dependent Transformation Functions creates feature names that are longer than 64 character causing logging feature group ingestion to fail #457

Merged
merged 1 commit into from
Jan 29, 2025

Conversation

manu-sj
Copy link
Contributor

@manu-sj manu-sj commented Jan 28, 2025

This PR cherry picks changes done in PR : #428 to the 4.1 branch

JIRA Issue: https://hopsworks.atlassian.net/browse/FSTORE-1630

Priority for Review: -

Related PRs:
https://github.com/logicalclocks/hopsworks-ee/pull/2217
https://github.com/logicalclocks/loadtest/pull/509
logicalclocks/logicalclocks.github.io#438
https://github.com/logicalclocks/hopsworks-front/pull/1436

How Has This Been Tested?

  • Unit Tests
  • Integration Tests
  • Manual Tests on VM

Checklist For The Assigned Reviewer:

- [ ] Checked if merge conflicts with master exist
- [ ] Checked if stylechecks for Java and Python pass
- [ ] Checked if all docstrings were added and/or updated appropriately
- [ ] Ran spellcheck on docstring
- [ ] Checked if guides & concepts need to be updated
- [ ] Checked if naming conventions for parameters and variables were followed
- [ ] Checked if private methods are properly declared and used
- [ ] Checked if hard-to-understand areas of code are commented
- [ ] Checked if tests are effective
- [ ] Built and deployed changes on dev VM and tested manually
- [x] (Checked if all type annotations were added and/or updated appropriately)

…e names that are longer than 64 character causing logging feature group ingestion to fail (logicalclocks#428)

* adding alias function to modify output column names

* adding unit tests

* fixing generation of output column names when udf is shared between transformation functions

* updating documentation

* converting error caused due to long column names to a warning and trying to solve the problem by manually slicing the column names

* adding tests for creation of stripped column names

* correcting documentation mistake and making test self contained
@manu-sj manu-sj merged commit 0e64745 into logicalclocks:branch-4.1 Jan 29, 2025
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants