Fix issue #19: Handle similarly named column headers in CSV merger

[sweep-ai]

Description

This PR addresses issue #19 by modifying the combine function in the Merger struct in internal/merger.go to handle similarly named column headers in the CSV merger. Currently, the merger treats each column as unique, resulting in duplicate columns for similarly named headers. The changes in this PR ensure that columns with the same header are merged into a single column.

Summary of Changes

• Modified the combine function in the Merger struct to handle similarly named column headers.
• Created a map to store the column headers and their indices.
• When iterating over the records, checked if the column header already exists in the map. If it does, appended the data to the existing column. If it doesn't, created a new column.
• Updated the TestCombine function in internal/merger_test.go to include a test case for similarly named column headers.

Fixes #19.

---

To checkout this PR branch, run the following command in your terminal:

git checkout sweep/fix-issue-19-handle-similarly-named-column-headers

To get Sweep to edit this pull request, leave a comment below or in the code. Leaving a comment in the code will only modify the file but commenting below can change the entire PR.